2023-05-12T08:45:04.686 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-12T08:45:04.687 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_vshankar@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --archive /home/teuthworker/archive/vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi/7272422 --name vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi/7272422/orig.config.yaml 2023-05-12T08:45:04.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-12T08:45:04.814 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi/7272422 branch: wip-vshankar-testing-20230509.090020-1 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7272422' kernel: flavor: default kdb: true sha1: 6f2d7574b970ef64b39f04653703bc084b088994 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-20230509.090020-1 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 5a6b166b7c43e2b5890833e75dd257ab21264ded ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5a6b166b7c43e2b5890833e75dd257ab21264ded selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230509.090020-1 sha1: 5a6b166b7c43e2b5890833e75dd257ab21264ded owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 5a6b166b7c43e2b5890833e75dd257ab21264ded sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230509.090020-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_5a6b166b7c43e2b5890833e75dd257ab21264ded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 5a6b166b7c43e2b5890833e75dd257ab21264ded syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi116.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPrB3mMnuvBanvZMHFNAKKYThu1us2DR9AqWuxzxBruG5rXnVcvb1kq+BH4IcJbOn3KOweMUyuoHKuwxBmLVwm/ZYz5+5tPL7ODa+bYKHPLC9gfD9juqphsFEjtjb1J6EbCjloVj+r+kout6Mj9zbaZ1T+okq/UhAhKDl3vJndxejdPmLCLpX7iot9XNqThWm0Kbq8BLdmhasN55ucxEnRSdepkN0BECEuYQOkQKD9YD03H5iYgmSQpNQ6q6Ex8yVovcYmBrl9EzWPUnaonwARO+znhmkwtxz1fVE8eMjUMCCPkYD2q/20sWx+UvVwk3WuGjhoOzo179dryK1lwoh8RRUUKufq7R5F9twCIBy6GdYguTdOVU43GgCSBHWjuCYCzQErnl6pjUj4FeXFAfl4H7TXusMmQOlAZK4+mwj55Ef3jYFfcDJwMFW2m2f9DOSjx55qWqrfuF60sIVr6JCfw5HmZ7EEzGyNXXPcjvVubNvpl3F0G/z/ET4qSdaETiM= smithi182.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSCP1964fHt4nuwxhaKn6NiEwBPBwaLYq4SMN9k692sbAcQYODem0y4cSyONrb5Z6h/oFYBBqdzpfkvVWwfjJ0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-12_08:25:27 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-12T08:45:04.814 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_5a6b166b7c43e2b5890833e75dd257ab21264ded/qa; will attempt to use it 2023-05-12T08:45:04.815 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_5a6b166b7c43e2b5890833e75dd257ab21264ded/qa/tasks 2023-05-12T08:45:04.815 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-12T08:45:04.817 INFO:teuthology.task.internal:Checking packages... 2023-05-12T08:45:04.843 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5a6b166b7c43e2b5890833e75dd257ab21264ded' 2023-05-12T08:45:04.844 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-12T08:45:04.844 INFO:teuthology.packaging:ref: None 2023-05-12T08:45:04.844 INFO:teuthology.packaging:tag: None 2023-05-12T08:45:04.845 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230509.090020-1 2023-05-12T08:45:04.845 INFO:teuthology.packaging:sha1: 5a6b166b7c43e2b5890833e75dd257ab21264ded 2023-05-12T08:45:04.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230509.090020-1 2023-05-12T08:45:04.984 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3871.g5a6b166b 2023-05-12T08:45:04.985 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-12T08:45:04.992 INFO:teuthology.task.internal:no buildpackages task found 2023-05-12T08:45:04.992 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-12T08:45:04.998 INFO:teuthology.task.internal:Saving configuration 2023-05-12T08:45:05.013 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-12T08:45:05.019 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-12T08:45:05.048 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi/7272422', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-12 08:40:05.605437', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA74F5AD3RpqEdyHSh8yqhmMs31fhot4qEGFRsDMjgZ16ko09RsRplyimZdR+wZ3zpamvcWeufebmV5qX/1jP6A='} 2023-05-12T08:45:05.076 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi182.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi/7272422', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-12 08:40:05.607386', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSCP1964fHt4nuwxhaKn6NiEwBPBwaLYq4SMN9k692sbAcQYODem0y4cSyONrb5Z6h/oFYBBqdzpfkvVWwfjJ0='} 2023-05-12T08:45:05.076 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-12T08:45:05.086 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-12T08:45:05.086 INFO:teuthology.task.internal:roles: ubuntu@smithi182.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-12T08:45:05.086 INFO:teuthology.run_tasks:Running task console_log... 2023-05-12T08:45:05.165 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb9f659fee0>, signals=[15]) 2023-05-12T08:45:05.166 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-12T08:45:05.172 INFO:teuthology.task.internal:Opening connections... 2023-05-12T08:45:05.172 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T08:45:05.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-12T08:45:05.245 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi182.front.sepia.ceph.com 2023-05-12T08:45:05.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-12T08:45:05.311 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-12T08:45:05.318 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-05-12T08:45:05.340 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-05-12T08:45:05.340 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-05-12T08:45:05.400 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-05-12T08:45:05.400 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-05-12T08:45:05.400 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-05-12T08:45:05.400 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-05-12T08:45:05.401 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-05-12T08:45:05.401 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-05-12T08:45:05.401 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-12T08:45:05.401 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-05-12T08:45:05.401 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-12T08:45:05.401 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-05-12T08:45:05.401 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-12T08:45:05.401 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-12T08:45:05.402 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-12T08:45:05.402 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-05-12T08:45:05.431 DEBUG:teuthology.orchestra.run.smithi182:> uname -m 2023-05-12T08:45:05.453 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64 2023-05-12T08:45:05.453 DEBUG:teuthology.orchestra.run.smithi182:> cat /etc/os-release 2023-05-12T08:45:05.515 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="CentOS Stream" 2023-05-12T08:45:05.515 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="8" 2023-05-12T08:45:05.515 INFO:teuthology.orchestra.run.smithi182.stdout:ID="centos" 2023-05-12T08:45:05.515 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE="rhel fedora" 2023-05-12T08:45:05.515 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="8" 2023-05-12T08:45:05.515 INFO:teuthology.orchestra.run.smithi182.stdout:PLATFORM_ID="platform:el8" 2023-05-12T08:45:05.516 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-12T08:45:05.516 INFO:teuthology.orchestra.run.smithi182.stdout:ANSI_COLOR="0;31" 2023-05-12T08:45:05.516 INFO:teuthology.orchestra.run.smithi182.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-12T08:45:05.516 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://centos.org/" 2023-05-12T08:45:05.516 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-12T08:45:05.516 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-12T08:45:05.516 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-12T08:45:05.517 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2023-05-12T08:45:05.538 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-12T08:45:05.547 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-12T08:45:05.562 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-12T08:45:05.563 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2023-05-12T08:45:05.565 DEBUG:teuthology.orchestra.run.smithi182:> test '!' -e /home/ubuntu/cephtest 2023-05-12T08:45:05.585 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-12T08:45:05.591 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-12T08:45:05.591 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2023-05-12T08:45:05.625 DEBUG:teuthology.orchestra.run.smithi182:> test -z $(ls -A /var/lib/ceph) 2023-05-12T08:45:05.660 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-12T08:45:05.723 INFO:teuthology.run_tasks:Running task kernel... 2023-05-12T08:45:05.739 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '6f2d7574b970ef64b39f04653703bc084b088994'} 2023-05-12T08:45:05.740 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '6f2d7574b970ef64b39f04653703bc084b088994'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '6f2d7574b970ef64b39f04653703bc084b088994'}}, timeout 300 2023-05-12T08:45:05.740 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-12T08:45:05.741 DEBUG:teuthology.orchestra.run.smithi182:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-12T08:45:05.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T08:45:05.761 DEBUG:teuthology.task.kernel:sha1 for mon.b is 6f2d7574b970ef64b39f04653703bc084b088994 2023-05-12T08:45:05.761 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6f2d7574b970ef64b39f04653703bc084b088994"... 2023-05-12T08:45:05.761 DEBUG:teuthology.orchestra.run.smithi182:> uname -r 2023-05-12T08:45:05.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T08:45:05.762 DEBUG:teuthology.task.kernel:sha1 for mon.a is 6f2d7574b970ef64b39f04653703bc084b088994 2023-05-12T08:45:05.762 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6f2d7574b970ef64b39f04653703bc084b088994"... 2023-05-12T08:45:05.763 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2023-05-12T08:45:05.820 INFO:teuthology.orchestra.run.smithi182.stdout:4.18.0-489.el8.x86_64 2023-05-12T08:45:05.821 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 6f2d7574b970ef64b39f04653703bc084b088994 2023-05-12T08:45:05.821 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-12T08:45:05.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6f2d7574b970ef64b39f04653703bc084b088994 2023-05-12T08:45:05.824 INFO:teuthology.orchestra.run.smithi116.stdout:4.18.0-489.el8.x86_64 2023-05-12T08:45:05.825 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 6f2d7574b970ef64b39f04653703bc084b088994 2023-05-12T08:45:05.825 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-12T08:45:05.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6f2d7574b970ef64b39f04653703bc084b088994 2023-05-12T08:45:05.963 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum upgrade -y linux-firmware 2023-05-12T08:45:05.966 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum upgrade -y linux-firmware 2023-05-12T08:45:11.548 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 8 - AppStream 9.5 MB/s | 29 MB 00:03 2023-05-12T08:45:11.574 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS Stream 8 - AppStream 9.2 MB/s | 29 MB 00:03 2023-05-12T08:45:17.883 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS Stream 8 - BaseOS 34 MB/s | 34 MB 00:01 2023-05-12T08:45:18.065 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 8 - BaseOS 27 MB/s | 34 MB 00:01 2023-05-12T08:45:23.492 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2023-05-12T08:45:23.582 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2023-05-12T08:45:24.034 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.4 kB 00:00 2023-05-12T08:45:24.158 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.4 kB 00:00 2023-05-12T08:45:26.152 INFO:teuthology.orchestra.run.smithi182.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2023-05-12T08:45:26.968 INFO:teuthology.orchestra.run.smithi116.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-05-12T08:45:28.087 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 14 MB/s | 14 MB 00:00 2023-05-12T08:45:29.855 INFO:teuthology.orchestra.run.smithi182.stdout:Extra Packages for Enterprise Linux 3.9 MB/s | 14 MB 00:03 2023-05-12T08:45:31.518 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 409 kB/s | 24 kB 00:00 2023-05-12T08:45:33.269 INFO:teuthology.orchestra.run.smithi182.stdout:lab-extras 364 kB/s | 24 kB 00:00 2023-05-12T08:45:34.805 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-05-12T08:45:34.806 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2023-05-12T08:45:34.806 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-05-12T08:45:34.938 INFO:teuthology.task.kernel:Downloading kernel 6f2d7574b970ef64b39f04653703bc084b088994 on mon.a... 2023-05-12T08:45:34.938 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6f2d7574b970ef64b39f04653703bc084b088994 2023-05-12T08:45:35.079 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/6f2d7574b970ef64b39f04653703bc084b088994/centos/8/flavors/default/x86_64/ 2023-05-12T08:45:35.080 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_g6f2d7574b970-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/6f2d7574b970ef64b39f04653703bc084b088994/centos/8/flavors/default/x86_64/ --input-file=- 2023-05-12T08:45:35.083 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi116.front.sepia.ceph.com to complete... 2023-05-12T08:45:36.572 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2023-05-12T08:45:36.573 INFO:teuthology.orchestra.run.smithi182.stdout:Nothing to do. 2023-05-12T08:45:36.573 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2023-05-12T08:45:36.705 INFO:teuthology.task.kernel:Downloading kernel 6f2d7574b970ef64b39f04653703bc084b088994 on mon.b... 2023-05-12T08:45:36.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6f2d7574b970ef64b39f04653703bc084b088994 2023-05-12T08:45:36.841 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/6f2d7574b970ef64b39f04653703bc084b088994/centos/8/flavors/default/x86_64/ 2023-05-12T08:45:36.841 DEBUG:teuthology.orchestra.run.smithi182:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_g6f2d7574b970-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/6f2d7574b970ef64b39f04653703bc084b088994/centos/8/flavors/default/x86_64/ --input-file=- 2023-05-12T08:45:36.844 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi182.front.sepia.ceph.com to complete... 2023-05-12T08:45:55.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12 08:45:55 URL:https://2.chacra.ceph.com/r/kernel/testing/6f2d7574b970ef64b39f04653703bc084b088994/centos/8/flavors/default/x86_64/kernel-6.3.0_g6f2d7574b970-1.x86_64.rpm [378544800/378544800] -> "/tmp/kernel.x86_64.rpm" [1] 2023-05-12T08:45:55.635 INFO:teuthology.orchestra.run.smithi116.stderr:FINISHED --2023-05-12 08:45:55-- 2023-05-12T08:45:55.635 INFO:teuthology.orchestra.run.smithi116.stderr:Total wall clock time: 21s 2023-05-12T08:45:55.635 INFO:teuthology.orchestra.run.smithi116.stderr:Downloaded: 1 files, 361M in 20s (17.8 MB/s) 2023-05-12T08:45:55.636 INFO:teuthology.task.kernel:Installing kernel 6f2d7574b970ef64b39f04653703bc084b088994 on mon.a... 2023-05-12T08:45:55.636 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-05-12T08:45:57.363 INFO:teuthology.orchestra.run.smithi116.stdout:Verifying... ######################################## 2023-05-12T08:45:57.422 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing... ######################################## 2023-05-12T08:45:57.552 INFO:teuthology.orchestra.run.smithi116.stdout:Updating / installing... 2023-05-12T08:46:00.517 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12 08:46:00 URL:https://2.chacra.ceph.com/r/kernel/testing/6f2d7574b970ef64b39f04653703bc084b088994/centos/8/flavors/default/x86_64/kernel-6.3.0_g6f2d7574b970-1.x86_64.rpm [378544800/378544800] -> "/tmp/kernel.x86_64.rpm" [1] 2023-05-12T08:46:00.517 INFO:teuthology.orchestra.run.smithi182.stderr:FINISHED --2023-05-12 08:46:00-- 2023-05-12T08:46:00.517 INFO:teuthology.orchestra.run.smithi182.stderr:Total wall clock time: 24s 2023-05-12T08:46:00.517 INFO:teuthology.orchestra.run.smithi182.stderr:Downloaded: 1 files, 361M in 23s (15.5 MB/s) 2023-05-12T08:46:00.518 INFO:teuthology.task.kernel:Installing kernel 6f2d7574b970ef64b39f04653703bc084b088994 on mon.b... 2023-05-12T08:46:00.519 DEBUG:teuthology.orchestra.run.smithi182:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-05-12T08:46:02.257 INFO:teuthology.orchestra.run.smithi182.stdout:Verifying... ######################################## 2023-05-12T08:46:02.321 INFO:teuthology.orchestra.run.smithi182.stdout:Preparing... ######################################## 2023-05-12T08:46:02.452 INFO:teuthology.orchestra.run.smithi182.stdout:Updating / installing... 2023-05-12T08:46:35.115 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-6.3.0_g6f2d7574b970-1 ######################################## 2023-05-12T08:46:40.086 INFO:teuthology.orchestra.run.smithi182.stdout:kernel-6.3.0_g6f2d7574b970-1 ######################################## 2023-05-12T08:46:57.431 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-05-12T08:46:57.431 DEBUG:teuthology.orchestra.run.smithi116:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-05-12T08:46:57.482 INFO:teuthology.orchestra.run.smithi116.stdout:/boot/System.map-6.3.0-g6f2d7574b970 2023-05-12T08:46:57.482 INFO:teuthology.orchestra.run.smithi116.stdout:/boot/config-6.3.0-g6f2d7574b970 2023-05-12T08:46:57.482 INFO:teuthology.orchestra.run.smithi116.stdout:/boot/vmlinuz-6.3.0-g6f2d7574b970 2023-05-12T08:46:57.483 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970 2023-05-12T08:46:57.483 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel 2023-05-12T08:46:57.483 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch 2023-05-12T08:46:57.483 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86 2023-05-12T08:46:57.483 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto 2023-05-12T08:46:57.483 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-12T08:46:57.483 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-12T08:46:57.484 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-12T08:46:57.484 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-12T08:46:57.484 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-12T08:46:57.484 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-12T08:46:57.484 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-12T08:46:57.484 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/crc32c-intel.ko 2023-05-12T08:46:57.484 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-12T08:46:57.485 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-12T08:46:57.485 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-12T08:46:57.485 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-12T08:46:57.485 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-12T08:46:57.485 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-12T08:46:57.485 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-12T08:46:57.485 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-12T08:46:57.485 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-12T08:46:57.486 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-12T08:46:57.486 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-12T08:46:57.486 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-12T08:46:57.486 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kernel 2023-05-12T08:46:57.486 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kernel/cpu 2023-05-12T08:46:57.486 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kernel/cpu/mce 2023-05-12T08:46:57.486 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-12T08:46:57.486 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kvm 2023-05-12T08:46:57.487 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-12T08:46:57.487 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-12T08:46:57.487 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kvm/kvm.ko 2023-05-12T08:46:57.487 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto 2023-05-12T08:46:57.487 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/ansi_cprng.ko 2023-05-12T08:46:57.487 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/anubis.ko 2023-05-12T08:46:57.487 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/arc4.ko 2023-05-12T08:46:57.488 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx 2023-05-12T08:46:57.488 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/async_memcpy.ko 2023-05-12T08:46:57.488 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/async_pq.ko 2023-05-12T08:46:57.488 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-12T08:46:57.488 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/async_tx.ko 2023-05-12T08:46:57.488 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/async_xor.ko 2023-05-12T08:46:57.488 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/raid6test.ko 2023-05-12T08:46:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/authenc.ko 2023-05-12T08:46:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/authencesn.ko 2023-05-12T08:46:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/blake2b_generic.ko 2023-05-12T08:46:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/blowfish_common.ko 2023-05-12T08:46:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/blowfish_generic.ko 2023-05-12T08:46:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/camellia_generic.ko 2023-05-12T08:46:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/cast5_generic.ko 2023-05-12T08:46:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/cast6_generic.ko 2023-05-12T08:46:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/cast_common.ko 2023-05-12T08:46:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/ccm.ko 2023-05-12T08:46:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/cmac.ko 2023-05-12T08:46:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/crc32_generic.ko 2023-05-12T08:46:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/crypto_engine.ko 2023-05-12T08:46:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/crypto_user.ko 2023-05-12T08:46:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/cts.ko 2023-05-12T08:46:57.491 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/des_generic.ko 2023-05-12T08:46:57.491 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/dh_generic.ko 2023-05-12T08:46:57.491 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/echainiv.ko 2023-05-12T08:46:57.491 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/essiv.ko 2023-05-12T08:46:57.491 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/fcrypt.ko 2023-05-12T08:46:57.491 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/khazad.ko 2023-05-12T08:46:57.491 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/lz4.ko 2023-05-12T08:46:57.491 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/lz4hc.ko 2023-05-12T08:46:57.492 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/md4.ko 2023-05-12T08:46:57.492 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/michael_mic.ko 2023-05-12T08:46:57.492 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/pcbc.ko 2023-05-12T08:46:57.492 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/pcrypt.ko 2023-05-12T08:46:57.492 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/rmd160.ko 2023-05-12T08:46:57.492 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/seed.ko 2023-05-12T08:46:57.492 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/serpent_generic.ko 2023-05-12T08:46:57.493 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/tcrypt.ko 2023-05-12T08:46:57.493 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/tea.ko 2023-05-12T08:46:57.493 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/twofish_common.ko 2023-05-12T08:46:57.493 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/twofish_generic.ko 2023-05-12T08:46:57.493 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/vmac.ko 2023-05-12T08:46:57.493 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/wp512.ko 2023-05-12T08:46:57.493 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/xcbc.ko 2023-05-12T08:46:57.493 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/xor.ko 2023-05-12T08:46:57.494 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/xxhash_generic.ko 2023-05-12T08:46:57.494 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers 2023-05-12T08:46:57.494 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi 2023-05-12T08:46:57.494 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-12T08:46:57.494 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/acpi_pad.ko 2023-05-12T08:46:57.494 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/custom_method.ko 2023-05-12T08:46:57.494 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/ec_sys.ko 2023-05-12T08:46:57.495 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/platform_profile.ko 2023-05-12T08:46:57.495 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/sbs.ko 2023-05-12T08:46:57.495 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/sbshc.ko 2023-05-12T08:46:57.495 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/video.ko 2023-05-12T08:46:57.495 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata 2023-05-12T08:46:57.495 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/acard-ahci.ko 2023-05-12T08:46:57.495 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/ahci_platform.ko 2023-05-12T08:46:57.495 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/ata_generic.ko 2023-05-12T08:46:57.496 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/libahci_platform.ko 2023-05-12T08:46:57.496 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_acpi.ko 2023-05-12T08:46:57.496 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_ali.ko 2023-05-12T08:46:57.496 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_amd.ko 2023-05-12T08:46:57.496 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_artop.ko 2023-05-12T08:46:57.496 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_atiixp.ko 2023-05-12T08:46:57.496 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_atp867x.ko 2023-05-12T08:46:57.496 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_cmd640.ko 2023-05-12T08:46:57.497 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_cmd64x.ko 2023-05-12T08:46:57.497 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_cypress.ko 2023-05-12T08:46:57.497 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_efar.ko 2023-05-12T08:46:57.497 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_hpt366.ko 2023-05-12T08:46:57.497 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_hpt37x.ko 2023-05-12T08:46:57.497 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-12T08:46:57.497 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-12T08:46:57.498 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_it8213.ko 2023-05-12T08:46:57.498 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_it821x.ko 2023-05-12T08:46:57.498 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_jmicron.ko 2023-05-12T08:46:57.498 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_marvell.ko 2023-05-12T08:46:57.498 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_mpiix.ko 2023-05-12T08:46:57.498 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_netcell.ko 2023-05-12T08:46:57.498 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_ninja32.ko 2023-05-12T08:46:57.498 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_ns87410.ko 2023-05-12T08:46:57.499 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_ns87415.ko 2023-05-12T08:46:57.499 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_oldpiix.ko 2023-05-12T08:46:57.499 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_opti.ko 2023-05-12T08:46:57.499 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_optidma.ko 2023-05-12T08:46:57.499 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_pcmcia.ko 2023-05-12T08:46:57.499 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-12T08:46:57.500 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-12T08:46:57.500 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_piccolo.ko 2023-05-12T08:46:57.500 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_rdc.ko 2023-05-12T08:46:57.500 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_sch.ko 2023-05-12T08:46:57.500 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_serverworks.ko 2023-05-12T08:46:57.500 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_sil680.ko 2023-05-12T08:46:57.501 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_sis.ko 2023-05-12T08:46:57.501 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_sl82c105.ko 2023-05-12T08:46:57.501 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_triflex.ko 2023-05-12T08:46:57.501 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_via.ko 2023-05-12T08:46:57.501 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pdc_adma.ko 2023-05-12T08:46:57.501 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_inic162x.ko 2023-05-12T08:46:57.501 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_mv.ko 2023-05-12T08:46:57.501 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_nv.ko 2023-05-12T08:46:57.502 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_promise.ko 2023-05-12T08:46:57.502 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_qstor.ko 2023-05-12T08:46:57.502 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_sil.ko 2023-05-12T08:46:57.502 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_sil24.ko 2023-05-12T08:46:57.502 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_sis.ko 2023-05-12T08:46:57.502 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_svw.ko 2023-05-12T08:46:57.503 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_sx4.ko 2023-05-12T08:46:57.503 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_uli.ko 2023-05-12T08:46:57.503 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_via.ko 2023-05-12T08:46:57.503 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_vsc.ko 2023-05-12T08:46:57.503 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/auxdisplay 2023-05-12T08:46:57.503 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/auxdisplay/ks0108.ko 2023-05-12T08:46:57.503 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/base 2023-05-12T08:46:57.503 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/base/regmap 2023-05-12T08:46:57.504 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/base/regmap/regmap-i2c.ko 2023-05-12T08:46:57.504 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/bcma 2023-05-12T08:46:57.504 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/bcma/bcma.ko 2023-05-12T08:46:57.504 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block 2023-05-12T08:46:57.504 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/aoe 2023-05-12T08:46:57.504 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/aoe/aoe.ko 2023-05-12T08:46:57.504 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/brd.ko 2023-05-12T08:46:57.505 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/drbd 2023-05-12T08:46:57.505 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/drbd/drbd.ko 2023-05-12T08:46:57.505 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/floppy.ko 2023-05-12T08:46:57.505 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/loop.ko 2023-05-12T08:46:57.505 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/mtip32xx 2023-05-12T08:46:57.505 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-12T08:46:57.505 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/nbd.ko 2023-05-12T08:46:57.506 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/null_blk 2023-05-12T08:46:57.506 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/null_blk/null_blk.ko 2023-05-12T08:46:57.506 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/pktcdvd.ko 2023-05-12T08:46:57.506 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/rbd.ko 2023-05-12T08:46:57.506 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/virtio_blk.ko 2023-05-12T08:46:57.506 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/xen-blkback 2023-05-12T08:46:57.506 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-12T08:46:57.506 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/xen-blkfront.ko 2023-05-12T08:46:57.507 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/zram 2023-05-12T08:46:57.507 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/zram/zram.ko 2023-05-12T08:46:57.507 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char 2023-05-12T08:46:57.507 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hangcheck-timer.ko 2023-05-12T08:46:57.507 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random 2023-05-12T08:46:57.507 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-12T08:46:57.507 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-12T08:46:57.508 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-12T08:46:57.508 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random/via-rng.ko 2023-05-12T08:46:57.508 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-12T08:46:57.508 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi 2023-05-12T08:46:57.508 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-12T08:46:57.508 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-12T08:46:57.508 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-12T08:46:57.508 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-12T08:46:57.509 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-12T08:46:57.509 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-12T08:46:57.509 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/lp.ko 2023-05-12T08:46:57.509 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/mwave 2023-05-12T08:46:57.509 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/mwave/mwave.ko 2023-05-12T08:46:57.509 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/pcmcia 2023-05-12T08:46:57.509 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-12T08:46:57.510 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-12T08:46:57.510 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ppdev.ko 2023-05-12T08:46:57.510 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tlclk.ko 2023-05-12T08:46:57.510 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm 2023-05-12T08:46:57.510 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm.ko 2023-05-12T08:46:57.510 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-12T08:46:57.510 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-12T08:46:57.510 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-12T08:46:57.511 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm_tis.ko 2023-05-12T08:46:57.511 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-05-12T08:46:57.511 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/uv_mmtimer.ko 2023-05-12T08:46:57.511 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/virtio_console.ko 2023-05-12T08:46:57.511 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq 2023-05-12T08:46:57.511 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-05-12T08:46:57.511 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-12T08:46:57.511 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-12T08:46:57.512 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-05-12T08:46:57.512 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/powernow-k8.ko 2023-05-12T08:46:57.512 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-12T08:46:57.512 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto 2023-05-12T08:46:57.512 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/ccp 2023-05-12T08:46:57.512 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-12T08:46:57.512 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/ccp/ccp.ko 2023-05-12T08:46:57.513 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/padlock-aes.ko 2023-05-12T08:46:57.513 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/padlock-sha.ko 2023-05-12T08:46:57.513 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/qat 2023-05-12T08:46:57.513 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/qat/qat_common 2023-05-12T08:46:57.513 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-12T08:46:57.513 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/qat/qat_dh895xcc 2023-05-12T08:46:57.513 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-12T08:46:57.513 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/virtio 2023-05-12T08:46:57.514 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-12T08:46:57.514 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dca 2023-05-12T08:46:57.514 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dca/dca.ko 2023-05-12T08:46:57.514 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/devfreq 2023-05-12T08:46:57.514 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-05-12T08:46:57.514 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dma 2023-05-12T08:46:57.514 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dma/dw 2023-05-12T08:46:57.514 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-12T08:46:57.515 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dma/ioat 2023-05-12T08:46:57.515 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-12T08:46:57.515 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac 2023-05-12T08:46:57.515 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/amd64_edac.ko 2023-05-12T08:46:57.515 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/e752x_edac.ko 2023-05-12T08:46:57.515 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/edac_mce_amd.ko 2023-05-12T08:46:57.515 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i3000_edac.ko 2023-05-12T08:46:57.516 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i3200_edac.ko 2023-05-12T08:46:57.516 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i5100_edac.ko 2023-05-12T08:46:57.516 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i5400_edac.ko 2023-05-12T08:46:57.516 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i7300_edac.ko 2023-05-12T08:46:57.516 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i7core_edac.ko 2023-05-12T08:46:57.516 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i82975x_edac.ko 2023-05-12T08:46:57.516 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/ie31200_edac.ko 2023-05-12T08:46:57.516 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/sb_edac.ko 2023-05-12T08:46:57.517 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/x38_edac.ko 2023-05-12T08:46:57.517 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/firmware 2023-05-12T08:46:57.517 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/firmware/edd.ko 2023-05-12T08:46:57.517 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-12T08:46:57.517 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/gpio 2023-05-12T08:46:57.517 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/gpio/gpio-ich.ko 2023-05-12T08:46:57.517 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-12T08:46:57.518 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid 2023-05-12T08:46:57.518 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-appleir.ko 2023-05-12T08:46:57.518 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-aureal.ko 2023-05-12T08:46:57.518 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-axff.ko 2023-05-12T08:46:57.518 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-dr.ko 2023-05-12T08:46:57.518 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-elecom.ko 2023-05-12T08:46:57.518 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-elo.ko 2023-05-12T08:46:57.518 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-emsff.ko 2023-05-12T08:46:57.519 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-gaff.ko 2023-05-12T08:46:57.519 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-gt683r.ko 2023-05-12T08:46:57.519 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-gyration.ko 2023-05-12T08:46:57.519 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-12T08:46:57.519 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-12T08:46:57.519 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-holtekff.ko 2023-05-12T08:46:57.519 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-hyperv.ko 2023-05-12T08:46:57.519 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-icade.ko 2023-05-12T08:46:57.520 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-keytouch.ko 2023-05-12T08:46:57.520 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-kye.ko 2023-05-12T08:46:57.520 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-lcpower.ko 2023-05-12T08:46:57.520 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-led.ko 2023-05-12T08:46:57.520 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-lenovo.ko 2023-05-12T08:46:57.520 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-12T08:46:57.520 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-12T08:46:57.521 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-multitouch.ko 2023-05-12T08:46:57.521 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-ortek.ko 2023-05-12T08:46:57.521 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-penmount.ko 2023-05-12T08:46:57.521 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-petalynx.ko 2023-05-12T08:46:57.521 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-picolcd.ko 2023-05-12T08:46:57.521 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-pl.ko 2023-05-12T08:46:57.521 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-plantronics.ko 2023-05-12T08:46:57.521 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-primax.ko 2023-05-12T08:46:57.522 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-rmi.ko 2023-05-12T08:46:57.522 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-12T08:46:57.522 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-common.ko 2023-05-12T08:46:57.522 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-12T08:46:57.522 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-12T08:46:57.522 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-12T08:46:57.522 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-12T08:46:57.522 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-12T08:46:57.523 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-12T08:46:57.523 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-12T08:46:57.523 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-12T08:46:57.523 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-12T08:46:57.523 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat.ko 2023-05-12T08:46:57.523 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-saitek.ko 2023-05-12T08:46:57.523 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-samsung.ko 2023-05-12T08:46:57.524 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-12T08:46:57.524 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-sjoy.ko 2023-05-12T08:46:57.524 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-sony.ko 2023-05-12T08:46:57.524 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-speedlink.ko 2023-05-12T08:46:57.524 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-steelseries.ko 2023-05-12T08:46:57.524 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-sunplus.ko 2023-05-12T08:46:57.524 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-12T08:46:57.525 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-tivo.ko 2023-05-12T08:46:57.525 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-tmff.ko 2023-05-12T08:46:57.525 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-topseed.ko 2023-05-12T08:46:57.525 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-twinhan.ko 2023-05-12T08:46:57.525 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-uclogic.ko 2023-05-12T08:46:57.525 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-waltop.ko 2023-05-12T08:46:57.525 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-wiimote.ko 2023-05-12T08:46:57.525 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-xinmo.ko 2023-05-12T08:46:57.526 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-zpff.ko 2023-05-12T08:46:57.526 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-zydacron.ko 2023-05-12T08:46:57.526 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/uhid.ko 2023-05-12T08:46:57.526 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/wacom.ko 2023-05-12T08:46:57.526 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hv 2023-05-12T08:46:57.526 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hv/hv_balloon.ko 2023-05-12T08:46:57.526 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hv/hv_utils.ko 2023-05-12T08:46:57.526 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hv/hv_vmbus.ko 2023-05-12T08:46:57.527 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon 2023-05-12T08:46:57.527 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/abituguru.ko 2023-05-12T08:46:57.527 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/abituguru3.ko 2023-05-12T08:46:57.527 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-12T08:46:57.527 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ad7414.ko 2023-05-12T08:46:57.527 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ad7418.ko 2023-05-12T08:46:57.527 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adc128d818.ko 2023-05-12T08:46:57.527 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adm1025.ko 2023-05-12T08:46:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adm1026.ko 2023-05-12T08:46:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adm1029.ko 2023-05-12T08:46:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adm1031.ko 2023-05-12T08:46:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adm9240.ko 2023-05-12T08:46:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ads7828.ko 2023-05-12T08:46:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7410.ko 2023-05-12T08:46:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7411.ko 2023-05-12T08:46:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7462.ko 2023-05-12T08:46:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7470.ko 2023-05-12T08:46:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7475.ko 2023-05-12T08:46:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7x10.ko 2023-05-12T08:46:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/amc6821.ko 2023-05-12T08:46:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/applesmc.ko 2023-05-12T08:46:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/asb100.ko 2023-05-12T08:46:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/asc7621.ko 2023-05-12T08:46:57.530 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-12T08:46:57.530 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/atxp1.ko 2023-05-12T08:46:57.530 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/coretemp.ko 2023-05-12T08:46:57.530 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-12T08:46:57.530 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/dme1737.ko 2023-05-12T08:46:57.530 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ds1621.ko 2023-05-12T08:46:57.530 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ds620.ko 2023-05-12T08:46:57.531 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/emc1403.ko 2023-05-12T08:46:57.531 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/emc6w201.ko 2023-05-12T08:46:57.531 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/f71805f.ko 2023-05-12T08:46:57.531 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/f71882fg.ko 2023-05-12T08:46:57.531 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/f75375s.ko 2023-05-12T08:46:57.531 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/fam15h_power.ko 2023-05-12T08:46:57.531 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/fschmd.ko 2023-05-12T08:46:57.531 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/g760a.ko 2023-05-12T08:46:57.532 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/g762.ko 2023-05-12T08:46:57.532 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/gl518sm.ko 2023-05-12T08:46:57.532 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/gl520sm.ko 2023-05-12T08:46:57.532 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-12T08:46:57.532 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/i5500_temp.ko 2023-05-12T08:46:57.532 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/i5k_amb.ko 2023-05-12T08:46:57.532 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ibmaem.ko 2023-05-12T08:46:57.532 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ibmpex.ko 2023-05-12T08:46:57.533 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ina209.ko 2023-05-12T08:46:57.533 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ina2xx.ko 2023-05-12T08:46:57.533 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/it87.ko 2023-05-12T08:46:57.533 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/k10temp.ko 2023-05-12T08:46:57.533 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/k8temp.ko 2023-05-12T08:46:57.533 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lineage-pem.ko 2023-05-12T08:46:57.533 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm63.ko 2023-05-12T08:46:57.534 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm73.ko 2023-05-12T08:46:57.534 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm75.ko 2023-05-12T08:46:57.534 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm77.ko 2023-05-12T08:46:57.534 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm78.ko 2023-05-12T08:46:57.534 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm80.ko 2023-05-12T08:46:57.534 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm83.ko 2023-05-12T08:46:57.534 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm85.ko 2023-05-12T08:46:57.534 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm87.ko 2023-05-12T08:46:57.535 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm90.ko 2023-05-12T08:46:57.535 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm92.ko 2023-05-12T08:46:57.535 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm93.ko 2023-05-12T08:46:57.535 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm95234.ko 2023-05-12T08:46:57.535 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm95241.ko 2023-05-12T08:46:57.535 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm95245.ko 2023-05-12T08:46:57.535 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc2945.ko 2023-05-12T08:46:57.536 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4151.ko 2023-05-12T08:46:57.536 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4215.ko 2023-05-12T08:46:57.536 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4222.ko 2023-05-12T08:46:57.536 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4245.ko 2023-05-12T08:46:57.536 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4260.ko 2023-05-12T08:46:57.536 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4261.ko 2023-05-12T08:46:57.536 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max16065.ko 2023-05-12T08:46:57.536 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max1619.ko 2023-05-12T08:46:57.537 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max1668.ko 2023-05-12T08:46:57.537 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max197.ko 2023-05-12T08:46:57.537 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max6639.ko 2023-05-12T08:46:57.537 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max6650.ko 2023-05-12T08:46:57.537 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max6697.ko 2023-05-12T08:46:57.537 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/mcp3021.ko 2023-05-12T08:46:57.537 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/nct6683.ko 2023-05-12T08:46:57.538 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/nct6775-core.ko 2023-05-12T08:46:57.538 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/nct6775.ko 2023-05-12T08:46:57.538 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/nct7802.ko 2023-05-12T08:46:57.538 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pc87360.ko 2023-05-12T08:46:57.538 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pc87427.ko 2023-05-12T08:46:57.538 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pcf8591.ko 2023-05-12T08:46:57.538 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus 2023-05-12T08:46:57.538 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-12T08:46:57.539 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-12T08:46:57.539 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-12T08:46:57.539 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-12T08:46:57.539 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-12T08:46:57.539 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-12T08:46:57.539 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-12T08:46:57.539 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-12T08:46:57.540 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-12T08:46:57.540 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-12T08:46:57.540 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-12T08:46:57.540 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-12T08:46:57.540 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/powr1220.ko 2023-05-12T08:46:57.540 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sch5627.ko 2023-05-12T08:46:57.540 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sch5636.ko 2023-05-12T08:46:57.540 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-12T08:46:57.541 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sht15.ko 2023-05-12T08:46:57.541 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sht21.ko 2023-05-12T08:46:57.541 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/shtc1.ko 2023-05-12T08:46:57.541 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sis5595.ko 2023-05-12T08:46:57.541 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/smsc47b397.ko 2023-05-12T08:46:57.541 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/smsc47m1.ko 2023-05-12T08:46:57.541 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/smsc47m192.ko 2023-05-12T08:46:57.541 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/thmc50.ko 2023-05-12T08:46:57.542 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/tmp102.ko 2023-05-12T08:46:57.542 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/tmp103.ko 2023-05-12T08:46:57.542 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/tmp401.ko 2023-05-12T08:46:57.542 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/tmp421.ko 2023-05-12T08:46:57.542 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/via-cputemp.ko 2023-05-12T08:46:57.542 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/via686a.ko 2023-05-12T08:46:57.542 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/vt1211.ko 2023-05-12T08:46:57.543 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/vt8231.ko 2023-05-12T08:46:57.543 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83627ehf.ko 2023-05-12T08:46:57.543 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83627hf.ko 2023-05-12T08:46:57.543 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83781d.ko 2023-05-12T08:46:57.543 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83791d.ko 2023-05-12T08:46:57.543 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83792d.ko 2023-05-12T08:46:57.543 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83793.ko 2023-05-12T08:46:57.543 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83795.ko 2023-05-12T08:46:57.544 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83l785ts.ko 2023-05-12T08:46:57.544 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83l786ng.ko 2023-05-12T08:46:57.544 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c 2023-05-12T08:46:57.544 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/algos 2023-05-12T08:46:57.544 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-12T08:46:57.544 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-12T08:46:57.544 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses 2023-05-12T08:46:57.544 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-12T08:46:57.545 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-12T08:46:57.545 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-12T08:46:57.545 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-12T08:46:57.545 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-12T08:46:57.545 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-12T08:46:57.545 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-12T08:46:57.545 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-12T08:46:57.546 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-12T08:46:57.546 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-12T08:46:57.546 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-12T08:46:57.546 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-12T08:46:57.546 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-12T08:46:57.546 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-12T08:46:57.546 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-12T08:46:57.546 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-12T08:46:57.547 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-12T08:46:57.547 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-12T08:46:57.547 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-12T08:46:57.547 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-12T08:46:57.547 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-12T08:46:57.547 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-12T08:46:57.547 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-12T08:46:57.547 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/i2c-dev.ko 2023-05-12T08:46:57.548 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/i2c-mux.ko 2023-05-12T08:46:57.548 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-05-12T08:46:57.548 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/i2c-smbus.ko 2023-05-12T08:46:57.548 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/i2c-stub.ko 2023-05-12T08:46:57.548 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband 2023-05-12T08:46:57.548 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core 2023-05-12T08:46:57.548 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-12T08:46:57.549 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/ib_core.ko 2023-05-12T08:46:57.549 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-12T08:46:57.549 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-12T08:46:57.549 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-12T08:46:57.549 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-12T08:46:57.549 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-12T08:46:57.549 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw 2023-05-12T08:46:57.549 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/cxgb4 2023-05-12T08:46:57.550 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-12T08:46:57.550 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mlx4 2023-05-12T08:46:57.550 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-12T08:46:57.550 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mlx5 2023-05-12T08:46:57.550 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-12T08:46:57.550 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mthca 2023-05-12T08:46:57.550 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-12T08:46:57.550 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp 2023-05-12T08:46:57.551 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/ipoib 2023-05-12T08:46:57.551 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-12T08:46:57.551 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/iser 2023-05-12T08:46:57.551 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-12T08:46:57.551 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/isert 2023-05-12T08:46:57.551 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-12T08:46:57.551 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/srp 2023-05-12T08:46:57.552 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-12T08:46:57.552 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/srpt 2023-05-12T08:46:57.552 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-12T08:46:57.552 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input 2023-05-12T08:46:57.552 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport 2023-05-12T08:46:57.552 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-12T08:46:57.552 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-12T08:46:57.552 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport/gameport.ko 2023-05-12T08:46:57.553 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport/lightning.ko 2023-05-12T08:46:57.553 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport/ns558.ko 2023-05-12T08:46:57.553 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/joydev.ko 2023-05-12T08:46:57.553 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/keyboard 2023-05-12T08:46:57.553 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-12T08:46:57.553 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse 2023-05-12T08:46:57.553 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/appletouch.ko 2023-05-12T08:46:57.554 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/bcm5974.ko 2023-05-12T08:46:57.554 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/cyapatp.ko 2023-05-12T08:46:57.554 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-12T08:46:57.554 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/sermouse.ko 2023-05-12T08:46:57.554 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-12T08:46:57.554 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-12T08:46:57.554 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-12T08:46:57.554 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/rmi4 2023-05-12T08:46:57.555 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-12T08:46:57.555 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/serio 2023-05-12T08:46:57.555 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/serio/altera_ps2.ko 2023-05-12T08:46:57.555 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/serio/arc_ps2.ko 2023-05-12T08:46:57.555 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-12T08:46:57.555 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/serio/serio_raw.ko 2023-05-12T08:46:57.555 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/sparse-keymap.ko 2023-05-12T08:46:57.555 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/iommu 2023-05-12T08:46:57.556 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/iommu/amd 2023-05-12T08:46:57.556 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-12T08:46:57.556 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds 2023-05-12T08:46:57.556 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/leds-blinkm.ko 2023-05-12T08:46:57.556 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/leds-lm3530.ko 2023-05-12T08:46:57.556 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/leds-lp3944.ko 2023-05-12T08:46:57.556 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/leds-ss4200.ko 2023-05-12T08:46:57.557 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger 2023-05-12T08:46:57.557 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-12T08:46:57.557 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-12T08:46:57.557 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-12T08:46:57.557 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-12T08:46:57.557 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-12T08:46:57.557 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-12T08:46:57.557 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-12T08:46:57.558 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-12T08:46:57.558 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-12T08:46:57.558 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md 2023-05-12T08:46:57.558 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/bcache 2023-05-12T08:46:57.558 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/bcache/bcache.ko 2023-05-12T08:46:57.558 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-bio-prison.ko 2023-05-12T08:46:57.558 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-cache-smq.ko 2023-05-12T08:46:57.558 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-cache.ko 2023-05-12T08:46:57.559 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-crypt.ko 2023-05-12T08:46:57.559 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-delay.ko 2023-05-12T08:46:57.559 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-flakey.ko 2023-05-12T08:46:57.559 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-log-userspace.ko 2023-05-12T08:46:57.559 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-multipath.ko 2023-05-12T08:46:57.559 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-queue-length.ko 2023-05-12T08:46:57.559 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-raid.ko 2023-05-12T08:46:57.560 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-round-robin.ko 2023-05-12T08:46:57.560 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-service-time.ko 2023-05-12T08:46:57.560 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-switch.ko 2023-05-12T08:46:57.560 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-thin-pool.ko 2023-05-12T08:46:57.560 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-verity.ko 2023-05-12T08:46:57.560 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/faulty.ko 2023-05-12T08:46:57.560 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/linear.ko 2023-05-12T08:46:57.560 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/multipath.ko 2023-05-12T08:46:57.561 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/persistent-data 2023-05-12T08:46:57.561 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-12T08:46:57.561 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/raid0.ko 2023-05-12T08:46:57.561 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/raid1.ko 2023-05-12T08:46:57.561 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/raid10.ko 2023-05-12T08:46:57.561 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/raid456.ko 2023-05-12T08:46:57.561 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message 2023-05-12T08:46:57.561 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion 2023-05-12T08:46:57.562 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptbase.ko 2023-05-12T08:46:57.562 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptctl.ko 2023-05-12T08:46:57.562 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptfc.ko 2023-05-12T08:46:57.562 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptlan.ko 2023-05-12T08:46:57.562 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptsas.ko 2023-05-12T08:46:57.562 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptscsih.ko 2023-05-12T08:46:57.562 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptspi.ko 2023-05-12T08:46:57.562 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd 2023-05-12T08:46:57.563 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/lpc_ich.ko 2023-05-12T08:46:57.563 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/lpc_sch.ko 2023-05-12T08:46:57.563 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/mfd-core.ko 2023-05-12T08:46:57.563 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/sm501.ko 2023-05-12T08:46:57.563 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/viperboard.ko 2023-05-12T08:46:57.563 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/vx855.ko 2023-05-12T08:46:57.563 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/wl1273-core.ko 2023-05-12T08:46:57.564 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc 2023-05-12T08:46:57.564 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/altera-stapl 2023-05-12T08:46:57.564 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-12T08:46:57.564 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/apds9802als.ko 2023-05-12T08:46:57.564 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/apds990x.ko 2023-05-12T08:46:57.564 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/bh1770glc.ko 2023-05-12T08:46:57.564 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/cb710 2023-05-12T08:46:57.565 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/cb710/cb710.ko 2023-05-12T08:46:57.565 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/eeprom 2023-05-12T08:46:57.565 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/eeprom/at24.ko 2023-05-12T08:46:57.565 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-12T08:46:57.565 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-12T08:46:57.565 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/eeprom/max6875.ko 2023-05-12T08:46:57.565 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/enclosure.ko 2023-05-12T08:46:57.565 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/hpilo.ko 2023-05-12T08:46:57.566 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/isl29003.ko 2023-05-12T08:46:57.566 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/isl29020.ko 2023-05-12T08:46:57.566 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/lis3lv02d 2023-05-12T08:46:57.566 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-12T08:46:57.566 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-12T08:46:57.566 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/mei 2023-05-12T08:46:57.566 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/mei/mei-me.ko 2023-05-12T08:46:57.566 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/mei/mei-txe.ko 2023-05-12T08:46:57.567 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/mei/mei.ko 2023-05-12T08:46:57.567 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-gru 2023-05-12T08:46:57.567 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-gru/gru.ko 2023-05-12T08:46:57.567 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-xp 2023-05-12T08:46:57.567 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-xp/xp.ko 2023-05-12T08:46:57.567 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-xp/xpc.ko 2023-05-12T08:46:57.567 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-05-12T08:46:57.567 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/tifm_7xx1.ko 2023-05-12T08:46:57.568 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/tifm_core.ko 2023-05-12T08:46:57.568 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/tsl2550.ko 2023-05-12T08:46:57.568 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/vmw_balloon.ko 2023-05-12T08:46:57.568 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/vmw_vmci 2023-05-12T08:46:57.568 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-12T08:46:57.568 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net 2023-05-12T08:46:57.568 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/bonding 2023-05-12T08:46:57.569 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/bonding/bonding.ko 2023-05-12T08:46:57.569 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa 2023-05-12T08:46:57.569 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/b53 2023-05-12T08:46:57.569 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-12T08:46:57.569 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-12T08:46:57.569 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-12T08:46:57.569 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/mv88e6xxx 2023-05-12T08:46:57.569 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-12T08:46:57.570 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dummy.ko 2023-05-12T08:46:57.570 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/eql.ko 2023-05-12T08:46:57.570 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet 2023-05-12T08:46:57.570 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/3com 2023-05-12T08:46:57.570 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-12T08:46:57.570 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-12T08:46:57.570 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-12T08:46:57.570 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-12T08:46:57.571 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/8390 2023-05-12T08:46:57.571 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-12T08:46:57.571 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-12T08:46:57.571 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-12T08:46:57.571 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-12T08:46:57.571 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/adaptec 2023-05-12T08:46:57.571 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-12T08:46:57.572 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/agere 2023-05-12T08:46:57.572 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-12T08:46:57.572 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/alteon 2023-05-12T08:46:57.572 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-12T08:46:57.572 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/altera 2023-05-12T08:46:57.572 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-12T08:46:57.572 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/amd 2023-05-12T08:46:57.572 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-12T08:46:57.573 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-12T08:46:57.573 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-12T08:46:57.573 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros 2023-05-12T08:46:57.573 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/alx 2023-05-12T08:46:57.573 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-12T08:46:57.573 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atl1c 2023-05-12T08:46:57.573 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-12T08:46:57.573 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atl1e 2023-05-12T08:46:57.574 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-12T08:46:57.574 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atlx 2023-05-12T08:46:57.574 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-12T08:46:57.574 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-12T08:46:57.574 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom 2023-05-12T08:46:57.574 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-12T08:46:57.574 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-12T08:46:57.574 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-05-12T08:46:57.575 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-12T08:46:57.575 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-12T08:46:57.575 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/genet 2023-05-12T08:46:57.575 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-12T08:46:57.575 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-12T08:46:57.575 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/brocade 2023-05-12T08:46:57.575 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/brocade/bna 2023-05-12T08:46:57.576 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-12T08:46:57.576 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio 2023-05-12T08:46:57.576 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb 2023-05-12T08:46:57.576 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-12T08:46:57.576 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-05-12T08:46:57.576 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-12T08:46:57.576 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-05-12T08:46:57.576 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-12T08:46:57.577 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-05-12T08:46:57.577 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-12T08:46:57.577 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-05-12T08:46:57.577 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-12T08:46:57.577 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/cisco 2023-05-12T08:46:57.577 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/cisco/enic 2023-05-12T08:46:57.577 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-12T08:46:57.577 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec 2023-05-12T08:46:57.578 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip 2023-05-12T08:46:57.578 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-12T08:46:57.578 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-12T08:46:57.578 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-12T08:46:57.578 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-12T08:46:57.578 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-12T08:46:57.578 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-12T08:46:57.578 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dlink 2023-05-12T08:46:57.579 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-12T08:46:57.579 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-12T08:46:57.579 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dnet.ko 2023-05-12T08:46:57.579 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/emulex 2023-05-12T08:46:57.579 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/emulex/benet 2023-05-12T08:46:57.579 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-12T08:46:57.579 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/ethoc.ko 2023-05-12T08:46:57.580 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/fealnx.ko 2023-05-12T08:46:57.580 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel 2023-05-12T08:46:57.580 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-12T08:46:57.580 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/e1000 2023-05-12T08:46:57.580 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-12T08:46:57.580 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/e1000e 2023-05-12T08:46:57.580 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-12T08:46:57.580 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/fm10k 2023-05-12T08:46:57.581 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-12T08:46:57.581 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/i40e 2023-05-12T08:46:57.581 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-12T08:46:57.581 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/iavf 2023-05-12T08:46:57.581 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-12T08:46:57.581 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/igb 2023-05-12T08:46:57.581 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-12T08:46:57.581 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/igbvf 2023-05-12T08:46:57.582 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-12T08:46:57.582 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgb 2023-05-12T08:46:57.582 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-12T08:46:57.582 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgbe 2023-05-12T08:46:57.582 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-12T08:46:57.582 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgbevf 2023-05-12T08:46:57.582 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-12T08:46:57.583 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/jme.ko 2023-05-12T08:46:57.583 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/marvell 2023-05-12T08:46:57.583 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-12T08:46:57.583 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-12T08:46:57.583 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-12T08:46:57.583 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox 2023-05-12T08:46:57.583 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx4 2023-05-12T08:46:57.583 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-12T08:46:57.584 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-12T08:46:57.584 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx5 2023-05-12T08:46:57.584 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-05-12T08:46:57.584 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-12T08:46:57.584 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/micrel 2023-05-12T08:46:57.584 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-12T08:46:57.584 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/myricom 2023-05-12T08:46:57.584 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/myricom/myri10ge 2023-05-12T08:46:57.585 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-12T08:46:57.585 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/natsemi 2023-05-12T08:46:57.585 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-12T08:46:57.585 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-12T08:46:57.585 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/neterion 2023-05-12T08:46:57.585 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-12T08:46:57.585 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/nvidia 2023-05-12T08:46:57.586 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-12T08:46:57.586 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/packetengines 2023-05-12T08:46:57.586 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-12T08:46:57.586 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-12T08:46:57.586 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic 2023-05-12T08:46:57.586 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic/netxen 2023-05-12T08:46:57.586 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-12T08:46:57.586 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-12T08:46:57.587 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-05-12T08:46:57.587 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-12T08:46:57.587 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/rdc 2023-05-12T08:46:57.587 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-12T08:46:57.587 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/realtek 2023-05-12T08:46:57.587 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-12T08:46:57.587 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-12T08:46:57.587 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-12T08:46:57.588 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-12T08:46:57.588 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/rocker 2023-05-12T08:46:57.588 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-05-12T08:46:57.588 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sfc 2023-05-12T08:46:57.588 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-12T08:46:57.588 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/silan 2023-05-12T08:46:57.588 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-12T08:46:57.589 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sis 2023-05-12T08:46:57.589 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-12T08:46:57.589 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-12T08:46:57.589 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/smsc 2023-05-12T08:46:57.589 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-12T08:46:57.589 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-12T08:46:57.589 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-12T08:46:57.589 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-12T08:46:57.590 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/stmicro 2023-05-12T08:46:57.590 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/stmicro/stmmac 2023-05-12T08:46:57.590 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-12T08:46:57.590 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-12T08:46:57.590 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sun 2023-05-12T08:46:57.590 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-12T08:46:57.590 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-12T08:46:57.590 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-12T08:46:57.591 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-12T08:46:57.591 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/tehuti 2023-05-12T08:46:57.591 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-12T08:46:57.591 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/ti 2023-05-12T08:46:57.591 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-12T08:46:57.591 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/via 2023-05-12T08:46:57.591 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-12T08:46:57.591 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-12T08:46:57.592 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/wiznet 2023-05-12T08:46:57.592 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-12T08:46:57.592 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-12T08:46:57.592 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/xircom 2023-05-12T08:46:57.592 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-12T08:46:57.592 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/geneve.ko 2023-05-12T08:46:57.592 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/hyperv 2023-05-12T08:46:57.593 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-12T08:46:57.593 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ieee802154 2023-05-12T08:46:57.593 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-12T08:46:57.593 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ifb.ko 2023-05-12T08:46:57.593 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ipvlan 2023-05-12T08:46:57.593 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-12T08:46:57.593 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/macvlan.ko 2023-05-12T08:46:57.593 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/macvtap.ko 2023-05-12T08:46:57.594 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/mdio 2023-05-12T08:46:57.594 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/mdio.ko 2023-05-12T08:46:57.594 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-12T08:46:57.594 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-12T08:46:57.594 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/mii.ko 2023-05-12T08:46:57.594 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/net_failover.ko 2023-05-12T08:46:57.594 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/netconsole.ko 2023-05-12T08:46:57.595 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/nlmon.ko 2023-05-12T08:46:57.595 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/pcs 2023-05-12T08:46:57.595 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-12T08:46:57.595 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-12T08:46:57.595 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy 2023-05-12T08:46:57.595 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/amd.ko 2023-05-12T08:46:57.596 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-12T08:46:57.596 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-05-12T08:46:57.596 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-12T08:46:57.596 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/bcm87xx.ko 2023-05-12T08:46:57.596 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/broadcom.ko 2023-05-12T08:46:57.596 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/cicada.ko 2023-05-12T08:46:57.596 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/davicom.ko 2023-05-12T08:46:57.597 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/dp83640.ko 2023-05-12T08:46:57.597 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/et1011c.ko 2023-05-12T08:46:57.597 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/icplus.ko 2023-05-12T08:46:57.597 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/lxt.ko 2023-05-12T08:46:57.597 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/marvell.ko 2023-05-12T08:46:57.597 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/micrel.ko 2023-05-12T08:46:57.597 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/national.ko 2023-05-12T08:46:57.597 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/phylink.ko 2023-05-12T08:46:57.598 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/qsemi.ko 2023-05-12T08:46:57.598 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/realtek.ko 2023-05-12T08:46:57.598 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/smsc.ko 2023-05-12T08:46:57.598 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/ste10Xp.ko 2023-05-12T08:46:57.598 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/vitesse.ko 2023-05-12T08:46:57.598 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp 2023-05-12T08:46:57.598 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-12T08:46:57.598 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/ppp_async.ko 2023-05-12T08:46:57.599 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-12T08:46:57.599 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/ppp_generic.ko 2023-05-12T08:46:57.599 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-12T08:46:57.599 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-12T08:46:57.599 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/pppoe.ko 2023-05-12T08:46:57.599 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/pppox.ko 2023-05-12T08:46:57.599 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/pptp.ko 2023-05-12T08:46:57.600 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/slip 2023-05-12T08:46:57.600 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/slip/slhc.ko 2023-05-12T08:46:57.600 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/slip/slip.ko 2023-05-12T08:46:57.600 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/sungem_phy.ko 2023-05-12T08:46:57.600 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/tap.ko 2023-05-12T08:46:57.600 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team 2023-05-12T08:46:57.600 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team.ko 2023-05-12T08:46:57.600 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-12T08:46:57.601 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-12T08:46:57.601 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-12T08:46:57.601 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team_mode_random.ko 2023-05-12T08:46:57.601 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-12T08:46:57.601 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/tun.ko 2023-05-12T08:46:57.601 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/veth.ko 2023-05-12T08:46:57.601 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/virtio_net.ko 2023-05-12T08:46:57.601 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/vmxnet3 2023-05-12T08:46:57.602 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-12T08:46:57.602 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/vxlan 2023-05-12T08:46:57.602 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/vxlan/vxlan.ko 2023-05-12T08:46:57.602 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/xen-netback 2023-05-12T08:46:57.602 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-12T08:46:57.602 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/xen-netfront.ko 2023-05-12T08:46:57.602 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ntb 2023-05-12T08:46:57.602 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ntb/ntb.ko 2023-05-12T08:46:57.603 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/nvme 2023-05-12T08:46:57.603 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/nvme/host 2023-05-12T08:46:57.603 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/nvme/host/nvme-core.ko 2023-05-12T08:46:57.603 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/nvme/host/nvme.ko 2023-05-12T08:46:57.603 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/parport 2023-05-12T08:46:57.603 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/parport/parport.ko 2023-05-12T08:46:57.603 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/parport/parport_cs.ko 2023-05-12T08:46:57.604 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/parport/parport_pc.ko 2023-05-12T08:46:57.604 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/parport/parport_serial.ko 2023-05-12T08:46:57.604 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci 2023-05-12T08:46:57.604 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci/hotplug 2023-05-12T08:46:57.604 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-12T08:46:57.604 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci/pcie 2023-05-12T08:46:57.604 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci/pcie/aer_inject.ko 2023-05-12T08:46:57.604 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci/xen-pcifront.ko 2023-05-12T08:46:57.605 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pcmcia 2023-05-12T08:46:57.605 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pcmcia/i82092.ko 2023-05-12T08:46:57.605 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pcmcia/pd6729.ko 2023-05-12T08:46:57.605 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-12T08:46:57.605 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pinctrl 2023-05-12T08:46:57.605 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pinctrl/intel 2023-05-12T08:46:57.605 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-12T08:46:57.605 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform 2023-05-12T08:46:57.606 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86 2023-05-12T08:46:57.606 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-12T08:46:57.606 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/acerhdf.ko 2023-05-12T08:46:57.606 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-12T08:46:57.606 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-12T08:46:57.606 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-12T08:46:57.606 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-12T08:46:57.606 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-12T08:46:57.607 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-12T08:46:57.607 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-12T08:46:57.607 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-12T08:46:57.607 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-12T08:46:57.607 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/hdaps.ko 2023-05-12T08:46:57.607 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/intel 2023-05-12T08:46:57.607 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-12T08:46:57.607 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/intel_ips.ko 2023-05-12T08:46:57.608 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-12T08:46:57.608 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-12T08:46:57.608 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-12T08:46:57.608 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-12T08:46:57.608 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-12T08:46:57.608 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-12T08:46:57.608 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-12T08:46:57.609 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-12T08:46:57.609 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-12T08:46:57.609 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/wmi.ko 2023-05-12T08:46:57.609 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/powercap 2023-05-12T08:46:57.609 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-12T08:46:57.609 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-12T08:46:57.609 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps 2023-05-12T08:46:57.609 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps/clients 2023-05-12T08:46:57.610 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-12T08:46:57.610 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-12T08:46:57.610 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps/clients/pps_parport.ko 2023-05-12T08:46:57.610 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps/pps_core.ko 2023-05-12T08:46:57.610 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ptp 2023-05-12T08:46:57.610 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ptp/ptp.ko 2023-05-12T08:46:57.610 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ptp/ptp_kvm.ko 2023-05-12T08:46:57.611 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc 2023-05-12T08:46:57.611 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-12T08:46:57.611 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-12T08:46:57.611 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-12T08:46:57.611 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-12T08:46:57.611 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-12T08:46:57.611 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-12T08:46:57.611 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-12T08:46:57.612 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-12T08:46:57.612 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-12T08:46:57.612 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-12T08:46:57.612 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-12T08:46:57.612 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-em3027.ko 2023-05-12T08:46:57.612 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-12T08:46:57.613 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-12T08:46:57.613 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-12T08:46:57.613 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-12T08:46:57.613 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-12T08:46:57.613 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-12T08:46:57.613 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-max6900.ko 2023-05-12T08:46:57.613 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-12T08:46:57.614 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-12T08:46:57.614 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-12T08:46:57.614 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-12T08:46:57.614 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-12T08:46:57.614 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-12T08:46:57.614 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-12T08:46:57.615 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-12T08:46:57.615 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-12T08:46:57.615 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-12T08:46:57.615 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-12T08:46:57.615 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-12T08:46:57.615 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-x1205.ko 2023-05-12T08:46:57.615 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi 2023-05-12T08:46:57.616 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/3w-9xxx.ko 2023-05-12T08:46:57.616 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/3w-sas.ko 2023-05-12T08:46:57.616 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/3w-xxxx.ko 2023-05-12T08:46:57.616 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/BusLogic.ko 2023-05-12T08:46:57.616 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/a100u2w.ko 2023-05-12T08:46:57.616 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/aacraid 2023-05-12T08:46:57.617 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-12T08:46:57.617 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/advansys.ko 2023-05-12T08:46:57.617 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/aic7xxx 2023-05-12T08:46:57.617 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-12T08:46:57.617 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-12T08:46:57.617 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/am53c974.ko 2023-05-12T08:46:57.617 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/arcmsr 2023-05-12T08:46:57.618 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-12T08:46:57.618 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/atp870u.ko 2023-05-12T08:46:57.618 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/be2iscsi 2023-05-12T08:46:57.618 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-12T08:46:57.618 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bfa 2023-05-12T08:46:57.618 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bfa/bfa.ko 2023-05-12T08:46:57.619 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bnx2fc 2023-05-12T08:46:57.619 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-12T08:46:57.619 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bnx2i 2023-05-12T08:46:57.619 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-12T08:46:57.619 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/ch.ko 2023-05-12T08:46:57.619 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/csiostor 2023-05-12T08:46:57.620 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-12T08:46:57.620 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi 2023-05-12T08:46:57.620 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi/cxgb3i 2023-05-12T08:46:57.620 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-12T08:46:57.620 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi/cxgb4i 2023-05-12T08:46:57.621 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-12T08:46:57.621 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-12T08:46:57.621 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/dc395x.ko 2023-05-12T08:46:57.621 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/device_handler 2023-05-12T08:46:57.621 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-05-12T08:46:57.621 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-05-12T08:46:57.622 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-05-12T08:46:57.622 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-05-12T08:46:57.622 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/dmx3191d.ko 2023-05-12T08:46:57.622 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/esas2r 2023-05-12T08:46:57.622 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-12T08:46:57.622 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/esp_scsi.ko 2023-05-12T08:46:57.622 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/fcoe 2023-05-12T08:46:57.622 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-12T08:46:57.623 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-12T08:46:57.623 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/fnic 2023-05-12T08:46:57.623 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/fnic/fnic.ko 2023-05-12T08:46:57.623 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/hpsa.ko 2023-05-12T08:46:57.623 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/hptiop.ko 2023-05-12T08:46:57.623 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/hv_storvsc.ko 2023-05-12T08:46:57.623 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/initio.ko 2023-05-12T08:46:57.623 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/ipr.ko 2023-05-12T08:46:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/ips.ko 2023-05-12T08:46:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/isci 2023-05-12T08:46:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/isci/isci.ko 2023-05-12T08:46:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-12T08:46:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-12T08:46:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libfc 2023-05-12T08:46:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libfc/libfc.ko 2023-05-12T08:46:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libiscsi.ko 2023-05-12T08:46:57.625 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-12T08:46:57.625 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libsas 2023-05-12T08:46:57.625 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libsas/libsas.ko 2023-05-12T08:46:57.625 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/lpfc 2023-05-12T08:46:57.625 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-12T08:46:57.625 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/megaraid 2023-05-12T08:46:57.625 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/megaraid.ko 2023-05-12T08:46:57.625 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-12T08:46:57.626 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-12T08:46:57.626 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-12T08:46:57.626 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/mpt3sas 2023-05-12T08:46:57.626 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-12T08:46:57.626 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/mvsas 2023-05-12T08:46:57.626 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-12T08:46:57.626 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/mvumi.ko 2023-05-12T08:46:57.626 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/pm8001 2023-05-12T08:46:57.627 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-12T08:46:57.627 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/pmcraid.ko 2023-05-12T08:46:57.627 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla1280.ko 2023-05-12T08:46:57.627 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla2xxx 2023-05-12T08:46:57.627 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-12T08:46:57.627 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-12T08:46:57.627 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla4xxx 2023-05-12T08:46:57.628 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-12T08:46:57.628 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/raid_class.ko 2023-05-12T08:46:57.628 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_debug.ko 2023-05-12T08:46:57.628 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-12T08:46:57.628 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-12T08:46:57.628 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-12T08:46:57.628 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-12T08:46:57.628 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-12T08:46:57.629 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/ses.ko 2023-05-12T08:46:57.629 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/st.ko 2023-05-12T08:46:57.629 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/stex.ko 2023-05-12T08:46:57.629 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/sym53c8xx_2 2023-05-12T08:46:57.629 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-12T08:46:57.629 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/virtio_scsi.ko 2023-05-12T08:46:57.629 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-12T08:46:57.630 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/wd719x.ko 2023-05-12T08:46:57.630 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ssb 2023-05-12T08:46:57.630 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ssb/ssb.ko 2023-05-12T08:46:57.630 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target 2023-05-12T08:46:57.630 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/iscsi 2023-05-12T08:46:57.630 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-12T08:46:57.630 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/loopback 2023-05-12T08:46:57.630 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-12T08:46:57.631 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/target_core_file.ko 2023-05-12T08:46:57.631 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/target_core_iblock.ko 2023-05-12T08:46:57.631 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/target_core_mod.ko 2023-05-12T08:46:57.631 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/target_core_pscsi.ko 2023-05-12T08:46:57.631 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/target_core_user.ko 2023-05-12T08:46:57.631 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/tcm_fc 2023-05-12T08:46:57.631 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-12T08:46:57.631 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal 2023-05-12T08:46:57.632 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel 2023-05-12T08:46:57.632 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal 2023-05-12T08:46:57.632 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-12T08:46:57.632 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-12T08:46:57.632 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-12T08:46:57.632 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-12T08:46:57.632 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-12T08:46:57.632 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-12T08:46:57.633 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-12T08:46:57.633 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-12T08:46:57.633 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-12T08:46:57.633 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-12T08:46:57.633 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-12T08:46:57.633 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-12T08:46:57.633 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-12T08:46:57.633 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-12T08:46:57.634 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-12T08:46:57.634 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty 2023-05-12T08:46:57.634 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/ipwireless 2023-05-12T08:46:57.634 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-12T08:46:57.634 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/n_gsm.ko 2023-05-12T08:46:57.634 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/n_hdlc.ko 2023-05-12T08:46:57.634 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/nozomi.ko 2023-05-12T08:46:57.635 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial 2023-05-12T08:46:57.635 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial/8250 2023-05-12T08:46:57.635 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-12T08:46:57.635 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial/arc_uart.ko 2023-05-12T08:46:57.635 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial/jsm 2023-05-12T08:46:57.635 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-12T08:46:57.635 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/synclink_gt.ko 2023-05-12T08:46:57.635 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ufs 2023-05-12T08:46:57.636 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ufs/core 2023-05-12T08:46:57.636 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-12T08:46:57.636 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ufs/host 2023-05-12T08:46:57.636 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-12T08:46:57.636 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio 2023-05-12T08:46:57.636 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio/uio.ko 2023-05-12T08:46:57.636 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio/uio_aec.ko 2023-05-12T08:46:57.636 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio/uio_cif.ko 2023-05-12T08:46:57.637 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio/uio_pci_generic.ko 2023-05-12T08:46:57.637 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio/uio_sercos3.ko 2023-05-12T08:46:57.637 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb 2023-05-12T08:46:57.637 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/class 2023-05-12T08:46:57.637 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/class/cdc-acm.ko 2023-05-12T08:46:57.637 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-12T08:46:57.637 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/class/usblp.ko 2023-05-12T08:46:57.637 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/class/usbtmc.ko 2023-05-12T08:46:57.638 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/host 2023-05-12T08:46:57.638 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-12T08:46:57.638 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/host/u132-hcd.ko 2023-05-12T08:46:57.638 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/image 2023-05-12T08:46:57.638 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/image/mdc800.ko 2023-05-12T08:46:57.638 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/image/microtek.ko 2023-05-12T08:46:57.638 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc 2023-05-12T08:46:57.638 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/adutux.ko 2023-05-12T08:46:57.639 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/appledisplay.ko 2023-05-12T08:46:57.639 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/emi26.ko 2023-05-12T08:46:57.639 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/emi62.ko 2023-05-12T08:46:57.639 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/ezusb.ko 2023-05-12T08:46:57.639 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-12T08:46:57.639 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/idmouse.ko 2023-05-12T08:46:57.639 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/iowarrior.ko 2023-05-12T08:46:57.639 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-12T08:46:57.640 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/ldusb.ko 2023-05-12T08:46:57.640 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/legousbtower.ko 2023-05-12T08:46:57.640 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/sisusbvga 2023-05-12T08:46:57.640 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-12T08:46:57.640 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-12T08:46:57.640 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/usb3503.ko 2023-05-12T08:46:57.640 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/usblcd.ko 2023-05-12T08:46:57.641 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-12T08:46:57.641 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/uss720.ko 2023-05-12T08:46:57.641 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/yurex.ko 2023-05-12T08:46:57.641 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/phy 2023-05-12T08:46:57.641 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/phy/phy-generic.ko 2023-05-12T08:46:57.641 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial 2023-05-12T08:46:57.641 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/aircable.ko 2023-05-12T08:46:57.641 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ark3116.ko 2023-05-12T08:46:57.642 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-12T08:46:57.642 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ch341.ko 2023-05-12T08:46:57.642 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/cp210x.ko 2023-05-12T08:46:57.642 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/cyberjack.ko 2023-05-12T08:46:57.642 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-12T08:46:57.642 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-12T08:46:57.642 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/empeg.ko 2023-05-12T08:46:57.642 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-12T08:46:57.643 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-12T08:46:57.643 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-12T08:46:57.643 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/io_ti.ko 2023-05-12T08:46:57.643 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ipaq.ko 2023-05-12T08:46:57.643 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ipw.ko 2023-05-12T08:46:57.643 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ir-usb.ko 2023-05-12T08:46:57.643 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-12T08:46:57.643 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/keyspan.ko 2023-05-12T08:46:57.644 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-12T08:46:57.644 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-12T08:46:57.644 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-12T08:46:57.644 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/mct_u232.ko 2023-05-12T08:46:57.644 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/mos7720.ko 2023-05-12T08:46:57.644 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/mos7840.ko 2023-05-12T08:46:57.644 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/navman.ko 2023-05-12T08:46:57.644 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/omninet.ko 2023-05-12T08:46:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/opticon.ko 2023-05-12T08:46:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/option.ko 2023-05-12T08:46:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/oti6858.ko 2023-05-12T08:46:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/pl2303.ko 2023-05-12T08:46:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/qcaux.ko 2023-05-12T08:46:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/qcserial.ko 2023-05-12T08:46:57.645 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/quatech2.ko 2023-05-12T08:46:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/safe_serial.ko 2023-05-12T08:46:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/sierra.ko 2023-05-12T08:46:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-12T08:46:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ssu100.ko 2023-05-12T08:46:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/symbolserial.ko 2023-05-12T08:46:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-12T08:46:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-12T08:46:57.646 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/usb_debug.ko 2023-05-12T08:46:57.647 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-12T08:46:57.647 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/visor.ko 2023-05-12T08:46:57.647 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/whiteheat.ko 2023-05-12T08:46:57.647 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-12T08:46:57.647 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage 2023-05-12T08:46:57.647 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/uas.ko 2023-05-12T08:46:57.647 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-12T08:46:57.647 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-12T08:46:57.648 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-12T08:46:57.648 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-12T08:46:57.648 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-12T08:46:57.648 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-12T08:46:57.648 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-12T08:46:57.648 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-karma.ko 2023-05-12T08:46:57.648 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-12T08:46:57.648 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-12T08:46:57.649 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-12T08:46:57.649 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-12T08:46:57.649 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-12T08:46:57.649 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/usb-storage.ko 2023-05-12T08:46:57.649 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/usbip 2023-05-12T08:46:57.649 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-12T08:46:57.649 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-12T08:46:57.649 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-12T08:46:57.650 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio 2023-05-12T08:46:57.650 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio/pci 2023-05-12T08:46:57.650 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-12T08:46:57.650 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-12T08:46:57.650 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio/vfio.ko 2023-05-12T08:46:57.650 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-12T08:46:57.650 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vhost 2023-05-12T08:46:57.650 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vhost/vhost.ko 2023-05-12T08:46:57.651 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-12T08:46:57.651 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vhost/vhost_net.ko 2023-05-12T08:46:57.651 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vhost/vhost_scsi.ko 2023-05-12T08:46:57.651 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/video 2023-05-12T08:46:57.651 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/video/backlight 2023-05-12T08:46:57.651 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/video/backlight/apple_bl.ko 2023-05-12T08:46:57.651 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/video/backlight/lcd.ko 2023-05-12T08:46:57.652 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-12T08:46:57.652 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio 2023-05-12T08:46:57.652 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio.ko 2023-05-12T08:46:57.652 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_balloon.ko 2023-05-12T08:46:57.652 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_mmio.ko 2023-05-12T08:46:57.652 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_pci.ko 2023-05-12T08:46:57.652 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-05-12T08:46:57.652 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-05-12T08:46:57.653 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_ring.ko 2023-05-12T08:46:57.653 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1 2023-05-12T08:46:57.653 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/masters 2023-05-12T08:46:57.653 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/masters/ds2482.ko 2023-05-12T08:46:57.653 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/masters/ds2490.ko 2023-05-12T08:46:57.653 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves 2023-05-12T08:46:57.653 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-12T08:46:57.653 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-12T08:46:57.654 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-12T08:46:57.654 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-12T08:46:57.654 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-12T08:46:57.654 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-12T08:46:57.654 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-12T08:46:57.654 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-12T08:46:57.654 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-12T08:46:57.654 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-12T08:46:57.655 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-12T08:46:57.655 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/wire.ko 2023-05-12T08:46:57.655 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog 2023-05-12T08:46:57.655 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-12T08:46:57.655 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-12T08:46:57.655 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-12T08:46:57.655 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/hpwdt.ko 2023-05-12T08:46:57.655 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/i6300esb.ko 2023-05-12T08:46:57.656 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-12T08:46:57.656 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-12T08:46:57.656 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/ib700wdt.ko 2023-05-12T08:46:57.656 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/ibmasr.ko 2023-05-12T08:46:57.656 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-12T08:46:57.656 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-12T08:46:57.656 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/it87_wdt.ko 2023-05-12T08:46:57.657 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/machzwd.ko 2023-05-12T08:46:57.657 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/nv_tco.ko 2023-05-12T08:46:57.657 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-12T08:46:57.657 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-12T08:46:57.657 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-12T08:46:57.657 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-12T08:46:57.657 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/softdog.ko 2023-05-12T08:46:57.657 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-12T08:46:57.658 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/via_wdt.ko 2023-05-12T08:46:57.658 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-12T08:46:57.658 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-12T08:46:57.658 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-12T08:46:57.658 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/wdt_pci.ko 2023-05-12T08:46:57.658 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/xen_wdt.ko 2023-05-12T08:46:57.658 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen 2023-05-12T08:46:57.658 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-acpi-processor.ko 2023-05-12T08:46:57.659 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-evtchn.ko 2023-05-12T08:46:57.659 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-gntalloc.ko 2023-05-12T08:46:57.659 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-gntdev.ko 2023-05-12T08:46:57.659 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-pciback 2023-05-12T08:46:57.659 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-12T08:46:57.659 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-privcmd.ko 2023-05-12T08:46:57.659 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xenfs 2023-05-12T08:46:57.659 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-12T08:46:57.660 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs 2023-05-12T08:46:57.660 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/9p 2023-05-12T08:46:57.660 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/9p/9p.ko 2023-05-12T08:46:57.660 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/affs 2023-05-12T08:46:57.660 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/affs/affs.ko 2023-05-12T08:46:57.660 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/befs 2023-05-12T08:46:57.660 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/befs/befs.ko 2023-05-12T08:46:57.661 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/binfmt_misc.ko 2023-05-12T08:46:57.661 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/btrfs 2023-05-12T08:46:57.661 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/btrfs/btrfs.ko 2023-05-12T08:46:57.661 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cachefiles 2023-05-12T08:46:57.661 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cachefiles/cachefiles.ko 2023-05-12T08:46:57.661 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ceph 2023-05-12T08:46:57.661 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ceph/ceph.ko 2023-05-12T08:46:57.661 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cifs 2023-05-12T08:46:57.662 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cifs/cifs.ko 2023-05-12T08:46:57.662 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/coda 2023-05-12T08:46:57.662 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/coda/coda.ko 2023-05-12T08:46:57.662 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cramfs 2023-05-12T08:46:57.662 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cramfs/cramfs.ko 2023-05-12T08:46:57.662 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/dlm 2023-05-12T08:46:57.662 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/dlm/dlm.ko 2023-05-12T08:46:57.662 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ecryptfs 2023-05-12T08:46:57.663 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ecryptfs/ecryptfs.ko 2023-05-12T08:46:57.663 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/f2fs 2023-05-12T08:46:57.663 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/f2fs/f2fs.ko 2023-05-12T08:46:57.663 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fat 2023-05-12T08:46:57.663 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fat/fat.ko 2023-05-12T08:46:57.663 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fat/msdos.ko 2023-05-12T08:46:57.663 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fat/vfat.ko 2023-05-12T08:46:57.663 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fscache 2023-05-12T08:46:57.664 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fscache/fscache.ko 2023-05-12T08:46:57.664 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fuse 2023-05-12T08:46:57.664 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fuse/cuse.ko 2023-05-12T08:46:57.664 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fuse/fuse.ko 2023-05-12T08:46:57.664 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/gfs2 2023-05-12T08:46:57.664 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/gfs2/gfs2.ko 2023-05-12T08:46:57.664 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/hfs 2023-05-12T08:46:57.665 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/hfs/hfs.ko 2023-05-12T08:46:57.665 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/hfsplus 2023-05-12T08:46:57.665 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/hfsplus/hfsplus.ko 2023-05-12T08:46:57.665 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/isofs 2023-05-12T08:46:57.665 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/isofs/isofs.ko 2023-05-12T08:46:57.665 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/jfs 2023-05-12T08:46:57.665 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/jfs/jfs.ko 2023-05-12T08:46:57.665 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/lockd 2023-05-12T08:46:57.666 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/lockd/lockd.ko 2023-05-12T08:46:57.666 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/minix 2023-05-12T08:46:57.666 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/minix/minix.ko 2023-05-12T08:46:57.666 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/netfs 2023-05-12T08:46:57.666 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/netfs/netfs.ko 2023-05-12T08:46:57.666 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs 2023-05-12T08:46:57.666 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/blocklayout 2023-05-12T08:46:57.666 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-12T08:46:57.667 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/filelayout 2023-05-12T08:46:57.667 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-12T08:46:57.667 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/flexfilelayout 2023-05-12T08:46:57.667 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-12T08:46:57.667 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/nfs.ko 2023-05-12T08:46:57.667 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/nfsv3.ko 2023-05-12T08:46:57.667 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/nfsv4.ko 2023-05-12T08:46:57.667 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs_common 2023-05-12T08:46:57.668 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs_common/grace.ko 2023-05-12T08:46:57.668 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs_common/nfs_acl.ko 2023-05-12T08:46:57.668 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfsd 2023-05-12T08:46:57.668 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfsd/nfsd.ko 2023-05-12T08:46:57.668 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nilfs2 2023-05-12T08:46:57.668 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nilfs2/nilfs2.ko 2023-05-12T08:46:57.668 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls 2023-05-12T08:46:57.669 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-celtic.ko 2023-05-12T08:46:57.669 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-centeuro.ko 2023-05-12T08:46:57.669 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-croatian.ko 2023-05-12T08:46:57.669 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-cyrillic.ko 2023-05-12T08:46:57.669 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-gaelic.ko 2023-05-12T08:46:57.669 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-greek.ko 2023-05-12T08:46:57.669 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-iceland.ko 2023-05-12T08:46:57.669 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-inuit.ko 2023-05-12T08:46:57.670 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-roman.ko 2023-05-12T08:46:57.670 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-romanian.ko 2023-05-12T08:46:57.670 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-turkish.ko 2023-05-12T08:46:57.670 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp1250.ko 2023-05-12T08:46:57.670 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp1251.ko 2023-05-12T08:46:57.670 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp1255.ko 2023-05-12T08:46:57.670 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp737.ko 2023-05-12T08:46:57.670 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp775.ko 2023-05-12T08:46:57.671 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp850.ko 2023-05-12T08:46:57.671 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp852.ko 2023-05-12T08:46:57.671 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp855.ko 2023-05-12T08:46:57.671 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp857.ko 2023-05-12T08:46:57.671 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp860.ko 2023-05-12T08:46:57.671 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp861.ko 2023-05-12T08:46:57.671 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp862.ko 2023-05-12T08:46:57.671 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp863.ko 2023-05-12T08:46:57.672 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp864.ko 2023-05-12T08:46:57.672 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp865.ko 2023-05-12T08:46:57.672 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp866.ko 2023-05-12T08:46:57.672 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp869.ko 2023-05-12T08:46:57.672 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp874.ko 2023-05-12T08:46:57.672 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp932.ko 2023-05-12T08:46:57.672 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp936.ko 2023-05-12T08:46:57.672 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp949.ko 2023-05-12T08:46:57.673 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp950.ko 2023-05-12T08:46:57.673 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_euc-jp.ko 2023-05-12T08:46:57.673 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-1.ko 2023-05-12T08:46:57.673 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-13.ko 2023-05-12T08:46:57.673 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-14.ko 2023-05-12T08:46:57.673 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-15.ko 2023-05-12T08:46:57.673 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-2.ko 2023-05-12T08:46:57.674 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-3.ko 2023-05-12T08:46:57.674 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-4.ko 2023-05-12T08:46:57.674 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-5.ko 2023-05-12T08:46:57.674 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-6.ko 2023-05-12T08:46:57.674 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-7.ko 2023-05-12T08:46:57.674 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-9.ko 2023-05-12T08:46:57.674 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_koi8-r.ko 2023-05-12T08:46:57.674 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_koi8-ru.ko 2023-05-12T08:46:57.675 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_koi8-u.ko 2023-05-12T08:46:57.675 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_utf8.ko 2023-05-12T08:46:57.675 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2 2023-05-12T08:46:57.675 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/cluster 2023-05-12T08:46:57.675 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-12T08:46:57.675 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/dlm 2023-05-12T08:46:57.675 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-12T08:46:57.675 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/dlmfs 2023-05-12T08:46:57.676 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-12T08:46:57.676 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/ocfs2.ko 2023-05-12T08:46:57.676 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-12T08:46:57.676 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-12T08:46:57.676 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-12T08:46:57.676 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/overlayfs 2023-05-12T08:46:57.676 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/overlayfs/overlay.ko 2023-05-12T08:46:57.677 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/pstore 2023-05-12T08:46:57.677 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/pstore/ramoops.ko 2023-05-12T08:46:57.677 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/reiserfs 2023-05-12T08:46:57.677 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/reiserfs/reiserfs.ko 2023-05-12T08:46:57.677 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/romfs 2023-05-12T08:46:57.677 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/romfs/romfs.ko 2023-05-12T08:46:57.677 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/smbfs_common 2023-05-12T08:46:57.677 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-12T08:46:57.678 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-12T08:46:57.678 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/squashfs 2023-05-12T08:46:57.678 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/squashfs/squashfs.ko 2023-05-12T08:46:57.678 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/sysv 2023-05-12T08:46:57.678 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/sysv/sysv.ko 2023-05-12T08:46:57.678 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/udf 2023-05-12T08:46:57.679 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/udf/udf.ko 2023-05-12T08:46:57.679 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ufs 2023-05-12T08:46:57.679 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ufs/ufs.ko 2023-05-12T08:46:57.679 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/xfs 2023-05-12T08:46:57.679 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/xfs/xfs.ko 2023-05-12T08:46:57.680 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel 2023-05-12T08:46:57.680 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel/rcu 2023-05-12T08:46:57.680 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel/rcu/rcutorture.ko 2023-05-12T08:46:57.680 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel/torture.ko 2023-05-12T08:46:57.680 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel/trace 2023-05-12T08:46:57.680 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-05-12T08:46:57.681 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib 2023-05-12T08:46:57.681 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/asn1_encoder.ko 2023-05-12T08:46:57.681 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/crc-itu-t.ko 2023-05-12T08:46:57.681 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/crc8.ko 2023-05-12T08:46:57.681 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/crypto 2023-05-12T08:46:57.681 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/crypto/libarc4.ko 2023-05-12T08:46:57.682 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/crypto/libdes.ko 2023-05-12T08:46:57.682 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/libcrc32c.ko 2023-05-12T08:46:57.682 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/lru_cache.ko 2023-05-12T08:46:57.682 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/lz4 2023-05-12T08:46:57.682 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/lz4/lz4_compress.ko 2023-05-12T08:46:57.682 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/lz4/lz4hc_compress.ko 2023-05-12T08:46:57.682 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/math 2023-05-12T08:46:57.683 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/math/cordic.ko 2023-05-12T08:46:57.683 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/raid6 2023-05-12T08:46:57.683 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/raid6/raid6_pq.ko 2023-05-12T08:46:57.683 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/reed_solomon 2023-05-12T08:46:57.683 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-12T08:46:57.683 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/ts_bm.ko 2023-05-12T08:46:57.683 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/ts_fsm.ko 2023-05-12T08:46:57.683 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/ts_kmp.ko 2023-05-12T08:46:57.684 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/zstd 2023-05-12T08:46:57.684 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/zstd/zstd_compress.ko 2023-05-12T08:46:57.684 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/mm 2023-05-12T08:46:57.684 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/mm/hwpoison-inject.ko 2023-05-12T08:46:57.684 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net 2023-05-12T08:46:57.684 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan 2023-05-12T08:46:57.684 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/6lowpan.ko 2023-05-12T08:46:57.684 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_dest.ko 2023-05-12T08:46:57.685 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_fragment.ko 2023-05-12T08:46:57.685 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_hop.ko 2023-05-12T08:46:57.685 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-12T08:46:57.685 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_mobility.ko 2023-05-12T08:46:57.685 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_routing.ko 2023-05-12T08:46:57.685 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_udp.ko 2023-05-12T08:46:57.685 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802 2023-05-12T08:46:57.686 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802/garp.ko 2023-05-12T08:46:57.686 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802/mrp.ko 2023-05-12T08:46:57.686 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802/p8022.ko 2023-05-12T08:46:57.686 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802/psnap.ko 2023-05-12T08:46:57.686 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802/stp.ko 2023-05-12T08:46:57.686 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/8021q 2023-05-12T08:46:57.686 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/8021q/8021q.ko 2023-05-12T08:46:57.686 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/9p 2023-05-12T08:46:57.687 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/9p/9pnet.ko 2023-05-12T08:46:57.687 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/9p/9pnet_fd.ko 2023-05-12T08:46:57.687 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/9p/9pnet_rdma.ko 2023-05-12T08:46:57.687 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/9p/9pnet_virtio.ko 2023-05-12T08:46:57.687 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/batman-adv 2023-05-12T08:46:57.687 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/batman-adv/batman-adv.ko 2023-05-12T08:46:57.687 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge 2023-05-12T08:46:57.687 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/br_netfilter.ko 2023-05-12T08:46:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/bridge.ko 2023-05-12T08:46:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter 2023-05-12T08:46:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-12T08:46:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-12T08:46:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-12T08:46:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-12T08:46:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-12T08:46:57.689 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-12T08:46:57.689 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-12T08:46:57.689 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-12T08:46:57.689 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-12T08:46:57.689 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-12T08:46:57.689 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-12T08:46:57.689 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-12T08:46:57.689 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-12T08:46:57.690 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-12T08:46:57.690 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-12T08:46:57.690 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-12T08:46:57.690 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-12T08:46:57.690 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-12T08:46:57.690 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-12T08:46:57.690 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-12T08:46:57.690 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebtables.ko 2023-05-12T08:46:57.691 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-05-12T08:46:57.691 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-12T08:46:57.691 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-12T08:46:57.691 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ceph 2023-05-12T08:46:57.691 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ceph/libceph.ko 2023-05-12T08:46:57.691 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/core 2023-05-12T08:46:57.691 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/core/failover.ko 2023-05-12T08:46:57.692 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/core/pktgen.ko 2023-05-12T08:46:57.692 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dccp 2023-05-12T08:46:57.692 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dccp/dccp.ko 2023-05-12T08:46:57.692 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dccp/dccp_diag.ko 2023-05-12T08:46:57.692 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dccp/dccp_ipv4.ko 2023-05-12T08:46:57.692 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dccp/dccp_ipv6.ko 2023-05-12T08:46:57.692 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dns_resolver 2023-05-12T08:46:57.692 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dns_resolver/dns_resolver.ko 2023-05-12T08:46:57.693 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa 2023-05-12T08:46:57.693 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa/dsa_core.ko 2023-05-12T08:46:57.693 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa/tag_brcm.ko 2023-05-12T08:46:57.693 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa/tag_dsa.ko 2023-05-12T08:46:57.693 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa/tag_none.ko 2023-05-12T08:46:57.693 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa/tag_trailer.ko 2023-05-12T08:46:57.693 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ieee802154 2023-05-12T08:46:57.693 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ieee802154/6lowpan 2023-05-12T08:46:57.694 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-12T08:46:57.694 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ieee802154/ieee802154.ko 2023-05-12T08:46:57.694 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-12T08:46:57.694 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4 2023-05-12T08:46:57.694 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ah4.ko 2023-05-12T08:46:57.694 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/esp4.ko 2023-05-12T08:46:57.694 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/fou.ko 2023-05-12T08:46:57.694 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/gre.ko 2023-05-12T08:46:57.695 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/inet_diag.ko 2023-05-12T08:46:57.695 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ip_gre.ko 2023-05-12T08:46:57.695 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ip_tunnel.ko 2023-05-12T08:46:57.695 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ip_vti.ko 2023-05-12T08:46:57.695 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ipcomp.ko 2023-05-12T08:46:57.695 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ipip.ko 2023-05-12T08:46:57.695 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter 2023-05-12T08:46:57.695 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-12T08:46:57.696 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-12T08:46:57.696 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-12T08:46:57.696 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-12T08:46:57.696 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-12T08:46:57.696 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-12T08:46:57.696 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-12T08:46:57.696 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-12T08:46:57.697 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-12T08:46:57.697 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-12T08:46:57.697 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-12T08:46:57.697 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-12T08:46:57.697 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-12T08:46:57.697 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-12T08:46:57.697 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-12T08:46:57.698 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-12T08:46:57.698 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-12T08:46:57.698 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-12T08:46:57.698 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-12T08:46:57.698 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-12T08:46:57.698 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-12T08:46:57.698 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_bic.ko 2023-05-12T08:46:57.699 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_dctcp.ko 2023-05-12T08:46:57.699 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_diag.ko 2023-05-12T08:46:57.699 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_highspeed.ko 2023-05-12T08:46:57.699 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_htcp.ko 2023-05-12T08:46:57.699 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_hybla.ko 2023-05-12T08:46:57.699 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_illinois.ko 2023-05-12T08:46:57.700 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_lp.ko 2023-05-12T08:46:57.700 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_scalable.ko 2023-05-12T08:46:57.700 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_vegas.ko 2023-05-12T08:46:57.700 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_veno.ko 2023-05-12T08:46:57.700 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_westwood.ko 2023-05-12T08:46:57.700 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_yeah.ko 2023-05-12T08:46:57.700 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tunnel4.ko 2023-05-12T08:46:57.701 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/udp_diag.ko 2023-05-12T08:46:57.701 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/udp_tunnel.ko 2023-05-12T08:46:57.701 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-12T08:46:57.701 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6 2023-05-12T08:46:57.701 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/ah6.ko 2023-05-12T08:46:57.701 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/esp6.ko 2023-05-12T08:46:57.702 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/fou6.ko 2023-05-12T08:46:57.702 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/ip6_tunnel.ko 2023-05-12T08:46:57.702 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-12T08:46:57.702 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/ip6_vti.ko 2023-05-12T08:46:57.702 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/ipcomp6.ko 2023-05-12T08:46:57.702 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter 2023-05-12T08:46:57.702 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-12T08:46:57.703 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-12T08:46:57.703 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-12T08:46:57.703 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-12T08:46:57.703 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-12T08:46:57.703 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-12T08:46:57.703 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-12T08:46:57.703 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-12T08:46:57.703 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-12T08:46:57.704 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-12T08:46:57.704 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-12T08:46:57.704 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-12T08:46:57.704 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-12T08:46:57.704 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-12T08:46:57.704 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-12T08:46:57.704 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-12T08:46:57.704 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-12T08:46:57.705 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-12T08:46:57.705 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-12T08:46:57.705 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-12T08:46:57.705 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-12T08:46:57.705 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-12T08:46:57.705 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-12T08:46:57.705 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-12T08:46:57.705 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/sit.ko 2023-05-12T08:46:57.706 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/tunnel6.ko 2023-05-12T08:46:57.706 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-12T08:46:57.706 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/key 2023-05-12T08:46:57.706 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/key/af_key.ko 2023-05-12T08:46:57.706 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp 2023-05-12T08:46:57.706 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_core.ko 2023-05-12T08:46:57.706 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-12T08:46:57.706 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_eth.ko 2023-05-12T08:46:57.707 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_ip.ko 2023-05-12T08:46:57.707 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_ip6.ko 2023-05-12T08:46:57.707 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_netlink.ko 2023-05-12T08:46:57.707 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_ppp.ko 2023-05-12T08:46:57.707 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/llc 2023-05-12T08:46:57.707 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/llc/llc.ko 2023-05-12T08:46:57.708 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/mac802154 2023-05-12T08:46:57.708 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/mac802154/mac802154.ko 2023-05-12T08:46:57.708 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/mpls 2023-05-12T08:46:57.708 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/mpls/mpls_gso.ko 2023-05-12T08:46:57.708 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter 2023-05-12T08:46:57.709 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset 2023-05-12T08:46:57.709 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set.ko 2023-05-12T08:46:57.709 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-12T08:46:57.709 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-12T08:46:57.709 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-12T08:46:57.709 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-12T08:46:57.710 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-12T08:46:57.710 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-12T08:46:57.710 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-12T08:46:57.710 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-12T08:46:57.710 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-12T08:46:57.710 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-12T08:46:57.711 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-12T08:46:57.711 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-12T08:46:57.711 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-12T08:46:57.711 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-12T08:46:57.711 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-12T08:46:57.711 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs 2023-05-12T08:46:57.711 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-12T08:46:57.712 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-12T08:46:57.712 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-12T08:46:57.712 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-12T08:46:57.712 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-12T08:46:57.712 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-12T08:46:57.712 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-12T08:46:57.712 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-12T08:46:57.713 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-12T08:46:57.713 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-12T08:46:57.713 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-12T08:46:57.713 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-12T08:46:57.713 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-12T08:46:57.713 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-12T08:46:57.713 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conncount.ko 2023-05-12T08:46:57.713 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack.ko 2023-05-12T08:46:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-12T08:46:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-12T08:46:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-12T08:46:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-12T08:46:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-12T08:46:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-12T08:46:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-12T08:46:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-12T08:46:57.715 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-12T08:46:57.715 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-12T08:46:57.715 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-12T08:46:57.715 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-12T08:46:57.715 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-12T08:46:57.715 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_flow_table.ko 2023-05-12T08:46:57.715 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-12T08:46:57.716 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_log_syslog.ko 2023-05-12T08:46:57.716 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat.ko 2023-05-12T08:46:57.716 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-12T08:46:57.716 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-12T08:46:57.716 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat_irc.ko 2023-05-12T08:46:57.716 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat_sip.ko 2023-05-12T08:46:57.716 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-12T08:46:57.716 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-12T08:46:57.717 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_tables.ko 2023-05-12T08:46:57.717 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nfnetlink.ko 2023-05-12T08:46:57.717 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-12T08:46:57.717 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nfnetlink_log.ko 2023-05-12T08:46:57.717 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-12T08:46:57.717 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-12T08:46:57.717 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_chain_nat.ko 2023-05-12T08:46:57.717 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_compat.ko 2023-05-12T08:46:57.718 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_ct.ko 2023-05-12T08:46:57.718 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-12T08:46:57.718 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_fib.ko 2023-05-12T08:46:57.718 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-12T08:46:57.718 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_hash.ko 2023-05-12T08:46:57.718 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_limit.ko 2023-05-12T08:46:57.718 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_log.ko 2023-05-12T08:46:57.718 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_masq.ko 2023-05-12T08:46:57.719 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_nat.ko 2023-05-12T08:46:57.719 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_numgen.ko 2023-05-12T08:46:57.719 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_queue.ko 2023-05-12T08:46:57.719 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_quota.ko 2023-05-12T08:46:57.719 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_redir.ko 2023-05-12T08:46:57.719 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_reject.ko 2023-05-12T08:46:57.719 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_reject_inet.ko 2023-05-12T08:46:57.720 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_socket.ko 2023-05-12T08:46:57.720 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_tunnel.ko 2023-05-12T08:46:57.720 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_AUDIT.ko 2023-05-12T08:46:57.720 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-12T08:46:57.720 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-12T08:46:57.720 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-12T08:46:57.720 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_CT.ko 2023-05-12T08:46:57.720 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_DSCP.ko 2023-05-12T08:46:57.721 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_HL.ko 2023-05-12T08:46:57.721 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_HMARK.ko 2023-05-12T08:46:57.721 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-12T08:46:57.721 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_LED.ko 2023-05-12T08:46:57.721 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_LOG.ko 2023-05-12T08:46:57.721 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-12T08:46:57.721 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_NETMAP.ko 2023-05-12T08:46:57.721 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_NFLOG.ko 2023-05-12T08:46:57.722 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-12T08:46:57.722 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_RATEEST.ko 2023-05-12T08:46:57.722 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-12T08:46:57.722 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_SECMARK.ko 2023-05-12T08:46:57.722 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-12T08:46:57.722 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-12T08:46:57.722 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_TEE.ko 2023-05-12T08:46:57.722 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_TPROXY.ko 2023-05-12T08:46:57.723 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_TRACE.ko 2023-05-12T08:46:57.723 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_addrtype.ko 2023-05-12T08:46:57.723 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_bpf.ko 2023-05-12T08:46:57.723 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_cgroup.ko 2023-05-12T08:46:57.723 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_cluster.ko 2023-05-12T08:46:57.723 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_comment.ko 2023-05-12T08:46:57.723 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_connbytes.ko 2023-05-12T08:46:57.723 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_connlabel.ko 2023-05-12T08:46:57.724 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_connlimit.ko 2023-05-12T08:46:57.724 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_connmark.ko 2023-05-12T08:46:57.724 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_conntrack.ko 2023-05-12T08:46:57.724 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_cpu.ko 2023-05-12T08:46:57.724 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_dccp.ko 2023-05-12T08:46:57.724 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_devgroup.ko 2023-05-12T08:46:57.724 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_dscp.ko 2023-05-12T08:46:57.725 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_ecn.ko 2023-05-12T08:46:57.725 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_esp.ko 2023-05-12T08:46:57.725 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_hashlimit.ko 2023-05-12T08:46:57.725 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_helper.ko 2023-05-12T08:46:57.725 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_hl.ko 2023-05-12T08:46:57.725 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_ipcomp.ko 2023-05-12T08:46:57.725 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_iprange.ko 2023-05-12T08:46:57.725 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_ipvs.ko 2023-05-12T08:46:57.726 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_l2tp.ko 2023-05-12T08:46:57.726 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_length.ko 2023-05-12T08:46:57.726 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_limit.ko 2023-05-12T08:46:57.726 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_mac.ko 2023-05-12T08:46:57.726 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_mark.ko 2023-05-12T08:46:57.726 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_multiport.ko 2023-05-12T08:46:57.726 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_nat.ko 2023-05-12T08:46:57.726 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_nfacct.ko 2023-05-12T08:46:57.727 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_osf.ko 2023-05-12T08:46:57.727 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_owner.ko 2023-05-12T08:46:57.727 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_physdev.ko 2023-05-12T08:46:57.727 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_pkttype.ko 2023-05-12T08:46:57.727 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_policy.ko 2023-05-12T08:46:57.727 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_quota.ko 2023-05-12T08:46:57.727 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_rateest.ko 2023-05-12T08:46:57.728 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_realm.ko 2023-05-12T08:46:57.728 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_recent.ko 2023-05-12T08:46:57.728 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_sctp.ko 2023-05-12T08:46:57.728 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_set.ko 2023-05-12T08:46:57.728 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_socket.ko 2023-05-12T08:46:57.728 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_state.ko 2023-05-12T08:46:57.728 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_statistic.ko 2023-05-12T08:46:57.728 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_string.ko 2023-05-12T08:46:57.729 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_tcpmss.ko 2023-05-12T08:46:57.729 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_time.ko 2023-05-12T08:46:57.729 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_u32.ko 2023-05-12T08:46:57.729 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netlink 2023-05-12T08:46:57.729 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netlink/netlink_diag.ko 2023-05-12T08:46:57.729 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/nsh 2023-05-12T08:46:57.729 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/nsh/nsh.ko 2023-05-12T08:46:57.729 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/openvswitch 2023-05-12T08:46:57.730 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/openvswitch/openvswitch.ko 2023-05-12T08:46:57.730 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/openvswitch/vport-geneve.ko 2023-05-12T08:46:57.730 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/openvswitch/vport-gre.ko 2023-05-12T08:46:57.730 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/openvswitch/vport-vxlan.ko 2023-05-12T08:46:57.730 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/packet 2023-05-12T08:46:57.730 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/packet/af_packet_diag.ko 2023-05-12T08:46:57.730 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/rds 2023-05-12T08:46:57.730 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/rds/rds.ko 2023-05-12T08:46:57.731 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/rds/rds_rdma.ko 2023-05-12T08:46:57.731 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/rds/rds_tcp.ko 2023-05-12T08:46:57.731 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched 2023-05-12T08:46:57.731 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_csum.ko 2023-05-12T08:46:57.731 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_gact.ko 2023-05-12T08:46:57.731 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_ipt.ko 2023-05-12T08:46:57.731 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_mirred.ko 2023-05-12T08:46:57.732 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_nat.ko 2023-05-12T08:46:57.732 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_pedit.ko 2023-05-12T08:46:57.732 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_police.ko 2023-05-12T08:46:57.732 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_simple.ko 2023-05-12T08:46:57.732 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_skbedit.ko 2023-05-12T08:46:57.732 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_vlan.ko 2023-05-12T08:46:57.732 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_basic.ko 2023-05-12T08:46:57.732 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_bpf.ko 2023-05-12T08:46:57.733 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_flow.ko 2023-05-12T08:46:57.733 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_fw.ko 2023-05-12T08:46:57.733 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_route.ko 2023-05-12T08:46:57.733 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_u32.ko 2023-05-12T08:46:57.733 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_cmp.ko 2023-05-12T08:46:57.733 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_ipset.ko 2023-05-12T08:46:57.733 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_meta.ko 2023-05-12T08:46:57.733 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_nbyte.ko 2023-05-12T08:46:57.734 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_text.ko 2023-05-12T08:46:57.734 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_u32.ko 2023-05-12T08:46:57.734 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_choke.ko 2023-05-12T08:46:57.734 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_codel.ko 2023-05-12T08:46:57.734 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_drr.ko 2023-05-12T08:46:57.734 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_fq.ko 2023-05-12T08:46:57.734 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_gred.ko 2023-05-12T08:46:57.735 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_hfsc.ko 2023-05-12T08:46:57.735 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_hhf.ko 2023-05-12T08:46:57.735 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_htb.ko 2023-05-12T08:46:57.735 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_ingress.ko 2023-05-12T08:46:57.735 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_mqprio.ko 2023-05-12T08:46:57.735 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_mqprio_lib.ko 2023-05-12T08:46:57.735 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_multiq.ko 2023-05-12T08:46:57.735 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_netem.ko 2023-05-12T08:46:57.736 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_pie.ko 2023-05-12T08:46:57.736 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_plug.ko 2023-05-12T08:46:57.736 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_prio.ko 2023-05-12T08:46:57.736 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_qfq.ko 2023-05-12T08:46:57.736 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_red.ko 2023-05-12T08:46:57.736 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_sfb.ko 2023-05-12T08:46:57.737 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_sfq.ko 2023-05-12T08:46:57.737 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_tbf.ko 2023-05-12T08:46:57.737 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_teql.ko 2023-05-12T08:46:57.737 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sctp 2023-05-12T08:46:57.737 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sctp/sctp.ko 2023-05-12T08:46:57.737 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sctp/sctp_diag.ko 2023-05-12T08:46:57.738 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc 2023-05-12T08:46:57.738 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/auth_gss 2023-05-12T08:46:57.738 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-12T08:46:57.738 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-12T08:46:57.738 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/sunrpc.ko 2023-05-12T08:46:57.739 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/xprtrdma 2023-05-12T08:46:57.739 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-12T08:46:57.739 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/tipc 2023-05-12T08:46:57.739 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/tipc/diag.ko 2023-05-12T08:46:57.739 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/tipc/tipc.ko 2023-05-12T08:46:57.739 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/unix 2023-05-12T08:46:57.739 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/unix/unix_diag.ko 2023-05-12T08:46:57.740 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock 2023-05-12T08:46:57.740 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-12T08:46:57.740 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-12T08:46:57.740 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock/vsock.ko 2023-05-12T08:46:57.740 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-12T08:46:57.740 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-12T08:46:57.740 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/xfrm 2023-05-12T08:46:57.741 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-12T08:46:57.741 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security 2023-05-12T08:46:57.741 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security/keys 2023-05-12T08:46:57.741 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security/keys/encrypted-keys 2023-05-12T08:46:57.741 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-05-12T08:46:57.741 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security/keys/trusted-keys 2023-05-12T08:46:57.741 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security/keys/trusted-keys/trusted.ko 2023-05-12T08:46:57.741 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/virt 2023-05-12T08:46:57.742 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/virt/lib 2023-05-12T08:46:57.742 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/virt/lib/irqbypass.ko 2023-05-12T08:46:57.742 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.alias 2023-05-12T08:46:57.742 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.alias.bin 2023-05-12T08:46:57.742 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.builtin 2023-05-12T08:46:57.742 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.builtin.bin 2023-05-12T08:46:57.742 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.builtin.modinfo 2023-05-12T08:46:57.742 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.dep 2023-05-12T08:46:57.743 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.dep.bin 2023-05-12T08:46:57.743 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.devname 2023-05-12T08:46:57.743 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.order 2023-05-12T08:46:57.743 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.softdep 2023-05-12T08:46:57.743 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.symbols 2023-05-12T08:46:57.743 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.symbols.bin 2023-05-12T08:46:57.744 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g6f2d7574b970 2023-05-12T08:46:57.744 DEBUG:teuthology.orchestra.run.smithi116:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-05-12T08:46:57.771 INFO:teuthology.orchestra.run.smithi116.stdout:postinstall scriptlet (using /bin/sh): 2023-05-12T08:46:57.772 INFO:teuthology.orchestra.run.smithi116.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-g6f2d7574b970 -a -r /boot/System.map-6.3.0-g6f2d7574b970 ]; then 2023-05-12T08:46:57.772 INFO:teuthology.orchestra.run.smithi116.stdout:cp /boot/vmlinuz-6.3.0-g6f2d7574b970 /boot/.vmlinuz-6.3.0-g6f2d7574b970-rpm 2023-05-12T08:46:57.772 INFO:teuthology.orchestra.run.smithi116.stdout:cp /boot/System.map-6.3.0-g6f2d7574b970 /boot/.System.map-6.3.0-g6f2d7574b970-rpm 2023-05-12T08:46:57.772 INFO:teuthology.orchestra.run.smithi116.stdout:rm -f /boot/vmlinuz-6.3.0-g6f2d7574b970 /boot/System.map-6.3.0-g6f2d7574b970 2023-05-12T08:46:57.772 INFO:teuthology.orchestra.run.smithi116.stdout:/sbin/installkernel 6.3.0-g6f2d7574b970 /boot/.vmlinuz-6.3.0-g6f2d7574b970-rpm /boot/.System.map-6.3.0-g6f2d7574b970-rpm 2023-05-12T08:46:57.772 INFO:teuthology.orchestra.run.smithi116.stdout:rm -f /boot/.vmlinuz-6.3.0-g6f2d7574b970-rpm /boot/.System.map-6.3.0-g6f2d7574b970-rpm 2023-05-12T08:46:57.773 INFO:teuthology.orchestra.run.smithi116.stdout:fi 2023-05-12T08:46:57.773 INFO:teuthology.orchestra.run.smithi116.stdout:preuninstall scriptlet (using /bin/sh): 2023-05-12T08:46:57.773 INFO:teuthology.orchestra.run.smithi116.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-05-12T08:46:57.773 INFO:teuthology.orchestra.run.smithi116.stdout:new-kernel-pkg --remove 6.3.0-g6f2d7574b970 --rminitrd --initrdfile=/boot/initramfs-6.3.0-g6f2d7574b970.img 2023-05-12T08:46:57.773 INFO:teuthology.orchestra.run.smithi116.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-05-12T08:46:57.773 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-install remove 6.3.0-g6f2d7574b970 2023-05-12T08:46:57.773 INFO:teuthology.orchestra.run.smithi116.stdout:fi 2023-05-12T08:46:57.774 INFO:teuthology.orchestra.run.smithi116.stdout:postuninstall scriptlet (using /bin/sh): 2023-05-12T08:46:57.774 INFO:teuthology.orchestra.run.smithi116.stdout:if [ -x /sbin/update-bootloader ]; then 2023-05-12T08:46:57.774 INFO:teuthology.orchestra.run.smithi116.stdout:/sbin/update-bootloader --remove 6.3.0-g6f2d7574b970 2023-05-12T08:46:57.774 INFO:teuthology.orchestra.run.smithi116.stdout:fi 2023-05-12T08:46:57.774 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2023-05-12T08:46:57.848 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2023-05-12T08:46:57.848 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2023-05-12T08:46:57.848 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.02 2023-05-12T08:46:57.848 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 129.el8 2023-05-12T08:46:57.849 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2023-05-12T08:46:57.849 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-05-12T08:46:57.849 INFO:teuthology.orchestra.run.smithi116.stdout:Group : System Environment/Base 2023-05-12T08:46:57.849 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 9265586 2023-05-12T08:46:57.849 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2023-05-12T08:46:57.849 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-05-12T08:46:57.849 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-05-12T08:46:57.849 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-05-12T08:46:57.850 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : kbuilder.bsys.centos.org 2023-05-12T08:46:57.850 INFO:teuthology.orchestra.run.smithi116.stdout:Relocations : (not relocatable) 2023-05-12T08:46:57.850 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : CentOS BuildSystem 2023-05-12T08:46:57.850 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2023-05-12T08:46:57.850 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2023-05-12T08:46:57.850 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2023-05-12T08:46:57.850 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2023-05-12T08:46:57.850 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T08:46:57.851 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-05-12T08:46:57.851 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2023-05-12T08:46:57.851 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2023-05-12T08:46:57.851 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2023-05-12T08:46:57.851 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T08:46:57.851 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2023-05-12T08:46:57.852 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-05-12T08:46:57.852 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 6.3.0-g6f2d7574b970 2023-05-12T08:46:57.853 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-05-12T08:47:01.921 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2023-05-12T08:47:03.675 INFO:teuthology.orchestra.run.smithi116.stderr:done 2023-05-12T08:47:03.677 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2023-05-12T08:47:03.708 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.PqF6ep8B8u 2023-05-12T08:47:03.708 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PqF6ep8B8u 2023-05-12T08:47:03.782 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.PqF6ep8B8u 2023-05-12T08:47:03.949 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.PqF6ep8B8u is 6KB 2023-05-12T08:47:03.972 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.PqF6ep8B8u 2023-05-12T08:47:03.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2023-05-12T08:47:04.064 INFO:teuthology.orchestra.run.smithi116.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-05-12T08:47:04.064 INFO:teuthology.orchestra.run.smithi116.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-05-12T08:47:04.064 INFO:teuthology.orchestra.run.smithi116.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-05-12T08:47:04.064 INFO:teuthology.orchestra.run.smithi116.stdout:a1b29d6c289747bdb22930598d39874a-6.3.0-g6f2d7574b970.conf 2023-05-12T08:47:04.065 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.3.0-g6f2d7574b970 2023-05-12T08:47:04.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2023-05-12T08:47:04.539 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi182.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-05-12T08:47:04.540 DEBUG:teuthology.orchestra.run.smithi182:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-05-12T08:47:04.595 INFO:teuthology.orchestra.run.smithi182.stdout:/boot/System.map-6.3.0-g6f2d7574b970 2023-05-12T08:47:04.595 INFO:teuthology.orchestra.run.smithi182.stdout:/boot/config-6.3.0-g6f2d7574b970 2023-05-12T08:47:04.595 INFO:teuthology.orchestra.run.smithi182.stdout:/boot/vmlinuz-6.3.0-g6f2d7574b970 2023-05-12T08:47:04.595 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970 2023-05-12T08:47:04.596 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel 2023-05-12T08:47:04.596 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch 2023-05-12T08:47:04.596 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86 2023-05-12T08:47:04.596 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto 2023-05-12T08:47:04.596 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-12T08:47:04.596 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-12T08:47:04.597 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-12T08:47:04.597 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-12T08:47:04.597 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-12T08:47:04.597 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-12T08:47:04.597 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-12T08:47:04.597 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/crc32c-intel.ko 2023-05-12T08:47:04.597 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-12T08:47:04.597 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-12T08:47:04.598 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-12T08:47:04.598 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-12T08:47:04.598 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-12T08:47:04.598 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-12T08:47:04.598 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-12T08:47:04.598 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-12T08:47:04.598 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-12T08:47:04.599 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-12T08:47:04.599 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-12T08:47:04.599 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-12T08:47:04.599 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kernel 2023-05-12T08:47:04.599 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kernel/cpu 2023-05-12T08:47:04.599 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kernel/cpu/mce 2023-05-12T08:47:04.599 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-12T08:47:04.600 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kvm 2023-05-12T08:47:04.600 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-12T08:47:04.600 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-12T08:47:04.600 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/arch/x86/kvm/kvm.ko 2023-05-12T08:47:04.600 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto 2023-05-12T08:47:04.601 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/ansi_cprng.ko 2023-05-12T08:47:04.601 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/anubis.ko 2023-05-12T08:47:04.601 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/arc4.ko 2023-05-12T08:47:04.601 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx 2023-05-12T08:47:04.601 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/async_memcpy.ko 2023-05-12T08:47:04.602 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/async_pq.ko 2023-05-12T08:47:04.602 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-12T08:47:04.602 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/async_tx.ko 2023-05-12T08:47:04.602 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/async_xor.ko 2023-05-12T08:47:04.602 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/async_tx/raid6test.ko 2023-05-12T08:47:04.602 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/authenc.ko 2023-05-12T08:47:04.602 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/authencesn.ko 2023-05-12T08:47:04.603 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/blake2b_generic.ko 2023-05-12T08:47:04.603 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/blowfish_common.ko 2023-05-12T08:47:04.603 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/blowfish_generic.ko 2023-05-12T08:47:04.603 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/camellia_generic.ko 2023-05-12T08:47:04.603 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/cast5_generic.ko 2023-05-12T08:47:04.603 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/cast6_generic.ko 2023-05-12T08:47:04.604 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/cast_common.ko 2023-05-12T08:47:04.604 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/ccm.ko 2023-05-12T08:47:04.604 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/cmac.ko 2023-05-12T08:47:04.604 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/crc32_generic.ko 2023-05-12T08:47:04.604 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/crypto_engine.ko 2023-05-12T08:47:04.604 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/crypto_user.ko 2023-05-12T08:47:04.604 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/cts.ko 2023-05-12T08:47:04.605 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/des_generic.ko 2023-05-12T08:47:04.605 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/dh_generic.ko 2023-05-12T08:47:04.605 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/echainiv.ko 2023-05-12T08:47:04.605 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/essiv.ko 2023-05-12T08:47:04.605 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/fcrypt.ko 2023-05-12T08:47:04.605 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/khazad.ko 2023-05-12T08:47:04.605 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/lz4.ko 2023-05-12T08:47:04.605 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/lz4hc.ko 2023-05-12T08:47:04.606 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/md4.ko 2023-05-12T08:47:04.606 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/michael_mic.ko 2023-05-12T08:47:04.606 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/pcbc.ko 2023-05-12T08:47:04.606 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/pcrypt.ko 2023-05-12T08:47:04.606 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/rmd160.ko 2023-05-12T08:47:04.606 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/seed.ko 2023-05-12T08:47:04.606 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/serpent_generic.ko 2023-05-12T08:47:04.607 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/tcrypt.ko 2023-05-12T08:47:04.607 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/tea.ko 2023-05-12T08:47:04.607 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/twofish_common.ko 2023-05-12T08:47:04.607 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/twofish_generic.ko 2023-05-12T08:47:04.607 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/vmac.ko 2023-05-12T08:47:04.608 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/wp512.ko 2023-05-12T08:47:04.608 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/xcbc.ko 2023-05-12T08:47:04.608 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/xor.ko 2023-05-12T08:47:04.608 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/crypto/xxhash_generic.ko 2023-05-12T08:47:04.608 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers 2023-05-12T08:47:04.609 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi 2023-05-12T08:47:04.609 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-12T08:47:04.609 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/acpi_pad.ko 2023-05-12T08:47:04.609 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/custom_method.ko 2023-05-12T08:47:04.609 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/ec_sys.ko 2023-05-12T08:47:04.609 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/platform_profile.ko 2023-05-12T08:47:04.609 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/sbs.ko 2023-05-12T08:47:04.610 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/sbshc.ko 2023-05-12T08:47:04.610 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/acpi/video.ko 2023-05-12T08:47:04.610 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata 2023-05-12T08:47:04.610 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/acard-ahci.ko 2023-05-12T08:47:04.610 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/ahci_platform.ko 2023-05-12T08:47:04.611 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/ata_generic.ko 2023-05-12T08:47:04.611 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/libahci_platform.ko 2023-05-12T08:47:04.611 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_acpi.ko 2023-05-12T08:47:04.611 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_ali.ko 2023-05-12T08:47:04.612 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_amd.ko 2023-05-12T08:47:04.612 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_artop.ko 2023-05-12T08:47:04.612 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_atiixp.ko 2023-05-12T08:47:04.612 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_atp867x.ko 2023-05-12T08:47:04.612 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_cmd640.ko 2023-05-12T08:47:04.613 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_cmd64x.ko 2023-05-12T08:47:04.613 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_cypress.ko 2023-05-12T08:47:04.613 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_efar.ko 2023-05-12T08:47:04.613 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_hpt366.ko 2023-05-12T08:47:04.613 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_hpt37x.ko 2023-05-12T08:47:04.613 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-12T08:47:04.613 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-12T08:47:04.613 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_it8213.ko 2023-05-12T08:47:04.614 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_it821x.ko 2023-05-12T08:47:04.614 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_jmicron.ko 2023-05-12T08:47:04.614 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_marvell.ko 2023-05-12T08:47:04.614 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_mpiix.ko 2023-05-12T08:47:04.614 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_netcell.ko 2023-05-12T08:47:04.614 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_ninja32.ko 2023-05-12T08:47:04.614 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_ns87410.ko 2023-05-12T08:47:04.614 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_ns87415.ko 2023-05-12T08:47:04.615 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_oldpiix.ko 2023-05-12T08:47:04.615 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_opti.ko 2023-05-12T08:47:04.615 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_optidma.ko 2023-05-12T08:47:04.615 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_pcmcia.ko 2023-05-12T08:47:04.615 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-12T08:47:04.616 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-12T08:47:04.616 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_piccolo.ko 2023-05-12T08:47:04.616 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_rdc.ko 2023-05-12T08:47:04.616 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_sch.ko 2023-05-12T08:47:04.617 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_serverworks.ko 2023-05-12T08:47:04.617 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_sil680.ko 2023-05-12T08:47:04.617 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_sis.ko 2023-05-12T08:47:04.618 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_sl82c105.ko 2023-05-12T08:47:04.618 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_triflex.ko 2023-05-12T08:47:04.618 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pata_via.ko 2023-05-12T08:47:04.618 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/pdc_adma.ko 2023-05-12T08:47:04.619 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_inic162x.ko 2023-05-12T08:47:04.619 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_mv.ko 2023-05-12T08:47:04.619 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_nv.ko 2023-05-12T08:47:04.619 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_promise.ko 2023-05-12T08:47:04.620 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_qstor.ko 2023-05-12T08:47:04.620 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_sil.ko 2023-05-12T08:47:04.620 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_sil24.ko 2023-05-12T08:47:04.621 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_sis.ko 2023-05-12T08:47:04.621 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_svw.ko 2023-05-12T08:47:04.621 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_sx4.ko 2023-05-12T08:47:04.621 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_uli.ko 2023-05-12T08:47:04.622 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_via.ko 2023-05-12T08:47:04.622 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ata/sata_vsc.ko 2023-05-12T08:47:04.622 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/auxdisplay 2023-05-12T08:47:04.622 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/auxdisplay/ks0108.ko 2023-05-12T08:47:04.623 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/base 2023-05-12T08:47:04.623 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/base/regmap 2023-05-12T08:47:04.623 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/base/regmap/regmap-i2c.ko 2023-05-12T08:47:04.624 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/bcma 2023-05-12T08:47:04.624 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/bcma/bcma.ko 2023-05-12T08:47:04.624 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block 2023-05-12T08:47:04.625 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/aoe 2023-05-12T08:47:04.625 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/aoe/aoe.ko 2023-05-12T08:47:04.625 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/brd.ko 2023-05-12T08:47:04.625 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/drbd 2023-05-12T08:47:04.626 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/drbd/drbd.ko 2023-05-12T08:47:04.626 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/floppy.ko 2023-05-12T08:47:04.626 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/loop.ko 2023-05-12T08:47:04.626 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/mtip32xx 2023-05-12T08:47:04.627 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-12T08:47:04.627 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/nbd.ko 2023-05-12T08:47:04.627 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/null_blk 2023-05-12T08:47:04.627 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/null_blk/null_blk.ko 2023-05-12T08:47:04.628 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/pktcdvd.ko 2023-05-12T08:47:04.628 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/rbd.ko 2023-05-12T08:47:04.628 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/virtio_blk.ko 2023-05-12T08:47:04.629 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/xen-blkback 2023-05-12T08:47:04.629 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-12T08:47:04.629 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/xen-blkfront.ko 2023-05-12T08:47:04.629 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/zram 2023-05-12T08:47:04.629 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/block/zram/zram.ko 2023-05-12T08:47:04.629 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char 2023-05-12T08:47:04.629 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hangcheck-timer.ko 2023-05-12T08:47:04.630 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random 2023-05-12T08:47:04.630 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-12T08:47:04.630 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-12T08:47:04.630 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-12T08:47:04.630 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random/via-rng.ko 2023-05-12T08:47:04.630 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-12T08:47:04.630 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi 2023-05-12T08:47:04.631 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-12T08:47:04.631 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-12T08:47:04.631 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-12T08:47:04.632 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-12T08:47:04.632 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-12T08:47:04.632 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-12T08:47:04.632 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/lp.ko 2023-05-12T08:47:04.633 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/mwave 2023-05-12T08:47:04.633 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/mwave/mwave.ko 2023-05-12T08:47:04.633 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/pcmcia 2023-05-12T08:47:04.633 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-12T08:47:04.633 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-12T08:47:04.634 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/ppdev.ko 2023-05-12T08:47:04.634 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tlclk.ko 2023-05-12T08:47:04.634 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm 2023-05-12T08:47:04.634 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm.ko 2023-05-12T08:47:04.634 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-12T08:47:04.635 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-12T08:47:04.635 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-12T08:47:04.635 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm_tis.ko 2023-05-12T08:47:04.635 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-05-12T08:47:04.636 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/uv_mmtimer.ko 2023-05-12T08:47:04.636 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/char/virtio_console.ko 2023-05-12T08:47:04.636 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq 2023-05-12T08:47:04.636 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-05-12T08:47:04.637 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-12T08:47:04.637 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-12T08:47:04.637 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-05-12T08:47:04.637 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/powernow-k8.ko 2023-05-12T08:47:04.638 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-12T08:47:04.638 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto 2023-05-12T08:47:04.638 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/ccp 2023-05-12T08:47:04.638 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-12T08:47:04.638 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/ccp/ccp.ko 2023-05-12T08:47:04.639 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/padlock-aes.ko 2023-05-12T08:47:04.639 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/padlock-sha.ko 2023-05-12T08:47:04.639 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/qat 2023-05-12T08:47:04.639 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/qat/qat_common 2023-05-12T08:47:04.640 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-12T08:47:04.640 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/qat/qat_dh895xcc 2023-05-12T08:47:04.640 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-12T08:47:04.640 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/virtio 2023-05-12T08:47:04.640 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-12T08:47:04.641 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dca 2023-05-12T08:47:04.641 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dca/dca.ko 2023-05-12T08:47:04.641 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/devfreq 2023-05-12T08:47:04.641 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-05-12T08:47:04.642 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dma 2023-05-12T08:47:04.642 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dma/dw 2023-05-12T08:47:04.642 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-12T08:47:04.642 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dma/ioat 2023-05-12T08:47:04.642 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-12T08:47:04.643 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac 2023-05-12T08:47:04.643 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/amd64_edac.ko 2023-05-12T08:47:04.643 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/e752x_edac.ko 2023-05-12T08:47:04.643 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/edac_mce_amd.ko 2023-05-12T08:47:04.644 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i3000_edac.ko 2023-05-12T08:47:04.644 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i3200_edac.ko 2023-05-12T08:47:04.644 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i5100_edac.ko 2023-05-12T08:47:04.644 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i5400_edac.ko 2023-05-12T08:47:04.645 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i7300_edac.ko 2023-05-12T08:47:04.645 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i7core_edac.ko 2023-05-12T08:47:04.645 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/i82975x_edac.ko 2023-05-12T08:47:04.645 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/ie31200_edac.ko 2023-05-12T08:47:04.646 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/sb_edac.ko 2023-05-12T08:47:04.646 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/edac/x38_edac.ko 2023-05-12T08:47:04.646 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/firmware 2023-05-12T08:47:04.646 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/firmware/edd.ko 2023-05-12T08:47:04.646 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-12T08:47:04.646 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/gpio 2023-05-12T08:47:04.647 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/gpio/gpio-ich.ko 2023-05-12T08:47:04.647 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-12T08:47:04.647 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid 2023-05-12T08:47:04.647 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-appleir.ko 2023-05-12T08:47:04.647 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-aureal.ko 2023-05-12T08:47:04.647 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-axff.ko 2023-05-12T08:47:04.647 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-dr.ko 2023-05-12T08:47:04.647 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-elecom.ko 2023-05-12T08:47:04.648 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-elo.ko 2023-05-12T08:47:04.648 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-emsff.ko 2023-05-12T08:47:04.648 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-gaff.ko 2023-05-12T08:47:04.648 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-gt683r.ko 2023-05-12T08:47:04.648 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-gyration.ko 2023-05-12T08:47:04.648 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-12T08:47:04.649 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-12T08:47:04.649 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-holtekff.ko 2023-05-12T08:47:04.649 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-hyperv.ko 2023-05-12T08:47:04.649 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-icade.ko 2023-05-12T08:47:04.649 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-keytouch.ko 2023-05-12T08:47:04.649 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-kye.ko 2023-05-12T08:47:04.649 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-lcpower.ko 2023-05-12T08:47:04.650 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-led.ko 2023-05-12T08:47:04.650 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-lenovo.ko 2023-05-12T08:47:04.650 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-12T08:47:04.650 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-12T08:47:04.650 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-multitouch.ko 2023-05-12T08:47:04.650 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-ortek.ko 2023-05-12T08:47:04.650 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-penmount.ko 2023-05-12T08:47:04.650 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-petalynx.ko 2023-05-12T08:47:04.651 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-picolcd.ko 2023-05-12T08:47:04.651 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-pl.ko 2023-05-12T08:47:04.651 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-plantronics.ko 2023-05-12T08:47:04.651 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-primax.ko 2023-05-12T08:47:04.651 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-rmi.ko 2023-05-12T08:47:04.651 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-12T08:47:04.651 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-common.ko 2023-05-12T08:47:04.652 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-12T08:47:04.652 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-12T08:47:04.652 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-12T08:47:04.652 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-12T08:47:04.652 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-12T08:47:04.652 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-12T08:47:04.652 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-12T08:47:04.652 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-12T08:47:04.653 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-12T08:47:04.653 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-roccat.ko 2023-05-12T08:47:04.653 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-saitek.ko 2023-05-12T08:47:04.653 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-samsung.ko 2023-05-12T08:47:04.653 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-12T08:47:04.653 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-sjoy.ko 2023-05-12T08:47:04.653 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-sony.ko 2023-05-12T08:47:04.654 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-speedlink.ko 2023-05-12T08:47:04.654 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-steelseries.ko 2023-05-12T08:47:04.654 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-sunplus.ko 2023-05-12T08:47:04.654 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-12T08:47:04.654 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-tivo.ko 2023-05-12T08:47:04.654 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-tmff.ko 2023-05-12T08:47:04.654 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-topseed.ko 2023-05-12T08:47:04.654 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-twinhan.ko 2023-05-12T08:47:04.655 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-uclogic.ko 2023-05-12T08:47:04.655 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-waltop.ko 2023-05-12T08:47:04.655 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-wiimote.ko 2023-05-12T08:47:04.655 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-xinmo.ko 2023-05-12T08:47:04.655 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-zpff.ko 2023-05-12T08:47:04.655 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/hid-zydacron.ko 2023-05-12T08:47:04.655 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/uhid.ko 2023-05-12T08:47:04.655 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hid/wacom.ko 2023-05-12T08:47:04.656 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hv 2023-05-12T08:47:04.656 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hv/hv_balloon.ko 2023-05-12T08:47:04.656 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hv/hv_utils.ko 2023-05-12T08:47:04.656 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hv/hv_vmbus.ko 2023-05-12T08:47:04.656 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon 2023-05-12T08:47:04.656 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/abituguru.ko 2023-05-12T08:47:04.657 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/abituguru3.ko 2023-05-12T08:47:04.657 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-12T08:47:04.657 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ad7414.ko 2023-05-12T08:47:04.657 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ad7418.ko 2023-05-12T08:47:04.657 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adc128d818.ko 2023-05-12T08:47:04.657 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adm1025.ko 2023-05-12T08:47:04.657 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adm1026.ko 2023-05-12T08:47:04.658 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adm1029.ko 2023-05-12T08:47:04.658 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adm1031.ko 2023-05-12T08:47:04.658 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adm9240.ko 2023-05-12T08:47:04.658 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ads7828.ko 2023-05-12T08:47:04.658 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7410.ko 2023-05-12T08:47:04.658 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7411.ko 2023-05-12T08:47:04.658 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7462.ko 2023-05-12T08:47:04.659 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7470.ko 2023-05-12T08:47:04.659 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7475.ko 2023-05-12T08:47:04.659 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/adt7x10.ko 2023-05-12T08:47:04.659 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/amc6821.ko 2023-05-12T08:47:04.659 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/applesmc.ko 2023-05-12T08:47:04.660 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/asb100.ko 2023-05-12T08:47:04.660 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/asc7621.ko 2023-05-12T08:47:04.660 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-12T08:47:04.660 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/atxp1.ko 2023-05-12T08:47:04.660 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/coretemp.ko 2023-05-12T08:47:04.661 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-12T08:47:04.661 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/dme1737.ko 2023-05-12T08:47:04.661 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ds1621.ko 2023-05-12T08:47:04.661 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ds620.ko 2023-05-12T08:47:04.661 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/emc1403.ko 2023-05-12T08:47:04.661 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/emc6w201.ko 2023-05-12T08:47:04.661 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/f71805f.ko 2023-05-12T08:47:04.661 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/f71882fg.ko 2023-05-12T08:47:04.662 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/f75375s.ko 2023-05-12T08:47:04.662 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/fam15h_power.ko 2023-05-12T08:47:04.662 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/fschmd.ko 2023-05-12T08:47:04.662 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/g760a.ko 2023-05-12T08:47:04.662 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/g762.ko 2023-05-12T08:47:04.662 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/gl518sm.ko 2023-05-12T08:47:04.662 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/gl520sm.ko 2023-05-12T08:47:04.662 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-12T08:47:04.663 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/i5500_temp.ko 2023-05-12T08:47:04.663 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/i5k_amb.ko 2023-05-12T08:47:04.663 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ibmaem.ko 2023-05-12T08:47:04.663 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ibmpex.ko 2023-05-12T08:47:04.663 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ina209.ko 2023-05-12T08:47:04.663 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ina2xx.ko 2023-05-12T08:47:04.663 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/it87.ko 2023-05-12T08:47:04.664 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/k10temp.ko 2023-05-12T08:47:04.664 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/k8temp.ko 2023-05-12T08:47:04.664 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lineage-pem.ko 2023-05-12T08:47:04.664 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm63.ko 2023-05-12T08:47:04.664 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm73.ko 2023-05-12T08:47:04.664 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm75.ko 2023-05-12T08:47:04.664 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm77.ko 2023-05-12T08:47:04.665 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm78.ko 2023-05-12T08:47:04.665 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm80.ko 2023-05-12T08:47:04.665 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm83.ko 2023-05-12T08:47:04.665 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm85.ko 2023-05-12T08:47:04.665 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm87.ko 2023-05-12T08:47:04.665 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm90.ko 2023-05-12T08:47:04.665 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm92.ko 2023-05-12T08:47:04.665 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm93.ko 2023-05-12T08:47:04.666 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm95234.ko 2023-05-12T08:47:04.666 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm95241.ko 2023-05-12T08:47:04.666 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/lm95245.ko 2023-05-12T08:47:04.666 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc2945.ko 2023-05-12T08:47:04.666 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4151.ko 2023-05-12T08:47:04.666 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4215.ko 2023-05-12T08:47:04.666 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4222.ko 2023-05-12T08:47:04.667 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4245.ko 2023-05-12T08:47:04.667 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4260.ko 2023-05-12T08:47:04.667 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/ltc4261.ko 2023-05-12T08:47:04.667 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max16065.ko 2023-05-12T08:47:04.667 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max1619.ko 2023-05-12T08:47:04.667 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max1668.ko 2023-05-12T08:47:04.667 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max197.ko 2023-05-12T08:47:04.667 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max6639.ko 2023-05-12T08:47:04.668 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max6650.ko 2023-05-12T08:47:04.668 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/max6697.ko 2023-05-12T08:47:04.668 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/mcp3021.ko 2023-05-12T08:47:04.668 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/nct6683.ko 2023-05-12T08:47:04.668 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/nct6775-core.ko 2023-05-12T08:47:04.668 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/nct6775.ko 2023-05-12T08:47:04.668 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/nct7802.ko 2023-05-12T08:47:04.669 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pc87360.ko 2023-05-12T08:47:04.669 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pc87427.ko 2023-05-12T08:47:04.669 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pcf8591.ko 2023-05-12T08:47:04.669 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus 2023-05-12T08:47:04.669 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-12T08:47:04.669 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-12T08:47:04.669 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-12T08:47:04.669 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-12T08:47:04.670 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-12T08:47:04.670 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-12T08:47:04.670 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-12T08:47:04.670 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-12T08:47:04.670 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-12T08:47:04.670 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-12T08:47:04.670 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-12T08:47:04.670 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-12T08:47:04.671 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/powr1220.ko 2023-05-12T08:47:04.671 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sch5627.ko 2023-05-12T08:47:04.671 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sch5636.ko 2023-05-12T08:47:04.671 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-12T08:47:04.671 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sht15.ko 2023-05-12T08:47:04.671 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sht21.ko 2023-05-12T08:47:04.671 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/shtc1.ko 2023-05-12T08:47:04.672 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/sis5595.ko 2023-05-12T08:47:04.672 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/smsc47b397.ko 2023-05-12T08:47:04.672 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/smsc47m1.ko 2023-05-12T08:47:04.672 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/smsc47m192.ko 2023-05-12T08:47:04.673 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/thmc50.ko 2023-05-12T08:47:04.673 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/tmp102.ko 2023-05-12T08:47:04.673 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/tmp103.ko 2023-05-12T08:47:04.673 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/tmp401.ko 2023-05-12T08:47:04.673 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/tmp421.ko 2023-05-12T08:47:04.673 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/via-cputemp.ko 2023-05-12T08:47:04.674 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/via686a.ko 2023-05-12T08:47:04.674 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/vt1211.ko 2023-05-12T08:47:04.674 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/vt8231.ko 2023-05-12T08:47:04.674 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83627ehf.ko 2023-05-12T08:47:04.674 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83627hf.ko 2023-05-12T08:47:04.675 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83781d.ko 2023-05-12T08:47:04.675 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83791d.ko 2023-05-12T08:47:04.675 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83792d.ko 2023-05-12T08:47:04.675 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83793.ko 2023-05-12T08:47:04.675 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83795.ko 2023-05-12T08:47:04.675 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83l785ts.ko 2023-05-12T08:47:04.675 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/hwmon/w83l786ng.ko 2023-05-12T08:47:04.675 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c 2023-05-12T08:47:04.676 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/algos 2023-05-12T08:47:04.676 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-12T08:47:04.676 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-12T08:47:04.676 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses 2023-05-12T08:47:04.676 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-12T08:47:04.676 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-12T08:47:04.677 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-12T08:47:04.677 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-12T08:47:04.677 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-12T08:47:04.677 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-12T08:47:04.677 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-12T08:47:04.678 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-12T08:47:04.678 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-12T08:47:04.678 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-12T08:47:04.678 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-12T08:47:04.678 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-12T08:47:04.679 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-12T08:47:04.679 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-12T08:47:04.679 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-12T08:47:04.679 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-12T08:47:04.680 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-12T08:47:04.680 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-12T08:47:04.680 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-12T08:47:04.680 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-12T08:47:04.680 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-12T08:47:04.681 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-12T08:47:04.681 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-12T08:47:04.681 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/i2c-dev.ko 2023-05-12T08:47:04.681 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/i2c-mux.ko 2023-05-12T08:47:04.682 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-05-12T08:47:04.682 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/i2c-smbus.ko 2023-05-12T08:47:04.682 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/i2c/i2c-stub.ko 2023-05-12T08:47:04.682 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband 2023-05-12T08:47:04.682 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core 2023-05-12T08:47:04.683 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-12T08:47:04.683 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/ib_core.ko 2023-05-12T08:47:04.683 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-12T08:47:04.683 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-12T08:47:04.684 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-12T08:47:04.684 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-12T08:47:04.684 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-12T08:47:04.684 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw 2023-05-12T08:47:04.684 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/cxgb4 2023-05-12T08:47:04.685 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-12T08:47:04.685 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mlx4 2023-05-12T08:47:04.685 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-12T08:47:04.685 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mlx5 2023-05-12T08:47:04.686 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-12T08:47:04.686 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mthca 2023-05-12T08:47:04.686 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-12T08:47:04.686 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp 2023-05-12T08:47:04.686 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/ipoib 2023-05-12T08:47:04.687 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-12T08:47:04.687 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/iser 2023-05-12T08:47:04.687 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-12T08:47:04.687 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/isert 2023-05-12T08:47:04.688 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-12T08:47:04.688 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/srp 2023-05-12T08:47:04.688 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-12T08:47:04.688 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/srpt 2023-05-12T08:47:04.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-12T08:47:04.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input 2023-05-12T08:47:04.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport 2023-05-12T08:47:04.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-12T08:47:04.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-12T08:47:04.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport/gameport.ko 2023-05-12T08:47:04.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport/lightning.ko 2023-05-12T08:47:04.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/gameport/ns558.ko 2023-05-12T08:47:04.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/joydev.ko 2023-05-12T08:47:04.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/keyboard 2023-05-12T08:47:04.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-12T08:47:04.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse 2023-05-12T08:47:04.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/appletouch.ko 2023-05-12T08:47:04.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/bcm5974.ko 2023-05-12T08:47:04.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/cyapatp.ko 2023-05-12T08:47:04.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-12T08:47:04.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/sermouse.ko 2023-05-12T08:47:04.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-12T08:47:04.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-12T08:47:04.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-12T08:47:04.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/rmi4 2023-05-12T08:47:04.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-12T08:47:04.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/serio 2023-05-12T08:47:04.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/serio/altera_ps2.ko 2023-05-12T08:47:04.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/serio/arc_ps2.ko 2023-05-12T08:47:04.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-12T08:47:04.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/serio/serio_raw.ko 2023-05-12T08:47:04.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/input/sparse-keymap.ko 2023-05-12T08:47:04.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/iommu 2023-05-12T08:47:04.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/iommu/amd 2023-05-12T08:47:04.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-12T08:47:04.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds 2023-05-12T08:47:04.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/leds-blinkm.ko 2023-05-12T08:47:04.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/leds-lm3530.ko 2023-05-12T08:47:04.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/leds-lp3944.ko 2023-05-12T08:47:04.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/leds-ss4200.ko 2023-05-12T08:47:04.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger 2023-05-12T08:47:04.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-12T08:47:04.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-12T08:47:04.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-12T08:47:04.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-12T08:47:04.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-12T08:47:04.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-12T08:47:04.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-12T08:47:04.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-12T08:47:04.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-12T08:47:04.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md 2023-05-12T08:47:04.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/bcache 2023-05-12T08:47:04.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/bcache/bcache.ko 2023-05-12T08:47:04.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-bio-prison.ko 2023-05-12T08:47:04.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-cache-smq.ko 2023-05-12T08:47:04.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-cache.ko 2023-05-12T08:47:04.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-crypt.ko 2023-05-12T08:47:04.698 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-delay.ko 2023-05-12T08:47:04.698 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-flakey.ko 2023-05-12T08:47:04.698 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-log-userspace.ko 2023-05-12T08:47:04.698 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-multipath.ko 2023-05-12T08:47:04.698 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-queue-length.ko 2023-05-12T08:47:04.698 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-raid.ko 2023-05-12T08:47:04.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-round-robin.ko 2023-05-12T08:47:04.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-service-time.ko 2023-05-12T08:47:04.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-switch.ko 2023-05-12T08:47:04.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-thin-pool.ko 2023-05-12T08:47:04.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/dm-verity.ko 2023-05-12T08:47:04.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/faulty.ko 2023-05-12T08:47:04.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/linear.ko 2023-05-12T08:47:04.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/multipath.ko 2023-05-12T08:47:04.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/persistent-data 2023-05-12T08:47:04.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-12T08:47:04.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/raid0.ko 2023-05-12T08:47:04.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/raid1.ko 2023-05-12T08:47:04.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/raid10.ko 2023-05-12T08:47:04.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/md/raid456.ko 2023-05-12T08:47:04.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message 2023-05-12T08:47:04.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion 2023-05-12T08:47:04.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptbase.ko 2023-05-12T08:47:04.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptctl.ko 2023-05-12T08:47:04.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptfc.ko 2023-05-12T08:47:04.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptlan.ko 2023-05-12T08:47:04.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptsas.ko 2023-05-12T08:47:04.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptscsih.ko 2023-05-12T08:47:04.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/message/fusion/mptspi.ko 2023-05-12T08:47:04.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd 2023-05-12T08:47:04.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/lpc_ich.ko 2023-05-12T08:47:04.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/lpc_sch.ko 2023-05-12T08:47:04.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/mfd-core.ko 2023-05-12T08:47:04.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/sm501.ko 2023-05-12T08:47:04.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/viperboard.ko 2023-05-12T08:47:04.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/vx855.ko 2023-05-12T08:47:04.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/mfd/wl1273-core.ko 2023-05-12T08:47:04.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc 2023-05-12T08:47:04.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/altera-stapl 2023-05-12T08:47:04.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-12T08:47:04.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/apds9802als.ko 2023-05-12T08:47:04.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/apds990x.ko 2023-05-12T08:47:04.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/bh1770glc.ko 2023-05-12T08:47:04.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/cb710 2023-05-12T08:47:04.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/cb710/cb710.ko 2023-05-12T08:47:04.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/eeprom 2023-05-12T08:47:04.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/eeprom/at24.ko 2023-05-12T08:47:04.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-12T08:47:04.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-12T08:47:04.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/eeprom/max6875.ko 2023-05-12T08:47:04.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/enclosure.ko 2023-05-12T08:47:04.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/hpilo.ko 2023-05-12T08:47:04.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/isl29003.ko 2023-05-12T08:47:04.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/isl29020.ko 2023-05-12T08:47:04.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/lis3lv02d 2023-05-12T08:47:04.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-12T08:47:04.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-12T08:47:04.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/mei 2023-05-12T08:47:04.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/mei/mei-me.ko 2023-05-12T08:47:04.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/mei/mei-txe.ko 2023-05-12T08:47:04.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/mei/mei.ko 2023-05-12T08:47:04.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-gru 2023-05-12T08:47:04.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-gru/gru.ko 2023-05-12T08:47:04.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-xp 2023-05-12T08:47:04.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-xp/xp.ko 2023-05-12T08:47:04.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-xp/xpc.ko 2023-05-12T08:47:04.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-05-12T08:47:04.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/tifm_7xx1.ko 2023-05-12T08:47:04.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/tifm_core.ko 2023-05-12T08:47:04.708 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/tsl2550.ko 2023-05-12T08:47:04.708 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/vmw_balloon.ko 2023-05-12T08:47:04.708 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/vmw_vmci 2023-05-12T08:47:04.708 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-12T08:47:04.708 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net 2023-05-12T08:47:04.708 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/bonding 2023-05-12T08:47:04.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/bonding/bonding.ko 2023-05-12T08:47:04.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa 2023-05-12T08:47:04.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/b53 2023-05-12T08:47:04.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-12T08:47:04.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-12T08:47:04.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-12T08:47:04.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/mv88e6xxx 2023-05-12T08:47:04.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-12T08:47:04.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/dummy.ko 2023-05-12T08:47:04.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/eql.ko 2023-05-12T08:47:04.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet 2023-05-12T08:47:04.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/3com 2023-05-12T08:47:04.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-12T08:47:04.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-12T08:47:04.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-12T08:47:04.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-12T08:47:04.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/8390 2023-05-12T08:47:04.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-12T08:47:04.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-12T08:47:04.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-12T08:47:04.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-12T08:47:04.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/adaptec 2023-05-12T08:47:04.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-12T08:47:04.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/agere 2023-05-12T08:47:04.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-12T08:47:04.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/alteon 2023-05-12T08:47:04.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-12T08:47:04.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/altera 2023-05-12T08:47:04.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-12T08:47:04.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/amd 2023-05-12T08:47:04.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-12T08:47:04.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-12T08:47:04.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-12T08:47:04.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros 2023-05-12T08:47:04.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/alx 2023-05-12T08:47:04.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-12T08:47:04.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atl1c 2023-05-12T08:47:04.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-12T08:47:04.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atl1e 2023-05-12T08:47:04.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-12T08:47:04.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atlx 2023-05-12T08:47:04.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-12T08:47:04.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-12T08:47:04.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom 2023-05-12T08:47:04.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-12T08:47:04.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-12T08:47:04.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-05-12T08:47:04.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-12T08:47:04.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-12T08:47:04.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/genet 2023-05-12T08:47:04.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-12T08:47:04.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-12T08:47:04.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/brocade 2023-05-12T08:47:04.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/brocade/bna 2023-05-12T08:47:04.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-12T08:47:04.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio 2023-05-12T08:47:04.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb 2023-05-12T08:47:04.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-12T08:47:04.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-05-12T08:47:04.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-12T08:47:04.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-05-12T08:47:04.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-12T08:47:04.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-05-12T08:47:04.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-12T08:47:04.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-05-12T08:47:04.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-12T08:47:04.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/cisco 2023-05-12T08:47:04.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/cisco/enic 2023-05-12T08:47:04.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-12T08:47:04.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec 2023-05-12T08:47:04.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip 2023-05-12T08:47:04.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-12T08:47:04.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-12T08:47:04.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-12T08:47:04.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-12T08:47:04.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-12T08:47:04.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-12T08:47:04.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dlink 2023-05-12T08:47:04.720 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-12T08:47:04.720 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-12T08:47:04.720 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/dnet.ko 2023-05-12T08:47:04.720 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/emulex 2023-05-12T08:47:04.720 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/emulex/benet 2023-05-12T08:47:04.720 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-12T08:47:04.720 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/ethoc.ko 2023-05-12T08:47:04.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/fealnx.ko 2023-05-12T08:47:04.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel 2023-05-12T08:47:04.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-12T08:47:04.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/e1000 2023-05-12T08:47:04.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-12T08:47:04.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/e1000e 2023-05-12T08:47:04.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-12T08:47:04.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/fm10k 2023-05-12T08:47:04.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-12T08:47:04.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/i40e 2023-05-12T08:47:04.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-12T08:47:04.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/iavf 2023-05-12T08:47:04.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-12T08:47:04.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/igb 2023-05-12T08:47:04.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-12T08:47:04.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/igbvf 2023-05-12T08:47:04.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-12T08:47:04.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgb 2023-05-12T08:47:04.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-12T08:47:04.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgbe 2023-05-12T08:47:04.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-12T08:47:04.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgbevf 2023-05-12T08:47:04.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-12T08:47:04.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/jme.ko 2023-05-12T08:47:04.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/marvell 2023-05-12T08:47:04.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-12T08:47:04.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-12T08:47:04.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-12T08:47:04.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox 2023-05-12T08:47:04.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx4 2023-05-12T08:47:04.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-12T08:47:04.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-12T08:47:04.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx5 2023-05-12T08:47:04.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-05-12T08:47:04.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-12T08:47:04.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/micrel 2023-05-12T08:47:04.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-12T08:47:04.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/myricom 2023-05-12T08:47:04.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/myricom/myri10ge 2023-05-12T08:47:04.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-12T08:47:04.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/natsemi 2023-05-12T08:47:04.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-12T08:47:04.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-12T08:47:04.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/neterion 2023-05-12T08:47:04.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-12T08:47:04.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/nvidia 2023-05-12T08:47:04.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-12T08:47:04.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/packetengines 2023-05-12T08:47:04.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-12T08:47:04.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-12T08:47:04.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic 2023-05-12T08:47:04.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic/netxen 2023-05-12T08:47:04.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-12T08:47:04.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-12T08:47:04.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-05-12T08:47:04.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-12T08:47:04.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/rdc 2023-05-12T08:47:04.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-12T08:47:04.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/realtek 2023-05-12T08:47:04.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-12T08:47:04.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-12T08:47:04.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-12T08:47:04.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-12T08:47:04.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/rocker 2023-05-12T08:47:04.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-05-12T08:47:04.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sfc 2023-05-12T08:47:04.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-12T08:47:04.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/silan 2023-05-12T08:47:04.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-12T08:47:04.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sis 2023-05-12T08:47:04.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-12T08:47:04.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-12T08:47:04.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/smsc 2023-05-12T08:47:04.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-12T08:47:04.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-12T08:47:04.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-12T08:47:04.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-12T08:47:04.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/stmicro 2023-05-12T08:47:04.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/stmicro/stmmac 2023-05-12T08:47:04.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-12T08:47:04.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-12T08:47:04.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sun 2023-05-12T08:47:04.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-12T08:47:04.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-12T08:47:04.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-12T08:47:04.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-12T08:47:04.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/tehuti 2023-05-12T08:47:04.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-12T08:47:04.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/ti 2023-05-12T08:47:04.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-12T08:47:04.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/via 2023-05-12T08:47:04.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-12T08:47:04.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-12T08:47:04.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/wiznet 2023-05-12T08:47:04.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-12T08:47:04.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-12T08:47:04.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/xircom 2023-05-12T08:47:04.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-12T08:47:04.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/geneve.ko 2023-05-12T08:47:04.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/hyperv 2023-05-12T08:47:04.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-12T08:47:04.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ieee802154 2023-05-12T08:47:04.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-12T08:47:04.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ifb.ko 2023-05-12T08:47:04.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ipvlan 2023-05-12T08:47:04.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-12T08:47:04.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/macvlan.ko 2023-05-12T08:47:04.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/macvtap.ko 2023-05-12T08:47:04.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/mdio 2023-05-12T08:47:04.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/mdio.ko 2023-05-12T08:47:04.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-12T08:47:04.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-12T08:47:04.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/mii.ko 2023-05-12T08:47:04.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/net_failover.ko 2023-05-12T08:47:04.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/netconsole.ko 2023-05-12T08:47:04.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/nlmon.ko 2023-05-12T08:47:04.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/pcs 2023-05-12T08:47:04.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-12T08:47:04.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-12T08:47:04.738 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy 2023-05-12T08:47:04.738 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/amd.ko 2023-05-12T08:47:04.738 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-12T08:47:04.738 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-05-12T08:47:04.738 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-12T08:47:04.738 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/bcm87xx.ko 2023-05-12T08:47:04.738 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/broadcom.ko 2023-05-12T08:47:04.738 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/cicada.ko 2023-05-12T08:47:04.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/davicom.ko 2023-05-12T08:47:04.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/dp83640.ko 2023-05-12T08:47:04.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/et1011c.ko 2023-05-12T08:47:04.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/icplus.ko 2023-05-12T08:47:04.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/lxt.ko 2023-05-12T08:47:04.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/marvell.ko 2023-05-12T08:47:04.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/micrel.ko 2023-05-12T08:47:04.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/national.ko 2023-05-12T08:47:04.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/phylink.ko 2023-05-12T08:47:04.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/qsemi.ko 2023-05-12T08:47:04.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/realtek.ko 2023-05-12T08:47:04.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/smsc.ko 2023-05-12T08:47:04.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/ste10Xp.ko 2023-05-12T08:47:04.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/phy/vitesse.ko 2023-05-12T08:47:04.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp 2023-05-12T08:47:04.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-12T08:47:04.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/ppp_async.ko 2023-05-12T08:47:04.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-12T08:47:04.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/ppp_generic.ko 2023-05-12T08:47:04.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-12T08:47:04.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-12T08:47:04.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/pppoe.ko 2023-05-12T08:47:04.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/pppox.ko 2023-05-12T08:47:04.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/ppp/pptp.ko 2023-05-12T08:47:04.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/slip 2023-05-12T08:47:04.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/slip/slhc.ko 2023-05-12T08:47:04.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/slip/slip.ko 2023-05-12T08:47:04.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/sungem_phy.ko 2023-05-12T08:47:04.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/tap.ko 2023-05-12T08:47:04.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team 2023-05-12T08:47:04.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team.ko 2023-05-12T08:47:04.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-12T08:47:04.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-12T08:47:04.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-12T08:47:04.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team_mode_random.ko 2023-05-12T08:47:04.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-12T08:47:04.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/tun.ko 2023-05-12T08:47:04.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/veth.ko 2023-05-12T08:47:04.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/virtio_net.ko 2023-05-12T08:47:04.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/vmxnet3 2023-05-12T08:47:04.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-12T08:47:04.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/vxlan 2023-05-12T08:47:04.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/vxlan/vxlan.ko 2023-05-12T08:47:04.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/xen-netback 2023-05-12T08:47:04.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-12T08:47:04.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/net/xen-netfront.ko 2023-05-12T08:47:04.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ntb 2023-05-12T08:47:04.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ntb/ntb.ko 2023-05-12T08:47:04.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/nvme 2023-05-12T08:47:04.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/nvme/host 2023-05-12T08:47:04.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/nvme/host/nvme-core.ko 2023-05-12T08:47:04.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/nvme/host/nvme.ko 2023-05-12T08:47:04.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/parport 2023-05-12T08:47:04.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/parport/parport.ko 2023-05-12T08:47:04.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/parport/parport_cs.ko 2023-05-12T08:47:04.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/parport/parport_pc.ko 2023-05-12T08:47:04.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/parport/parport_serial.ko 2023-05-12T08:47:04.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci 2023-05-12T08:47:04.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci/hotplug 2023-05-12T08:47:04.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-12T08:47:04.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci/pcie 2023-05-12T08:47:04.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci/pcie/aer_inject.ko 2023-05-12T08:47:04.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pci/xen-pcifront.ko 2023-05-12T08:47:04.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pcmcia 2023-05-12T08:47:04.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pcmcia/i82092.ko 2023-05-12T08:47:04.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pcmcia/pd6729.ko 2023-05-12T08:47:04.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-12T08:47:04.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pinctrl 2023-05-12T08:47:04.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pinctrl/intel 2023-05-12T08:47:04.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-12T08:47:04.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform 2023-05-12T08:47:04.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86 2023-05-12T08:47:04.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-12T08:47:04.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/acerhdf.ko 2023-05-12T08:47:04.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-12T08:47:04.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-12T08:47:04.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-12T08:47:04.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-12T08:47:04.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-12T08:47:04.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-12T08:47:04.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-12T08:47:04.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-12T08:47:04.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-12T08:47:04.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/hdaps.ko 2023-05-12T08:47:04.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/intel 2023-05-12T08:47:04.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-12T08:47:04.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/intel_ips.ko 2023-05-12T08:47:04.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-12T08:47:04.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-12T08:47:04.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-12T08:47:04.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-12T08:47:04.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-12T08:47:04.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-12T08:47:04.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-12T08:47:04.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-12T08:47:04.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-12T08:47:04.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/platform/x86/wmi.ko 2023-05-12T08:47:04.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/powercap 2023-05-12T08:47:04.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-12T08:47:04.753 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-12T08:47:04.753 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps 2023-05-12T08:47:04.753 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps/clients 2023-05-12T08:47:04.753 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-12T08:47:04.753 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-12T08:47:04.753 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps/clients/pps_parport.ko 2023-05-12T08:47:04.753 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/pps/pps_core.ko 2023-05-12T08:47:04.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ptp 2023-05-12T08:47:04.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ptp/ptp.ko 2023-05-12T08:47:04.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ptp/ptp_kvm.ko 2023-05-12T08:47:04.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc 2023-05-12T08:47:04.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-12T08:47:04.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-12T08:47:04.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-12T08:47:04.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-12T08:47:04.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-12T08:47:04.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-12T08:47:04.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-12T08:47:04.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-12T08:47:04.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-12T08:47:04.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-12T08:47:04.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-12T08:47:04.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-em3027.ko 2023-05-12T08:47:04.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-12T08:47:04.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-12T08:47:04.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-12T08:47:04.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-12T08:47:04.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-12T08:47:04.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-12T08:47:04.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-max6900.ko 2023-05-12T08:47:04.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-12T08:47:04.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-12T08:47:04.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-12T08:47:04.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-12T08:47:04.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-12T08:47:04.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-12T08:47:04.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-12T08:47:04.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-12T08:47:04.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-12T08:47:04.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-12T08:47:04.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-12T08:47:04.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-12T08:47:04.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/rtc/rtc-x1205.ko 2023-05-12T08:47:04.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi 2023-05-12T08:47:04.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/3w-9xxx.ko 2023-05-12T08:47:04.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/3w-sas.ko 2023-05-12T08:47:04.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/3w-xxxx.ko 2023-05-12T08:47:04.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/BusLogic.ko 2023-05-12T08:47:04.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/a100u2w.ko 2023-05-12T08:47:04.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/aacraid 2023-05-12T08:47:04.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-12T08:47:04.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/advansys.ko 2023-05-12T08:47:04.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/aic7xxx 2023-05-12T08:47:04.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-12T08:47:04.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-12T08:47:04.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/am53c974.ko 2023-05-12T08:47:04.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/arcmsr 2023-05-12T08:47:04.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-12T08:47:04.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/atp870u.ko 2023-05-12T08:47:04.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/be2iscsi 2023-05-12T08:47:04.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-12T08:47:04.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bfa 2023-05-12T08:47:04.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bfa/bfa.ko 2023-05-12T08:47:04.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bnx2fc 2023-05-12T08:47:04.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-12T08:47:04.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bnx2i 2023-05-12T08:47:04.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-12T08:47:04.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/ch.ko 2023-05-12T08:47:04.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/csiostor 2023-05-12T08:47:04.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-12T08:47:04.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi 2023-05-12T08:47:04.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi/cxgb3i 2023-05-12T08:47:04.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-12T08:47:04.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi/cxgb4i 2023-05-12T08:47:04.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-12T08:47:04.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-12T08:47:04.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/dc395x.ko 2023-05-12T08:47:04.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/device_handler 2023-05-12T08:47:04.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-05-12T08:47:04.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-05-12T08:47:04.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-05-12T08:47:04.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-05-12T08:47:04.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/dmx3191d.ko 2023-05-12T08:47:04.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/esas2r 2023-05-12T08:47:04.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-12T08:47:04.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/esp_scsi.ko 2023-05-12T08:47:04.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/fcoe 2023-05-12T08:47:04.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-12T08:47:04.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-12T08:47:04.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/fnic 2023-05-12T08:47:04.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/fnic/fnic.ko 2023-05-12T08:47:04.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/hpsa.ko 2023-05-12T08:47:04.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/hptiop.ko 2023-05-12T08:47:04.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/hv_storvsc.ko 2023-05-12T08:47:04.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/initio.ko 2023-05-12T08:47:04.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/ipr.ko 2023-05-12T08:47:04.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/ips.ko 2023-05-12T08:47:04.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/isci 2023-05-12T08:47:04.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/isci/isci.ko 2023-05-12T08:47:04.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-12T08:47:04.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-12T08:47:04.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libfc 2023-05-12T08:47:04.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libfc/libfc.ko 2023-05-12T08:47:04.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libiscsi.ko 2023-05-12T08:47:04.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-12T08:47:04.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libsas 2023-05-12T08:47:04.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/libsas/libsas.ko 2023-05-12T08:47:04.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/lpfc 2023-05-12T08:47:04.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-12T08:47:04.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/megaraid 2023-05-12T08:47:04.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/megaraid.ko 2023-05-12T08:47:04.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-12T08:47:04.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-12T08:47:04.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-12T08:47:04.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/mpt3sas 2023-05-12T08:47:04.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-12T08:47:04.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/mvsas 2023-05-12T08:47:04.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-12T08:47:04.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/mvumi.ko 2023-05-12T08:47:04.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/pm8001 2023-05-12T08:47:04.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-12T08:47:04.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/pmcraid.ko 2023-05-12T08:47:04.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla1280.ko 2023-05-12T08:47:04.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla2xxx 2023-05-12T08:47:04.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-12T08:47:04.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-12T08:47:04.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla4xxx 2023-05-12T08:47:04.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-12T08:47:04.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/raid_class.ko 2023-05-12T08:47:04.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_debug.ko 2023-05-12T08:47:04.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-12T08:47:04.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-12T08:47:04.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-12T08:47:04.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-12T08:47:04.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-12T08:47:04.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/ses.ko 2023-05-12T08:47:04.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/st.ko 2023-05-12T08:47:04.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/stex.ko 2023-05-12T08:47:04.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/sym53c8xx_2 2023-05-12T08:47:04.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-12T08:47:04.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/virtio_scsi.ko 2023-05-12T08:47:04.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-12T08:47:04.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/scsi/wd719x.ko 2023-05-12T08:47:04.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ssb 2023-05-12T08:47:04.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ssb/ssb.ko 2023-05-12T08:47:04.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target 2023-05-12T08:47:04.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/iscsi 2023-05-12T08:47:04.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-12T08:47:04.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/loopback 2023-05-12T08:47:04.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-12T08:47:04.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/target_core_file.ko 2023-05-12T08:47:04.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/target_core_iblock.ko 2023-05-12T08:47:04.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/target_core_mod.ko 2023-05-12T08:47:04.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/target_core_pscsi.ko 2023-05-12T08:47:04.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/target_core_user.ko 2023-05-12T08:47:04.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/tcm_fc 2023-05-12T08:47:04.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-12T08:47:04.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal 2023-05-12T08:47:04.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel 2023-05-12T08:47:04.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal 2023-05-12T08:47:04.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-12T08:47:04.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-12T08:47:04.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-12T08:47:04.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-12T08:47:04.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-12T08:47:04.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-12T08:47:04.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-12T08:47:04.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-12T08:47:04.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-12T08:47:04.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-12T08:47:04.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-12T08:47:04.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-12T08:47:04.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-12T08:47:04.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-12T08:47:04.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-12T08:47:04.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty 2023-05-12T08:47:04.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/ipwireless 2023-05-12T08:47:04.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-12T08:47:04.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/n_gsm.ko 2023-05-12T08:47:04.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/n_hdlc.ko 2023-05-12T08:47:04.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/nozomi.ko 2023-05-12T08:47:04.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial 2023-05-12T08:47:04.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial/8250 2023-05-12T08:47:04.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-12T08:47:04.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial/arc_uart.ko 2023-05-12T08:47:04.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial/jsm 2023-05-12T08:47:04.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-12T08:47:04.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/tty/synclink_gt.ko 2023-05-12T08:47:04.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ufs 2023-05-12T08:47:04.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ufs/core 2023-05-12T08:47:04.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-12T08:47:04.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ufs/host 2023-05-12T08:47:04.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-12T08:47:04.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio 2023-05-12T08:47:04.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio/uio.ko 2023-05-12T08:47:04.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio/uio_aec.ko 2023-05-12T08:47:04.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio/uio_cif.ko 2023-05-12T08:47:04.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio/uio_pci_generic.ko 2023-05-12T08:47:04.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/uio/uio_sercos3.ko 2023-05-12T08:47:04.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb 2023-05-12T08:47:04.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/class 2023-05-12T08:47:04.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/class/cdc-acm.ko 2023-05-12T08:47:04.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-12T08:47:04.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/class/usblp.ko 2023-05-12T08:47:04.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/class/usbtmc.ko 2023-05-12T08:47:04.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/host 2023-05-12T08:47:04.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-12T08:47:04.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/host/u132-hcd.ko 2023-05-12T08:47:04.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/image 2023-05-12T08:47:04.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/image/mdc800.ko 2023-05-12T08:47:04.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/image/microtek.ko 2023-05-12T08:47:04.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc 2023-05-12T08:47:04.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/adutux.ko 2023-05-12T08:47:04.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/appledisplay.ko 2023-05-12T08:47:04.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/emi26.ko 2023-05-12T08:47:04.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/emi62.ko 2023-05-12T08:47:04.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/ezusb.ko 2023-05-12T08:47:04.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-12T08:47:04.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/idmouse.ko 2023-05-12T08:47:04.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/iowarrior.ko 2023-05-12T08:47:04.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-12T08:47:04.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/ldusb.ko 2023-05-12T08:47:04.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/legousbtower.ko 2023-05-12T08:47:04.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/sisusbvga 2023-05-12T08:47:04.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-12T08:47:04.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-12T08:47:04.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/usb3503.ko 2023-05-12T08:47:04.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/usblcd.ko 2023-05-12T08:47:04.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-12T08:47:04.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/uss720.ko 2023-05-12T08:47:04.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/misc/yurex.ko 2023-05-12T08:47:04.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/phy 2023-05-12T08:47:04.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/phy/phy-generic.ko 2023-05-12T08:47:04.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial 2023-05-12T08:47:04.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/aircable.ko 2023-05-12T08:47:04.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ark3116.ko 2023-05-12T08:47:04.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-12T08:47:04.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ch341.ko 2023-05-12T08:47:04.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/cp210x.ko 2023-05-12T08:47:04.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/cyberjack.ko 2023-05-12T08:47:04.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-12T08:47:04.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-12T08:47:04.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/empeg.ko 2023-05-12T08:47:04.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-12T08:47:04.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-12T08:47:04.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-12T08:47:04.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/io_ti.ko 2023-05-12T08:47:04.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ipaq.ko 2023-05-12T08:47:04.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ipw.ko 2023-05-12T08:47:04.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ir-usb.ko 2023-05-12T08:47:04.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-12T08:47:04.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/keyspan.ko 2023-05-12T08:47:04.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-12T08:47:04.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-12T08:47:04.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-12T08:47:04.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/mct_u232.ko 2023-05-12T08:47:04.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/mos7720.ko 2023-05-12T08:47:04.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/mos7840.ko 2023-05-12T08:47:04.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/navman.ko 2023-05-12T08:47:04.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/omninet.ko 2023-05-12T08:47:04.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/opticon.ko 2023-05-12T08:47:04.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/option.ko 2023-05-12T08:47:04.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/oti6858.ko 2023-05-12T08:47:04.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/pl2303.ko 2023-05-12T08:47:04.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/qcaux.ko 2023-05-12T08:47:04.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/qcserial.ko 2023-05-12T08:47:04.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/quatech2.ko 2023-05-12T08:47:04.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/safe_serial.ko 2023-05-12T08:47:04.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/sierra.ko 2023-05-12T08:47:04.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-12T08:47:04.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ssu100.ko 2023-05-12T08:47:04.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/symbolserial.ko 2023-05-12T08:47:04.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-12T08:47:04.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-12T08:47:04.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/usb_debug.ko 2023-05-12T08:47:04.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-12T08:47:04.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/visor.ko 2023-05-12T08:47:04.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/whiteheat.ko 2023-05-12T08:47:04.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-12T08:47:04.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage 2023-05-12T08:47:04.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/uas.ko 2023-05-12T08:47:04.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-12T08:47:04.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-12T08:47:04.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-12T08:47:04.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-12T08:47:04.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-12T08:47:04.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-12T08:47:04.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-12T08:47:04.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-karma.ko 2023-05-12T08:47:04.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-12T08:47:04.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-12T08:47:04.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-12T08:47:04.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-12T08:47:04.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-12T08:47:04.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/storage/usb-storage.ko 2023-05-12T08:47:04.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/usbip 2023-05-12T08:47:04.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-12T08:47:04.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-12T08:47:04.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-12T08:47:04.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio 2023-05-12T08:47:04.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio/pci 2023-05-12T08:47:04.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-12T08:47:04.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-12T08:47:04.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio/vfio.ko 2023-05-12T08:47:04.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-12T08:47:04.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vhost 2023-05-12T08:47:04.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vhost/vhost.ko 2023-05-12T08:47:04.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-12T08:47:04.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vhost/vhost_net.ko 2023-05-12T08:47:04.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/vhost/vhost_scsi.ko 2023-05-12T08:47:04.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/video 2023-05-12T08:47:04.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/video/backlight 2023-05-12T08:47:04.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/video/backlight/apple_bl.ko 2023-05-12T08:47:04.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/video/backlight/lcd.ko 2023-05-12T08:47:04.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-12T08:47:04.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio 2023-05-12T08:47:04.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio.ko 2023-05-12T08:47:04.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_balloon.ko 2023-05-12T08:47:04.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_mmio.ko 2023-05-12T08:47:04.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_pci.ko 2023-05-12T08:47:04.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-05-12T08:47:04.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-05-12T08:47:04.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/virtio/virtio_ring.ko 2023-05-12T08:47:04.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1 2023-05-12T08:47:04.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/masters 2023-05-12T08:47:04.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/masters/ds2482.ko 2023-05-12T08:47:04.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/masters/ds2490.ko 2023-05-12T08:47:04.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves 2023-05-12T08:47:04.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-12T08:47:04.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-12T08:47:04.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-12T08:47:04.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-12T08:47:04.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-12T08:47:04.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-12T08:47:04.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-12T08:47:04.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-12T08:47:04.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-12T08:47:04.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-12T08:47:04.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-12T08:47:04.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/w1/wire.ko 2023-05-12T08:47:04.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog 2023-05-12T08:47:04.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-12T08:47:04.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-12T08:47:04.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-12T08:47:04.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/hpwdt.ko 2023-05-12T08:47:04.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/i6300esb.ko 2023-05-12T08:47:04.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-12T08:47:04.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-12T08:47:04.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/ib700wdt.ko 2023-05-12T08:47:04.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/ibmasr.ko 2023-05-12T08:47:04.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-12T08:47:04.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-12T08:47:04.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/it87_wdt.ko 2023-05-12T08:47:04.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/machzwd.ko 2023-05-12T08:47:04.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/nv_tco.ko 2023-05-12T08:47:04.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-12T08:47:04.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-12T08:47:04.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-12T08:47:04.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-12T08:47:04.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/softdog.ko 2023-05-12T08:47:04.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-12T08:47:04.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/via_wdt.ko 2023-05-12T08:47:04.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-12T08:47:04.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-12T08:47:04.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-12T08:47:04.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/wdt_pci.ko 2023-05-12T08:47:04.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/watchdog/xen_wdt.ko 2023-05-12T08:47:04.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen 2023-05-12T08:47:04.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-acpi-processor.ko 2023-05-12T08:47:04.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-evtchn.ko 2023-05-12T08:47:04.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-gntalloc.ko 2023-05-12T08:47:04.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-gntdev.ko 2023-05-12T08:47:04.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-pciback 2023-05-12T08:47:04.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-12T08:47:04.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xen-privcmd.ko 2023-05-12T08:47:04.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xenfs 2023-05-12T08:47:04.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-12T08:47:04.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs 2023-05-12T08:47:04.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/9p 2023-05-12T08:47:04.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/9p/9p.ko 2023-05-12T08:47:04.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/affs 2023-05-12T08:47:04.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/affs/affs.ko 2023-05-12T08:47:04.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/befs 2023-05-12T08:47:04.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/befs/befs.ko 2023-05-12T08:47:04.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/binfmt_misc.ko 2023-05-12T08:47:04.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/btrfs 2023-05-12T08:47:04.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/btrfs/btrfs.ko 2023-05-12T08:47:04.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cachefiles 2023-05-12T08:47:04.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cachefiles/cachefiles.ko 2023-05-12T08:47:04.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ceph 2023-05-12T08:47:04.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ceph/ceph.ko 2023-05-12T08:47:04.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cifs 2023-05-12T08:47:04.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cifs/cifs.ko 2023-05-12T08:47:04.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/coda 2023-05-12T08:47:04.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/coda/coda.ko 2023-05-12T08:47:04.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cramfs 2023-05-12T08:47:04.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/cramfs/cramfs.ko 2023-05-12T08:47:04.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/dlm 2023-05-12T08:47:04.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/dlm/dlm.ko 2023-05-12T08:47:04.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ecryptfs 2023-05-12T08:47:04.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ecryptfs/ecryptfs.ko 2023-05-12T08:47:04.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/f2fs 2023-05-12T08:47:04.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/f2fs/f2fs.ko 2023-05-12T08:47:04.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fat 2023-05-12T08:47:04.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fat/fat.ko 2023-05-12T08:47:04.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fat/msdos.ko 2023-05-12T08:47:04.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fat/vfat.ko 2023-05-12T08:47:04.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fscache 2023-05-12T08:47:04.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fscache/fscache.ko 2023-05-12T08:47:04.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fuse 2023-05-12T08:47:04.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fuse/cuse.ko 2023-05-12T08:47:04.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/fuse/fuse.ko 2023-05-12T08:47:04.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/gfs2 2023-05-12T08:47:04.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/gfs2/gfs2.ko 2023-05-12T08:47:04.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/hfs 2023-05-12T08:47:04.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/hfs/hfs.ko 2023-05-12T08:47:04.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/hfsplus 2023-05-12T08:47:04.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/hfsplus/hfsplus.ko 2023-05-12T08:47:04.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/isofs 2023-05-12T08:47:04.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/isofs/isofs.ko 2023-05-12T08:47:04.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/jfs 2023-05-12T08:47:04.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/jfs/jfs.ko 2023-05-12T08:47:04.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/lockd 2023-05-12T08:47:04.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/lockd/lockd.ko 2023-05-12T08:47:04.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/minix 2023-05-12T08:47:04.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/minix/minix.ko 2023-05-12T08:47:04.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/netfs 2023-05-12T08:47:04.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/netfs/netfs.ko 2023-05-12T08:47:04.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs 2023-05-12T08:47:04.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/blocklayout 2023-05-12T08:47:04.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-12T08:47:04.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/filelayout 2023-05-12T08:47:04.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-12T08:47:04.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/flexfilelayout 2023-05-12T08:47:04.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-12T08:47:04.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/nfs.ko 2023-05-12T08:47:04.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/nfsv3.ko 2023-05-12T08:47:04.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs/nfsv4.ko 2023-05-12T08:47:04.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs_common 2023-05-12T08:47:04.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs_common/grace.ko 2023-05-12T08:47:04.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfs_common/nfs_acl.ko 2023-05-12T08:47:04.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfsd 2023-05-12T08:47:04.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nfsd/nfsd.ko 2023-05-12T08:47:04.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nilfs2 2023-05-12T08:47:04.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nilfs2/nilfs2.ko 2023-05-12T08:47:04.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls 2023-05-12T08:47:04.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-celtic.ko 2023-05-12T08:47:04.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-centeuro.ko 2023-05-12T08:47:04.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-croatian.ko 2023-05-12T08:47:04.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-cyrillic.ko 2023-05-12T08:47:04.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-gaelic.ko 2023-05-12T08:47:04.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-greek.ko 2023-05-12T08:47:04.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-iceland.ko 2023-05-12T08:47:04.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-inuit.ko 2023-05-12T08:47:04.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-roman.ko 2023-05-12T08:47:04.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-romanian.ko 2023-05-12T08:47:04.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/mac-turkish.ko 2023-05-12T08:47:04.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp1250.ko 2023-05-12T08:47:04.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp1251.ko 2023-05-12T08:47:04.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp1255.ko 2023-05-12T08:47:04.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp737.ko 2023-05-12T08:47:04.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp775.ko 2023-05-12T08:47:04.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp850.ko 2023-05-12T08:47:04.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp852.ko 2023-05-12T08:47:04.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp855.ko 2023-05-12T08:47:04.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp857.ko 2023-05-12T08:47:04.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp860.ko 2023-05-12T08:47:04.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp861.ko 2023-05-12T08:47:04.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp862.ko 2023-05-12T08:47:04.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp863.ko 2023-05-12T08:47:04.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp864.ko 2023-05-12T08:47:04.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp865.ko 2023-05-12T08:47:04.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp866.ko 2023-05-12T08:47:04.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp869.ko 2023-05-12T08:47:04.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp874.ko 2023-05-12T08:47:04.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp932.ko 2023-05-12T08:47:04.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp936.ko 2023-05-12T08:47:04.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp949.ko 2023-05-12T08:47:04.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_cp950.ko 2023-05-12T08:47:04.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_euc-jp.ko 2023-05-12T08:47:04.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-1.ko 2023-05-12T08:47:04.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-13.ko 2023-05-12T08:47:04.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-14.ko 2023-05-12T08:47:04.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-15.ko 2023-05-12T08:47:04.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-2.ko 2023-05-12T08:47:04.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-3.ko 2023-05-12T08:47:04.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-4.ko 2023-05-12T08:47:04.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-5.ko 2023-05-12T08:47:04.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-6.ko 2023-05-12T08:47:04.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-7.ko 2023-05-12T08:47:04.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_iso8859-9.ko 2023-05-12T08:47:04.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_koi8-r.ko 2023-05-12T08:47:04.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_koi8-ru.ko 2023-05-12T08:47:04.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_koi8-u.ko 2023-05-12T08:47:04.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/nls/nls_utf8.ko 2023-05-12T08:47:04.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2 2023-05-12T08:47:04.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/cluster 2023-05-12T08:47:04.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-12T08:47:04.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/dlm 2023-05-12T08:47:04.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-12T08:47:04.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/dlmfs 2023-05-12T08:47:04.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-12T08:47:04.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/ocfs2.ko 2023-05-12T08:47:04.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-12T08:47:04.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-12T08:47:04.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-12T08:47:04.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/overlayfs 2023-05-12T08:47:04.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/overlayfs/overlay.ko 2023-05-12T08:47:04.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/pstore 2023-05-12T08:47:04.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/pstore/ramoops.ko 2023-05-12T08:47:04.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/reiserfs 2023-05-12T08:47:04.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/reiserfs/reiserfs.ko 2023-05-12T08:47:04.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/romfs 2023-05-12T08:47:04.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/romfs/romfs.ko 2023-05-12T08:47:04.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/smbfs_common 2023-05-12T08:47:04.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-12T08:47:04.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-12T08:47:04.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/squashfs 2023-05-12T08:47:04.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/squashfs/squashfs.ko 2023-05-12T08:47:04.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/sysv 2023-05-12T08:47:04.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/sysv/sysv.ko 2023-05-12T08:47:04.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/udf 2023-05-12T08:47:04.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/udf/udf.ko 2023-05-12T08:47:04.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ufs 2023-05-12T08:47:04.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/ufs/ufs.ko 2023-05-12T08:47:04.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/xfs 2023-05-12T08:47:04.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/fs/xfs/xfs.ko 2023-05-12T08:47:04.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel 2023-05-12T08:47:04.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel/rcu 2023-05-12T08:47:04.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel/rcu/rcutorture.ko 2023-05-12T08:47:04.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel/torture.ko 2023-05-12T08:47:04.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel/trace 2023-05-12T08:47:04.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-05-12T08:47:04.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib 2023-05-12T08:47:04.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/asn1_encoder.ko 2023-05-12T08:47:04.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/crc-itu-t.ko 2023-05-12T08:47:04.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/crc8.ko 2023-05-12T08:47:04.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/crypto 2023-05-12T08:47:04.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/crypto/libarc4.ko 2023-05-12T08:47:04.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/crypto/libdes.ko 2023-05-12T08:47:04.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/libcrc32c.ko 2023-05-12T08:47:04.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/lru_cache.ko 2023-05-12T08:47:04.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/lz4 2023-05-12T08:47:04.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/lz4/lz4_compress.ko 2023-05-12T08:47:04.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/lz4/lz4hc_compress.ko 2023-05-12T08:47:04.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/math 2023-05-12T08:47:04.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/math/cordic.ko 2023-05-12T08:47:04.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/raid6 2023-05-12T08:47:04.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/raid6/raid6_pq.ko 2023-05-12T08:47:04.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/reed_solomon 2023-05-12T08:47:04.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-12T08:47:04.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/ts_bm.ko 2023-05-12T08:47:04.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/ts_fsm.ko 2023-05-12T08:47:04.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/ts_kmp.ko 2023-05-12T08:47:04.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/zstd 2023-05-12T08:47:04.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/lib/zstd/zstd_compress.ko 2023-05-12T08:47:04.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/mm 2023-05-12T08:47:04.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/mm/hwpoison-inject.ko 2023-05-12T08:47:04.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net 2023-05-12T08:47:04.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan 2023-05-12T08:47:04.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/6lowpan.ko 2023-05-12T08:47:04.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_dest.ko 2023-05-12T08:47:04.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_fragment.ko 2023-05-12T08:47:04.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_hop.ko 2023-05-12T08:47:04.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-12T08:47:04.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_mobility.ko 2023-05-12T08:47:04.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_routing.ko 2023-05-12T08:47:04.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/6lowpan/nhc_udp.ko 2023-05-12T08:47:04.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802 2023-05-12T08:47:04.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802/garp.ko 2023-05-12T08:47:04.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802/mrp.ko 2023-05-12T08:47:04.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802/p8022.ko 2023-05-12T08:47:04.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802/psnap.ko 2023-05-12T08:47:04.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/802/stp.ko 2023-05-12T08:47:04.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/8021q 2023-05-12T08:47:04.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/8021q/8021q.ko 2023-05-12T08:47:04.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/9p 2023-05-12T08:47:04.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/9p/9pnet.ko 2023-05-12T08:47:04.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/9p/9pnet_fd.ko 2023-05-12T08:47:04.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/9p/9pnet_rdma.ko 2023-05-12T08:47:04.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/9p/9pnet_virtio.ko 2023-05-12T08:47:04.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/batman-adv 2023-05-12T08:47:04.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/batman-adv/batman-adv.ko 2023-05-12T08:47:04.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge 2023-05-12T08:47:04.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/br_netfilter.ko 2023-05-12T08:47:04.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/bridge.ko 2023-05-12T08:47:04.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter 2023-05-12T08:47:04.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-12T08:47:04.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-12T08:47:04.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-12T08:47:04.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-12T08:47:04.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-12T08:47:04.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-12T08:47:04.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-12T08:47:04.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-12T08:47:04.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-12T08:47:04.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-12T08:47:04.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-12T08:47:04.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-12T08:47:04.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-12T08:47:04.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-12T08:47:04.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-12T08:47:04.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-12T08:47:04.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-12T08:47:04.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-12T08:47:04.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-12T08:47:04.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-12T08:47:04.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/ebtables.ko 2023-05-12T08:47:04.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-05-12T08:47:04.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-12T08:47:04.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-12T08:47:04.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ceph 2023-05-12T08:47:04.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ceph/libceph.ko 2023-05-12T08:47:04.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/core 2023-05-12T08:47:04.841 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/core/failover.ko 2023-05-12T08:47:04.841 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/core/pktgen.ko 2023-05-12T08:47:04.841 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dccp 2023-05-12T08:47:04.841 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dccp/dccp.ko 2023-05-12T08:47:04.841 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dccp/dccp_diag.ko 2023-05-12T08:47:04.841 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dccp/dccp_ipv4.ko 2023-05-12T08:47:04.841 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dccp/dccp_ipv6.ko 2023-05-12T08:47:04.842 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dns_resolver 2023-05-12T08:47:04.842 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dns_resolver/dns_resolver.ko 2023-05-12T08:47:04.842 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa 2023-05-12T08:47:04.842 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa/dsa_core.ko 2023-05-12T08:47:04.842 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa/tag_brcm.ko 2023-05-12T08:47:04.842 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa/tag_dsa.ko 2023-05-12T08:47:04.842 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa/tag_none.ko 2023-05-12T08:47:04.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/dsa/tag_trailer.ko 2023-05-12T08:47:04.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ieee802154 2023-05-12T08:47:04.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ieee802154/6lowpan 2023-05-12T08:47:04.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-12T08:47:04.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ieee802154/ieee802154.ko 2023-05-12T08:47:04.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-12T08:47:04.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4 2023-05-12T08:47:04.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ah4.ko 2023-05-12T08:47:04.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/esp4.ko 2023-05-12T08:47:04.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/fou.ko 2023-05-12T08:47:04.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/gre.ko 2023-05-12T08:47:04.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/inet_diag.ko 2023-05-12T08:47:04.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ip_gre.ko 2023-05-12T08:47:04.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ip_tunnel.ko 2023-05-12T08:47:04.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ip_vti.ko 2023-05-12T08:47:04.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ipcomp.ko 2023-05-12T08:47:04.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/ipip.ko 2023-05-12T08:47:04.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter 2023-05-12T08:47:04.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-12T08:47:04.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-12T08:47:04.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-12T08:47:04.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-12T08:47:04.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-12T08:47:04.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-12T08:47:04.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-12T08:47:04.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-12T08:47:04.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-12T08:47:04.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-12T08:47:04.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-12T08:47:04.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-12T08:47:04.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-12T08:47:04.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-12T08:47:04.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-12T08:47:04.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-12T08:47:04.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-12T08:47:04.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-12T08:47:04.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-12T08:47:04.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-12T08:47:04.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-12T08:47:04.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_bic.ko 2023-05-12T08:47:04.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_dctcp.ko 2023-05-12T08:47:04.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_diag.ko 2023-05-12T08:47:04.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_highspeed.ko 2023-05-12T08:47:04.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_htcp.ko 2023-05-12T08:47:04.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_hybla.ko 2023-05-12T08:47:04.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_illinois.ko 2023-05-12T08:47:04.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_lp.ko 2023-05-12T08:47:04.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_scalable.ko 2023-05-12T08:47:04.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_vegas.ko 2023-05-12T08:47:04.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_veno.ko 2023-05-12T08:47:04.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_westwood.ko 2023-05-12T08:47:04.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tcp_yeah.ko 2023-05-12T08:47:04.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/tunnel4.ko 2023-05-12T08:47:04.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/udp_diag.ko 2023-05-12T08:47:04.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/udp_tunnel.ko 2023-05-12T08:47:04.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-12T08:47:04.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6 2023-05-12T08:47:04.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/ah6.ko 2023-05-12T08:47:04.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/esp6.ko 2023-05-12T08:47:04.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/fou6.ko 2023-05-12T08:47:04.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/ip6_tunnel.ko 2023-05-12T08:47:04.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-12T08:47:04.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/ip6_vti.ko 2023-05-12T08:47:04.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/ipcomp6.ko 2023-05-12T08:47:04.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter 2023-05-12T08:47:04.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-12T08:47:04.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-12T08:47:04.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-12T08:47:04.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-12T08:47:04.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-12T08:47:04.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-12T08:47:04.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-12T08:47:04.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-12T08:47:04.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-12T08:47:04.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-12T08:47:04.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-12T08:47:04.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-12T08:47:04.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-12T08:47:04.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-12T08:47:04.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-12T08:47:04.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-12T08:47:04.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-12T08:47:04.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-12T08:47:04.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-12T08:47:04.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-12T08:47:04.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-12T08:47:04.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-12T08:47:04.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-12T08:47:04.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-12T08:47:04.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/sit.ko 2023-05-12T08:47:04.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/tunnel6.ko 2023-05-12T08:47:04.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-12T08:47:04.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/key 2023-05-12T08:47:04.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/key/af_key.ko 2023-05-12T08:47:04.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp 2023-05-12T08:47:04.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_core.ko 2023-05-12T08:47:04.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-12T08:47:04.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_eth.ko 2023-05-12T08:47:04.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_ip.ko 2023-05-12T08:47:04.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_ip6.ko 2023-05-12T08:47:04.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_netlink.ko 2023-05-12T08:47:04.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/l2tp/l2tp_ppp.ko 2023-05-12T08:47:04.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/llc 2023-05-12T08:47:04.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/llc/llc.ko 2023-05-12T08:47:04.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/mac802154 2023-05-12T08:47:04.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/mac802154/mac802154.ko 2023-05-12T08:47:04.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/mpls 2023-05-12T08:47:04.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/mpls/mpls_gso.ko 2023-05-12T08:47:04.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter 2023-05-12T08:47:04.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset 2023-05-12T08:47:04.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set.ko 2023-05-12T08:47:04.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-12T08:47:04.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-12T08:47:04.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-12T08:47:04.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-12T08:47:04.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-12T08:47:04.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-12T08:47:04.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-12T08:47:04.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-12T08:47:04.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-12T08:47:04.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-12T08:47:04.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-12T08:47:04.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-12T08:47:04.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-12T08:47:04.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-12T08:47:04.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-12T08:47:04.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs 2023-05-12T08:47:04.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-12T08:47:04.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-12T08:47:04.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-12T08:47:04.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-12T08:47:04.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-12T08:47:04.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-12T08:47:04.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-12T08:47:04.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-12T08:47:04.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-12T08:47:04.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-12T08:47:04.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-12T08:47:04.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-12T08:47:04.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-12T08:47:04.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-12T08:47:04.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conncount.ko 2023-05-12T08:47:04.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack.ko 2023-05-12T08:47:04.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-12T08:47:04.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-12T08:47:04.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-12T08:47:04.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-12T08:47:04.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-12T08:47:04.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-12T08:47:04.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-12T08:47:04.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-12T08:47:04.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-12T08:47:04.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-12T08:47:04.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-12T08:47:04.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-12T08:47:04.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-12T08:47:04.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_flow_table.ko 2023-05-12T08:47:04.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-12T08:47:04.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_log_syslog.ko 2023-05-12T08:47:04.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat.ko 2023-05-12T08:47:04.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-12T08:47:04.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-12T08:47:04.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat_irc.ko 2023-05-12T08:47:04.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat_sip.ko 2023-05-12T08:47:04.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-12T08:47:04.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-12T08:47:04.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nf_tables.ko 2023-05-12T08:47:04.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nfnetlink.ko 2023-05-12T08:47:04.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-12T08:47:04.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nfnetlink_log.ko 2023-05-12T08:47:04.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-12T08:47:04.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-12T08:47:04.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_chain_nat.ko 2023-05-12T08:47:04.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_compat.ko 2023-05-12T08:47:04.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_ct.ko 2023-05-12T08:47:04.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-12T08:47:04.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_fib.ko 2023-05-12T08:47:04.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-12T08:47:04.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_hash.ko 2023-05-12T08:47:04.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_limit.ko 2023-05-12T08:47:04.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_log.ko 2023-05-12T08:47:04.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_masq.ko 2023-05-12T08:47:04.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_nat.ko 2023-05-12T08:47:04.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_numgen.ko 2023-05-12T08:47:04.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_queue.ko 2023-05-12T08:47:04.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_quota.ko 2023-05-12T08:47:04.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_redir.ko 2023-05-12T08:47:04.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_reject.ko 2023-05-12T08:47:04.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_reject_inet.ko 2023-05-12T08:47:04.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_socket.ko 2023-05-12T08:47:04.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/nft_tunnel.ko 2023-05-12T08:47:04.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_AUDIT.ko 2023-05-12T08:47:04.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-12T08:47:04.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-12T08:47:04.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-12T08:47:04.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_CT.ko 2023-05-12T08:47:04.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_DSCP.ko 2023-05-12T08:47:04.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_HL.ko 2023-05-12T08:47:04.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_HMARK.ko 2023-05-12T08:47:04.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-12T08:47:04.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_LED.ko 2023-05-12T08:47:04.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_LOG.ko 2023-05-12T08:47:04.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-12T08:47:04.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_NETMAP.ko 2023-05-12T08:47:04.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_NFLOG.ko 2023-05-12T08:47:04.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-12T08:47:04.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_RATEEST.ko 2023-05-12T08:47:04.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-12T08:47:04.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_SECMARK.ko 2023-05-12T08:47:04.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-12T08:47:04.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-12T08:47:04.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_TEE.ko 2023-05-12T08:47:04.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_TPROXY.ko 2023-05-12T08:47:04.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_TRACE.ko 2023-05-12T08:47:04.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_addrtype.ko 2023-05-12T08:47:04.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_bpf.ko 2023-05-12T08:47:04.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_cgroup.ko 2023-05-12T08:47:04.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_cluster.ko 2023-05-12T08:47:04.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_comment.ko 2023-05-12T08:47:04.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_connbytes.ko 2023-05-12T08:47:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_connlabel.ko 2023-05-12T08:47:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_connlimit.ko 2023-05-12T08:47:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_connmark.ko 2023-05-12T08:47:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_conntrack.ko 2023-05-12T08:47:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_cpu.ko 2023-05-12T08:47:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_dccp.ko 2023-05-12T08:47:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_devgroup.ko 2023-05-12T08:47:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_dscp.ko 2023-05-12T08:47:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_ecn.ko 2023-05-12T08:47:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_esp.ko 2023-05-12T08:47:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_hashlimit.ko 2023-05-12T08:47:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_helper.ko 2023-05-12T08:47:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_hl.ko 2023-05-12T08:47:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_ipcomp.ko 2023-05-12T08:47:04.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_iprange.ko 2023-05-12T08:47:04.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_ipvs.ko 2023-05-12T08:47:04.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_l2tp.ko 2023-05-12T08:47:04.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_length.ko 2023-05-12T08:47:04.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_limit.ko 2023-05-12T08:47:04.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_mac.ko 2023-05-12T08:47:04.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_mark.ko 2023-05-12T08:47:04.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_multiport.ko 2023-05-12T08:47:04.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_nat.ko 2023-05-12T08:47:04.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_nfacct.ko 2023-05-12T08:47:04.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_osf.ko 2023-05-12T08:47:04.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_owner.ko 2023-05-12T08:47:04.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_physdev.ko 2023-05-12T08:47:04.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_pkttype.ko 2023-05-12T08:47:04.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_policy.ko 2023-05-12T08:47:04.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_quota.ko 2023-05-12T08:47:04.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_rateest.ko 2023-05-12T08:47:04.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_realm.ko 2023-05-12T08:47:04.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_recent.ko 2023-05-12T08:47:04.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_sctp.ko 2023-05-12T08:47:04.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_set.ko 2023-05-12T08:47:04.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_socket.ko 2023-05-12T08:47:04.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_state.ko 2023-05-12T08:47:04.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_statistic.ko 2023-05-12T08:47:04.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_string.ko 2023-05-12T08:47:04.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_tcpmss.ko 2023-05-12T08:47:04.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_time.ko 2023-05-12T08:47:04.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netfilter/xt_u32.ko 2023-05-12T08:47:04.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netlink 2023-05-12T08:47:04.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/netlink/netlink_diag.ko 2023-05-12T08:47:04.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/nsh 2023-05-12T08:47:04.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/nsh/nsh.ko 2023-05-12T08:47:04.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/openvswitch 2023-05-12T08:47:04.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/openvswitch/openvswitch.ko 2023-05-12T08:47:04.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/openvswitch/vport-geneve.ko 2023-05-12T08:47:04.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/openvswitch/vport-gre.ko 2023-05-12T08:47:04.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/openvswitch/vport-vxlan.ko 2023-05-12T08:47:04.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/packet 2023-05-12T08:47:04.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/packet/af_packet_diag.ko 2023-05-12T08:47:04.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/rds 2023-05-12T08:47:04.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/rds/rds.ko 2023-05-12T08:47:04.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/rds/rds_rdma.ko 2023-05-12T08:47:04.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/rds/rds_tcp.ko 2023-05-12T08:47:04.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched 2023-05-12T08:47:04.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_csum.ko 2023-05-12T08:47:04.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_gact.ko 2023-05-12T08:47:04.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_ipt.ko 2023-05-12T08:47:04.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_mirred.ko 2023-05-12T08:47:04.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_nat.ko 2023-05-12T08:47:04.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_pedit.ko 2023-05-12T08:47:04.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_police.ko 2023-05-12T08:47:04.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_simple.ko 2023-05-12T08:47:04.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_skbedit.ko 2023-05-12T08:47:04.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/act_vlan.ko 2023-05-12T08:47:04.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_basic.ko 2023-05-12T08:47:04.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_bpf.ko 2023-05-12T08:47:04.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_flow.ko 2023-05-12T08:47:04.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_fw.ko 2023-05-12T08:47:04.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_route.ko 2023-05-12T08:47:04.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/cls_u32.ko 2023-05-12T08:47:04.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_cmp.ko 2023-05-12T08:47:04.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_ipset.ko 2023-05-12T08:47:04.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_meta.ko 2023-05-12T08:47:04.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_nbyte.ko 2023-05-12T08:47:04.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_text.ko 2023-05-12T08:47:04.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/em_u32.ko 2023-05-12T08:47:04.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_choke.ko 2023-05-12T08:47:04.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_codel.ko 2023-05-12T08:47:04.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_drr.ko 2023-05-12T08:47:04.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_fq.ko 2023-05-12T08:47:04.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_gred.ko 2023-05-12T08:47:04.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_hfsc.ko 2023-05-12T08:47:04.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_hhf.ko 2023-05-12T08:47:04.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_htb.ko 2023-05-12T08:47:04.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_ingress.ko 2023-05-12T08:47:04.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_mqprio.ko 2023-05-12T08:47:04.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_mqprio_lib.ko 2023-05-12T08:47:04.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_multiq.ko 2023-05-12T08:47:04.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_netem.ko 2023-05-12T08:47:04.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_pie.ko 2023-05-12T08:47:04.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_plug.ko 2023-05-12T08:47:04.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_prio.ko 2023-05-12T08:47:04.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_qfq.ko 2023-05-12T08:47:04.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_red.ko 2023-05-12T08:47:04.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_sfb.ko 2023-05-12T08:47:04.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_sfq.ko 2023-05-12T08:47:04.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_tbf.ko 2023-05-12T08:47:04.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sched/sch_teql.ko 2023-05-12T08:47:04.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sctp 2023-05-12T08:47:04.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sctp/sctp.ko 2023-05-12T08:47:04.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sctp/sctp_diag.ko 2023-05-12T08:47:04.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc 2023-05-12T08:47:04.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/auth_gss 2023-05-12T08:47:04.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-12T08:47:04.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-12T08:47:04.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/sunrpc.ko 2023-05-12T08:47:04.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/xprtrdma 2023-05-12T08:47:04.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-12T08:47:04.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/tipc 2023-05-12T08:47:04.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/tipc/diag.ko 2023-05-12T08:47:04.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/tipc/tipc.ko 2023-05-12T08:47:04.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/unix 2023-05-12T08:47:04.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/unix/unix_diag.ko 2023-05-12T08:47:04.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock 2023-05-12T08:47:04.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-12T08:47:04.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-12T08:47:04.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock/vsock.ko 2023-05-12T08:47:04.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-12T08:47:04.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-12T08:47:04.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/xfrm 2023-05-12T08:47:04.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-12T08:47:04.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security 2023-05-12T08:47:04.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security/keys 2023-05-12T08:47:04.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security/keys/encrypted-keys 2023-05-12T08:47:04.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-05-12T08:47:04.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security/keys/trusted-keys 2023-05-12T08:47:04.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/security/keys/trusted-keys/trusted.ko 2023-05-12T08:47:04.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/virt 2023-05-12T08:47:04.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/virt/lib 2023-05-12T08:47:04.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/kernel/virt/lib/irqbypass.ko 2023-05-12T08:47:04.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.alias 2023-05-12T08:47:04.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.alias.bin 2023-05-12T08:47:04.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.builtin 2023-05-12T08:47:04.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.builtin.bin 2023-05-12T08:47:04.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.builtin.modinfo 2023-05-12T08:47:04.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.dep 2023-05-12T08:47:04.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.dep.bin 2023-05-12T08:47:04.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.devname 2023-05-12T08:47:04.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.order 2023-05-12T08:47:04.894 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.softdep 2023-05-12T08:47:04.894 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.symbols 2023-05-12T08:47:04.894 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.3.0-g6f2d7574b970/modules.symbols.bin 2023-05-12T08:47:04.895 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g6f2d7574b970 2023-05-12T08:47:04.895 DEBUG:teuthology.orchestra.run.smithi182:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-05-12T08:47:04.924 INFO:teuthology.orchestra.run.smithi182.stdout:postinstall scriptlet (using /bin/sh): 2023-05-12T08:47:04.924 INFO:teuthology.orchestra.run.smithi182.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-g6f2d7574b970 -a -r /boot/System.map-6.3.0-g6f2d7574b970 ]; then 2023-05-12T08:47:04.924 INFO:teuthology.orchestra.run.smithi182.stdout:cp /boot/vmlinuz-6.3.0-g6f2d7574b970 /boot/.vmlinuz-6.3.0-g6f2d7574b970-rpm 2023-05-12T08:47:04.924 INFO:teuthology.orchestra.run.smithi182.stdout:cp /boot/System.map-6.3.0-g6f2d7574b970 /boot/.System.map-6.3.0-g6f2d7574b970-rpm 2023-05-12T08:47:04.924 INFO:teuthology.orchestra.run.smithi182.stdout:rm -f /boot/vmlinuz-6.3.0-g6f2d7574b970 /boot/System.map-6.3.0-g6f2d7574b970 2023-05-12T08:47:04.925 INFO:teuthology.orchestra.run.smithi182.stdout:/sbin/installkernel 6.3.0-g6f2d7574b970 /boot/.vmlinuz-6.3.0-g6f2d7574b970-rpm /boot/.System.map-6.3.0-g6f2d7574b970-rpm 2023-05-12T08:47:04.925 INFO:teuthology.orchestra.run.smithi182.stdout:rm -f /boot/.vmlinuz-6.3.0-g6f2d7574b970-rpm /boot/.System.map-6.3.0-g6f2d7574b970-rpm 2023-05-12T08:47:04.925 INFO:teuthology.orchestra.run.smithi182.stdout:fi 2023-05-12T08:47:04.925 INFO:teuthology.orchestra.run.smithi182.stdout:preuninstall scriptlet (using /bin/sh): 2023-05-12T08:47:04.925 INFO:teuthology.orchestra.run.smithi182.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-05-12T08:47:04.925 INFO:teuthology.orchestra.run.smithi182.stdout:new-kernel-pkg --remove 6.3.0-g6f2d7574b970 --rminitrd --initrdfile=/boot/initramfs-6.3.0-g6f2d7574b970.img 2023-05-12T08:47:04.925 INFO:teuthology.orchestra.run.smithi182.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-05-12T08:47:04.926 INFO:teuthology.orchestra.run.smithi182.stdout:kernel-install remove 6.3.0-g6f2d7574b970 2023-05-12T08:47:04.926 INFO:teuthology.orchestra.run.smithi182.stdout:fi 2023-05-12T08:47:04.926 INFO:teuthology.orchestra.run.smithi182.stdout:postuninstall scriptlet (using /bin/sh): 2023-05-12T08:47:04.926 INFO:teuthology.orchestra.run.smithi182.stdout:if [ -x /sbin/update-bootloader ]; then 2023-05-12T08:47:04.926 INFO:teuthology.orchestra.run.smithi182.stdout:/sbin/update-bootloader --remove 6.3.0-g6f2d7574b970 2023-05-12T08:47:04.926 INFO:teuthology.orchestra.run.smithi182.stdout:fi 2023-05-12T08:47:04.927 DEBUG:teuthology.orchestra.run.smithi182:> sudo rpm -qi grub2-tools 2023-05-12T08:47:05.007 INFO:teuthology.orchestra.run.smithi182.stdout:Name : grub2-tools 2023-05-12T08:47:05.008 INFO:teuthology.orchestra.run.smithi182.stdout:Epoch : 1 2023-05-12T08:47:05.008 INFO:teuthology.orchestra.run.smithi182.stdout:Version : 2.02 2023-05-12T08:47:05.008 INFO:teuthology.orchestra.run.smithi182.stdout:Release : 129.el8 2023-05-12T08:47:05.008 INFO:teuthology.orchestra.run.smithi182.stdout:Architecture: x86_64 2023-05-12T08:47:05.008 INFO:teuthology.orchestra.run.smithi182.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-05-12T08:47:05.009 INFO:teuthology.orchestra.run.smithi182.stdout:Group : System Environment/Base 2023-05-12T08:47:05.009 INFO:teuthology.orchestra.run.smithi182.stdout:Size : 9265586 2023-05-12T08:47:05.009 INFO:teuthology.orchestra.run.smithi182.stdout:License : GPLv3+ 2023-05-12T08:47:05.009 INFO:teuthology.orchestra.run.smithi182.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-05-12T08:47:05.009 INFO:teuthology.orchestra.run.smithi182.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-05-12T08:47:05.009 INFO:teuthology.orchestra.run.smithi182.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-05-12T08:47:05.009 INFO:teuthology.orchestra.run.smithi182.stdout:Build Host : kbuilder.bsys.centos.org 2023-05-12T08:47:05.010 INFO:teuthology.orchestra.run.smithi182.stdout:Relocations : (not relocatable) 2023-05-12T08:47:05.010 INFO:teuthology.orchestra.run.smithi182.stdout:Packager : CentOS BuildSystem 2023-05-12T08:47:05.010 INFO:teuthology.orchestra.run.smithi182.stdout:Vendor : CentOS 2023-05-12T08:47:05.010 INFO:teuthology.orchestra.run.smithi182.stdout:URL : http://www.gnu.org/software/grub/ 2023-05-12T08:47:05.010 INFO:teuthology.orchestra.run.smithi182.stdout:Summary : Support tools for GRUB. 2023-05-12T08:47:05.010 INFO:teuthology.orchestra.run.smithi182.stdout:Description : 2023-05-12T08:47:05.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T08:47:05.010 INFO:teuthology.orchestra.run.smithi182.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-05-12T08:47:05.011 INFO:teuthology.orchestra.run.smithi182.stdout:customizable bootloader with modular architecture. It supports a rich 2023-05-12T08:47:05.011 INFO:teuthology.orchestra.run.smithi182.stdout:variety of kernel formats, file systems, computer architectures and 2023-05-12T08:47:05.011 INFO:teuthology.orchestra.run.smithi182.stdout:hardware devices. 2023-05-12T08:47:05.011 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T08:47:05.011 INFO:teuthology.orchestra.run.smithi182.stdout:This subpackage provides tools for support of all platforms. 2023-05-12T08:47:05.012 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-05-12T08:47:05.012 INFO:teuthology.task.kernel:Updating grub on smithi182 to boot 6.3.0-g6f2d7574b970 2023-05-12T08:47:05.013 DEBUG:teuthology.orchestra.run.smithi182:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-05-12T08:47:08.364 INFO:teuthology.orchestra.run.smithi182.stderr:Generating grub configuration file ... 2023-05-12T08:47:10.208 INFO:teuthology.orchestra.run.smithi182.stderr:done 2023-05-12T08:47:10.210 DEBUG:teuthology.orchestra.run.smithi182:> mktemp 2023-05-12T08:47:10.240 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.bAd4H3mvL9 2023-05-12T08:47:10.241 DEBUG:teuthology.orchestra.run.smithi182:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bAd4H3mvL9 2023-05-12T08:47:10.314 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.bAd4H3mvL9 2023-05-12T08:47:10.463 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.bAd4H3mvL9 is 6KB 2023-05-12T08:47:10.511 DEBUG:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.bAd4H3mvL9 2023-05-12T08:47:10.529 DEBUG:teuthology.orchestra.run.smithi182:> sudo /bin/ls /boot/loader/entries || true 2023-05-12T08:47:10.594 INFO:teuthology.orchestra.run.smithi182.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-05-12T08:47:10.595 INFO:teuthology.orchestra.run.smithi182.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-05-12T08:47:10.595 INFO:teuthology.orchestra.run.smithi182.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-05-12T08:47:10.595 INFO:teuthology.orchestra.run.smithi182.stdout:a1b29d6c289747bdb22930598d39874a-6.3.0-g6f2d7574b970.conf 2023-05-12T08:47:10.596 DEBUG:teuthology.orchestra.run.smithi182:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.3.0-g6f2d7574b970 2023-05-12T08:47:10.769 DEBUG:teuthology.orchestra.run.smithi182:> sudo shutdown -r now 2023-05-12T08:47:34.224 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-05-12T08:47:34.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-05-12T08:47:34.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-12T08:47:40.776 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-05-12T08:47:40.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-05-12T08:47:40.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-12T08:48:08.816 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-05-12T08:48:38.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-05-12T08:48:38.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-12T08:48:40.780 DEBUG:teuthology.orchestra.remote:timed out 2023-05-12T08:48:54.409 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-05-12T08:48:54.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-05-12T08:48:54.792 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.3.0-g6f2d7574b970"... 2023-05-12T08:48:54.792 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2023-05-12T08:48:54.831 INFO:teuthology.orchestra.run.smithi116.stdout:6.3.0-g6f2d7574b970 2023-05-12T08:48:54.832 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g6f2d7574b970 vs 6.3.0-g6f2d7574b970 2023-05-12T08:48:54.832 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-12T08:48:54.832 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-05-12T08:48:55.833 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-05-12T08:48:55.834 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-12T08:48:55.942 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2023-05-12T08:48:55.971 DEBUG:teuthology.parallel:result is None 2023-05-12T08:49:10.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-05-12T08:49:10.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-12T08:49:11.167 DEBUG:teuthology.orchestra.run.smithi182:> true 2023-05-12T08:49:11.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-05-12T08:49:11.561 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.3.0-g6f2d7574b970"... 2023-05-12T08:49:11.561 DEBUG:teuthology.orchestra.run.smithi182:> uname -r 2023-05-12T08:49:11.603 INFO:teuthology.orchestra.run.smithi182.stdout:6.3.0-g6f2d7574b970 2023-05-12T08:49:11.603 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g6f2d7574b970 vs 6.3.0-g6f2d7574b970 2023-05-12T08:49:11.603 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-12T08:49:11.604 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-05-12T08:49:12.604 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-05-12T08:49:12.605 DEBUG:teuthology.orchestra.run.smithi182:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-12T08:49:12.718 INFO:teuthology.orchestra.run.smithi182.stdout:ttyS1 2023-05-12T08:49:12.739 DEBUG:teuthology.parallel:result is None 2023-05-12T08:49:12.739 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-12T08:49:12.747 INFO:teuthology.task.internal:Creating test directory... 2023-05-12T08:49:12.748 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-12T08:49:12.752 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-12T08:49:12.794 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-12T08:49:12.807 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-12T08:49:12.815 INFO:teuthology.task.internal:Creating archive directory... 2023-05-12T08:49:12.816 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-12T08:49:12.838 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-12T08:49:12.903 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-12T08:49:12.911 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-12T08:49:12.912 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-12T08:49:12.916 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-12T08:49:12.991 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-12T08:49:12.993 INFO:teuthology.orchestra.run.smithi182.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-12T08:49:13.014 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-12T08:49:13.017 INFO:teuthology.orchestra.run.smithi182.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-12T08:49:13.019 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-12T08:49:13.027 INFO:teuthology.task.internal:Configuring sudo... 2023-05-12T08:49:13.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-12T08:49:13.032 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-12T08:49:13.095 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-12T08:49:13.106 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-12T08:49:13.107 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-12T08:49:13.111 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-12T08:49:13.152 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-12T08:49:13.262 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-12T08:49:13.336 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-12T08:49:13.407 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-12T08:49:13.482 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T08:49:13.482 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-12T08:49:13.544 DEBUG:teuthology.orchestra.run.smithi182:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-12T08:49:13.617 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-12T08:49:13.680 DEBUG:teuthology.orchestra.run.smithi182:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-12T08:49:13.752 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-12T08:49:13.827 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T08:49:13.827 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-12T08:49:13.890 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2023-05-12T08:49:13.894 DEBUG:teuthology.orchestra.run.smithi182:> sudo service rsyslog restart 2023-05-12T08:49:13.993 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-12T08:49:14.035 INFO:teuthology.orchestra.run.smithi182.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-12T08:49:14.475 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-12T08:49:14.485 INFO:teuthology.task.internal:Starting timer... 2023-05-12T08:49:14.485 INFO:teuthology.run_tasks:Running task pcp... 2023-05-12T08:49:14.495 INFO:teuthology.run_tasks:Running task selinux... 2023-05-12T08:49:14.504 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-05-12T08:49:14.505 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2023-05-12T08:49:14.627 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2023-05-12T08:49:14.631 DEBUG:teuthology.orchestra.run.smithi182:> sudo service auditd rotate 2023-05-12T08:49:14.749 INFO:teuthology.orchestra.run.smithi182.stdout:Rotating logs: 2023-05-12T08:49:14.752 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-12T08:49:14.753 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2023-05-12T08:49:14.804 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2023-05-12T08:49:14.804 DEBUG:teuthology.orchestra.run.smithi182:> /usr/sbin/getenforce 2023-05-12T08:49:14.857 INFO:teuthology.orchestra.run.smithi182.stdout:Permissive 2023-05-12T08:49:14.858 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi116.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi182.front.sepia.ceph.com': 'permissive'} 2023-05-12T08:49:14.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-12T08:49:14.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T08:49:14.922 DEBUG:teuthology.orchestra.run.smithi182:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-12T08:49:14.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T08:49:14.985 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-12T08:49:14.985 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2023-05-12T08:49:15.064 DEBUG:teuthology.orchestra.run.smithi182:> sudo /usr/sbin/setenforce permissive 2023-05-12T08:49:15.135 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-12T08:49:15.146 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-05-12T08:49:15.158 INFO:teuthology.repo_utils:Fetching main from origin 2023-05-12T08:49:15.291 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-12T08:49:15.344 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-12T08:49:15.346 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi116.front.sepia.ceph.com,smithi182.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-12T08:57:24.395 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi182.front.sepia.ceph.com')] 2023-05-12T08:57:24.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-05-12T08:57:24.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-12T08:57:24.502 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-05-12T08:57:24.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-05-12T08:57:24.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-12T08:57:24.690 DEBUG:teuthology.orchestra.run.smithi182:> true 2023-05-12T08:57:24.801 INFO:teuthology.run_tasks:Running task clock... 2023-05-12T08:57:24.815 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-12T08:57:24.816 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-12T08:57:24.817 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-12T08:57:24.821 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-12T08:57:24.821 DEBUG:teuthology.orchestra.run.smithi182:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-12T08:57:24.884 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-12T08:57:24.908 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-12T08:57:24.914 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-12T08:57:24.937 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-12T08:57:24.996 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2023-05-12T08:57:25.020 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2023-05-12T08:57:25.026 INFO:teuthology.orchestra.run.smithi182.stderr:sudo: ntpd: command not found 2023-05-12T08:57:25.049 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-12T08:57:25.051 INFO:teuthology.orchestra.run.smithi182.stdout:506 Cannot talk to daemon 2023-05-12T08:57:25.079 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-12T08:57:25.081 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-12T08:57:25.111 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-12T08:57:25.165 INFO:teuthology.orchestra.run.smithi116.stderr:bash: ntpq: command not found 2023-05-12T08:57:25.172 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-12T08:57:25.173 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2023-05-12T08:57:25.173 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-12T08:57:25.173 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-12T08:57:25.173 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-12T08:57:25.173 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-12T08:57:25.191 INFO:teuthology.orchestra.run.smithi182.stderr:bash: ntpq: command not found 2023-05-12T08:57:25.198 INFO:teuthology.orchestra.run.smithi182.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-12T08:57:25.198 INFO:teuthology.orchestra.run.smithi182.stdout:=============================================================================== 2023-05-12T08:57:25.198 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-12T08:57:25.198 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-12T08:57:25.199 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-12T08:57:25.199 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-12T08:57:25.199 INFO:teuthology.run_tasks:Running task install... 2023-05-12T08:57:25.208 DEBUG:teuthology.task.install:project ceph 2023-05-12T08:57:25.208 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5a6b166b7c43e2b5890833e75dd257ab21264ded'}} 2023-05-12T08:57:25.209 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '5a6b166b7c43e2b5890833e75dd257ab21264ded'} 2023-05-12T08:57:25.209 INFO:teuthology.task.install:Using flavor: default 2023-05-12T08:57:25.214 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-12T08:57:25.215 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-12T08:57:25.215 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5a6b166b7c43e2b5890833e75dd257ab21264ded', 'tag': None, 'wait_for_package': False} 2023-05-12T08:57:25.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5a6b166b7c43e2b5890833e75dd257ab21264ded 2023-05-12T08:57:25.218 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5a6b166b7c43e2b5890833e75dd257ab21264ded', 'tag': None, 'wait_for_package': False} 2023-05-12T08:57:25.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5a6b166b7c43e2b5890833e75dd257ab21264ded 2023-05-12T08:57:25.354 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-1/5a6b166b7c43e2b5890833e75dd257ab21264ded/centos/8/flavors/default/ 2023-05-12T08:57:25.355 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3871.g5a6b166b 2023-05-12T08:57:25.368 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-1/5a6b166b7c43e2b5890833e75dd257ab21264ded/centos/8/flavors/default/ 2023-05-12T08:57:25.368 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3871.g5a6b166b 2023-05-12T08:57:25.472 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-1/5a6b166b7c43e2b5890833e75dd257ab21264ded/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-1/5a6b166b7c43e2b5890833e75dd257ab21264ded/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-1/5a6b166b7c43e2b5890833e75dd257ab21264ded/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-12T08:57:25.472 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T08:57:25.473 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-12T08:57:25.476 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-1/5a6b166b7c43e2b5890833e75dd257ab21264ded/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-1/5a6b166b7c43e2b5890833e75dd257ab21264ded/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-1/5a6b166b7c43e2b5890833e75dd257ab21264ded/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-12T08:57:25.476 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T08:57:25.477 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-12T08:57:25.536 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-12T08:57:25.536 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5a6b166b7c43e2b5890833e75dd257ab21264ded/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-12T08:57:25.540 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-12T08:57:25.541 DEBUG:teuthology.orchestra.run.smithi182:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5a6b166b7c43e2b5890833e75dd257ab21264ded/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-12T08:57:25.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-12T08:57:25.643 DEBUG:teuthology.orchestra.run.smithi182:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-12T08:57:25.735 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-12T08:57:25.741 DEBUG:teuthology.orchestra.run.smithi182:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-12T08:57:25.797 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2023-05-12T08:57:25.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2023-05-12T08:57:25.802 INFO:teuthology.orchestra.run.smithi182.stdout:check_obsoletes = 1 2023-05-12T08:57:25.805 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum clean all 2023-05-12T08:57:26.116 INFO:teuthology.orchestra.run.smithi116.stdout:53 files removed 2023-05-12T08:57:26.123 INFO:teuthology.orchestra.run.smithi182.stdout:53 files removed 2023-05-12T08:57:26.150 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-12T08:57:26.156 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-12T08:57:26.947 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 330 kB/s | 80 kB 00:00 2023-05-12T08:57:26.959 INFO:teuthology.orchestra.run.smithi182.stdout:ceph packages for x86_64 320 kB/s | 80 kB 00:00 2023-05-12T08:57:27.214 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 41 kB/s | 9.4 kB 00:00 2023-05-12T08:57:27.235 INFO:teuthology.orchestra.run.smithi182.stdout:ceph noarch packages 39 kB/s | 9.4 kB 00:00 2023-05-12T08:57:27.473 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 6.4 kB/s | 1.5 kB 00:00 2023-05-12T08:57:27.494 INFO:teuthology.orchestra.run.smithi182.stdout:ceph source packages 6.4 kB/s | 1.5 kB 00:00 2023-05-12T08:57:30.015 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 8 - AppStream 12 MB/s | 29 MB 00:02 2023-05-12T08:57:30.778 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS Stream 8 - AppStream 8.9 MB/s | 29 MB 00:03 2023-05-12T08:57:36.699 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 8 - BaseOS 30 MB/s | 34 MB 00:01 2023-05-12T08:57:37.245 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS Stream 8 - BaseOS 38 MB/s | 34 MB 00:00 2023-05-12T08:57:42.549 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 8 - Extras 34 kB/s | 18 kB 00:00 2023-05-12T08:57:42.945 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2023-05-12T08:57:43.133 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.4 kB 00:00 2023-05-12T08:57:43.512 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.4 kB 00:00 2023-05-12T08:57:45.984 INFO:teuthology.orchestra.run.smithi116.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-05-12T08:57:46.063 INFO:teuthology.orchestra.run.smithi182.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-12T08:57:47.501 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 10 MB/s | 14 MB 00:01 2023-05-12T08:57:51.526 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 214 kB/s | 24 kB 00:00 2023-05-12T08:57:54.928 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-12T08:57:54.929 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-12T08:57:54.940 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-05-12T08:57:54.940 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-05-12T08:57:54.941 INFO:teuthology.orchestra.run.smithi116.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-05-12T08:57:54.942 INFO:teuthology.orchestra.run.smithi116.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-05-12T08:57:54.943 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-12T08:57:54.945 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-12T08:57:54.947 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-12T08:57:54.948 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-12T08:57:55.116 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-05-12T08:57:55.128 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================================ 2023-05-12T08:57:55.128 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-05-12T08:57:55.128 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================================ 2023-05-12T08:57:55.128 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-05-12T08:57:55.128 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-05-12T08:57:55.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 6.4 k 2023-05-12T08:57:55.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 5.3 M 2023-05-12T08:57:55.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 848 k 2023-05-12T08:57:55.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 166 k 2023-05-12T08:57:55.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 1.5 M 2023-05-12T08:57:55.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 127 k 2023-05-12T08:57:55.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 1.7 M 2023-05-12T08:57:55.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 7.4 M 2023-05-12T08:57:55.130 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 47 k 2023-05-12T08:57:55.130 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 13 M 2023-05-12T08:57:55.130 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 41 M 2023-05-12T08:57:55.130 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 265 k 2023-05-12T08:57:55.130 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 83 k 2023-05-12T08:57:55.130 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 258 k 2023-05-12T08:57:55.130 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 18 k 2023-05-12T08:57:55.131 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-05-12T08:57:55.131 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-05-12T08:57:55.131 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-05-12T08:57:55.131 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 31 k 2023-05-12T08:57:55.131 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 772 k 2023-05-12T08:57:55.131 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 139 k 2023-05-12T08:57:55.131 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-05-12T08:57:55.131 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_64 2.32.1-41.el8 baseos 99 k 2023-05-12T08:57:55.132 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-05-12T08:57:55.132 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-05-12T08:57:55.132 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-05-12T08:57:55.132 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-05-12T08:57:55.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 197 k 2023-05-12T08:57:55.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 372 k 2023-05-12T08:57:55.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 365 k 2023-05-12T08:57:55.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 107 k 2023-05-12T08:57:55.133 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 94 k 2023-05-12T08:57:55.133 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 3.4 M 2023-05-12T08:57:55.133 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 179 k 2023-05-12T08:57:55.133 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 baseos 72 k 2023-05-12T08:57:55.133 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2023-05-12T08:57:55.133 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-05-12T08:57:55.133 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-05-12T08:57:55.134 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-05-12T08:57:55.134 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 3.7 M 2023-05-12T08:57:55.134 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 3.6 M 2023-05-12T08:57:55.134 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-05-12T08:57:55.134 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-05-12T08:57:55.134 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 22 M 2023-05-12T08:57:55.134 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 23 k 2023-05-12T08:57:55.135 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 2.3 M 2023-05-12T08:57:55.135 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 240 k 2023-05-12T08:57:55.135 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 4.6 M 2023-05-12T08:57:55.135 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 18 M 2023-05-12T08:57:55.135 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 15 k 2023-05-12T08:57:55.135 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 24 k 2023-05-12T08:57:55.135 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-05-12T08:57:55.135 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-12T08:57:55.136 INFO:teuthology.orchestra.run.smithi116.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-05-12T08:57:55.136 INFO:teuthology.orchestra.run.smithi116.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-05-12T08:57:55.136 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-05-12T08:57:55.136 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 137 k 2023-05-12T08:57:55.136 INFO:teuthology.orchestra.run.smithi116.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-05-12T08:57:55.136 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-05-12T08:57:55.136 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-12T08:57:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-05-12T08:57:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-05-12T08:57:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-05-12T08:57:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 473 k 2023-05-12T08:57:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-05-12T08:57:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 6.5 M 2023-05-12T08:57:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-05-12T08:57:55.137 INFO:teuthology.orchestra.run.smithi116.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-05-12T08:57:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-12T08:57:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-05-12T08:57:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-05-12T08:57:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-05-12T08:57:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-05-12T08:57:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-05-12T08:57:55.138 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-05-12T08:57:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-05-12T08:57:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-05-12T08:57:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-05-12T08:57:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-12T08:57:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-05-12T08:57:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-12T08:57:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-12T08:57:55.139 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-12T08:57:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 45 k 2023-05-12T08:57:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 119 k 2023-05-12T08:57:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-12T08:57:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.11.5-5.el8 baseos 237 k 2023-05-12T08:57:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-12T08:57:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-12T08:57:55.140 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 3.2.1-5.el8 baseos 559 k 2023-05-12T08:57:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-12T08:57:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-12T08:57:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-12T08:57:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-05-12T08:57:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-05-12T08:57:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-05-12T08:57:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-05-12T08:57:55.141 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-12T08:57:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-12T08:57:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-05-12T08:57:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-05-12T08:57:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-12T08:57:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-12T08:57:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-05-12T08:57:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-05-12T08:57:55.142 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-05-12T08:57:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-12T08:57:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-12T08:57:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-05-12T08:57:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-05-12T08:57:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-05-12T08:57:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-05-12T08:57:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-05-12T08:57:55.143 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-05-12T08:57:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-12T08:57:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-05-12T08:57:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-12T08:57:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-12T08:57:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-05-12T08:57:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-12T08:57:55.144 INFO:teuthology.orchestra.run.smithi116.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-12T08:57:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-12T08:57:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-12T08:57:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-12T08:57:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-12T08:57:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-12T08:57:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-12T08:57:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-05-12T08:57:55.145 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-12T08:57:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-05-12T08:57:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-12T08:57:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-05-12T08:57:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-05-12T08:57:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-05-12T08:57:55.146 INFO:teuthology.orchestra.run.smithi116.stdout:Enabling module streams: 2023-05-12T08:57:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql 10 2023-05-12T08:57:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T08:57:55.147 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-05-12T08:57:55.147 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================================ 2023-05-12T08:57:55.147 INFO:teuthology.orchestra.run.smithi116.stdout:Install 128 Packages 2023-05-12T08:57:55.147 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 5 Packages 2023-05-12T08:57:55.147 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T08:57:55.148 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 197 M 2023-05-12T08:57:55.148 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-05-12T08:57:55.761 INFO:teuthology.orchestra.run.smithi116.stdout:(1/133): ceph-18.0.0-3871.g5a6b166b.el8.x86_64. 32 kB/s | 6.4 kB 00:00 2023-05-12T08:57:56.636 INFO:teuthology.orchestra.run.smithi116.stdout:(2/133): ceph-fuse-18.0.0-3871.g5a6b166b.el8.x8 969 kB/s | 848 kB 00:00 2023-05-12T08:57:56.804 INFO:teuthology.orchestra.run.smithi116.stdout:(3/133): ceph-immutable-object-cache-18.0.0-387 995 kB/s | 166 kB 00:00 2023-05-12T08:57:57.279 INFO:teuthology.orchestra.run.smithi116.stdout:(4/133): ceph-base-18.0.0-3871.g5a6b166b.el8.x8 3.1 MB/s | 5.3 MB 00:01 2023-05-12T08:57:57.846 INFO:teuthology.orchestra.run.smithi116.stdout:(5/133): ceph-mgr-18.0.0-3871.g5a6b166b.el8.x86 2.7 MB/s | 1.5 MB 00:00 2023-05-12T08:57:58.704 INFO:teuthology.orchestra.run.smithi116.stdout:(6/133): ceph-mds-18.0.0-3871.g5a6b166b.el8.x86 1.2 MB/s | 2.3 MB 00:01 2023-05-12T08:57:58.771 INFO:teuthology.orchestra.run.smithi116.stdout:(7/133): ceph-mon-18.0.0-3871.g5a6b166b.el8.x86 5.0 MB/s | 4.6 MB 00:00 2023-05-12T08:58:01.787 INFO:teuthology.orchestra.run.smithi116.stdout:(8/133): ceph-radosgw-18.0.0-3871.g5a6b166b.el8 4.3 MB/s | 13 MB 00:03 2023-05-12T08:58:02.030 INFO:teuthology.orchestra.run.smithi116.stdout:(9/133): ceph-common-18.0.0-3871.g5a6b166b.el8. 3.3 MB/s | 22 MB 00:06 2023-05-12T08:58:02.055 INFO:teuthology.orchestra.run.smithi116.stdout:(10/133): ceph-selinux-18.0.0-3871.g5a6b166b.el 91 kB/s | 24 kB 00:00 2023-05-12T08:58:02.147 INFO:teuthology.orchestra.run.smithi116.stdout:(11/133): cephfs-mirror-18.0.0-3871.g5a6b166b.e 2.8 MB/s | 258 kB 00:00 2023-05-12T08:58:02.197 INFO:teuthology.orchestra.run.smithi116.stdout:(12/133): libcephfs-devel-18.0.0-3871.g5a6b166b 622 kB/s | 31 kB 00:00 2023-05-12T08:58:02.314 INFO:teuthology.orchestra.run.smithi116.stdout:(13/133): libcephfs2-18.0.0-3871.g5a6b166b.el8. 6.5 MB/s | 772 kB 00:00 2023-05-12T08:58:02.364 INFO:teuthology.orchestra.run.smithi116.stdout:(14/133): libcephsqlite-18.0.0-3871.g5a6b166b.e 2.7 MB/s | 137 kB 00:00 2023-05-12T08:58:02.414 INFO:teuthology.orchestra.run.smithi116.stdout:(15/133): librados-devel-18.0.0-3871.g5a6b166b. 2.7 MB/s | 139 kB 00:00 2023-05-12T08:58:02.490 INFO:teuthology.orchestra.run.smithi116.stdout:(16/133): libradosstriper1-18.0.0-3871.g5a6b166 6.2 MB/s | 473 kB 00:00 2023-05-12T08:58:03.140 INFO:teuthology.orchestra.run.smithi116.stdout:(17/133): librgw2-18.0.0-3871.g5a6b166b.el8.x86 10 MB/s | 6.5 MB 00:00 2023-05-12T08:58:03.190 INFO:teuthology.orchestra.run.smithi116.stdout:(18/133): python3-ceph-argparse-18.0.0-3871.g5a 902 kB/s | 45 kB 00:00 2023-05-12T08:58:03.240 INFO:teuthology.orchestra.run.smithi116.stdout:(19/133): python3-ceph-common-18.0.0-3871.g5a6b 2.3 MB/s | 119 kB 00:00 2023-05-12T08:58:03.299 INFO:teuthology.orchestra.run.smithi116.stdout:(20/133): python3-cephfs-18.0.0-3871.g5a6b166b. 3.3 MB/s | 197 kB 00:00 2023-05-12T08:58:03.424 INFO:teuthology.orchestra.run.smithi116.stdout:(21/133): python3-rados-18.0.0-3871.g5a6b166b.e 2.9 MB/s | 372 kB 00:00 2023-05-12T08:58:03.525 INFO:teuthology.orchestra.run.smithi116.stdout:(22/133): python3-rbd-18.0.0-3871.g5a6b166b.el8 3.6 MB/s | 365 kB 00:00 2023-05-12T08:58:03.575 INFO:teuthology.orchestra.run.smithi116.stdout:(23/133): python3-rgw-18.0.0-3871.g5a6b166b.el8 2.1 MB/s | 107 kB 00:00 2023-05-12T08:58:03.625 INFO:teuthology.orchestra.run.smithi116.stdout:(24/133): rbd-fuse-18.0.0-3871.g5a6b166b.el8.x8 1.9 MB/s | 94 kB 00:00 2023-05-12T08:58:04.009 INFO:teuthology.orchestra.run.smithi116.stdout:(25/133): rbd-mirror-18.0.0-3871.g5a6b166b.el8. 9.0 MB/s | 3.4 MB 00:00 2023-05-12T08:58:04.059 INFO:teuthology.orchestra.run.smithi116.stdout:(26/133): rbd-nbd-18.0.0-3871.g5a6b166b.el8.x86 3.5 MB/s | 179 kB 00:00 2023-05-12T08:58:04.109 INFO:teuthology.orchestra.run.smithi116.stdout:(27/133): ceph-grafana-dashboards-18.0.0-3871.g 462 kB/s | 23 kB 00:00 2023-05-12T08:58:04.160 INFO:teuthology.orchestra.run.smithi116.stdout:(28/133): ceph-mgr-cephadm-18.0.0-3871.g5a6b166 2.5 MB/s | 127 kB 00:00 2023-05-12T08:58:04.377 INFO:teuthology.orchestra.run.smithi116.stdout:(29/133): ceph-mgr-dashboard-18.0.0-3871.g5a6b1 7.9 MB/s | 1.7 MB 00:00 2023-05-12T08:58:04.610 INFO:teuthology.orchestra.run.smithi116.stdout:(30/133): ceph-osd-18.0.0-3871.g5a6b166b.el8.x8 3.0 MB/s | 18 MB 00:05 2023-05-12T08:58:04.719 INFO:teuthology.orchestra.run.smithi116.stdout:(31/133): ceph-mgr-modules-core-18.0.0-3871.g5a 2.2 MB/s | 240 kB 00:00 2023-05-12T08:58:04.777 INFO:teuthology.orchestra.run.smithi116.stdout:(32/133): ceph-mgr-rook-18.0.0-3871.g5a6b166b.e 814 kB/s | 47 kB 00:00 2023-05-12T08:58:04.828 INFO:teuthology.orchestra.run.smithi116.stdout:(33/133): ceph-prometheus-alerts-18.0.0-3871.g5 291 kB/s | 15 kB 00:00 2023-05-12T08:58:04.912 INFO:teuthology.orchestra.run.smithi116.stdout:(34/133): ceph-volume-18.0.0-3871.g5a6b166b.el8 3.1 MB/s | 265 kB 00:00 2023-05-12T08:58:04.970 INFO:teuthology.orchestra.run.smithi116.stdout:(35/133): cephadm-18.0.0-3871.g5a6b166b.el8.noa 1.4 MB/s | 83 kB 00:00 2023-05-12T08:58:05.029 INFO:teuthology.orchestra.run.smithi116.stdout:(36/133): cephfs-top-18.0.0-3871.g5a6b166b.el8. 308 kB/s | 18 kB 00:00 2023-05-12T08:58:05.287 INFO:teuthology.orchestra.run.smithi116.stdout:(37/133): ceph-mgr-diskprediction-local-18.0.0- 8.1 MB/s | 7.4 MB 00:00 2023-05-12T08:58:05.321 INFO:teuthology.orchestra.run.smithi116.stdout:(38/133): automake-1.16.1-7.el8.noarch.rpm 2.4 MB/s | 713 kB 00:00 2023-05-12T08:58:05.396 INFO:teuthology.orchestra.run.smithi116.stdout:(39/133): flex-2.6.1-9.el8.x86_64.rpm 4.2 MB/s | 320 kB 00:00 2023-05-12T08:58:05.447 INFO:teuthology.orchestra.run.smithi116.stdout:(40/133): jq-1.6-7.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-05-12T08:58:05.497 INFO:teuthology.orchestra.run.smithi116.stdout:(41/133): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-05-12T08:58:05.530 INFO:teuthology.orchestra.run.smithi116.stdout:(42/133): bison-3.0.4-10.el8.x86_64.rpm 2.8 MB/s | 688 kB 00:00 2023-05-12T08:58:05.580 INFO:teuthology.orchestra.run.smithi116.stdout:(43/133): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2023-05-12T08:58:05.639 INFO:teuthology.orchestra.run.smithi116.stdout:(44/133): libtool-2.4.6-25.el8.x86_64.rpm 6.4 MB/s | 709 kB 00:00 2023-05-12T08:58:05.665 INFO:teuthology.orchestra.run.smithi116.stdout:(45/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2023-05-12T08:58:05.690 INFO:teuthology.orchestra.run.smithi116.stdout:(46/133): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-05-12T08:58:06.407 INFO:teuthology.orchestra.run.smithi116.stdout:(47/133): ceph-test-18.0.0-3871.g5a6b166b.el8.x 9.3 MB/s | 41 MB 00:04 2023-05-12T08:58:06.490 INFO:teuthology.orchestra.run.smithi116.stdout:(48/133): openblas-0.3.15-4.el8.x86_64.rpm 5.7 MB/s | 4.7 MB 00:00 2023-05-12T08:58:06.566 INFO:teuthology.orchestra.run.smithi116.stdout:(49/133): openblas-threads-0.3.15-4.el8.x86_64. 5.5 MB/s | 4.9 MB 00:00 2023-05-12T08:58:06.666 INFO:teuthology.orchestra.run.smithi116.stdout:(50/133): postgresql-contrib-10.23-1.module_el8 5.0 MB/s | 903 kB 00:00 2023-05-12T08:58:06.808 INFO:teuthology.orchestra.run.smithi116.stdout:(51/133): postgresql-10.23-1.module_el8+300+2c5 3.9 MB/s | 1.6 MB 00:00 2023-05-12T08:58:06.891 INFO:teuthology.orchestra.run.smithi116.stdout:(52/133): python3-jinja2-2.10.1-3.el8.noarch.rp 6.3 MB/s | 538 kB 00:00 2023-05-12T08:58:06.942 INFO:teuthology.orchestra.run.smithi116.stdout:(53/133): python3-jsonpatch-1.21-2.el8.noarch.r 536 kB/s | 27 kB 00:00 2023-05-12T08:58:06.992 INFO:teuthology.orchestra.run.smithi116.stdout:(54/133): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-05-12T08:58:07.043 INFO:teuthology.orchestra.run.smithi116.stdout:(55/133): python3-mako-1.0.6-14.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-05-12T08:58:07.093 INFO:teuthology.orchestra.run.smithi116.stdout:(56/133): python3-markupsafe-0.23-19.el8.x86_64 779 kB/s | 39 kB 00:00 2023-05-12T08:58:07.402 INFO:teuthology.orchestra.run.smithi116.stdout:(57/133): postgresql-server-10.23-1.module_el8+ 6.1 MB/s | 5.1 MB 00:00 2023-05-12T08:58:07.469 INFO:teuthology.orchestra.run.smithi116.stdout:(58/133): python3-babel-2.5.1-7.el8.noarch.rpm 6.0 MB/s | 4.8 MB 00:00 2023-05-12T08:58:07.494 INFO:teuthology.orchestra.run.smithi116.stdout:(59/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.4 MB/s | 225 kB 00:00 2023-05-12T08:58:07.519 INFO:teuthology.orchestra.run.smithi116.stdout:(60/133): python3-prettytable-0.7.2-14.el8.noar 880 kB/s | 44 kB 00:00 2023-05-12T08:58:07.544 INFO:teuthology.orchestra.run.smithi116.stdout:(61/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-05-12T08:58:07.578 INFO:teuthology.orchestra.run.smithi116.stdout:(62/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-05-12T08:58:07.603 INFO:teuthology.orchestra.run.smithi116.stdout:(63/133): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-05-12T08:58:07.629 INFO:teuthology.orchestra.run.smithi116.stdout:(64/133): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-05-12T08:58:07.746 INFO:teuthology.orchestra.run.smithi116.stdout:(65/133): python3-numpy-1.14.3-10.el8.x86_64.rp 5.7 MB/s | 3.7 MB 00:00 2023-05-12T08:58:07.771 INFO:teuthology.orchestra.run.smithi116.stdout:(66/133): python3-werkzeug-0.12.2-4.el8.noarch. 3.2 MB/s | 457 kB 00:00 2023-05-12T08:58:07.821 INFO:teuthology.orchestra.run.smithi116.stdout:(67/133): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-05-12T08:58:07.838 INFO:teuthology.orchestra.run.smithi116.stdout:(68/133): uuid-1.6.2-43.el8.x86_64.rpm 958 kB/s | 64 kB 00:00 2023-05-12T08:58:07.872 INFO:teuthology.orchestra.run.smithi116.stdout:(69/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2023-05-12T08:58:07.922 INFO:teuthology.orchestra.run.smithi116.stdout:(70/133): elfutils-libelf-devel-0.189-2.el8.x86 736 kB/s | 61 kB 00:00 2023-05-12T08:58:07.947 INFO:teuthology.orchestra.run.smithi116.stdout:(71/133): fuse-2.9.7-17.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-05-12T08:58:07.964 INFO:teuthology.orchestra.run.smithi116.stdout:(72/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-05-12T08:58:07.989 INFO:teuthology.orchestra.run.smithi116.stdout:(73/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 759 kB/s | 19 kB 00:00 2023-05-12T08:58:08.023 INFO:teuthology.orchestra.run.smithi116.stdout:(74/133): krb5-devel-1.18.2-22.el8.x86_64.rpm 7.3 MB/s | 561 kB 00:00 2023-05-12T08:58:08.048 INFO:teuthology.orchestra.run.smithi116.stdout:(75/133): libcom_err-devel-1.45.6-5.el8.x86_64. 664 kB/s | 39 kB 00:00 2023-05-12T08:58:08.085 INFO:teuthology.orchestra.run.smithi116.stdout:(76/133): libgfortran-8.5.0-19.el8.x86_64.rpm 11 MB/s | 645 kB 00:00 2023-05-12T08:58:08.107 INFO:teuthology.orchestra.run.smithi116.stdout:(77/133): libquadmath-8.5.0-19.el8.x86_64.rpm 2.9 MB/s | 172 kB 00:00 2023-05-12T08:58:08.132 INFO:teuthology.orchestra.run.smithi116.stdout:(78/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 940 kB/s | 47 kB 00:00 2023-05-12T08:58:08.166 INFO:teuthology.orchestra.run.smithi116.stdout:(79/133): libselinux-devel-2.9-8.el8.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2023-05-12T08:58:08.191 INFO:teuthology.orchestra.run.smithi116.stdout:(80/133): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-05-12T08:58:08.217 INFO:teuthology.orchestra.run.smithi116.stdout:(81/133): libuuid-devel-2.32.1-41.el8.x86_64.rp 1.9 MB/s | 99 kB 00:00 2023-05-12T08:58:08.251 INFO:teuthology.orchestra.run.smithi116.stdout:(82/133): libverto-devel-0.3.2-2.el8.x86_64.rpm 308 kB/s | 18 kB 00:00 2023-05-12T08:58:08.276 INFO:teuthology.orchestra.run.smithi116.stdout:(83/133): libzstd-devel-1.4.4-1.el8.x86_64.rpm 749 kB/s | 44 kB 00:00 2023-05-12T08:58:08.343 INFO:teuthology.orchestra.run.smithi116.stdout:(84/133): pcre2-devel-10.32-3.el8.x86_64.rpm 8.9 MB/s | 605 kB 00:00 2023-05-12T08:58:08.410 INFO:teuthology.orchestra.run.smithi116.stdout:(85/133): openssl-devel-1.1.1k-9.el8.x86_64.rpm 20 MB/s | 3.2 MB 00:00 2023-05-12T08:58:08.435 INFO:teuthology.orchestra.run.smithi116.stdout:(86/133): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2023-05-12T08:58:08.460 INFO:teuthology.orchestra.run.smithi116.stdout:(87/133): pcre2-utf32-10.32-3.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-05-12T08:58:08.485 INFO:teuthology.orchestra.run.smithi116.stdout:(88/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.7 MB/s | 237 kB 00:00 2023-05-12T08:58:08.519 INFO:teuthology.orchestra.run.smithi116.stdout:(89/133): python3-cryptography-3.2.1-5.el8.x86_ 9.4 MB/s | 559 kB 00:00 2023-05-12T08:58:08.545 INFO:teuthology.orchestra.run.smithi116.stdout:(90/133): python3-jwt-1.6.1-2.el8.noarch.rpm 730 kB/s | 43 kB 00:00 2023-05-12T08:58:08.570 INFO:teuthology.orchestra.run.smithi116.stdout:(91/133): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-05-12T08:58:08.595 INFO:teuthology.orchestra.run.smithi116.stdout:(92/133): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-05-12T08:58:08.629 INFO:teuthology.orchestra.run.smithi116.stdout:(93/133): python3-requests-oauthlib-1.0.0-1.el8 732 kB/s | 43 kB 00:00 2023-05-12T08:58:08.646 INFO:teuthology.orchestra.run.smithi116.stdout:(94/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-05-12T08:58:08.671 INFO:teuthology.orchestra.run.smithi116.stdout:(95/133): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2023-05-12T08:58:08.838 INFO:teuthology.orchestra.run.smithi116.stdout:(96/133): liboath-2.6.2-3.el8.x86_64.rpm 353 kB/s | 59 kB 00:00 2023-05-12T08:58:08.913 INFO:teuthology.orchestra.run.smithi116.stdout:(97/133): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-05-12T08:58:08.955 INFO:teuthology.orchestra.run.smithi116.stdout:(98/133): libunwind-1.3.1-3.el8.x86_64.rpm 646 kB/s | 75 kB 00:00 2023-05-12T08:58:09.014 INFO:teuthology.orchestra.run.smithi116.stdout:(99/133): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2023-05-12T08:58:09.039 INFO:teuthology.orchestra.run.smithi116.stdout:(100/133): python3-bcrypt-3.1.6-2.el8.1.x86_64. 520 kB/s | 44 kB 00:00 2023-05-12T08:58:09.073 INFO:teuthology.orchestra.run.smithi116.stdout:(101/133): python3-beautifulsoup4-4.6.3-2.el8.1 3.1 MB/s | 185 kB 00:00 2023-05-12T08:58:09.098 INFO:teuthology.orchestra.run.smithi116.stdout:(102/133): python3-cachetools-3.1.1-4.el8.noarc 565 kB/s | 33 kB 00:00 2023-05-12T08:58:09.132 INFO:teuthology.orchestra.run.smithi116.stdout:(103/133): python3-certifi-2018.10.15-7.el8.noa 279 kB/s | 16 kB 00:00 2023-05-12T08:58:09.307 INFO:teuthology.orchestra.run.smithi116.stdout:(104/133): python3-scipy-1.0.0-21.module_el8.5. 8.0 MB/s | 14 MB 00:01 2023-05-12T08:58:09.333 INFO:teuthology.orchestra.run.smithi116.stdout:(105/133): python3-cheroot-8.5.2-1.el8.noarch.r 738 kB/s | 173 kB 00:00 2023-05-12T08:58:09.358 INFO:teuthology.orchestra.run.smithi116.stdout:(106/133): python3-cherrypy-18.4.0-1.el8.noarch 1.7 MB/s | 384 kB 00:00 2023-05-12T08:58:09.383 INFO:teuthology.orchestra.run.smithi116.stdout:(107/133): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-05-12T08:58:09.408 INFO:teuthology.orchestra.run.smithi116.stdout:(108/133): python3-jaraco-functools-2.0-4.el8.n 350 kB/s | 18 kB 00:00 2023-05-12T08:58:09.459 INFO:teuthology.orchestra.run.smithi116.stdout:(109/133): python3-logutils-0.3.5-11.el8.noarch 976 kB/s | 49 kB 00:00 2023-05-12T08:58:09.500 INFO:teuthology.orchestra.run.smithi116.stdout:(110/133): python3-google-auth-1.1.1-10.el8.noa 423 kB/s | 81 kB 00:00 2023-05-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi116.stdout:(111/133): python3-more-itertools-7.2.0-3.el8.n 782 kB/s | 59 kB 00:00 2023-05-12T08:58:09.576 INFO:teuthology.orchestra.run.smithi116.stdout:(112/133): python3-kubernetes-11.0.0-6.el8.noar 6.0 MB/s | 1.2 MB 00:00 2023-05-12T08:58:09.602 INFO:teuthology.orchestra.run.smithi116.stdout:(113/133): python3-natsort-7.1.1-2.el8.noarch.r 599 kB/s | 60 kB 00:00 2023-05-12T08:58:09.627 INFO:teuthology.orchestra.run.smithi116.stdout:(114/133): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-05-12T08:58:09.652 INFO:teuthology.orchestra.run.smithi116.stdout:(115/133): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2023-05-12T08:58:09.677 INFO:teuthology.orchestra.run.smithi116.stdout:(116/133): python3-repoze-lru-0.7-6.el8.noarch. 446 kB/s | 34 kB 00:00 2023-05-12T08:58:09.703 INFO:teuthology.orchestra.run.smithi116.stdout:(117/133): python3-routes-2.4.1-12.el8.noarch.r 2.5 MB/s | 196 kB 00:00 2023-05-12T08:58:09.728 INFO:teuthology.orchestra.run.smithi116.stdout:(118/133): python3-rsa-4.8-1.el8.noarch.rpm 816 kB/s | 61 kB 00:00 2023-05-12T08:58:09.753 INFO:teuthology.orchestra.run.smithi116.stdout:(119/133): python3-simplegeneric-0.8.1-17.el8.n 248 kB/s | 19 kB 00:00 2023-05-12T08:58:09.779 INFO:teuthology.orchestra.run.smithi116.stdout:(120/133): python3-singledispatch-3.4.0.3-18.el 317 kB/s | 24 kB 00:00 2023-05-12T08:58:09.804 INFO:teuthology.orchestra.run.smithi116.stdout:(121/133): python3-tempora-1.14.1-5.el8.noarch. 387 kB/s | 29 kB 00:00 2023-05-12T08:58:09.829 INFO:teuthology.orchestra.run.smithi116.stdout:(122/133): python3-trustme-0.6.0-4.el8.noarch.r 365 kB/s | 27 kB 00:00 2023-05-12T08:58:09.855 INFO:teuthology.orchestra.run.smithi116.stdout:(123/133): python3-waitress-1.2.1-2.el8.1.noarc 3.1 MB/s | 241 kB 00:00 2023-05-12T08:58:09.880 INFO:teuthology.orchestra.run.smithi116.stdout:(124/133): python3-webob-1.8.5-1.el8.1.noarch.r 3.3 MB/s | 251 kB 00:00 2023-05-12T08:58:09.905 INFO:teuthology.orchestra.run.smithi116.stdout:(125/133): python3-websocket-client-0.56.0-5.el 814 kB/s | 61 kB 00:00 2023-05-12T08:58:09.922 INFO:teuthology.orchestra.run.smithi116.stdout:(126/133): python3-webtest-2.0.33-1.el8.noarch. 1.2 MB/s | 85 kB 00:00 2023-05-12T08:58:09.947 INFO:teuthology.orchestra.run.smithi116.stdout:(127/133): python3-zc-lockfile-2.0-2.el8.noarch 341 kB/s | 23 kB 00:00 2023-05-12T08:58:10.122 INFO:teuthology.orchestra.run.smithi116.stdout:(128/133): thrift-0.13.0-2.el8.x86_64.rpm 8.0 MB/s | 1.7 MB 00:00 2023-05-12T08:58:10.147 INFO:teuthology.orchestra.run.smithi116.stdout:(129/133): elfutils-debuginfod-client-0.189-2.e 3.0 MB/s | 76 kB 00:00 2023-05-12T08:58:10.190 INFO:teuthology.orchestra.run.smithi116.stdout:(130/133): elfutils-libelf-0.189-2.el8.x86_64.r 5.5 MB/s | 232 kB 00:00 2023-05-12T08:58:10.232 INFO:teuthology.orchestra.run.smithi116.stdout:(131/133): elfutils-libs-0.189-2.el8.x86_64.rpm 7.1 MB/s | 302 kB 00:00 2023-05-12T08:58:10.399 INFO:teuthology.orchestra.run.smithi116.stdout:(132/133): librbd1-18.0.0-3871.g5a6b166b.el8.x8 7.9 MB/s | 3.6 MB 00:00 2023-05-12T08:58:10.590 INFO:teuthology.orchestra.run.smithi116.stdout:(133/133): librados2-18.0.0-3871.g5a6b166b.el8. 5.5 MB/s | 3.7 MB 00:00 2023-05-12T08:58:10.593 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-05-12T08:58:10.593 INFO:teuthology.orchestra.run.smithi116.stdout:Total 13 MB/s | 197 MB 00:15 2023-05-12T08:58:11.990 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-05-12T08:58:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-05-12T08:58:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-05-12T08:58:13.907 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-05-12T08:58:13.911 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-05-12T08:58:18.786 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-05-12T08:58:18.980 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/138 2023-05-12T08:58:19.162 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/138 2023-05-12T08:58:19.420 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/138 2023-05-12T08:58:19.606 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-12T08:58:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-12T08:58:20.281 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:18.0.0-3871.g5a6b166b.el8.x86_64 5/138 2023-05-12T08:58:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:18.0.0-3871.g5a6b166b.el8.x86_64 5/138 2023-05-12T08:58:20.907 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:18.0.0-3871.g5a6b166b.el8.x86_64 6/138 2023-05-12T08:58:21.039 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:18.0.0-3871.g5a6b166b.el8.x86_64 6/138 2023-05-12T08:58:21.232 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:18.0.0-3871.g5a6b166b.el8.x86_64 7/138 2023-05-12T08:58:21.332 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:18.0.0-3871.g5a6b166b.el8.x86_64 7/138 2023-05-12T08:58:21.591 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:18.0.0-3871.g5a6b166b.el8.x86_64 8/138 2023-05-12T08:58:21.814 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-12T08:58:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-12T08:58:22.153 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 10/138 2023-05-12T08:58:22.430 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/138 2023-05-12T08:58:22.869 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2023-05-12T08:58:23.336 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpq-13.5-1.el8.x86_64 13/138 2023-05-12T08:58:23.569 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 14/138 2023-05-12T08:58:23.756 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:18.0.0-3871.g5a6b166b.el8.x86_64 15/138 2023-05-12T08:58:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3871.g5a6b166b.el8.x86_64 15/138 2023-05-12T08:58:24.014 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:18.0.0-3871.g5a6b166b.el8.x86 16/138 2023-05-12T08:58:24.157 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3871.g5a6b166b.el8.x86 16/138 2023-05-12T08:58:24.373 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 17/138 2023-05-12T08:58:24.552 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 18/138 2023-05-12T08:58:24.706 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-12T08:58:24.864 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-12T08:58:25.048 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-12T08:58:25.708 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-12T08:58:25.906 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.15-4.el8.x86_64 21/138 2023-05-12T08:58:26.604 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 21/138 2023-05-12T08:58:26.756 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-12T08:58:27.572 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-12T08:58:28.174 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/138 2023-05-12T08:58:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/138 2023-05-12T08:58:28.587 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/138 2023-05-12T08:58:28.832 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/138 2023-05-12T08:58:29.037 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:18.0.0-3871.g5a6b166b.el8. 27/138 2023-05-12T08:58:29.168 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:18.0.0-3871.g5a6b166b.el 28/138 2023-05-12T08:58:29.386 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:18.0.0-3871.g5a6b166b.el8.x86_6 29/138 2023-05-12T08:58:30.465 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 30/138 2023-05-12T08:58:30.809 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2023-05-12T08:58:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2023-05-12T08:58:31.271 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-12T08:58:33.359 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-12T08:58:33.675 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 34/138 2023-05-12T08:58:33.871 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/138 2023-05-12T08:58:34.110 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/138 2023-05-12T08:58:34.289 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 37/138 2023-05-12T08:58:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 38/138 2023-05-12T08:58:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 39/138 2023-05-12T08:58:34.889 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:18.0.0-3871.g5a6b166b.el8.x86_6 40/138 2023-05-12T08:58:35.079 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 41/138 2023-05-12T08:58:35.333 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 42/138 2023-05-12T08:58:35.562 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 43/138 2023-05-12T08:58:35.726 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 44/138 2023-05-12T08:58:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 45/138 2023-05-12T08:58:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 46/138 2023-05-12T08:58:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 47/138 2023-05-12T08:58:36.517 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 48/138 2023-05-12T08:58:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/138 2023-05-12T08:58:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/138 2023-05-12T08:58:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2023-05-12T08:58:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 52/138 2023-05-12T08:58:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-2.6-1.el8.noarch 53/138 2023-05-12T08:58:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/138 2023-05-12T08:58:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/138 2023-05-12T08:58:38.062 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/138 2023-05-12T08:58:38.263 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/138 2023-05-12T08:58:38.651 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/138 2023-05-12T08:58:38.932 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 59/138 2023-05-12T08:58:39.134 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 60/138 2023-05-12T08:58:39.967 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 61/138 2023-05-12T08:58:40.154 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:18.0.0-3871.g5a6b166b.el8.x86_64 62/138 2023-05-12T08:58:40.241 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:18.0.0-3871.g5a6b166b.el8.x86_64 62/138 2023-05-12T08:58:40.472 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 63/138 2023-05-12T08:58:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/138 2023-05-12T08:58:41.127 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 65/138 2023-05-12T08:58:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 66/138 2023-05-12T08:58:41.618 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/138 2023-05-12T08:58:41.865 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/138 2023-05-12T08:58:42.105 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/138 2023-05-12T08:58:43.421 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/138 2023-05-12T08:58:43.888 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 71/138 2023-05-12T08:58:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/138 2023-05-12T08:58:44.364 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/138 2023-05-12T08:58:44.696 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 74/138 2023-05-12T08:58:44.959 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/138 2023-05-12T08:58:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/138 2023-05-12T08:58:45.430 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 77/138 2023-05-12T08:58:45.802 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 78/138 2023-05-12T08:58:46.000 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 79/138 2023-05-12T08:58:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 80/138 2023-05-12T08:58:46.320 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 81/138 2023-05-12T08:58:46.471 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-12T08:58:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 83/138 2023-05-12T08:58:47.066 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 84/138 2023-05-12T08:58:47.218 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 85/138 2023-05-12T08:58:47.418 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 86/138 2023-05-12T08:58:47.655 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 87/138 2023-05-12T08:58:47.881 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.7-17.el8.x86_64 88/138 2023-05-12T08:58:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 89/138 2023-05-12T08:58:48.297 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : uuid-1.6.2-43.el8.x86_64 90/138 2023-05-12T08:58:48.411 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 90/138 2023-05-12T08:58:48.628 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 91/138 2023-05-12T08:58:48.869 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 92/138 2023-05-12T08:58:51.828 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 93/138 2023-05-12T08:58:52.094 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 93/138 2023-05-12T08:58:52.782 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 93/138 2023-05-12T08:58:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:18.0.0-3871.g5a6b166b.el8.x86_64 94/138 2023-05-12T08:58:53.226 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:18.0.0-3871.g5a6b166b.el8.x86_64 94/138 2023-05-12T08:58:53.385 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:18.0.0-3871.g5a6b166b.el8.x86_64 95/138 2023-05-12T08:59:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3871.g5a6b166b.el8.x86_64 95/138 2023-05-12T08:59:13.464 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2023-05-12T08:59:13.464 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2023-05-12T08:59:13.464 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /dev 2023-05-12T08:59:13.465 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /run 2023-05-12T08:59:13.465 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2023-05-12T08:59:13.465 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2023-05-12T08:59:13.465 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2023-05-12T08:59:13.465 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2023-05-12T08:59:13.465 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /dev 2023-05-12T08:59:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T08:59:13.866 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:18.0.0-3871.g5a6b166b.el8.noarch 96/138 2023-05-12T08:59:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:18.0.0-3871.g5a6b166b.el8.noarch 96/138 2023-05-12T08:59:15.825 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:18.0.0-3871.g5a6b166b.el8.x86_64 97/138 2023-05-12T08:59:16.086 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:18.0.0-3871.g5a6b166b.el8.x86_64 97/138 2023-05-12T08:59:16.274 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:18.0.0-3871.g5a6b166b.el8.x86_64 98/138 2023-05-12T08:59:16.789 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:18.0.0-3871.g5a6b166b.el8.x86_64 98/138 2023-05-12T08:59:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:18.0.0-3871.g5a6b166b.el8.x86_64 99/138 2023-05-12T08:59:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:18.0.0-3871.g5a6b166b.el8.x86_64 99/138 2023-05-12T08:59:17.240 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 100/138 2023-05-12T08:59:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 101/138 2023-05-12T08:59:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-12T08:59:17.775 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-12T08:59:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jq-1.6-7.el8.x86_64 103/138 2023-05-12T08:59:18.340 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.1-7.el8.noarch 104/138 2023-05-12T08:59:18.901 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:18.0.0-3871.g5a6b166b.el8.noarch 105/138 2023-05-12T08:59:19.069 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:18.0.0-3871.g5a6b166b.el8.noarch 105/138 2023-05-12T08:59:19.189 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3871.g5a6b166b.e 106/138 2023-05-12T08:59:19.385 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3871.g5a6b166b. 107/138 2023-05-12T08:59:19.631 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3871.g5a6b166b.el8.noa 108/138 2023-05-12T08:59:19.883 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3871.g5a6b166b.el8.noa 108/138 2023-05-12T08:59:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3871.g5a6b166b.el8.n 109/138 2023-05-12T08:59:21.211 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3871.g5a6b166b.el8.n 109/138 2023-05-12T08:59:21.389 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3871.g5a6 110/138 2023-05-12T08:59:21.511 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3871.g5a6 110/138 2023-05-12T08:59:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3871.g5a6b166b.el 111/138 2023-05-12T08:59:22.141 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:18.0.0-3871.g5a6b166b.el8.x86_64 112/138 2023-05-12T08:59:22.200 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3871.g5a6b166b.el8.x86_64 112/138 2023-05-12T08:59:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:18.0.0-3871.g5a6b166b.el8.noarch 113/138 2023-05-12T08:59:22.420 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3871.g5a6b166b.el8.noarch 113/138 2023-05-12T08:59:22.608 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:18.0.0-3871.g5a6b166b.el8.x86_64 114/138 2023-05-12T08:59:22.780 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/138 2023-05-12T08:59:27.076 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/138 2023-05-12T08:59:28.569 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:18.0.0-3871.g5a6b166b.el8.x86_64 116/138 2023-05-12T08:59:28.798 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 117/138 2023-05-12T08:59:28.855 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 117/138 2023-05-12T08:59:29.055 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3871.g5a6b1 118/138 2023-05-12T08:59:29.121 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3871.g5a6b1 118/138 2023-05-12T08:59:29.363 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 119/138 2023-05-12T08:59:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 119/138 2023-05-12T08:59:29.946 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 120/138 2023-05-12T08:59:30.213 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 120/138 2023-05-12T08:59:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 121/138 2023-05-12T08:59:31.742 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 122/138 2023-05-12T08:59:32.076 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 123/138 2023-05-12T08:59:32.226 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 124/138 2023-05-12T08:59:32.401 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 125/138 2023-05-12T08:59:32.597 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:18.0.0-3871.g5a6b166b.el8.x86_ 126/138 2023-05-12T08:59:33.775 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-12T08:59:34.038 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-12T08:59:34.070 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-12T08:59:34.305 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-top-2:18.0.0-3871.g5a6b166b.el8.noarch 128/138 2023-05-12T08:59:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 129/138 2023-05-12T08:59:34.763 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 130/138 2023-05-12T08:59:34.927 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2023-05-12T08:59:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2023-05-12T08:59:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2023-05-12T08:59:35.520 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2023-05-12T08:59:35.543 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2023-05-12T08:59:35.721 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-12T08:59:35.907 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 135/138 2023-05-12T08:59:35.907 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-12T08:59:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-12T08:59:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-12T08:59:36.390 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-12T08:59:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-12T08:59:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-12T08:59:36.800 INFO:teuthology.orchestra.run.smithi116.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-05-12T08:59:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T08:59:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:18.0.0-3871.g5a6b166b.el8.x86_64 1/138 2023-05-12T08:59:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:18.0.0-3871.g5a6b166b.el8.x86_64 2/138 2023-05-12T08:59:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 3/138 2023-05-12T08:59:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 4/138 2023-05-12T08:59:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3871.g5a6b1 5/138 2023-05-12T08:59:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:18.0.0-3871.g5a6b166b.el8.x86_64 6/138 2023-05-12T08:59:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:18.0.0-3871.g5a6b166b.el8.x86_64 7/138 2023-05-12T08:59:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:18.0.0-3871.g5a6b166b.el8.x86_64 8/138 2023-05-12T08:59:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:18.0.0-3871.g5a6b166b.el8.x86_64 9/138 2023-05-12T08:59:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 10/138 2023-05-12T08:59:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:18.0.0-3871.g5a6b166b.el8.x86_64 11/138 2023-05-12T08:59:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:18.0.0-3871.g5a6b166b.el8.x86_64 12/138 2023-05-12T08:59:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 13/138 2023-05-12T08:59:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:18.0.0-3871.g5a6b166b.el8.x86_ 14/138 2023-05-12T08:59:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:18.0.0-3871.g5a6b166b.el8.x86_64 15/138 2023-05-12T08:59:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:18.0.0-3871.g5a6b166b.el8.x86_64 16/138 2023-05-12T08:59:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:18.0.0-3871.g5a6b166b.el8.x86_6 17/138 2023-05-12T08:59:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:18.0.0-3871.g5a6b166b.el8.x86 18/138 2023-05-12T08:59:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:18.0.0-3871.g5a6b166b.el8.x86_64 19/138 2023-05-12T08:59:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3871.g5a6b166b.el 20/138 2023-05-12T08:59:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:18.0.0-3871.g5a6b166b.el8. 21/138 2023-05-12T08:59:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:18.0.0-3871.g5a6b166b.el8.x86_6 22/138 2023-05-12T08:59:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:18.0.0-3871.g5a6b166b.el8.x86_64 23/138 2023-05-12T08:59:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 24/138 2023-05-12T08:59:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 25/138 2023-05-12T08:59:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 26/138 2023-05-12T08:59:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 27/138 2023-05-12T08:59:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 28/138 2023-05-12T08:59:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3871.g5a6b166b. 29/138 2023-05-12T08:59:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3871.g5a6b166b.el8.noa 30/138 2023-05-12T08:59:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3871.g5a6b166b.el8.n 31/138 2023-05-12T08:59:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3871.g5a6 32/138 2023-05-12T08:59:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3871.g5a6b166b.el 33/138 2023-05-12T08:59:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3871.g5a6b166b.el8.noarch 34/138 2023-05-12T08:59:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3871.g5a6b166b.e 35/138 2023-05-12T08:59:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:18.0.0-3871.g5a6b166b.el8.noarch 36/138 2023-05-12T08:59:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:18.0.0-3871.g5a6b166b.el8.noarch 37/138 2023-05-12T08:59:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-top-2:18.0.0-3871.g5a6b166b.el8.noarch 38/138 2023-05-12T08:59:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/138 2023-05-12T08:59:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/138 2023-05-12T08:59:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/138 2023-05-12T08:59:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jq-1.6-7.el8.x86_64 42/138 2023-05-12T08:59:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/138 2023-05-12T08:59:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/138 2023-05-12T08:59:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/138 2023-05-12T08:59:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/138 2023-05-12T08:59:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/138 2023-05-12T08:59:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/138 2023-05-12T08:59:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/138 2023-05-12T08:59:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/138 2023-05-12T08:59:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/138 2023-05-12T08:59:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/138 2023-05-12T08:59:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/138 2023-05-12T08:59:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/138 2023-05-12T08:59:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/138 2023-05-12T08:59:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/138 2023-05-12T08:59:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/138 2023-05-12T08:59:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/138 2023-05-12T08:59:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/138 2023-05-12T08:59:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/138 2023-05-12T08:59:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/138 2023-05-12T08:59:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/138 2023-05-12T08:59:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/138 2023-05-12T08:59:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/138 2023-05-12T08:59:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/138 2023-05-12T08:59:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/138 2023-05-12T08:59:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/138 2023-05-12T08:59:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/138 2023-05-12T08:59:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/138 2023-05-12T08:59:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/138 2023-05-12T08:59:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/138 2023-05-12T08:59:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/138 2023-05-12T08:59:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/138 2023-05-12T08:59:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/138 2023-05-12T08:59:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/138 2023-05-12T08:59:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/138 2023-05-12T08:59:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/138 2023-05-12T08:59:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/138 2023-05-12T08:59:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/138 2023-05-12T08:59:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/138 2023-05-12T08:59:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/138 2023-05-12T08:59:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-12T08:59:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/138 2023-05-12T08:59:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/138 2023-05-12T08:59:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/138 2023-05-12T08:59:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/138 2023-05-12T08:59:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/138 2023-05-12T08:59:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/138 2023-05-12T08:59:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/138 2023-05-12T08:59:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 90/138 2023-05-12T08:59:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/138 2023-05-12T08:59:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/138 2023-05-12T08:59:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/138 2023-05-12T08:59:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/138 2023-05-12T08:59:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 95/138 2023-05-12T08:59:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/138 2023-05-12T08:59:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/138 2023-05-12T08:59:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/138 2023-05-12T08:59:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/138 2023-05-12T08:59:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/138 2023-05-12T08:59:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/138 2023-05-12T08:59:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/138 2023-05-12T08:59:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/138 2023-05-12T08:59:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/138 2023-05-12T08:59:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/138 2023-05-12T08:59:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/138 2023-05-12T08:59:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/138 2023-05-12T08:59:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/138 2023-05-12T08:59:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/138 2023-05-12T08:59:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/138 2023-05-12T08:59:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/138 2023-05-12T08:59:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/138 2023-05-12T08:59:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/138 2023-05-12T08:59:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/138 2023-05-12T08:59:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/138 2023-05-12T08:59:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/138 2023-05-12T08:59:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/138 2023-05-12T08:59:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/138 2023-05-12T08:59:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/138 2023-05-12T08:59:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/138 2023-05-12T08:59:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/138 2023-05-12T08:59:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/138 2023-05-12T08:59:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 123/138 2023-05-12T08:59:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/138 2023-05-12T08:59:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/138 2023-05-12T08:59:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/138 2023-05-12T08:59:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/138 2023-05-12T08:59:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/138 2023-05-12T08:59:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:18.0.0-3871.g5a6b166b.el8.x86_64 129/138 2023-05-12T08:59:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2023-05-12T08:59:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:18.0.0-3871.g5a6b166b.el8.x86_64 131/138 2023-05-12T08:59:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2023-05-12T08:59:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 133/138 2023-05-12T08:59:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-12T08:59:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 135/138 2023-05-12T08:59:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 136/138 2023-05-12T08:59:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 137/138 2023-05-12T08:59:39.595 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 138/138 2023-05-12T08:59:39.595 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T08:59:39.596 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2023-05-12T08:59:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-05-12T08:59:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-05-12T08:59:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-05-12T08:59:39.597 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.597 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.597 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-05-12T08:59:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.1-7.el8.noarch 2023-05-12T08:59:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.0.4-10.el8.x86_64 2023-05-12T08:59:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T08:59:39.600 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.600 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.600 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T08:59:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T08:59:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T08:59:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T08:59:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T08:59:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T08:59:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T08:59:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T08:59:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T08:59:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-05-12T08:59:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.1-9.el8.x86_64 2023-05-12T08:59:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.7-17.el8.x86_64 2023-05-12T08:59:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-12T08:59:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: jq-1.6-7.el8.x86_64 2023-05-12T08:59:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-12T08:59:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-05-12T08:59:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-12T08:59:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.606 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.606 INFO:teuthology.orchestra.run.smithi116.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-05-12T08:59:39.606 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-05-12T08:59:39.606 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-12T08:59:39.606 INFO:teuthology.orchestra.run.smithi116.stdout: libpq-13.5-1.el8.x86_64 2023-05-12T08:59:39.606 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-05-12T08:59:39.606 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-12T08:59:39.607 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.607 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.607 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-12T08:59:39.607 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.607 INFO:teuthology.orchestra.run.smithi116.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-05-12T08:59:39.607 INFO:teuthology.orchestra.run.smithi116.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-12T08:59:39.607 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-12T08:59:39.607 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-12T08:59:39.608 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.32.1-41.el8.x86_64 2023-05-12T08:59:39.608 INFO:teuthology.orchestra.run.smithi116.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-05-12T08:59:39.608 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-05-12T08:59:39.608 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-12T08:59:39.608 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-12T08:59:39.608 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.15-4.el8.x86_64 2023-05-12T08:59:39.609 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-05-12T08:59:39.609 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-05-12T08:59:39.609 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-05-12T08:59:39.609 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-05-12T08:59:39.609 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-05-12T08:59:39.609 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-12T08:59:39.609 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-12T08:59:39.610 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-12T08:59:39.610 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-12T08:59:39.610 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-12T08:59:39.610 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-12T08:59:39.610 INFO:teuthology.orchestra.run.smithi116.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-12T08:59:39.610 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-12T08:59:39.610 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.610 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.611 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.611 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-12T08:59:39.611 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-12T08:59:39.611 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-12T08:59:39.611 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-12T08:59:39.611 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-12T08:59:39.611 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-12T08:59:39.612 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-12T08:59:39.612 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-12T08:59:39.612 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-12T08:59:39.612 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-12T08:59:39.612 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-12T08:59:39.612 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-12T08:59:39.613 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-12T08:59:39.613 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-12T08:59:39.613 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.0.6-14.el8.noarch 2023-05-12T08:59:39.613 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-12T08:59:39.613 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-12T08:59:39.613 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-12T08:59:39.613 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-12T08:59:39.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-12T08:59:39.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-12T08:59:39.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-12T08:59:39.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-2.6-1.el8.noarch 2023-05-12T08:59:39.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-12T08:59:39.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-12T08:59:39.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-12T08:59:39.615 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-12T08:59:39.615 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-12T08:59:39.615 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-12T08:59:39.615 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.615 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.615 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-12T08:59:39.615 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-12T08:59:39.616 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.616 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-12T08:59:39.616 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-12T08:59:39.616 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-05-12T08:59:39.616 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-12T08:59:39.616 INFO:teuthology.orchestra.run.smithi116.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-12T08:59:39.616 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-12T08:59:39.616 INFO:teuthology.orchestra.run.smithi116.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-12T08:59:39.617 INFO:teuthology.orchestra.run.smithi116.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-12T08:59:39.617 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-12T08:59:39.617 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-12T08:59:39.617 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-12T08:59:39.617 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-12T08:59:39.617 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-12T08:59:39.617 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.617 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T08:59:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-12T08:59:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-12T08:59:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-12T08:59:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-12T08:59:39.618 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-12T08:59:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-05-12T08:59:39.619 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T08:59:39.619 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-05-12T08:59:39.836 DEBUG:teuthology.parallel:result is None 2023-05-12T09:04:19.140 INFO:teuthology.orchestra.run.smithi182.stdout:Extra Packages for Enterprise Linux 36 kB/s | 14 MB 06:32 2023-05-12T09:04:23.071 INFO:teuthology.orchestra.run.smithi182.stdout:lab-extras 418 kB/s | 24 kB 00:00 2023-05-12T09:04:26.440 INFO:teuthology.orchestra.run.smithi182.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-12T09:04:26.440 INFO:teuthology.orchestra.run.smithi182.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-12T09:04:26.451 INFO:teuthology.orchestra.run.smithi182.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-05-12T09:04:26.452 INFO:teuthology.orchestra.run.smithi182.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-05-12T09:04:26.452 INFO:teuthology.orchestra.run.smithi182.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-05-12T09:04:26.453 INFO:teuthology.orchestra.run.smithi182.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-05-12T09:04:26.454 INFO:teuthology.orchestra.run.smithi182.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-12T09:04:26.456 INFO:teuthology.orchestra.run.smithi182.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-12T09:04:26.459 INFO:teuthology.orchestra.run.smithi182.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-12T09:04:26.459 INFO:teuthology.orchestra.run.smithi182.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-12T09:04:26.624 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2023-05-12T09:04:26.636 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================================ 2023-05-12T09:04:26.636 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2023-05-12T09:04:26.637 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================================ 2023-05-12T09:04:26.637 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2023-05-12T09:04:26.637 INFO:teuthology.orchestra.run.smithi182.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-05-12T09:04:26.637 INFO:teuthology.orchestra.run.smithi182.stdout: ceph x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 6.4 k 2023-05-12T09:04:26.637 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-base x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 5.3 M 2023-05-12T09:04:26.637 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-fuse x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 848 k 2023-05-12T09:04:26.638 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 166 k 2023-05-12T09:04:26.638 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 1.5 M 2023-05-12T09:04:26.638 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 127 k 2023-05-12T09:04:26.638 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 1.7 M 2023-05-12T09:04:26.638 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 7.4 M 2023-05-12T09:04:26.638 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-rook noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 47 k 2023-05-12T09:04:26.639 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-radosgw x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 13 M 2023-05-12T09:04:26.639 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-test x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 41 M 2023-05-12T09:04:26.639 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-volume noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 265 k 2023-05-12T09:04:26.639 INFO:teuthology.orchestra.run.smithi182.stdout: cephadm noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 83 k 2023-05-12T09:04:26.639 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-mirror x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 258 k 2023-05-12T09:04:26.639 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-top noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 18 k 2023-05-12T09:04:26.639 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-05-12T09:04:26.640 INFO:teuthology.orchestra.run.smithi182.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-05-12T09:04:26.640 INFO:teuthology.orchestra.run.smithi182.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-05-12T09:04:26.640 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs-devel x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 31 k 2023-05-12T09:04:26.640 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs2 x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 772 k 2023-05-12T09:04:26.640 INFO:teuthology.orchestra.run.smithi182.stdout: librados-devel x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 139 k 2023-05-12T09:04:26.641 INFO:teuthology.orchestra.run.smithi182.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-05-12T09:04:26.641 INFO:teuthology.orchestra.run.smithi182.stdout: libuuid-devel x86_64 2.32.1-41.el8 baseos 99 k 2023-05-12T09:04:26.641 INFO:teuthology.orchestra.run.smithi182.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-05-12T09:04:26.641 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-05-12T09:04:26.641 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-05-12T09:04:26.641 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-05-12T09:04:26.642 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cephfs x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 197 k 2023-05-12T09:04:26.642 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rados x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 372 k 2023-05-12T09:04:26.642 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rbd x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 365 k 2023-05-12T09:04:26.642 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rgw x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 107 k 2023-05-12T09:04:26.642 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-fuse x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 94 k 2023-05-12T09:04:26.642 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-mirror x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 3.4 M 2023-05-12T09:04:26.643 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-nbd x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 179 k 2023-05-12T09:04:26.643 INFO:teuthology.orchestra.run.smithi182.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 baseos 72 k 2023-05-12T09:04:26.643 INFO:teuthology.orchestra.run.smithi182.stdout:Upgrading: 2023-05-12T09:04:26.643 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-05-12T09:04:26.643 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-05-12T09:04:26.643 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-05-12T09:04:26.644 INFO:teuthology.orchestra.run.smithi182.stdout: librados2 x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 3.7 M 2023-05-12T09:04:26.644 INFO:teuthology.orchestra.run.smithi182.stdout: librbd1 x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 3.6 M 2023-05-12T09:04:26.644 INFO:teuthology.orchestra.run.smithi182.stdout:Installing dependencies: 2023-05-12T09:04:26.644 INFO:teuthology.orchestra.run.smithi182.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-05-12T09:04:26.644 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-common x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 22 M 2023-05-12T09:04:26.644 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 23 k 2023-05-12T09:04:26.644 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mds x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 2.3 M 2023-05-12T09:04:26.645 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 240 k 2023-05-12T09:04:26.645 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mon x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 4.6 M 2023-05-12T09:04:26.645 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-osd x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 18 M 2023-05-12T09:04:26.645 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3871.g5a6b166b.el8 ceph-noarch 15 k 2023-05-12T09:04:26.645 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-selinux x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 24 k 2023-05-12T09:04:26.645 INFO:teuthology.orchestra.run.smithi182.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-05-12T09:04:26.645 INFO:teuthology.orchestra.run.smithi182.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-12T09:04:26.646 INFO:teuthology.orchestra.run.smithi182.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-05-12T09:04:26.646 INFO:teuthology.orchestra.run.smithi182.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-05-12T09:04:26.646 INFO:teuthology.orchestra.run.smithi182.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-05-12T09:04:26.646 INFO:teuthology.orchestra.run.smithi182.stdout: libcephsqlite x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 137 k 2023-05-12T09:04:26.646 INFO:teuthology.orchestra.run.smithi182.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-05-12T09:04:26.646 INFO:teuthology.orchestra.run.smithi182.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-05-12T09:04:26.647 INFO:teuthology.orchestra.run.smithi182.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-12T09:04:26.647 INFO:teuthology.orchestra.run.smithi182.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-05-12T09:04:26.647 INFO:teuthology.orchestra.run.smithi182.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-05-12T09:04:26.647 INFO:teuthology.orchestra.run.smithi182.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-05-12T09:04:26.647 INFO:teuthology.orchestra.run.smithi182.stdout: libradosstriper1 x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 473 k 2023-05-12T09:04:26.648 INFO:teuthology.orchestra.run.smithi182.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-05-12T09:04:26.648 INFO:teuthology.orchestra.run.smithi182.stdout: librgw2 x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 6.5 M 2023-05-12T09:04:26.648 INFO:teuthology.orchestra.run.smithi182.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-05-12T09:04:26.648 INFO:teuthology.orchestra.run.smithi182.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-05-12T09:04:26.648 INFO:teuthology.orchestra.run.smithi182.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-12T09:04:26.648 INFO:teuthology.orchestra.run.smithi182.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-05-12T09:04:26.649 INFO:teuthology.orchestra.run.smithi182.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-05-12T09:04:26.649 INFO:teuthology.orchestra.run.smithi182.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-05-12T09:04:26.649 INFO:teuthology.orchestra.run.smithi182.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-05-12T09:04:26.649 INFO:teuthology.orchestra.run.smithi182.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-05-12T09:04:26.649 INFO:teuthology.orchestra.run.smithi182.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-05-12T09:04:26.649 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-05-12T09:04:26.649 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-05-12T09:04:26.649 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-05-12T09:04:26.650 INFO:teuthology.orchestra.run.smithi182.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-12T09:04:26.650 INFO:teuthology.orchestra.run.smithi182.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-05-12T09:04:26.650 INFO:teuthology.orchestra.run.smithi182.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-12T09:04:26.650 INFO:teuthology.orchestra.run.smithi182.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-12T09:04:26.650 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-12T09:04:26.650 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-argparse x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 45 k 2023-05-12T09:04:26.650 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-common x86_64 2:18.0.0-3871.g5a6b166b.el8 ceph 119 k 2023-05-12T09:04:26.651 INFO:teuthology.orchestra.run.smithi182.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-12T09:04:26.651 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cffi x86_64 1.11.5-5.el8 baseos 237 k 2023-05-12T09:04:26.651 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-12T09:04:26.651 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-12T09:04:26.651 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cryptography x86_64 3.2.1-5.el8 baseos 559 k 2023-05-12T09:04:26.651 INFO:teuthology.orchestra.run.smithi182.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-12T09:04:26.651 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-12T09:04:26.652 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-12T09:04:26.652 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-05-12T09:04:26.652 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-05-12T09:04:26.652 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-05-12T09:04:26.652 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-05-12T09:04:26.652 INFO:teuthology.orchestra.run.smithi182.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-12T09:04:26.652 INFO:teuthology.orchestra.run.smithi182.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-12T09:04:26.652 INFO:teuthology.orchestra.run.smithi182.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-05-12T09:04:26.653 INFO:teuthology.orchestra.run.smithi182.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-05-12T09:04:26.653 INFO:teuthology.orchestra.run.smithi182.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-12T09:04:26.653 INFO:teuthology.orchestra.run.smithi182.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-12T09:04:26.653 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-05-12T09:04:26.653 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-05-12T09:04:26.653 INFO:teuthology.orchestra.run.smithi182.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-05-12T09:04:26.653 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-12T09:04:26.654 INFO:teuthology.orchestra.run.smithi182.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-12T09:04:26.654 INFO:teuthology.orchestra.run.smithi182.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-05-12T09:04:26.654 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-05-12T09:04:26.654 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-05-12T09:04:26.654 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-05-12T09:04:26.654 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-05-12T09:04:26.654 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-05-12T09:04:26.655 INFO:teuthology.orchestra.run.smithi182.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-12T09:04:26.655 INFO:teuthology.orchestra.run.smithi182.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-05-12T09:04:26.655 INFO:teuthology.orchestra.run.smithi182.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-12T09:04:26.655 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-12T09:04:26.655 INFO:teuthology.orchestra.run.smithi182.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-05-12T09:04:26.655 INFO:teuthology.orchestra.run.smithi182.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-12T09:04:26.655 INFO:teuthology.orchestra.run.smithi182.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-12T09:04:26.655 INFO:teuthology.orchestra.run.smithi182.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-12T09:04:26.656 INFO:teuthology.orchestra.run.smithi182.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-12T09:04:26.656 INFO:teuthology.orchestra.run.smithi182.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-12T09:04:26.656 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-12T09:04:26.656 INFO:teuthology.orchestra.run.smithi182.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-12T09:04:26.656 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-12T09:04:26.656 INFO:teuthology.orchestra.run.smithi182.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-05-12T09:04:26.656 INFO:teuthology.orchestra.run.smithi182.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-12T09:04:26.657 INFO:teuthology.orchestra.run.smithi182.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-05-12T09:04:26.657 INFO:teuthology.orchestra.run.smithi182.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-12T09:04:26.657 INFO:teuthology.orchestra.run.smithi182.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-05-12T09:04:26.657 INFO:teuthology.orchestra.run.smithi182.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-05-12T09:04:26.657 INFO:teuthology.orchestra.run.smithi182.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-05-12T09:04:26.657 INFO:teuthology.orchestra.run.smithi182.stdout:Enabling module streams: 2023-05-12T09:04:26.657 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql 10 2023-05-12T09:04:26.657 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:04:26.658 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2023-05-12T09:04:26.658 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================================ 2023-05-12T09:04:26.658 INFO:teuthology.orchestra.run.smithi182.stdout:Install 128 Packages 2023-05-12T09:04:26.658 INFO:teuthology.orchestra.run.smithi182.stdout:Upgrade 5 Packages 2023-05-12T09:04:26.658 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:04:26.659 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 197 M 2023-05-12T09:04:26.659 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading Packages: 2023-05-12T09:04:27.155 INFO:teuthology.orchestra.run.smithi182.stdout:(1/133): ceph-18.0.0-3871.g5a6b166b.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2023-05-12T09:04:27.347 INFO:teuthology.orchestra.run.smithi182.stdout:(2/133): ceph-fuse-18.0.0-3871.g5a6b166b.el8.x8 4.3 MB/s | 848 kB 00:00 2023-05-12T09:04:27.406 INFO:teuthology.orchestra.run.smithi182.stdout:(3/133): ceph-immutable-object-cache-18.0.0-387 2.8 MB/s | 166 kB 00:00 2023-05-12T09:04:27.731 INFO:teuthology.orchestra.run.smithi182.stdout:(4/133): ceph-mds-18.0.0-3871.g5a6b166b.el8.x86 7.0 MB/s | 2.3 MB 00:00 2023-05-12T09:04:27.806 INFO:teuthology.orchestra.run.smithi182.stdout:(5/133): ceph-base-18.0.0-3871.g5a6b166b.el8.x8 6.9 MB/s | 5.3 MB 00:00 2023-05-12T09:04:27.965 INFO:teuthology.orchestra.run.smithi182.stdout:(6/133): ceph-mgr-18.0.0-3871.g5a6b166b.el8.x86 6.6 MB/s | 1.5 MB 00:00 2023-05-12T09:04:28.340 INFO:teuthology.orchestra.run.smithi182.stdout:(7/133): ceph-mon-18.0.0-3871.g5a6b166b.el8.x86 8.6 MB/s | 4.6 MB 00:00 2023-05-12T09:04:29.424 INFO:teuthology.orchestra.run.smithi182.stdout:(8/133): ceph-common-18.0.0-3871.g5a6b166b.el8. 9.0 MB/s | 22 MB 00:02 2023-05-12T09:04:29.490 INFO:teuthology.orchestra.run.smithi182.stdout:(9/133): ceph-selinux-18.0.0-3871.g5a6b166b.el8 368 kB/s | 24 kB 00:00 2023-05-12T09:04:29.783 INFO:teuthology.orchestra.run.smithi182.stdout:(10/133): ceph-radosgw-18.0.0-3871.g5a6b166b.el 9.0 MB/s | 13 MB 00:01 2023-05-12T09:04:29.983 INFO:teuthology.orchestra.run.smithi182.stdout:(11/133): ceph-osd-18.0.0-3871.g5a6b166b.el8.x8 8.8 MB/s | 18 MB 00:02 2023-05-12T09:04:30.016 INFO:teuthology.orchestra.run.smithi182.stdout:(12/133): cephfs-mirror-18.0.0-3871.g5a6b166b.e 1.1 MB/s | 258 kB 00:00 2023-05-12T09:04:30.042 INFO:teuthology.orchestra.run.smithi182.stdout:(13/133): libcephfs-devel-18.0.0-3871.g5a6b166b 533 kB/s | 31 kB 00:00 2023-05-12T09:04:30.092 INFO:teuthology.orchestra.run.smithi182.stdout:(14/133): libcephfs2-18.0.0-3871.g5a6b166b.el8. 10 MB/s | 772 kB 00:00 2023-05-12T09:04:30.117 INFO:teuthology.orchestra.run.smithi182.stdout:(15/133): libcephsqlite-18.0.0-3871.g5a6b166b.e 1.8 MB/s | 137 kB 00:00 2023-05-12T09:04:30.159 INFO:teuthology.orchestra.run.smithi182.stdout:(16/133): librados-devel-18.0.0-3871.g5a6b166b. 2.0 MB/s | 139 kB 00:00 2023-05-12T09:04:30.193 INFO:teuthology.orchestra.run.smithi182.stdout:(17/133): libradosstriper1-18.0.0-3871.g5a6b166 6.2 MB/s | 473 kB 00:00 2023-05-12T09:04:30.268 INFO:teuthology.orchestra.run.smithi182.stdout:(18/133): python3-ceph-argparse-18.0.0-3871.g5a 596 kB/s | 45 kB 00:00 2023-05-12T09:04:30.374 INFO:teuthology.orchestra.run.smithi182.stdout:(19/133): python3-ceph-common-18.0.0-3871.g5a6b 1.1 MB/s | 119 kB 00:00 2023-05-12T09:04:30.452 INFO:teuthology.orchestra.run.smithi182.stdout:(20/133): python3-cephfs-18.0.0-3871.g5a6b166b. 2.5 MB/s | 197 kB 00:00 2023-05-12T09:04:30.544 INFO:teuthology.orchestra.run.smithi182.stdout:(21/133): python3-rados-18.0.0-3871.g5a6b166b.e 4.0 MB/s | 372 kB 00:00 2023-05-12T09:04:30.644 INFO:teuthology.orchestra.run.smithi182.stdout:(22/133): python3-rbd-18.0.0-3871.g5a6b166b.el8 3.6 MB/s | 365 kB 00:00 2023-05-12T09:04:30.720 INFO:teuthology.orchestra.run.smithi182.stdout:(23/133): python3-rgw-18.0.0-3871.g5a6b166b.el8 1.4 MB/s | 107 kB 00:00 2023-05-12T09:04:30.812 INFO:teuthology.orchestra.run.smithi182.stdout:(24/133): librgw2-18.0.0-3871.g5a6b166b.el8.x86 10 MB/s | 6.5 MB 00:00 2023-05-12T09:04:30.837 INFO:teuthology.orchestra.run.smithi182.stdout:(25/133): rbd-fuse-18.0.0-3871.g5a6b166b.el8.x8 806 kB/s | 94 kB 00:00 2023-05-12T09:04:30.920 INFO:teuthology.orchestra.run.smithi182.stdout:(26/133): rbd-nbd-18.0.0-3871.g5a6b166b.el8.x86 2.1 MB/s | 179 kB 00:00 2023-05-12T09:04:30.996 INFO:teuthology.orchestra.run.smithi182.stdout:(27/133): ceph-grafana-dashboards-18.0.0-3871.g 308 kB/s | 23 kB 00:00 2023-05-12T09:04:31.079 INFO:teuthology.orchestra.run.smithi182.stdout:(28/133): ceph-mgr-cephadm-18.0.0-3871.g5a6b166 1.5 MB/s | 127 kB 00:00 2023-05-12T09:04:31.171 INFO:teuthology.orchestra.run.smithi182.stdout:(29/133): rbd-mirror-18.0.0-3871.g5a6b166b.el8. 9.6 MB/s | 3.4 MB 00:00 2023-05-12T09:04:31.305 INFO:teuthology.orchestra.run.smithi182.stdout:(30/133): ceph-mgr-dashboard-18.0.0-3871.g5a6b1 7.6 MB/s | 1.7 MB 00:00 2023-05-12T09:04:31.397 INFO:teuthology.orchestra.run.smithi182.stdout:(31/133): ceph-mgr-modules-core-18.0.0-3871.g5a 2.6 MB/s | 240 kB 00:00 2023-05-12T09:04:31.481 INFO:teuthology.orchestra.run.smithi182.stdout:(32/133): ceph-mgr-rook-18.0.0-3871.g5a6b166b.e 571 kB/s | 47 kB 00:00 2023-05-12T09:04:31.556 INFO:teuthology.orchestra.run.smithi182.stdout:(33/133): ceph-prometheus-alerts-18.0.0-3871.g5 194 kB/s | 15 kB 00:00 2023-05-12T09:04:31.648 INFO:teuthology.orchestra.run.smithi182.stdout:(34/133): ceph-volume-18.0.0-3871.g5a6b166b.el8 2.8 MB/s | 265 kB 00:00 2023-05-12T09:04:31.731 INFO:teuthology.orchestra.run.smithi182.stdout:(35/133): cephadm-18.0.0-3871.g5a6b166b.el8.noa 1.0 MB/s | 83 kB 00:00 2023-05-12T09:04:31.806 INFO:teuthology.orchestra.run.smithi182.stdout:(36/133): cephfs-top-18.0.0-3871.g5a6b166b.el8. 240 kB/s | 18 kB 00:00 2023-05-12T09:04:31.932 INFO:teuthology.orchestra.run.smithi182.stdout:(37/133): ceph-mgr-diskprediction-local-18.0.0- 9.7 MB/s | 7.4 MB 00:00 2023-05-12T09:04:32.082 INFO:teuthology.orchestra.run.smithi182.stdout:(38/133): automake-1.16.1-7.el8.noarch.rpm 2.5 MB/s | 713 kB 00:00 2023-05-12T09:04:32.475 INFO:teuthology.orchestra.run.smithi182.stdout:(39/133): ceph-test-18.0.0-3871.g5a6b166b.el8.x 14 MB/s | 41 MB 00:02 2023-05-12T09:04:32.508 INFO:teuthology.orchestra.run.smithi182.stdout:(40/133): flex-2.6.1-9.el8.x86_64.rpm 751 kB/s | 320 kB 00:00 2023-05-12T09:04:32.558 INFO:teuthology.orchestra.run.smithi182.stdout:(41/133): bison-3.0.4-10.el8.x86_64.rpm 1.1 MB/s | 688 kB 00:00 2023-05-12T09:04:32.584 INFO:teuthology.orchestra.run.smithi182.stdout:(42/133): libpq-13.5-1.el8.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2023-05-12T09:04:32.634 INFO:teuthology.orchestra.run.smithi182.stdout:(43/133): librdkafka-0.11.4-3.el8.x86_64.rpm 4.6 MB/s | 354 kB 00:00 2023-05-12T09:04:32.659 INFO:teuthology.orchestra.run.smithi182.stdout:(44/133): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2023-05-12T09:04:32.693 INFO:teuthology.orchestra.run.smithi182.stdout:(45/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-05-12T09:04:32.735 INFO:teuthology.orchestra.run.smithi182.stdout:(46/133): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2023-05-12T09:04:32.777 INFO:teuthology.orchestra.run.smithi182.stdout:(47/133): oniguruma-6.8.2-2.el8.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-05-12T09:04:32.969 INFO:teuthology.orchestra.run.smithi182.stdout:(48/133): postgresql-10.23-1.module_el8+300+2c5 8.2 MB/s | 1.6 MB 00:00 2023-05-12T09:04:33.103 INFO:teuthology.orchestra.run.smithi182.stdout:(49/133): postgresql-contrib-10.23-1.module_el8 6.6 MB/s | 903 kB 00:00 2023-05-12T09:04:33.244 INFO:teuthology.orchestra.run.smithi182.stdout:(50/133): openblas-0.3.15-4.el8.x86_64.rpm 8.6 MB/s | 4.7 MB 00:00 2023-05-12T09:04:33.344 INFO:teuthology.orchestra.run.smithi182.stdout:(51/133): openblas-threads-0.3.15-4.el8.x86_64. 8.0 MB/s | 4.9 MB 00:00 2023-05-12T09:04:33.428 INFO:teuthology.orchestra.run.smithi182.stdout:(52/133): python3-jinja2-2.10.1-3.el8.noarch.rp 6.3 MB/s | 538 kB 00:00 2023-05-12T09:04:33.478 INFO:teuthology.orchestra.run.smithi182.stdout:(53/133): python3-jsonpatch-1.21-2.el8.noarch.r 537 kB/s | 27 kB 00:00 2023-05-12T09:04:33.529 INFO:teuthology.orchestra.run.smithi182.stdout:(54/133): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-05-12T09:04:33.596 INFO:teuthology.orchestra.run.smithi182.stdout:(55/133): python3-mako-1.0.6-14.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-05-12T09:04:33.646 INFO:teuthology.orchestra.run.smithi182.stdout:(56/133): python3-markupsafe-0.23-19.el8.x86_64 780 kB/s | 39 kB 00:00 2023-05-12T09:04:33.779 INFO:teuthology.orchestra.run.smithi182.stdout:(57/133): postgresql-server-10.23-1.module_el8+ 7.6 MB/s | 5.1 MB 00:00 2023-05-12T09:04:33.838 INFO:teuthology.orchestra.run.smithi182.stdout:(58/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-05-12T09:04:33.905 INFO:teuthology.orchestra.run.smithi182.stdout:(59/133): python3-babel-2.5.1-7.el8.noarch.rpm 7.3 MB/s | 4.8 MB 00:00 2023-05-12T09:04:33.930 INFO:teuthology.orchestra.run.smithi182.stdout:(60/133): python3-prettytable-0.7.2-14.el8.noar 478 kB/s | 44 kB 00:00 2023-05-12T09:04:33.964 INFO:teuthology.orchestra.run.smithi182.stdout:(61/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-05-12T09:04:33.989 INFO:teuthology.orchestra.run.smithi182.stdout:(62/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-05-12T09:04:34.023 INFO:teuthology.orchestra.run.smithi182.stdout:(63/133): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-05-12T09:04:34.048 INFO:teuthology.orchestra.run.smithi182.stdout:(64/133): python3-pytz-2017.2-9.el8.noarch.rpm 925 kB/s | 54 kB 00:00 2023-05-12T09:04:34.132 INFO:teuthology.orchestra.run.smithi182.stdout:(65/133): python3-werkzeug-0.12.2-4.el8.noarch. 5.4 MB/s | 457 kB 00:00 2023-05-12T09:04:34.199 INFO:teuthology.orchestra.run.smithi182.stdout:(66/133): python3-numpy-1.14.3-10.el8.x86_64.rp 6.8 MB/s | 3.7 MB 00:00 2023-05-12T09:04:34.274 INFO:teuthology.orchestra.run.smithi182.stdout:(67/133): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-05-12T09:04:34.291 INFO:teuthology.orchestra.run.smithi182.stdout:(68/133): uuid-1.6.2-43.el8.x86_64.rpm 696 kB/s | 64 kB 00:00 2023-05-12T09:04:34.333 INFO:teuthology.orchestra.run.smithi182.stdout:(69/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-05-12T09:04:34.475 INFO:teuthology.orchestra.run.smithi182.stdout:(70/133): elfutils-libelf-devel-0.189-2.el8.x86 335 kB/s | 61 kB 00:00 2023-05-12T09:04:34.501 INFO:teuthology.orchestra.run.smithi182.stdout:(71/133): fuse-2.9.7-17.el8.x86_64.rpm 497 kB/s | 83 kB 00:00 2023-05-12T09:04:34.584 INFO:teuthology.orchestra.run.smithi182.stdout:(72/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 443 kB/s | 48 kB 00:00 2023-05-12T09:04:34.651 INFO:teuthology.orchestra.run.smithi182.stdout:(73/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 281 kB/s | 19 kB 00:00 2023-05-12T09:04:34.718 INFO:teuthology.orchestra.run.smithi182.stdout:(74/133): libcom_err-devel-1.45.6-5.el8.x86_64. 581 kB/s | 39 kB 00:00 2023-05-12T09:04:34.993 INFO:teuthology.orchestra.run.smithi182.stdout:(75/133): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.1 MB/s | 561 kB 00:00 2023-05-12T09:04:35.152 INFO:teuthology.orchestra.run.smithi182.stdout:(76/133): libquadmath-8.5.0-19.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2023-05-12T09:04:35.219 INFO:teuthology.orchestra.run.smithi182.stdout:(77/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 704 kB/s | 47 kB 00:00 2023-05-12T09:04:35.278 INFO:teuthology.orchestra.run.smithi182.stdout:(78/133): libgfortran-8.5.0-19.el8.x86_64.rpm 1.1 MB/s | 645 kB 00:00 2023-05-12T09:04:35.353 INFO:teuthology.orchestra.run.smithi182.stdout:(79/133): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-05-12T09:04:35.386 INFO:teuthology.orchestra.run.smithi182.stdout:(80/133): libselinux-devel-2.9-8.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2023-05-12T09:04:35.436 INFO:teuthology.orchestra.run.smithi182.stdout:(81/133): libverto-devel-0.3.2-2.el8.x86_64.rpm 362 kB/s | 18 kB 00:00 2023-05-12T09:04:35.462 INFO:teuthology.orchestra.run.smithi182.stdout:(82/133): libuuid-devel-2.32.1-41.el8.x86_64.rp 911 kB/s | 99 kB 00:00 2023-05-12T09:04:35.604 INFO:teuthology.orchestra.run.smithi182.stdout:(83/133): python3-scipy-1.0.0-21.module_el8.5.0 8.7 MB/s | 14 MB 00:01 2023-05-12T09:04:35.629 INFO:teuthology.orchestra.run.smithi182.stdout:(84/133): libzstd-devel-1.4.4-1.el8.x86_64.rpm 228 kB/s | 44 kB 00:00 2023-05-12T09:04:35.730 INFO:teuthology.orchestra.run.smithi182.stdout:(85/133): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-05-12T09:04:35.780 INFO:teuthology.orchestra.run.smithi182.stdout:(86/133): pcre2-utf32-10.32-3.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-05-12T09:04:35.822 INFO:teuthology.orchestra.run.smithi182.stdout:(87/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 237 kB 00:00 2023-05-12T09:04:35.889 INFO:teuthology.orchestra.run.smithi182.stdout:(88/133): pcre2-devel-10.32-3.el8.x86_64.rpm 2.1 MB/s | 605 kB 00:00 2023-05-12T09:04:35.914 INFO:teuthology.orchestra.run.smithi182.stdout:(89/133): python3-cryptography-3.2.1-5.el8.x86_ 5.9 MB/s | 559 kB 00:00 2023-05-12T09:04:35.939 INFO:teuthology.orchestra.run.smithi182.stdout:(90/133): python3-jwt-1.6.1-2.el8.noarch.rpm 854 kB/s | 43 kB 00:00 2023-05-12T09:04:35.965 INFO:teuthology.orchestra.run.smithi182.stdout:(91/133): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-05-12T09:04:35.998 INFO:teuthology.orchestra.run.smithi182.stdout:(92/133): python3-requests-oauthlib-1.0.0-1.el8 1.3 MB/s | 43 kB 00:00 2023-05-12T09:04:36.024 INFO:teuthology.orchestra.run.smithi182.stdout:(93/133): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2023-05-12T09:04:36.049 INFO:teuthology.orchestra.run.smithi182.stdout:(94/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-05-12T09:04:36.083 INFO:teuthology.orchestra.run.smithi182.stdout:(95/133): zlib-devel-1.2.11-21.el8.x86_64.rpm 988 kB/s | 58 kB 00:00 2023-05-12T09:04:36.250 INFO:teuthology.orchestra.run.smithi182.stdout:(96/133): openssl-devel-1.1.1k-9.el8.x86_64.rpm 4.0 MB/s | 3.2 MB 00:00 2023-05-12T09:04:36.408 INFO:teuthology.orchestra.run.smithi182.stdout:(97/133): liboath-2.6.2-3.el8.x86_64.rpm 181 kB/s | 59 kB 00:00 2023-05-12T09:04:36.492 INFO:teuthology.orchestra.run.smithi182.stdout:(98/133): gperftools-libs-2.7-9.el8.x86_64.rpm 692 kB/s | 306 kB 00:00 2023-05-12T09:04:36.559 INFO:teuthology.orchestra.run.smithi182.stdout:(99/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 657 kB/s | 44 kB 00:00 2023-05-12T09:04:36.584 INFO:teuthology.orchestra.run.smithi182.stdout:(100/133): libunwind-1.3.1-3.el8.x86_64.rpm 225 kB/s | 75 kB 00:00 2023-05-12T09:04:36.659 INFO:teuthology.orchestra.run.smithi182.stdout:(101/133): python3-asyncssh-2.7.0-2.el8.noarch. 1.9 MB/s | 476 kB 00:00 2023-05-12T09:04:36.676 INFO:teuthology.orchestra.run.smithi182.stdout:(102/133): python3-cachetools-3.1.1-4.el8.noarc 359 kB/s | 33 kB 00:00 2023-05-12T09:04:36.702 INFO:teuthology.orchestra.run.smithi182.stdout:(103/133): python3-beautifulsoup4-4.6.3-2.el8.1 1.3 MB/s | 185 kB 00:00 2023-05-12T09:04:36.719 INFO:teuthology.orchestra.run.smithi182.stdout:(104/133): python3-certifi-2018.10.15-7.el8.noa 277 kB/s | 16 kB 00:00 2023-05-12T09:04:36.794 INFO:teuthology.orchestra.run.smithi182.stdout:(105/133): python3-google-auth-1.1.1-10.el8.noa 1.1 MB/s | 81 kB 00:00 2023-05-12T09:04:36.853 INFO:teuthology.orchestra.run.smithi182.stdout:(106/133): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-05-12T09:04:36.878 INFO:teuthology.orchestra.run.smithi182.stdout:(107/133): python3-cheroot-8.5.2-1.el8.noarch.r 859 kB/s | 173 kB 00:00 2023-05-12T09:04:36.903 INFO:teuthology.orchestra.run.smithi182.stdout:(108/133): python3-cherrypy-18.4.0-1.el8.noarch 1.9 MB/s | 384 kB 00:00 2023-05-12T09:04:36.920 INFO:teuthology.orchestra.run.smithi182.stdout:(109/133): python3-jaraco-functools-2.0-4.el8.n 262 kB/s | 18 kB 00:00 2023-05-12T09:04:36.979 INFO:teuthology.orchestra.run.smithi182.stdout:(110/133): python3-more-itertools-7.2.0-3.el8.n 1.0 MB/s | 59 kB 00:00 2023-05-12T09:04:37.037 INFO:teuthology.orchestra.run.smithi182.stdout:(111/133): python3-natsort-7.1.1-2.el8.noarch.r 1.0 MB/s | 60 kB 00:00 2023-05-12T09:04:37.188 INFO:teuthology.orchestra.run.smithi182.stdout:(112/133): python3-logutils-0.3.5-11.el8.noarch 171 kB/s | 49 kB 00:00 2023-05-12T09:04:37.213 INFO:teuthology.orchestra.run.smithi182.stdout:(113/133): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-05-12T09:04:37.246 INFO:teuthology.orchestra.run.smithi182.stdout:(114/133): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2023-05-12T09:04:37.271 INFO:teuthology.orchestra.run.smithi182.stdout:(115/133): python3-repoze-lru-0.7-6.el8.noarch. 573 kB/s | 34 kB 00:00 2023-05-12T09:04:37.347 INFO:teuthology.orchestra.run.smithi182.stdout:(116/133): python3-rsa-4.8-1.el8.noarch.rpm 821 kB/s | 61 kB 00:00 2023-05-12T09:04:37.414 INFO:teuthology.orchestra.run.smithi182.stdout:(117/133): python3-simplegeneric-0.8.1-17.el8.n 281 kB/s | 19 kB 00:00 2023-05-12T09:04:37.447 INFO:teuthology.orchestra.run.smithi182.stdout:(118/133): python3-kubernetes-11.0.0-6.el8.noar 2.0 MB/s | 1.2 MB 00:00 2023-05-12T09:04:37.472 INFO:teuthology.orchestra.run.smithi182.stdout:(119/133): python3-routes-2.4.1-12.el8.noarch.r 869 kB/s | 196 kB 00:00 2023-05-12T09:04:37.498 INFO:teuthology.orchestra.run.smithi182.stdout:(120/133): python3-singledispatch-3.4.0.3-18.el 286 kB/s | 24 kB 00:00 2023-05-12T09:04:37.523 INFO:teuthology.orchestra.run.smithi182.stdout:(121/133): python3-tempora-1.14.1-5.el8.noarch. 387 kB/s | 29 kB 00:00 2023-05-12T09:04:37.548 INFO:teuthology.orchestra.run.smithi182.stdout:(122/133): python3-trustme-0.6.0-4.el8.noarch.r 364 kB/s | 27 kB 00:00 2023-05-12T09:04:37.624 INFO:teuthology.orchestra.run.smithi182.stdout:(123/133): python3-waitress-1.2.1-2.el8.1.noarc 1.9 MB/s | 241 kB 00:00 2023-05-12T09:04:37.649 INFO:teuthology.orchestra.run.smithi182.stdout:(124/133): python3-websocket-client-0.56.0-5.el 609 kB/s | 61 kB 00:00 2023-05-12T09:04:37.683 INFO:teuthology.orchestra.run.smithi182.stdout:(125/133): python3-webob-1.8.5-1.el8.1.noarch.r 1.5 MB/s | 251 kB 00:00 2023-05-12T09:04:37.708 INFO:teuthology.orchestra.run.smithi182.stdout:(126/133): python3-webtest-2.0.33-1.el8.noarch. 1.0 MB/s | 85 kB 00:00 2023-05-12T09:04:37.733 INFO:teuthology.orchestra.run.smithi182.stdout:(127/133): python3-zc-lockfile-2.0-2.el8.noarch 274 kB/s | 23 kB 00:00 2023-05-12T09:04:38.075 INFO:teuthology.orchestra.run.smithi182.stdout:(128/133): librados2-18.0.0-3871.g5a6b166b.el8. 10 MB/s | 3.7 MB 00:00 2023-05-12T09:04:38.142 INFO:teuthology.orchestra.run.smithi182.stdout:(129/133): librbd1-18.0.0-3871.g5a6b166b.el8.x8 8.7 MB/s | 3.6 MB 00:00 2023-05-12T09:04:38.192 INFO:teuthology.orchestra.run.smithi182.stdout:(130/133): elfutils-debuginfod-client-0.189-2.e 650 kB/s | 76 kB 00:00 2023-05-12T09:04:38.309 INFO:teuthology.orchestra.run.smithi182.stdout:(131/133): elfutils-libs-0.189-2.el8.x86_64.rpm 2.5 MB/s | 302 kB 00:00 2023-05-12T09:04:38.451 INFO:teuthology.orchestra.run.smithi182.stdout:(132/133): elfutils-libelf-0.189-2.el8.x86_64.r 751 kB/s | 232 kB 00:00 2023-05-12T09:04:38.660 INFO:teuthology.orchestra.run.smithi182.stdout:(133/133): thrift-0.13.0-2.el8.x86_64.rpm 1.8 MB/s | 1.7 MB 00:00 2023-05-12T09:04:38.665 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2023-05-12T09:04:38.665 INFO:teuthology.orchestra.run.smithi182.stdout:Total 16 MB/s | 197 MB 00:12 2023-05-12T09:04:40.057 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2023-05-12T09:04:40.317 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction check succeeded. 2023-05-12T09:04:40.317 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2023-05-12T09:04:42.306 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded. 2023-05-12T09:04:42.309 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2023-05-12T09:04:47.184 INFO:teuthology.orchestra.run.smithi182.stdout: Preparing : 1/1 2023-05-12T09:04:47.371 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/138 2023-05-12T09:04:47.561 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/138 2023-05-12T09:04:47.756 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/138 2023-05-12T09:04:47.939 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-12T09:04:48.393 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-12T09:04:48.597 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : librados2-2:18.0.0-3871.g5a6b166b.el8.x86_64 5/138 2023-05-12T09:04:49.054 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librados2-2:18.0.0-3871.g5a6b166b.el8.x86_64 5/138 2023-05-12T09:04:49.239 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : librbd1-2:18.0.0-3871.g5a6b166b.el8.x86_64 6/138 2023-05-12T09:04:49.370 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librbd1-2:18.0.0-3871.g5a6b166b.el8.x86_64 6/138 2023-05-12T09:04:49.564 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcephfs2-2:18.0.0-3871.g5a6b166b.el8.x86_64 7/138 2023-05-12T09:04:49.676 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libcephfs2-2:18.0.0-3871.g5a6b166b.el8.x86_64 7/138 2023-05-12T09:04:49.906 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rados-2:18.0.0-3871.g5a6b166b.el8.x86_64 8/138 2023-05-12T09:04:50.097 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-12T09:04:50.208 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-12T09:04:50.436 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 10/138 2023-05-12T09:04:50.704 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/138 2023-05-12T09:04:50.951 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2023-05-12T09:04:51.407 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libpq-13.5-1.el8.x86_64 13/138 2023-05-12T09:04:51.644 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 14/138 2023-05-12T09:04:51.789 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcephsqlite-2:18.0.0-3871.g5a6b166b.el8.x86_64 15/138 2023-05-12T09:04:51.893 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3871.g5a6b166b.el8.x86_64 15/138 2023-05-12T09:04:52.072 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libradosstriper1-2:18.0.0-3871.g5a6b166b.el8.x86 16/138 2023-05-12T09:04:52.216 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3871.g5a6b166b.el8.x86 16/138 2023-05-12T09:04:52.497 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 17/138 2023-05-12T09:04:52.674 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 18/138 2023-05-12T09:04:52.830 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-12T09:04:52.974 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-12T09:04:53.113 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-12T09:04:53.787 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-12T09:04:53.996 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : openblas-0.3.15-4.el8.x86_64 21/138 2023-05-12T09:04:54.682 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 21/138 2023-05-12T09:04:54.813 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-12T09:04:55.621 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-12T09:04:55.989 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/138 2023-05-12T09:04:56.180 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/138 2023-05-12T09:04:56.378 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/138 2023-05-12T09:04:56.608 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/138 2023-05-12T09:04:56.812 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-ceph-common-2:18.0.0-3871.g5a6b166b.el8. 27/138 2023-05-12T09:04:56.942 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-ceph-argparse-2:18.0.0-3871.g5a6b166b.el 28/138 2023-05-12T09:04:57.162 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cephfs-2:18.0.0-3871.g5a6b166b.el8.x86_6 29/138 2023-05-12T09:04:58.364 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 30/138 2023-05-12T09:04:58.717 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2023-05-12T09:04:59.006 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2023-05-12T09:04:59.212 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-12T09:05:01.296 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-12T09:05:01.600 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 34/138 2023-05-12T09:05:01.803 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/138 2023-05-12T09:05:02.032 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/138 2023-05-12T09:05:02.212 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 37/138 2023-05-12T09:05:02.400 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 38/138 2023-05-12T09:05:02.611 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 39/138 2023-05-12T09:05:02.772 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librados-devel-2:18.0.0-3871.g5a6b166b.el8.x86_6 40/138 2023-05-12T09:05:02.945 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 41/138 2023-05-12T09:05:03.174 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 42/138 2023-05-12T09:05:03.411 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 43/138 2023-05-12T09:05:03.575 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 44/138 2023-05-12T09:05:03.741 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 45/138 2023-05-12T09:05:03.924 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 46/138 2023-05-12T09:05:04.160 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 47/138 2023-05-12T09:05:04.367 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 48/138 2023-05-12T09:05:04.531 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/138 2023-05-12T09:05:04.676 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/138 2023-05-12T09:05:04.858 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2023-05-12T09:05:05.034 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 52/138 2023-05-12T09:05:05.230 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-portend-2.6-1.el8.noarch 53/138 2023-05-12T09:05:05.388 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/138 2023-05-12T09:05:05.618 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/138 2023-05-12T09:05:05.850 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/138 2023-05-12T09:05:06.068 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/138 2023-05-12T09:05:06.429 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/138 2023-05-12T09:05:06.672 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 59/138 2023-05-12T09:05:06.858 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 60/138 2023-05-12T09:05:07.686 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 61/138 2023-05-12T09:05:07.886 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librgw2-2:18.0.0-3871.g5a6b166b.el8.x86_64 62/138 2023-05-12T09:05:07.975 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librgw2-2:18.0.0-3871.g5a6b166b.el8.x86_64 62/138 2023-05-12T09:05:08.180 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 63/138 2023-05-12T09:05:08.414 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/138 2023-05-12T09:05:08.818 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 65/138 2023-05-12T09:05:09.112 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 66/138 2023-05-12T09:05:09.284 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/138 2023-05-12T09:05:09.505 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/138 2023-05-12T09:05:09.754 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/138 2023-05-12T09:05:11.059 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/138 2023-05-12T09:05:11.437 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 71/138 2023-05-12T09:05:11.645 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/138 2023-05-12T09:05:11.896 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/138 2023-05-12T09:05:12.220 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 74/138 2023-05-12T09:05:12.451 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/138 2023-05-12T09:05:12.714 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/138 2023-05-12T09:05:12.964 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 77/138 2023-05-12T09:05:13.322 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 78/138 2023-05-12T09:05:13.524 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 79/138 2023-05-12T09:05:13.697 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 80/138 2023-05-12T09:05:13.860 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 81/138 2023-05-12T09:05:14.012 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-12T09:05:14.370 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 83/138 2023-05-12T09:05:14.617 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 84/138 2023-05-12T09:05:14.767 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 85/138 2023-05-12T09:05:15.003 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 86/138 2023-05-12T09:05:15.238 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 87/138 2023-05-12T09:05:15.446 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : fuse-2.9.7-17.el8.x86_64 88/138 2023-05-12T09:05:15.658 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 89/138 2023-05-12T09:05:15.870 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : uuid-1.6.2-43.el8.x86_64 90/138 2023-05-12T09:05:15.978 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 90/138 2023-05-12T09:05:16.195 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 91/138 2023-05-12T09:05:16.343 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 92/138 2023-05-12T09:05:19.393 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 93/138 2023-05-12T09:05:19.635 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 93/138 2023-05-12T09:05:20.321 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 93/138 2023-05-12T09:05:20.625 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-base-2:18.0.0-3871.g5a6b166b.el8.x86_64 94/138 2023-05-12T09:05:20.740 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-base-2:18.0.0-3871.g5a6b166b.el8.x86_64 94/138 2023-05-12T09:05:20.908 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-selinux-2:18.0.0-3871.g5a6b166b.el8.x86_64 95/138 2023-05-12T09:05:41.431 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3871.g5a6b166b.el8.x86_64 95/138 2023-05-12T09:05:41.431 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /sys 2023-05-12T09:05:41.432 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /proc 2023-05-12T09:05:41.432 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /dev 2023-05-12T09:05:41.432 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /run 2023-05-12T09:05:41.432 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /mnt 2023-05-12T09:05:41.432 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /var/tmp 2023-05-12T09:05:41.433 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /home 2023-05-12T09:05:41.433 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /tmp 2023-05-12T09:05:41.433 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /dev 2023-05-12T09:05:41.433 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:05:41.847 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-volume-2:18.0.0-3871.g5a6b166b.el8.noarch 96/138 2023-05-12T09:05:43.565 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-volume-2:18.0.0-3871.g5a6b166b.el8.noarch 96/138 2023-05-12T09:05:43.805 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-osd-2:18.0.0-3871.g5a6b166b.el8.x86_64 97/138 2023-05-12T09:05:44.067 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-osd-2:18.0.0-3871.g5a6b166b.el8.x86_64 97/138 2023-05-12T09:05:44.230 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mds-2:18.0.0-3871.g5a6b166b.el8.x86_64 98/138 2023-05-12T09:05:44.747 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mds-2:18.0.0-3871.g5a6b166b.el8.x86_64 98/138 2023-05-12T09:05:44.931 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mon-2:18.0.0-3871.g5a6b166b.el8.x86_64 99/138 2023-05-12T09:05:44.976 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mon-2:18.0.0-3871.g5a6b166b.el8.x86_64 99/138 2023-05-12T09:05:45.172 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 100/138 2023-05-12T09:05:45.402 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 101/138 2023-05-12T09:05:45.563 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-12T09:05:45.653 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-12T09:05:45.939 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : jq-1.6-7.el8.x86_64 103/138 2023-05-12T09:05:46.146 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : automake-1.16.1-7.el8.noarch 104/138 2023-05-12T09:05:46.742 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: cephadm-2:18.0.0-3871.g5a6b166b.el8.noarch 105/138 2023-05-12T09:05:46.932 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : cephadm-2:18.0.0-3871.g5a6b166b.el8.noarch 105/138 2023-05-12T09:05:47.063 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3871.g5a6b166b.e 106/138 2023-05-12T09:05:47.283 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3871.g5a6b166b. 107/138 2023-05-12T09:05:47.537 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3871.g5a6b166b.el8.noa 108/138 2023-05-12T09:05:47.787 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3871.g5a6b166b.el8.noa 108/138 2023-05-12T09:05:48.012 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3871.g5a6b166b.el8.n 109/138 2023-05-12T09:05:49.124 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3871.g5a6b166b.el8.n 109/138 2023-05-12T09:05:49.304 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3871.g5a6 110/138 2023-05-12T09:05:49.429 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3871.g5a6 110/138 2023-05-12T09:05:49.828 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3871.g5a6b166b.el 111/138 2023-05-12T09:05:50.029 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-2:18.0.0-3871.g5a6b166b.el8.x86_64 112/138 2023-05-12T09:05:50.090 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3871.g5a6b166b.el8.x86_64 112/138 2023-05-12T09:05:50.270 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-rook-2:18.0.0-3871.g5a6b166b.el8.noarch 113/138 2023-05-12T09:05:50.295 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3871.g5a6b166b.el8.noarch 113/138 2023-05-12T09:05:50.488 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-2:18.0.0-3871.g5a6b166b.el8.x86_64 114/138 2023-05-12T09:05:50.645 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/138 2023-05-12T09:05:55.013 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/138 2023-05-12T09:05:56.538 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-test-2:18.0.0-3871.g5a6b166b.el8.x86_64 116/138 2023-05-12T09:05:56.820 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-radosgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 117/138 2023-05-12T09:05:56.877 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 117/138 2023-05-12T09:05:57.057 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3871.g5a6b1 118/138 2023-05-12T09:05:57.119 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3871.g5a6b1 118/138 2023-05-12T09:05:57.303 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : cephfs-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 119/138 2023-05-12T09:05:57.704 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 119/138 2023-05-12T09:05:57.887 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : rbd-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 120/138 2023-05-12T09:05:58.151 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 120/138 2023-05-12T09:05:58.457 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 121/138 2023-05-12T09:05:59.644 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 122/138 2023-05-12T09:05:59.971 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 123/138 2023-05-12T09:06:00.124 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 124/138 2023-05-12T09:06:00.307 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 125/138 2023-05-12T09:06:00.487 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcephfs-devel-2:18.0.0-3871.g5a6b166b.el8.x86_ 126/138 2023-05-12T09:06:01.606 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-12T09:06:01.861 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-12T09:06:01.893 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-12T09:06:02.103 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : cephfs-top-2:18.0.0-3871.g5a6b166b.el8.noarch 128/138 2023-05-12T09:06:02.320 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : rbd-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 129/138 2023-05-12T09:06:02.546 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : rbd-nbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 130/138 2023-05-12T09:06:02.759 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2023-05-12T09:06:02.993 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2023-05-12T09:06:03.104 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2023-05-12T09:06:03.335 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2023-05-12T09:06:03.359 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2023-05-12T09:06:03.528 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-12T09:06:03.696 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 135/138 2023-05-12T09:06:03.696 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-12T09:06:03.924 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-12T09:06:03.925 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-12T09:06:04.171 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-12T09:06:04.369 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-12T09:06:04.564 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-12T09:06:04.564 INFO:teuthology.orchestra.run.smithi182.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-05-12T09:06:04.565 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:05.275 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-2:18.0.0-3871.g5a6b166b.el8.x86_64 1/138 2023-05-12T09:06:05.275 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-base-2:18.0.0-3871.g5a6b166b.el8.x86_64 2/138 2023-05-12T09:06:05.276 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 3/138 2023-05-12T09:06:05.276 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 4/138 2023-05-12T09:06:05.276 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3871.g5a6b1 5/138 2023-05-12T09:06:05.276 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mds-2:18.0.0-3871.g5a6b166b.el8.x86_64 6/138 2023-05-12T09:06:05.276 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-2:18.0.0-3871.g5a6b166b.el8.x86_64 7/138 2023-05-12T09:06:05.276 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mon-2:18.0.0-3871.g5a6b166b.el8.x86_64 8/138 2023-05-12T09:06:05.276 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-osd-2:18.0.0-3871.g5a6b166b.el8.x86_64 9/138 2023-05-12T09:06:05.277 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-radosgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 10/138 2023-05-12T09:06:05.277 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-selinux-2:18.0.0-3871.g5a6b166b.el8.x86_64 11/138 2023-05-12T09:06:05.277 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-test-2:18.0.0-3871.g5a6b166b.el8.x86_64 12/138 2023-05-12T09:06:05.277 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cephfs-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 13/138 2023-05-12T09:06:05.277 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcephfs-devel-2:18.0.0-3871.g5a6b166b.el8.x86_ 14/138 2023-05-12T09:06:05.278 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcephfs2-2:18.0.0-3871.g5a6b166b.el8.x86_64 15/138 2023-05-12T09:06:05.278 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcephsqlite-2:18.0.0-3871.g5a6b166b.el8.x86_64 16/138 2023-05-12T09:06:05.278 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librados-devel-2:18.0.0-3871.g5a6b166b.el8.x86_6 17/138 2023-05-12T09:06:05.278 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libradosstriper1-2:18.0.0-3871.g5a6b166b.el8.x86 18/138 2023-05-12T09:06:05.278 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librgw2-2:18.0.0-3871.g5a6b166b.el8.x86_64 19/138 2023-05-12T09:06:05.286 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3871.g5a6b166b.el 20/138 2023-05-12T09:06:05.286 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-ceph-common-2:18.0.0-3871.g5a6b166b.el8. 21/138 2023-05-12T09:06:05.286 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cephfs-2:18.0.0-3871.g5a6b166b.el8.x86_6 22/138 2023-05-12T09:06:05.286 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rados-2:18.0.0-3871.g5a6b166b.el8.x86_64 23/138 2023-05-12T09:06:05.286 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 24/138 2023-05-12T09:06:05.286 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 25/138 2023-05-12T09:06:05.287 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : rbd-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 26/138 2023-05-12T09:06:05.287 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : rbd-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 27/138 2023-05-12T09:06:05.287 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : rbd-nbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 28/138 2023-05-12T09:06:05.287 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3871.g5a6b166b. 29/138 2023-05-12T09:06:05.287 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3871.g5a6b166b.el8.noa 30/138 2023-05-12T09:06:05.287 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3871.g5a6b166b.el8.n 31/138 2023-05-12T09:06:05.287 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3871.g5a6 32/138 2023-05-12T09:06:05.288 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3871.g5a6b166b.el 33/138 2023-05-12T09:06:05.288 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3871.g5a6b166b.el8.noarch 34/138 2023-05-12T09:06:05.288 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3871.g5a6b166b.e 35/138 2023-05-12T09:06:05.288 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-volume-2:18.0.0-3871.g5a6b166b.el8.noarch 36/138 2023-05-12T09:06:05.288 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cephadm-2:18.0.0-3871.g5a6b166b.el8.noarch 37/138 2023-05-12T09:06:05.288 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cephfs-top-2:18.0.0-3871.g5a6b166b.el8.noarch 38/138 2023-05-12T09:06:05.288 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/138 2023-05-12T09:06:05.288 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/138 2023-05-12T09:06:05.289 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/138 2023-05-12T09:06:05.289 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : jq-1.6-7.el8.x86_64 42/138 2023-05-12T09:06:05.289 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/138 2023-05-12T09:06:05.289 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/138 2023-05-12T09:06:05.289 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/138 2023-05-12T09:06:05.289 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/138 2023-05-12T09:06:05.289 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/138 2023-05-12T09:06:05.290 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/138 2023-05-12T09:06:05.290 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/138 2023-05-12T09:06:05.290 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/138 2023-05-12T09:06:05.290 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/138 2023-05-12T09:06:05.290 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/138 2023-05-12T09:06:05.290 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/138 2023-05-12T09:06:05.290 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/138 2023-05-12T09:06:05.290 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/138 2023-05-12T09:06:05.291 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/138 2023-05-12T09:06:05.291 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/138 2023-05-12T09:06:05.291 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/138 2023-05-12T09:06:05.291 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/138 2023-05-12T09:06:05.291 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/138 2023-05-12T09:06:05.291 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/138 2023-05-12T09:06:05.291 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/138 2023-05-12T09:06:05.291 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/138 2023-05-12T09:06:05.292 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/138 2023-05-12T09:06:05.292 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/138 2023-05-12T09:06:05.292 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/138 2023-05-12T09:06:05.292 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/138 2023-05-12T09:06:05.292 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/138 2023-05-12T09:06:05.292 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/138 2023-05-12T09:06:05.292 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/138 2023-05-12T09:06:05.293 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/138 2023-05-12T09:06:05.293 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/138 2023-05-12T09:06:05.293 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/138 2023-05-12T09:06:05.293 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/138 2023-05-12T09:06:05.293 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/138 2023-05-12T09:06:05.293 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/138 2023-05-12T09:06:05.293 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/138 2023-05-12T09:06:05.293 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/138 2023-05-12T09:06:05.294 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/138 2023-05-12T09:06:05.294 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/138 2023-05-12T09:06:05.294 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/138 2023-05-12T09:06:05.294 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-12T09:06:05.294 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/138 2023-05-12T09:06:05.294 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/138 2023-05-12T09:06:05.294 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/138 2023-05-12T09:06:05.294 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/138 2023-05-12T09:06:05.295 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/138 2023-05-12T09:06:05.295 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/138 2023-05-12T09:06:05.295 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/138 2023-05-12T09:06:05.295 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 90/138 2023-05-12T09:06:05.295 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/138 2023-05-12T09:06:05.295 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/138 2023-05-12T09:06:05.295 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/138 2023-05-12T09:06:05.296 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/138 2023-05-12T09:06:05.296 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 95/138 2023-05-12T09:06:05.296 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/138 2023-05-12T09:06:05.296 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/138 2023-05-12T09:06:05.296 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/138 2023-05-12T09:06:05.296 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/138 2023-05-12T09:06:05.296 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/138 2023-05-12T09:06:05.296 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/138 2023-05-12T09:06:05.297 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/138 2023-05-12T09:06:05.297 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/138 2023-05-12T09:06:05.297 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/138 2023-05-12T09:06:05.297 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/138 2023-05-12T09:06:05.297 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/138 2023-05-12T09:06:05.297 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/138 2023-05-12T09:06:05.297 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/138 2023-05-12T09:06:05.298 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/138 2023-05-12T09:06:05.298 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/138 2023-05-12T09:06:05.298 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/138 2023-05-12T09:06:05.298 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/138 2023-05-12T09:06:05.298 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/138 2023-05-12T09:06:05.298 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/138 2023-05-12T09:06:05.298 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/138 2023-05-12T09:06:05.298 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/138 2023-05-12T09:06:05.299 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/138 2023-05-12T09:06:05.299 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/138 2023-05-12T09:06:05.299 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/138 2023-05-12T09:06:05.299 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/138 2023-05-12T09:06:05.299 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/138 2023-05-12T09:06:05.299 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/138 2023-05-12T09:06:05.299 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 123/138 2023-05-12T09:06:05.300 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/138 2023-05-12T09:06:05.300 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/138 2023-05-12T09:06:05.300 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/138 2023-05-12T09:06:05.300 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/138 2023-05-12T09:06:05.301 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/138 2023-05-12T09:06:05.301 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librados2-2:18.0.0-3871.g5a6b166b.el8.x86_64 129/138 2023-05-12T09:06:05.301 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2023-05-12T09:06:05.301 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librbd1-2:18.0.0-3871.g5a6b166b.el8.x86_64 131/138 2023-05-12T09:06:05.301 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2023-05-12T09:06:05.301 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 133/138 2023-05-12T09:06:05.301 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-12T09:06:05.302 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 135/138 2023-05-12T09:06:05.302 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 136/138 2023-05-12T09:06:05.302 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 137/138 2023-05-12T09:06:07.273 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 138/138 2023-05-12T09:06:07.273 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:07.273 INFO:teuthology.orchestra.run.smithi182.stdout:Upgraded: 2023-05-12T09:06:07.273 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-05-12T09:06:07.274 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-05-12T09:06:07.274 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-05-12T09:06:07.274 INFO:teuthology.orchestra.run.smithi182.stdout: librados2-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.274 INFO:teuthology.orchestra.run.smithi182.stdout: librbd1-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.274 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2023-05-12T09:06:07.274 INFO:teuthology.orchestra.run.smithi182.stdout: automake-1.16.1-7.el8.noarch 2023-05-12T09:06:07.274 INFO:teuthology.orchestra.run.smithi182.stdout: bison-3.0.4-10.el8.x86_64 2023-05-12T09:06:07.275 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.275 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-base-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.275 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.275 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.275 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-grafana-dashboards-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T09:06:07.275 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-immutable-object-cache-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.275 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mds-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.275 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.276 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-cephadm-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T09:06:07.276 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-dashboard-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T09:06:07.276 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T09:06:07.276 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-modules-core-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T09:06:07.276 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-rook-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T09:06:07.276 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mon-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.276 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-osd-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.277 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-prometheus-alerts-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T09:06:07.277 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-radosgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.277 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-selinux-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.277 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-test-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.277 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-volume-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T09:06:07.277 INFO:teuthology.orchestra.run.smithi182.stdout: cephadm-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T09:06:07.277 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.278 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-top-2:18.0.0-3871.g5a6b166b.el8.noarch 2023-05-12T09:06:07.278 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-05-12T09:06:07.278 INFO:teuthology.orchestra.run.smithi182.stdout: flex-2.6.1-9.el8.x86_64 2023-05-12T09:06:07.278 INFO:teuthology.orchestra.run.smithi182.stdout: fuse-2.9.7-17.el8.x86_64 2023-05-12T09:06:07.278 INFO:teuthology.orchestra.run.smithi182.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-12T09:06:07.278 INFO:teuthology.orchestra.run.smithi182.stdout: jq-1.6-7.el8.x86_64 2023-05-12T09:06:07.278 INFO:teuthology.orchestra.run.smithi182.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-12T09:06:07.278 INFO:teuthology.orchestra.run.smithi182.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-05-12T09:06:07.279 INFO:teuthology.orchestra.run.smithi182.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-12T09:06:07.279 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs-devel-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.279 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs2-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.279 INFO:teuthology.orchestra.run.smithi182.stdout: libcephsqlite-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.279 INFO:teuthology.orchestra.run.smithi182.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-05-12T09:06:07.279 INFO:teuthology.orchestra.run.smithi182.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-05-12T09:06:07.279 INFO:teuthology.orchestra.run.smithi182.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-12T09:06:07.280 INFO:teuthology.orchestra.run.smithi182.stdout: libpq-13.5-1.el8.x86_64 2023-05-12T09:06:07.280 INFO:teuthology.orchestra.run.smithi182.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-05-12T09:06:07.280 INFO:teuthology.orchestra.run.smithi182.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-12T09:06:07.280 INFO:teuthology.orchestra.run.smithi182.stdout: librados-devel-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.280 INFO:teuthology.orchestra.run.smithi182.stdout: libradosstriper1-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.280 INFO:teuthology.orchestra.run.smithi182.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-12T09:06:07.280 INFO:teuthology.orchestra.run.smithi182.stdout: librgw2-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.280 INFO:teuthology.orchestra.run.smithi182.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-05-12T09:06:07.281 INFO:teuthology.orchestra.run.smithi182.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-12T09:06:07.281 INFO:teuthology.orchestra.run.smithi182.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-12T09:06:07.281 INFO:teuthology.orchestra.run.smithi182.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-12T09:06:07.281 INFO:teuthology.orchestra.run.smithi182.stdout: libuuid-devel-2.32.1-41.el8.x86_64 2023-05-12T09:06:07.281 INFO:teuthology.orchestra.run.smithi182.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-05-12T09:06:07.281 INFO:teuthology.orchestra.run.smithi182.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-05-12T09:06:07.281 INFO:teuthology.orchestra.run.smithi182.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-12T09:06:07.282 INFO:teuthology.orchestra.run.smithi182.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-12T09:06:07.282 INFO:teuthology.orchestra.run.smithi182.stdout: openblas-0.3.15-4.el8.x86_64 2023-05-12T09:06:07.282 INFO:teuthology.orchestra.run.smithi182.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-05-12T09:06:07.282 INFO:teuthology.orchestra.run.smithi182.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-05-12T09:06:07.282 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-05-12T09:06:07.282 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-05-12T09:06:07.282 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-05-12T09:06:07.282 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-12T09:06:07.283 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-12T09:06:07.283 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-12T09:06:07.283 INFO:teuthology.orchestra.run.smithi182.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-12T09:06:07.283 INFO:teuthology.orchestra.run.smithi182.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-12T09:06:07.283 INFO:teuthology.orchestra.run.smithi182.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-12T09:06:07.283 INFO:teuthology.orchestra.run.smithi182.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-12T09:06:07.283 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-12T09:06:07.284 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-argparse-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.284 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-common-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.284 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cephfs-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.284 INFO:teuthology.orchestra.run.smithi182.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-12T09:06:07.284 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-12T09:06:07.284 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-12T09:06:07.284 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-12T09:06:07.285 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-12T09:06:07.285 INFO:teuthology.orchestra.run.smithi182.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-12T09:06:07.285 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-12T09:06:07.285 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-12T09:06:07.285 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-12T09:06:07.285 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-12T09:06:07.286 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-12T09:06:07.286 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-12T09:06:07.286 INFO:teuthology.orchestra.run.smithi182.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-12T09:06:07.286 INFO:teuthology.orchestra.run.smithi182.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-12T09:06:07.286 INFO:teuthology.orchestra.run.smithi182.stdout: python3-mako-1.0.6-14.el8.noarch 2023-05-12T09:06:07.286 INFO:teuthology.orchestra.run.smithi182.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-12T09:06:07.286 INFO:teuthology.orchestra.run.smithi182.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-12T09:06:07.287 INFO:teuthology.orchestra.run.smithi182.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-12T09:06:07.287 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-12T09:06:07.287 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-12T09:06:07.287 INFO:teuthology.orchestra.run.smithi182.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-12T09:06:07.287 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-12T09:06:07.287 INFO:teuthology.orchestra.run.smithi182.stdout: python3-portend-2.6-1.el8.noarch 2023-05-12T09:06:07.287 INFO:teuthology.orchestra.run.smithi182.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-12T09:06:07.287 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-12T09:06:07.288 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-12T09:06:07.288 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-12T09:06:07.288 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-12T09:06:07.288 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-12T09:06:07.288 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rados-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.288 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.288 INFO:teuthology.orchestra.run.smithi182.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-12T09:06:07.289 INFO:teuthology.orchestra.run.smithi182.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-12T09:06:07.289 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rgw-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.289 INFO:teuthology.orchestra.run.smithi182.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-12T09:06:07.289 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-12T09:06:07.289 INFO:teuthology.orchestra.run.smithi182.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-05-12T09:06:07.289 INFO:teuthology.orchestra.run.smithi182.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-12T09:06:07.289 INFO:teuthology.orchestra.run.smithi182.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-12T09:06:07.290 INFO:teuthology.orchestra.run.smithi182.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-12T09:06:07.290 INFO:teuthology.orchestra.run.smithi182.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-12T09:06:07.290 INFO:teuthology.orchestra.run.smithi182.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-12T09:06:07.290 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-12T09:06:07.290 INFO:teuthology.orchestra.run.smithi182.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-12T09:06:07.290 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-12T09:06:07.290 INFO:teuthology.orchestra.run.smithi182.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-12T09:06:07.290 INFO:teuthology.orchestra.run.smithi182.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-12T09:06:07.291 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-fuse-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.291 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-mirror-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.291 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-nbd-2:18.0.0-3871.g5a6b166b.el8.x86_64 2023-05-12T09:06:07.291 INFO:teuthology.orchestra.run.smithi182.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-12T09:06:07.291 INFO:teuthology.orchestra.run.smithi182.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-12T09:06:07.291 INFO:teuthology.orchestra.run.smithi182.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-12T09:06:07.291 INFO:teuthology.orchestra.run.smithi182.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-12T09:06:07.291 INFO:teuthology.orchestra.run.smithi182.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-12T09:06:07.292 INFO:teuthology.orchestra.run.smithi182.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-05-12T09:06:07.292 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:07.292 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2023-05-12T09:06:07.516 DEBUG:teuthology.parallel:result is None 2023-05-12T09:06:07.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5a6b166b7c43e2b5890833e75dd257ab21264ded 2023-05-12T09:06:07.664 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-12T09:06:07.722 INFO:teuthology.orchestra.run.smithi116.stdout:18.0.0-3871.g5a6b166b.el8 2023-05-12T09:06:07.723 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3871.g5a6b166b.el8 2023-05-12T09:06:07.723 INFO:teuthology.task.install:The correct ceph version 18.0.0-3871.g5a6b166b is installed. 2023-05-12T09:06:07.724 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5a6b166b7c43e2b5890833e75dd257ab21264ded 2023-05-12T09:06:07.864 DEBUG:teuthology.orchestra.run.smithi182:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-12T09:06:07.915 INFO:teuthology.orchestra.run.smithi182.stdout:18.0.0-3871.g5a6b166b.el8 2023-05-12T09:06:07.915 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3871.g5a6b166b.el8 2023-05-12T09:06:07.916 INFO:teuthology.task.install:The correct ceph version 18.0.0-3871.g5a6b166b is installed. 2023-05-12T09:06:07.917 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-12T09:06:07.918 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:07.918 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-12T09:06:07.991 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:07.991 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-12T09:06:08.060 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-12T09:06:08.061 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:08.061 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2023-05-12T09:06:08.126 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-12T09:06:08.229 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:08.230 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/usr/bin/daemon-helper 2023-05-12T09:06:08.295 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-12T09:06:08.399 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-12T09:06:08.399 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:08.400 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-12T09:06:08.461 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-12T09:06:08.563 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:08.564 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-12T09:06:08.630 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-12T09:06:08.732 INFO:teuthology.run_tasks:Running task ceph... 2023-05-12T09:06:08.818 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-12T09:06:08.819 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2023-05-12T09:06:08.823 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 777 /var/log/ceph 2023-05-12T09:06:08.886 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-12T09:06:08.887 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-12T09:06:08.891 DEBUG:teuthology.orchestra.run.smithi182:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-12T09:06:08.954 INFO:tasks.ceph:Creating extra log directories... 2023-05-12T09:06:08.954 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-12T09:06:08.958 DEBUG:teuthology.orchestra.run.smithi182:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-12T09:06:09.028 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-12T09:06:09.029 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-12T09:06:09.029 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-12T09:06:09.030 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:09.030 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-12T09:06:09.071 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-12T09:06:09.284 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-12T09:06:09.346 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:09.347 DEBUG:teuthology.orchestra.run.smithi182:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-12T09:06:09.388 DEBUG:teuthology.orchestra.run.smithi182:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-12T09:06:09.583 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-12T09:06:09.652 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-12T09:06:09.652 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-12T09:06:09.652 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi/7272422', 'branch': 'wip-vshankar-testing-20230509.090020-1', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7272422', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '6f2d7574b970ef64b39f04653703bc084b088994'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230509.090020-1'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '5a6b166b7c43e2b5890833e75dd257ab21264ded'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5a6b166b7c43e2b5890833e75dd257ab21264ded'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230509.090020-1', 'sha1': '5a6b166b7c43e2b5890833e75dd257ab21264ded'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '5a6b166b7c43e2b5890833e75dd257ab21264ded', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230509.090020-1', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_5a6b166b7c43e2b5890833e75dd257ab21264ded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '5a6b166b7c43e2b5890833e75dd257ab21264ded', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi116.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPrB3mMnuvBanvZMHFNAKKYThu1us2DR9AqWuxzxBruG5rXnVcvb1kq+BH4IcJbOn3KOweMUyuoHKuwxBmLVwm/ZYz5+5tPL7ODa+bYKHPLC9gfD9juqphsFEjtjb1J6EbCjloVj+r+kout6Mj9zbaZ1T+okq/UhAhKDl3vJndxejdPmLCLpX7iot9XNqThWm0Kbq8BLdmhasN55ucxEnRSdepkN0BECEuYQOkQKD9YD03H5iYgmSQpNQ6q6Ex8yVovcYmBrl9EzWPUnaonwARO+znhmkwtxz1fVE8eMjUMCCPkYD2q/20sWx+UvVwk3WuGjhoOzo179dryK1lwoh8RRUUKufq7R5F9twCIBy6GdYguTdOVU43GgCSBHWjuCYCzQErnl6pjUj4FeXFAfl4H7TXusMmQOlAZK4+mwj55Ef3jYFfcDJwMFW2m2f9DOSjx55qWqrfuF60sIVr6JCfw5HmZ7EEzGyNXXPcjvVubNvpl3F0G/z/ET4qSdaETiM=', 'smithi182.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSCP1964fHt4nuwxhaKn6NiEwBPBwaLYq4SMN9k692sbAcQYODem0y4cSyONrb5Z6h/oFYBBqdzpfkvVWwfjJ0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '6f2d7574b970ef64b39f04653703bc084b088994'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '5a6b166b7c43e2b5890833e75dd257ab21264ded'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-12_08:25:27', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-12T09:06:09.653 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-12T09:06:09.657 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-12T09:06:09.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2023-05-12T09:06:09.740 DEBUG:teuthology.orchestra.run.smithi182:> sudo install -d -m0777 -- /var/run/ceph 2023-05-12T09:06:09.802 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:09.803 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2023-05-12T09:06:09.844 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-12T09:06:09.845 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2023-05-12T09:06:09.924 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-12T09:06:09.925 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-12T09:06:09.925 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-05-12T09:06:09.925 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-12T09:06:09.925 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-05-12T09:06:09.925 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-05-12 08:59:37.019640863 +0000 2023-05-12T09:06:09.926 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-05-12 08:56:46.155388892 +0000 2023-05-12T09:06:09.926 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-05-12 08:56:46.155388892 +0000 2023-05-12T09:06:09.926 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2023-05-12 08:56:46.129389355 +0000 2023-05-12T09:06:09.926 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-12T09:06:10.023 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-05-12T09:06:10.024 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-05-12T09:06:10.024 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000359108 s, 1.4 MB/s 2023-05-12T09:06:10.026 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-12T09:06:10.070 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2023-05-12T09:06:10.153 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-12T09:06:10.153 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-12T09:06:10.153 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-05-12T09:06:10.154 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-12T09:06:10.154 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-05-12T09:06:10.154 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-05-12 08:59:37.019640863 +0000 2023-05-12T09:06:10.154 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-05-12 08:56:46.936374981 +0000 2023-05-12T09:06:10.154 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-05-12 08:56:46.936374981 +0000 2023-05-12T09:06:10.154 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2023-05-12 08:56:46.914375373 +0000 2023-05-12T09:06:10.155 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-12T09:06:10.251 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-05-12T09:06:10.252 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-05-12T09:06:10.252 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000315195 s, 1.6 MB/s 2023-05-12T09:06:10.254 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-12T09:06:10.296 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2023-05-12T09:06:10.378 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-12T09:06:10.378 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-12T09:06:10.378 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-05-12T09:06:10.378 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-12T09:06:10.379 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-05-12T09:06:10.379 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-05-12 08:59:37.020640846 +0000 2023-05-12T09:06:10.379 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-05-12 08:56:47.730360838 +0000 2023-05-12T09:06:10.379 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-05-12 08:56:47.730360838 +0000 2023-05-12T09:06:10.379 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2023-05-12 08:56:47.707361247 +0000 2023-05-12T09:06:10.379 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-12T09:06:10.477 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-05-12T09:06:10.477 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-05-12T09:06:10.478 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000295716 s, 1.7 MB/s 2023-05-12T09:06:10.479 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-12T09:06:10.522 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2023-05-12T09:06:10.603 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-12T09:06:10.603 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-12T09:06:10.603 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-05-12T09:06:10.603 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-12T09:06:10.603 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-05-12T09:06:10.604 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-05-12 08:59:37.020640846 +0000 2023-05-12T09:06:10.604 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-05-12 08:56:48.521346748 +0000 2023-05-12T09:06:10.604 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-05-12 08:56:48.521346748 +0000 2023-05-12T09:06:10.604 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2023-05-12 08:56:48.493347247 +0000 2023-05-12T09:06:10.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-12T09:06:10.702 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-05-12T09:06:10.702 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-05-12T09:06:10.702 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000325671 s, 1.6 MB/s 2023-05-12T09:06:10.704 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-12T09:06:10.746 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-12T09:06:10.747 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:10.747 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/scratch_devs of=/dev/stdout 2023-05-12T09:06:10.790 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-12T09:06:10.790 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_1 2023-05-12T09:06:10.875 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-12T09:06:10.875 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-12T09:06:10.875 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-05-12T09:06:10.875 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-12T09:06:10.875 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2023-05-12T09:06:10.876 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2023-05-12 09:06:04.783876568 +0000 2023-05-12T09:06:10.876 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2023-05-12 08:56:46.180224294 +0000 2023-05-12T09:06:10.876 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2023-05-12 08:56:46.180224294 +0000 2023-05-12T09:06:10.876 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: 2023-05-12 08:56:46.155224858 +0000 2023-05-12T09:06:10.876 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-12T09:06:10.975 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2023-05-12T09:06:10.975 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2023-05-12T09:06:10.975 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000667114 s, 767 kB/s 2023-05-12T09:06:10.977 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-12T09:06:11.021 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_2 2023-05-12T09:06:11.104 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-12T09:06:11.105 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-12T09:06:11.105 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-05-12T09:06:11.105 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-12T09:06:11.105 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2023-05-12T09:06:11.105 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2023-05-12 09:06:04.783876568 +0000 2023-05-12T09:06:11.106 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2023-05-12 08:56:46.969206487 +0000 2023-05-12T09:06:11.106 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2023-05-12 08:56:46.969206487 +0000 2023-05-12T09:06:11.106 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: 2023-05-12 08:56:46.948206961 +0000 2023-05-12T09:06:11.106 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-12T09:06:11.209 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2023-05-12T09:06:11.209 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2023-05-12T09:06:11.209 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000300601 s, 1.7 MB/s 2023-05-12T09:06:11.211 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-12T09:06:11.254 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_3 2023-05-12T09:06:11.338 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-12T09:06:11.338 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-12T09:06:11.338 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-05-12T09:06:11.338 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-12T09:06:11.339 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2023-05-12T09:06:11.339 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2023-05-12 09:06:04.784876544 +0000 2023-05-12T09:06:11.339 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2023-05-12 08:56:47.756188726 +0000 2023-05-12T09:06:11.339 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2023-05-12 08:56:47.756188726 +0000 2023-05-12T09:06:11.339 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: 2023-05-12 08:56:47.730189312 +0000 2023-05-12T09:06:11.339 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-12T09:06:11.439 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2023-05-12T09:06:11.439 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2023-05-12T09:06:11.439 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000300955 s, 1.7 MB/s 2023-05-12T09:06:11.442 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-12T09:06:11.485 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_4 2023-05-12T09:06:11.568 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-12T09:06:11.569 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-12T09:06:11.569 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-05-12T09:06:11.569 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-12T09:06:11.569 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2023-05-12T09:06:11.570 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2023-05-12 09:06:04.784876544 +0000 2023-05-12T09:06:11.570 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2023-05-12 08:56:48.533171189 +0000 2023-05-12T09:06:11.570 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2023-05-12 08:56:48.533171189 +0000 2023-05-12T09:06:11.570 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: 2023-05-12 08:56:48.508171754 +0000 2023-05-12T09:06:11.570 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-12T09:06:11.669 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2023-05-12T09:06:11.670 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2023-05-12T09:06:11.670 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000271449 s, 1.9 MB/s 2023-05-12T09:06:11.672 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-12T09:06:11.717 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-12T09:06:11.717 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi182.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-12T09:06:11.717 INFO:tasks.ceph:Generating config... 2023-05-12T09:06:11.719 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-12T09:06:11.719 INFO:tasks.ceph:[client] debug client = 20 2023-05-12T09:06:11.719 INFO:tasks.ceph:[client] debug ms = 1 2023-05-12T09:06:11.720 INFO:tasks.ceph:[client] pid file = 2023-05-12T09:06:11.720 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-12T09:06:11.720 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-12T09:06:11.721 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-12T09:06:11.721 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-12T09:06:11.721 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-12T09:06:11.722 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-12T09:06:11.723 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-12T09:06:11.723 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-12T09:06:11.723 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-12T09:06:11.724 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-12T09:06:11.724 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-12T09:06:11.724 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-12T09:06:11.724 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-12T09:06:11.724 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-12T09:06:11.725 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-12T09:06:11.725 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-12T09:06:11.725 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-12T09:06:11.725 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-12T09:06:11.725 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-12T09:06:11.725 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-12T09:06:11.726 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-05-12T09:06:11.726 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-05-12T09:06:11.726 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-12T09:06:11.726 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-12T09:06:11.726 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-05-12T09:06:11.727 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-12T09:06:11.727 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-12T09:06:11.727 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-12T09:06:11.727 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-12T09:06:11.727 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-12T09:06:11.728 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-12T09:06:11.728 INFO:tasks.ceph:Setting up mon.a... 2023-05-12T09:06:11.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-12T09:06:12.011 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.keyring 2023-05-12T09:06:12.016 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-12T09:06:12.108 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-12T09:06:12.170 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.116'), ('mon.b', '172.21.15.182'), ('mon.c', '[v2:172.21.15.182:3301,v1:172.21.15.182:6790]')] 2023-05-12T09:06:12.170 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.116,172.21.15.182,[v2:172.21.15.182:3301,v1:172.21.15.182:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-12T09:06:12.171 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:12.172 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-12T09:06:12.212 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.116 --add b 172.21.15.182 --addv c '[v2:172.21.15.182:3301,v1:172.21.15.182:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:12.335 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:12.335 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: generated fsid 09fd430d-d641-4faf-8b07-e4040d2273e8 2023-05-12T09:06:12.336 INFO:teuthology.orchestra.run.smithi116.stdout:setting min_mon_release = pacific 2023-05-12T09:06:12.336 INFO:teuthology.orchestra.run.smithi116.stdout:epoch 0 2023-05-12T09:06:12.336 INFO:teuthology.orchestra.run.smithi116.stdout:fsid 09fd430d-d641-4faf-8b07-e4040d2273e8 2023-05-12T09:06:12.336 INFO:teuthology.orchestra.run.smithi116.stdout:last_changed 2023-05-12T09:06:12.333526+0000 2023-05-12T09:06:12.336 INFO:teuthology.orchestra.run.smithi116.stdout:created 2023-05-12T09:06:12.333526+0000 2023-05-12T09:06:12.336 INFO:teuthology.orchestra.run.smithi116.stdout:min_mon_release 16 (pacific) 2023-05-12T09:06:12.336 INFO:teuthology.orchestra.run.smithi116.stdout:election_strategy: 1 2023-05-12T09:06:12.337 INFO:teuthology.orchestra.run.smithi116.stdout:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2023-05-12T09:06:12.337 INFO:teuthology.orchestra.run.smithi116.stdout:1: [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] mon.b 2023-05-12T09:06:12.337 INFO:teuthology.orchestra.run.smithi116.stdout:2: [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] mon.c 2023-05-12T09:06:12.337 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-12T09:06:12.338 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-12T09:06:12.378 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 09fd430d-d641-4faf-8b07-e4040d2273e8... 2023-05-12T09:06:12.379 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-12T09:06:12.422 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-12T09:06:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2023-05-12T09:06:12.523 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2023-05-12T09:06:12.523 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-12T09:06:12.523 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2023-05-12T09:06:12.523 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.523 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2023-05-12T09:06:12.523 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.523 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2023-05-12T09:06:12.524 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.524 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2023-05-12T09:06:12.524 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2023-05-12T09:06:12.524 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.524 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2023-05-12T09:06:12.524 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2023-05-12T09:06:12.524 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-12T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2023-05-12T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2023-05-12T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-12T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2023-05-12T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2023-05-12T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2023-05-12T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2023-05-12T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2023-05-12T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2023-05-12T09:06:12.527 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2023-05-12T09:06:12.527 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2023-05-12T09:06:12.527 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-12T09:06:12.527 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-12T09:06:12.527 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2023-05-12T09:06:12.527 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.527 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-12T09:06:12.527 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.528 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2023-05-12T09:06:12.528 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.529 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2023-05-12T09:06:12.529 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.529 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2023-05-12T09:06:12.529 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2023-05-12T09:06:12.529 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2023-05-12T09:06:12.529 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.116,172.21.15.182,[v2:172.21.15.182:3301,v1:172.21.15.182:6790]" 2023-05-12T09:06:12.530 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 09fd430d-d641-4faf-8b07-e4040d2273e8 2023-05-12T09:06:12.530 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.530 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2023-05-12T09:06:12.530 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2023-05-12T09:06:12.530 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.530 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2023-05-12T09:06:12.530 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2023-05-12T09:06:12.530 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.531 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2023-05-12T09:06:12.531 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2023-05-12T09:06:12.531 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.531 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2023-05-12T09:06:12.531 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2023-05-12T09:06:12.531 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2023-05-12T09:06:12.531 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.532 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2023-05-12T09:06:12.532 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2023-05-12T09:06:12.532 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.532 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2023-05-12T09:06:12.532 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.532 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2023-05-12T09:06:12.532 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.533 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2023-05-12T09:06:12.533 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.533 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2023-05-12T09:06:12.533 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2023-05-12T09:06:12.533 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.533 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2023-05-12T09:06:12.533 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2023-05-12T09:06:12.534 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2023-05-12T09:06:12.534 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2023-05-12T09:06:12.534 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 20 2023-05-12T09:06:12.534 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 20 2023-05-12T09:06:12.534 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-05-12T09:06:12.534 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2023-05-12T09:06:12.534 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 10 2023-05-12T09:06:12.534 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2023-05-12T09:06:12.535 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2023-05-12T09:06:12.535 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2023-05-12T09:06:12.535 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2023-05-12T09:06:12.535 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2023-05-12T09:06:12.535 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2023-05-12T09:06:12.535 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.535 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2023-05-12T09:06:12.536 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-05-12T09:06:12.536 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2023-05-12T09:06:12.536 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2023-05-12T09:06:12.536 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2023-05-12T09:06:12.536 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2023-05-12T09:06:12.536 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2023-05-12T09:06:12.536 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2023-05-12T09:06:12.537 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.537 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2023-05-12T09:06:12.537 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-05-12T09:06:12.537 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2023-05-12T09:06:12.537 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2023-05-12T09:06:12.537 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2023-05-12T09:06:12.537 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2023-05-12T09:06:12.537 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2023-05-12T09:06:12.538 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2023-05-12T09:06:12.538 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2023-05-12T09:06:12.538 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2023-05-12T09:06:12.538 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2023-05-12T09:06:12.538 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.539 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-12T09:06:12.539 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2023-05-12T09:06:12.539 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2023-05-12T09:06:12.539 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.539 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2023-05-12T09:06:12.539 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-12T09:06:12.539 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-12T09:06:12.540 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.540 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2023-05-12T09:06:12.540 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2023-05-12T09:06:12.540 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.540 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2023-05-12T09:06:12.540 INFO:teuthology.orchestra.run.smithi116.stdout: mon op complaint time = 120 2023-05-12T09:06:12.540 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:12.541 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2023-05-12T09:06:12.541 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2023-05-12T09:06:12.541 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2023-05-12T09:06:12.541 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2023-05-12T09:06:12.541 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-12T09:06:12.541 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-12T09:06:12.542 INFO:teuthology.orchestra.run.smithi116.stdout: client mount timeout = 600 2023-05-12T09:06:12.542 INFO:teuthology.orchestra.run.smithi116.stdout: debug client = 20 2023-05-12T09:06:12.542 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-05-12T09:06:12.542 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = "" 2023-05-12T09:06:12.542 INFO:teuthology.orchestra.run.smithi116.stdout: rados mon op timeout = 900 2023-05-12T09:06:12.542 INFO:teuthology.orchestra.run.smithi116.stdout: rados osd op timeout = 900 2023-05-12T09:06:12.542 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2023-05-12T09:06:12.543 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2023-05-12T09:06:12.543 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2023-05-12T09:06:12.543 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2023-05-12T09:06:12.543 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.c] 2023-05-12T09:06:12.543 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2023-05-12T09:06:12.543 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.d] 2023-05-12T09:06:12.543 INFO:teuthology.orchestra.run.smithi116.stdout:[mds] 2023-05-12T09:06:12.543 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds = 20 2023-05-12T09:06:12.544 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds balancer = 20 2023-05-12T09:06:12.544 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-05-12T09:06:12.544 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug frag = True 2023-05-12T09:06:12.544 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug scatterstat = True 2023-05-12T09:06:12.544 INFO:teuthology.orchestra.run.smithi116.stdout: mds op complaint time = 180 2023-05-12T09:06:12.544 INFO:teuthology.orchestra.run.smithi116.stdout: mds verify scatter = True 2023-05-12T09:06:12.544 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2023-05-12T09:06:12.545 INFO:teuthology.orchestra.run.smithi116.stdout: rados mon op timeout = 900 2023-05-12T09:06:12.545 INFO:teuthology.orchestra.run.smithi116.stdout: rados osd op timeout = 900 2023-05-12T09:06:12.545 INFO:teuthology.orchestra.run.smithi182.stdout:[global] 2023-05-12T09:06:12.546 INFO:teuthology.orchestra.run.smithi182.stdout: chdir = "" 2023-05-12T09:06:12.546 INFO:teuthology.orchestra.run.smithi182.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-12T09:06:12.546 INFO:teuthology.orchestra.run.smithi182.stdout: auth supported = cephx 2023-05-12T09:06:12.546 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.546 INFO:teuthology.orchestra.run.smithi182.stdout: filestore xattr use omap = true 2023-05-12T09:06:12.546 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.546 INFO:teuthology.orchestra.run.smithi182.stdout: mon clock drift allowed = 1.000 2023-05-12T09:06:12.547 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.547 INFO:teuthology.orchestra.run.smithi182.stdout: osd crush chooseleaf type = 0 2023-05-12T09:06:12.547 INFO:teuthology.orchestra.run.smithi182.stdout: auth debug = true 2023-05-12T09:06:12.547 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.547 INFO:teuthology.orchestra.run.smithi182.stdout: ms die on old message = true 2023-05-12T09:06:12.547 INFO:teuthology.orchestra.run.smithi182.stdout: ms die on bug = true 2023-05-12T09:06:12.547 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.548 INFO:teuthology.orchestra.run.smithi182.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-12T09:06:12.548 INFO:teuthology.orchestra.run.smithi182.stdout: mon pg warn max object skew = 0 2023-05-12T09:06:12.548 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.548 INFO:teuthology.orchestra.run.smithi182.stdout: # disable pg_autoscaler by default for new pools 2023-05-12T09:06:12.548 INFO:teuthology.orchestra.run.smithi182.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-12T09:06:12.548 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.548 INFO:teuthology.orchestra.run.smithi182.stdout: osd pool default size = 2 2023-05-12T09:06:12.549 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.549 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd allow primary affinity = true 2023-05-12T09:06:12.549 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd allow pg remap = true 2023-05-12T09:06:12.549 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on legacy crush tunables = false 2023-05-12T09:06:12.549 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on crush straw calc version zero = false 2023-05-12T09:06:12.549 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on no sortbitwise = false 2023-05-12T09:06:12.549 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on osd down out interval zero = false 2023-05-12T09:06:12.549 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on too few osds = false 2023-05-12T09:06:12.550 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-12T09:06:12.550 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-12T09:06:12.550 INFO:teuthology.orchestra.run.smithi182.stdout: mon_allow_pool_size_one = true 2023-05-12T09:06:12.550 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.550 INFO:teuthology.orchestra.run.smithi182.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-12T09:06:12.550 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.550 INFO:teuthology.orchestra.run.smithi182.stdout: osd default data pool replay window = 5 2023-05-12T09:06:12.550 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.551 INFO:teuthology.orchestra.run.smithi182.stdout: mon allow pool delete = true 2023-05-12T09:06:12.551 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.551 INFO:teuthology.orchestra.run.smithi182.stdout: mon cluster log file level = debug 2023-05-12T09:06:12.551 INFO:teuthology.orchestra.run.smithi182.stdout: debug asserts on shutdown = true 2023-05-12T09:06:12.551 INFO:teuthology.orchestra.run.smithi182.stdout: mon health detail to clog = false 2023-05-12T09:06:12.551 INFO:teuthology.orchestra.run.smithi182.stdout: mon host = "172.21.15.116,172.21.15.182,[v2:172.21.15.182:3301,v1:172.21.15.182:6790]" 2023-05-12T09:06:12.551 INFO:teuthology.orchestra.run.smithi182.stdout: fsid = 09fd430d-d641-4faf-8b07-e4040d2273e8 2023-05-12T09:06:12.551 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.552 INFO:teuthology.orchestra.run.smithi182.stdout:[osd] 2023-05-12T09:06:12.552 INFO:teuthology.orchestra.run.smithi182.stdout: osd journal size = 100 2023-05-12T09:06:12.552 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.552 INFO:teuthology.orchestra.run.smithi182.stdout: osd scrub load threshold = 5.0 2023-05-12T09:06:12.552 INFO:teuthology.orchestra.run.smithi182.stdout: osd scrub max interval = 600 2023-05-12T09:06:12.552 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.552 INFO:teuthology.orchestra.run.smithi182.stdout: osd recover clone overlap = true 2023-05-12T09:06:12.553 INFO:teuthology.orchestra.run.smithi182.stdout: osd recovery max chunk = 1048576 2023-05-12T09:06:12.553 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.553 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug shutdown = true 2023-05-12T09:06:12.553 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug op order = true 2023-05-12T09:06:12.553 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug verify stray on activate = true 2023-05-12T09:06:12.553 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.553 INFO:teuthology.orchestra.run.smithi182.stdout: osd open classes on start = true 2023-05-12T09:06:12.553 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug pg log writeout = true 2023-05-12T09:06:12.554 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.554 INFO:teuthology.orchestra.run.smithi182.stdout: osd deep scrub update digest min age = 30 2023-05-12T09:06:12.554 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.554 INFO:teuthology.orchestra.run.smithi182.stdout: osd map max advance = 10 2023-05-12T09:06:12.554 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.554 INFO:teuthology.orchestra.run.smithi182.stdout: journal zero on create = true 2023-05-12T09:06:12.554 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.555 INFO:teuthology.orchestra.run.smithi182.stdout: filestore ondisk finisher threads = 3 2023-05-12T09:06:12.555 INFO:teuthology.orchestra.run.smithi182.stdout: filestore apply finisher threads = 3 2023-05-12T09:06:12.555 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.555 INFO:teuthology.orchestra.run.smithi182.stdout: bdev debug aio = true 2023-05-12T09:06:12.555 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug misdirected ops = true 2023-05-12T09:06:12.555 INFO:teuthology.orchestra.run.smithi182.stdout: bluestore block size = 96636764160 2023-05-12T09:06:12.555 INFO:teuthology.orchestra.run.smithi182.stdout: bluestore fsck on mount = True 2023-05-12T09:06:12.556 INFO:teuthology.orchestra.run.smithi182.stdout: debug bluefs = 20 2023-05-12T09:06:12.556 INFO:teuthology.orchestra.run.smithi182.stdout: debug bluestore = 20 2023-05-12T09:06:12.556 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2023-05-12T09:06:12.556 INFO:teuthology.orchestra.run.smithi182.stdout: debug osd = 20 2023-05-12T09:06:12.556 INFO:teuthology.orchestra.run.smithi182.stdout: debug rocksdb = 10 2023-05-12T09:06:12.556 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd backfillfull_ratio = 0.85 2023-05-12T09:06:12.556 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd full ratio = 0.9 2023-05-12T09:06:12.556 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd nearfull ratio = 0.8 2023-05-12T09:06:12.557 INFO:teuthology.orchestra.run.smithi182.stdout: osd failsafe full ratio = 0.95 2023-05-12T09:06:12.557 INFO:teuthology.orchestra.run.smithi182.stdout: osd objectstore = bluestore 2023-05-12T09:06:12.557 INFO:teuthology.orchestra.run.smithi182.stdout: osd op complaint time = 180 2023-05-12T09:06:12.557 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.557 INFO:teuthology.orchestra.run.smithi182.stdout:[mgr] 2023-05-12T09:06:12.557 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2023-05-12T09:06:12.558 INFO:teuthology.orchestra.run.smithi182.stdout: debug mgr = 20 2023-05-12T09:06:12.558 INFO:teuthology.orchestra.run.smithi182.stdout: debug mon = 20 2023-05-12T09:06:12.558 INFO:teuthology.orchestra.run.smithi182.stdout: debug auth = 20 2023-05-12T09:06:12.558 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min pgs per osd = 4 2023-05-12T09:06:12.558 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min bytes per osd = 10 2023-05-12T09:06:12.558 INFO:teuthology.orchestra.run.smithi182.stdout: mgr/telemetry/nag = false 2023-05-12T09:06:12.559 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.559 INFO:teuthology.orchestra.run.smithi182.stdout:[mon] 2023-05-12T09:06:12.559 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2023-05-12T09:06:12.559 INFO:teuthology.orchestra.run.smithi182.stdout: debug mon = 20 2023-05-12T09:06:12.559 INFO:teuthology.orchestra.run.smithi182.stdout: debug paxos = 20 2023-05-12T09:06:12.559 INFO:teuthology.orchestra.run.smithi182.stdout: debug auth = 20 2023-05-12T09:06:12.559 INFO:teuthology.orchestra.run.smithi182.stdout: mon data avail warn = 5 2023-05-12T09:06:12.559 INFO:teuthology.orchestra.run.smithi182.stdout: mon mgr mkfs grace = 240 2023-05-12T09:06:12.560 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min pgs per osd = 4 2023-05-12T09:06:12.560 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd reporter subtree level = osd 2023-05-12T09:06:12.560 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd prime pg temp = true 2023-05-12T09:06:12.560 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min bytes per osd = 10 2023-05-12T09:06:12.560 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.560 INFO:teuthology.orchestra.run.smithi182.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-12T09:06:12.560 INFO:teuthology.orchestra.run.smithi182.stdout: auth mon ticket ttl = 660 # 11m 2023-05-12T09:06:12.561 INFO:teuthology.orchestra.run.smithi182.stdout: auth service ticket ttl = 240 # 4m 2023-05-12T09:06:12.561 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.561 INFO:teuthology.orchestra.run.smithi182.stdout: # don't complain about insecure global_id in the test suite 2023-05-12T09:06:12.561 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-12T09:06:12.561 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-12T09:06:12.561 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.561 INFO:teuthology.orchestra.run.smithi182.stdout: # 1m isn't quite enough 2023-05-12T09:06:12.561 INFO:teuthology.orchestra.run.smithi182.stdout: mon_down_mkfs_grace = 2m 2023-05-12T09:06:12.562 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.562 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_filestore_osds = false 2023-05-12T09:06:12.562 INFO:teuthology.orchestra.run.smithi182.stdout: mon op complaint time = 120 2023-05-12T09:06:12.562 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-05-12T09:06:12.562 INFO:teuthology.orchestra.run.smithi182.stdout:[client] 2023-05-12T09:06:12.562 INFO:teuthology.orchestra.run.smithi182.stdout: rgw cache enabled = true 2023-05-12T09:06:12.562 INFO:teuthology.orchestra.run.smithi182.stdout: rgw enable ops log = true 2023-05-12T09:06:12.562 INFO:teuthology.orchestra.run.smithi182.stdout: rgw enable usage log = true 2023-05-12T09:06:12.563 INFO:teuthology.orchestra.run.smithi182.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-12T09:06:12.563 INFO:teuthology.orchestra.run.smithi182.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-12T09:06:12.563 INFO:teuthology.orchestra.run.smithi182.stdout: client mount timeout = 600 2023-05-12T09:06:12.563 INFO:teuthology.orchestra.run.smithi182.stdout: debug client = 20 2023-05-12T09:06:12.563 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2023-05-12T09:06:12.563 INFO:teuthology.orchestra.run.smithi182.stdout: pid file = "" 2023-05-12T09:06:12.563 INFO:teuthology.orchestra.run.smithi182.stdout: rados mon op timeout = 900 2023-05-12T09:06:12.564 INFO:teuthology.orchestra.run.smithi182.stdout: rados osd op timeout = 900 2023-05-12T09:06:12.564 INFO:teuthology.orchestra.run.smithi182.stdout:[mon.a] 2023-05-12T09:06:12.564 INFO:teuthology.orchestra.run.smithi182.stdout:[mon.b] 2023-05-12T09:06:12.564 INFO:teuthology.orchestra.run.smithi182.stdout:[mon.c] 2023-05-12T09:06:12.564 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.a] 2023-05-12T09:06:12.564 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.c] 2023-05-12T09:06:12.564 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.b] 2023-05-12T09:06:12.564 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.d] 2023-05-12T09:06:12.565 INFO:teuthology.orchestra.run.smithi182.stdout:[mds] 2023-05-12T09:06:12.565 INFO:teuthology.orchestra.run.smithi182.stdout: debug mds = 20 2023-05-12T09:06:12.565 INFO:teuthology.orchestra.run.smithi182.stdout: debug mds balancer = 20 2023-05-12T09:06:12.565 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2023-05-12T09:06:12.565 INFO:teuthology.orchestra.run.smithi182.stdout: mds debug frag = True 2023-05-12T09:06:12.565 INFO:teuthology.orchestra.run.smithi182.stdout: mds debug scatterstat = True 2023-05-12T09:06:12.565 INFO:teuthology.orchestra.run.smithi182.stdout: mds op complaint time = 180 2023-05-12T09:06:12.565 INFO:teuthology.orchestra.run.smithi182.stdout: mds verify scatter = True 2023-05-12T09:06:12.566 INFO:teuthology.orchestra.run.smithi182.stdout: osd op complaint time = 180 2023-05-12T09:06:12.566 INFO:teuthology.orchestra.run.smithi182.stdout: rados mon op timeout = 900 2023-05-12T09:06:12.566 INFO:teuthology.orchestra.run.smithi182.stdout: rados osd op timeout = 900 2023-05-12T09:06:12.567 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-12T09:06:12.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-12T09:06:12.672 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-12T09:06:12.672 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:12.673 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-12T09:06:12.713 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:12.713 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-12T09:06:12.793 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T09:06:12.794 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:12.794 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-12T09:06:12.794 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-12T09:06:12.916 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:12.917 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:12.997 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi182.front.sepia.ceph.com 2023-05-12T09:06:12.997 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:12.998 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-12T09:06:12.998 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-12T09:06:13.086 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:13.086 DEBUG:teuthology.orchestra.run.smithi182:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:13.168 INFO:tasks.ceph:Setting up mon nodes... 2023-05-12T09:06:13.169 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-12T09:06:13.169 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-12T09:06:13.279 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-12T09:06:13.284 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-12T09:06:13.402 INFO:teuthology.orchestra.run.smithi182.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-12T09:06:13.408 INFO:tasks.ceph:Setting up mds nodes... 2023-05-12T09:06:13.409 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-12T09:06:13.521 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-12T09:06:13.526 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-12T09:06:13.588 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-12T09:06:13.699 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-12T09:06:13.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-12T09:06:13.767 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-12T09:06:13.882 INFO:teuthology.orchestra.run.smithi182.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-12T09:06:13.889 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-12T09:06:13.954 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-12T09:06:14.067 INFO:teuthology.orchestra.run.smithi182.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-12T09:06:14.073 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-12T09:06:14.136 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-12T09:06:14.137 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-12T09:06:14.225 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-12T09:06:14.251 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-12T09:06:14.338 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-12T09:06:14.366 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-12T09:06:14.456 INFO:teuthology.orchestra.run.smithi182.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-12T09:06:14.484 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-12T09:06:14.572 INFO:teuthology.orchestra.run.smithi182.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-12T09:06:14.599 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-12T09:06:14.599 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi182.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-12T09:06:14.600 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-12T09:06:14.662 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-12T09:06:14.662 INFO:tasks.ceph:role: osd.0 2023-05-12T09:06:14.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T09:06:14.663 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-12T09:06:14.732 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-12T09:06:14.732 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-12T09:06:14.732 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-12T09:06:14.732 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-12T09:06:14.733 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-12T09:06:14.733 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-05-12T09:06:14.733 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-12T09:06:14.733 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-12T09:06:14.733 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-12T09:06:14.733 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-12T09:06:15.164 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-05-12T09:06:15.168 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-05-12T09:06:15.168 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-12T09:06:15.340 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-12T09:06:15.410 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-12T09:06:15.472 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-12T09:06:15.473 INFO:tasks.ceph:role: osd.1 2023-05-12T09:06:15.473 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T09:06:15.473 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-12T09:06:15.542 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-12T09:06:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-12T09:06:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-12T09:06:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-12T09:06:15.543 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-12T09:06:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-05-12T09:06:15.543 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-12T09:06:15.543 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-12T09:06:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-12T09:06:15.543 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-12T09:06:15.948 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-05-12T09:06:15.952 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-05-12T09:06:15.953 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-12T09:06:16.081 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-12T09:06:16.149 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-12T09:06:16.211 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-12T09:06:16.211 INFO:tasks.ceph:role: osd.2 2023-05-12T09:06:16.211 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T09:06:16.211 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-12T09:06:16.281 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-12T09:06:16.281 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-12T09:06:16.281 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-12T09:06:16.282 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-12T09:06:16.282 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-12T09:06:16.282 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-05-12T09:06:16.282 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-12T09:06:16.283 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-12T09:06:16.283 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-12T09:06:16.283 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-12T09:06:16.738 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-05-12T09:06:16.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-05-12T09:06:16.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-12T09:06:16.928 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-12T09:06:16.998 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-12T09:06:17.060 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-12T09:06:17.061 INFO:tasks.ceph:role: osd.3 2023-05-12T09:06:17.061 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T09:06:17.061 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-12T09:06:17.131 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-12T09:06:17.131 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-12T09:06:17.131 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-12T09:06:17.131 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-12T09:06:17.131 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-12T09:06:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-05-12T09:06:17.132 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-12T09:06:17.132 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-12T09:06:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-12T09:06:17.132 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-12T09:06:17.562 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-05-12T09:06:17.565 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-05-12T09:06:17.565 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-12T09:06:17.715 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-12T09:06:17.786 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:17.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:17.895+0000 7f78da3d8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-12T09:06:17.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:17.896+0000 7f78da3d8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-12T09:06:17.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:17.896+0000 7f78da3d8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-12T09:06:17.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:17.896+0000 7f78da3d8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-12T09:06:17.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:17.896+0000 7f78da3d8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-12T09:06:17.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:17.898+0000 7f78da3d8640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-12T09:06:20.783 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-12T09:06:20.849 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:20.944 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:20.942+0000 7f47d08cf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-12T09:06:20.945 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:20.942+0000 7f47d08cf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-12T09:06:20.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:20.942+0000 7f47d08cf640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-12T09:06:20.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:20.942+0000 7f47d08cf640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-12T09:06:20.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:20.942+0000 7f47d08cf640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-12T09:06:20.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:20.943+0000 7f47d08cf640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-12T09:06:23.828 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-12T09:06:23.895 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:23.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:23.989+0000 7f280e52e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-12T09:06:23.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:23.990+0000 7f280e52e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-12T09:06:23.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:23.990+0000 7f280e52e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-12T09:06:23.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:23.990+0000 7f280e52e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-12T09:06:23.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:23.990+0000 7f280e52e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-12T09:06:23.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:23.991+0000 7f280e52e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-12T09:06:26.879 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-12T09:06:26.944 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:27.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:27.037+0000 7fd502614640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-12T09:06:27.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:27.037+0000 7fd502614640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-12T09:06:27.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:27.037+0000 7fd502614640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-12T09:06:27.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:27.037+0000 7fd502614640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-12T09:06:27.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:27.037+0000 7fd502614640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-12T09:06:27.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:27.039+0000 7fd502614640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-12T09:06:29.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-12T09:06:29.994 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-12T09:06:30.060 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-12T09:06:30.060 INFO:tasks.ceph:role: osd.4 2023-05-12T09:06:30.061 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi182.front.sepia.ceph.com 2023-05-12T09:06:30.061 DEBUG:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-12T09:06:30.133 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-12T09:06:30.134 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-12T09:06:30.134 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-12T09:06:30.134 INFO:teuthology.orchestra.run.smithi182.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-12T09:06:30.134 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-12T09:06:30.134 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2023-05-12T09:06:30.134 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-12T09:06:30.134 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-12T09:06:30.135 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-12T09:06:30.135 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-12T09:06:30.564 INFO:teuthology.orchestra.run.smithi182.stdout:Discarding blocks...Done. 2023-05-12T09:06:30.567 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2023-05-12T09:06:30.567 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-12T09:06:30.765 DEBUG:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-12T09:06:30.840 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-12T09:06:30.905 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-12T09:06:30.906 INFO:tasks.ceph:role: osd.5 2023-05-12T09:06:30.906 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi182.front.sepia.ceph.com 2023-05-12T09:06:30.906 DEBUG:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-12T09:06:30.977 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-12T09:06:30.977 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-12T09:06:30.977 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-12T09:06:30.977 INFO:teuthology.orchestra.run.smithi182.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-12T09:06:30.978 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-12T09:06:30.978 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2023-05-12T09:06:30.978 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-12T09:06:30.978 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-12T09:06:30.978 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-12T09:06:30.978 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-12T09:06:31.384 INFO:teuthology.orchestra.run.smithi182.stdout:Discarding blocks...Done. 2023-05-12T09:06:31.387 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2023-05-12T09:06:31.388 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-12T09:06:31.528 DEBUG:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-12T09:06:31.597 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-12T09:06:31.661 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-12T09:06:31.662 INFO:tasks.ceph:role: osd.6 2023-05-12T09:06:31.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi182.front.sepia.ceph.com 2023-05-12T09:06:31.662 DEBUG:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-12T09:06:31.731 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-12T09:06:31.732 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-12T09:06:31.732 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-12T09:06:31.732 INFO:teuthology.orchestra.run.smithi182.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-12T09:06:31.733 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-12T09:06:31.733 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2023-05-12T09:06:31.733 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-12T09:06:31.733 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-12T09:06:31.734 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-12T09:06:31.734 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-12T09:06:32.174 INFO:teuthology.orchestra.run.smithi182.stdout:Discarding blocks...Done. 2023-05-12T09:06:32.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2023-05-12T09:06:32.178 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-12T09:06:32.390 DEBUG:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-12T09:06:32.463 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-12T09:06:32.526 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-12T09:06:32.527 INFO:tasks.ceph:role: osd.7 2023-05-12T09:06:32.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi182.front.sepia.ceph.com 2023-05-12T09:06:32.527 DEBUG:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-12T09:06:32.603 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-12T09:06:32.603 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-12T09:06:32.603 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-12T09:06:32.603 INFO:teuthology.orchestra.run.smithi182.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-12T09:06:32.603 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-12T09:06:32.604 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2023-05-12T09:06:32.604 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-12T09:06:32.604 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-12T09:06:32.604 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-12T09:06:32.604 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-12T09:06:33.046 INFO:teuthology.orchestra.run.smithi182.stdout:Discarding blocks...Done. 2023-05-12T09:06:33.051 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2023-05-12T09:06:33.051 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-12T09:06:33.179 DEBUG:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-12T09:06:33.247 DEBUG:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:33.457 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:33.455+0000 7f1584502640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-12T09:06:33.458 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:33.455+0000 7f1584502640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-12T09:06:33.459 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:33.455+0000 7f1584502640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-12T09:06:33.459 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:33.455+0000 7f1584502640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-12T09:06:33.459 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:33.455+0000 7f1584502640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-12T09:06:33.460 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:33.457+0000 7f1584502640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-12T09:06:36.383 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-12T09:06:36.446 DEBUG:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:36.546 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:36.543+0000 7f01755a9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-12T09:06:36.546 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:36.543+0000 7f01755a9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-12T09:06:36.547 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:36.543+0000 7f01755a9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-12T09:06:36.547 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:36.543+0000 7f01755a9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-12T09:06:36.547 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:36.543+0000 7f01755a9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-12T09:06:36.548 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:36.545+0000 7f01755a9640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-12T09:06:39.490 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-12T09:06:39.552 DEBUG:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:39.653 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:39.651+0000 7fab25b0a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-12T09:06:39.653 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:39.651+0000 7fab25b0a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-12T09:06:39.654 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:39.651+0000 7fab25b0a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-12T09:06:39.654 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:39.651+0000 7fab25b0a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-12T09:06:39.654 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:39.651+0000 7fab25b0a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-12T09:06:39.654 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:06:39.655 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:39.654+0000 7fab25b0a640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-12T09:06:39.658 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:06:42.604 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-12T09:06:42.670 DEBUG:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:42.772 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:42.769+0000 7f465a22c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-12T09:06:42.773 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:42.769+0000 7f465a22c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-12T09:06:42.773 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:42.769+0000 7f465a22c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-12T09:06:42.773 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:42.769+0000 7f465a22c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-12T09:06:42.773 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:42.769+0000 7f465a22c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-12T09:06:42.774 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:42.771+0000 7f465a22c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-12T09:06:45.697 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-12T09:06:45.759 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-12T09:06:45.759 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:45.760 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-12T09:06:45.830 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:45.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-12T09:06:45.934 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:45.934 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-12T09:06:46.038 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:46.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-12T09:06:46.140 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:46.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-12T09:06:46.241 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:46.242 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-12T09:06:46.343 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:46.343 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-12T09:06:46.444 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:46.445 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-12T09:06:46.511 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:46.511 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-12T09:06:46.615 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:46.616 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-12T09:06:46.719 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:46.720 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-12T09:06:46.824 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:46.824 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-12T09:06:46.927 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:46.928 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-12T09:06:47.030 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:47.031 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-12T09:06:47.134 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:47.134 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-12T09:06:47.177 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:47.177 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-12T09:06:47.258 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:47.259 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-12T09:06:47.300 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:47.301 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-12T09:06:47.381 INFO:tasks.ceph:Adding keys to all mons... 2023-05-12T09:06:47.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-12T09:06:47.385 DEBUG:teuthology.orchestra.run.smithi182:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-12T09:06:47.441 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.y] 2023-05-12T09:06:47.442 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCFAV5kkOiGEBAApvnwqZdbB63Th503DTLm7g== 2023-05-12T09:06:47.442 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2023-05-12T09:06:47.442 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCFAV5knyv0HhAA+XePiQqvMxnfYR+yOfudbg== 2023-05-12T09:06:47.442 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.c] 2023-05-12T09:06:47.442 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCFAV5kCS+TKRAADCeMHCgcUsxE9Iijf6u2RA== 2023-05-12T09:06:47.443 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.0] 2023-05-12T09:06:47.443 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCJAV5kUNdyNRAAKmmQh3xDLMTWae3RWSV6Ug== 2023-05-12T09:06:47.443 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.1] 2023-05-12T09:06:47.443 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCMAV5ku243OBAATyNYA1E0yXYDC1lBFeTWCQ== 2023-05-12T09:06:47.443 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.2] 2023-05-12T09:06:47.443 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCPAV5kseYSOxAAwaPHFLjD4nL2boFN0js7hg== 2023-05-12T09:06:47.443 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.3] 2023-05-12T09:06:47.443 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCTAV5kPK5IAhAAY5TbKM6lLkU4lvv7FuZFDg== 2023-05-12T09:06:47.444 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.x] 2023-05-12T09:06:47.444 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCFAV5kJjTmFxAAuwDFdATx/ekdgl4Mi3Ffxg== 2023-05-12T09:06:47.444 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2023-05-12T09:06:47.444 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCFAV5kj1R5NBAALVHNgQgMjSUunPGKS8yM2Q== 2023-05-12T09:06:47.444 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.d] 2023-05-12T09:06:47.444 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCGAV5kWbLnAxAA4U72yQhgPsrqEXg4hTODxw== 2023-05-12T09:06:47.444 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.4] 2023-05-12T09:06:47.445 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCZAV5kMg4wGxAAZSFSHdVBNhbK5VUE69YdwQ== 2023-05-12T09:06:47.445 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.5] 2023-05-12T09:06:47.445 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCcAV5k0M50IBAATnqlN/oBFXIwflJKZPpxDQ== 2023-05-12T09:06:47.445 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.6] 2023-05-12T09:06:47.445 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCfAV5k0GbWJhAA4e8aeLD6w+/zrcP0IbbJqA== 2023-05-12T09:06:47.445 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.7] 2023-05-12T09:06:47.445 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCiAV5kLgXtLRAALJOHDthSL7I5XLS4PzsgLA== 2023-05-12T09:06:47.446 INFO:teuthology.orchestra.run.smithi116.stdout:[client.0] 2023-05-12T09:06:47.446 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCGAV5k6b9ODRAA+Q01ixNIFwqKlPUUfO6alg== 2023-05-12T09:06:47.446 INFO:teuthology.orchestra.run.smithi116.stdout:[client.2] 2023-05-12T09:06:47.446 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCGAV5kCjgWFBAAqZG/4pP70B9jSzEoNJZdrw== 2023-05-12T09:06:47.446 INFO:teuthology.orchestra.run.smithi116.stdout:[client.1] 2023-05-12T09:06:47.446 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCGAV5k04UcGxAArh2Fhcjg16KDQe6hzKaHxg== 2023-05-12T09:06:47.446 INFO:teuthology.orchestra.run.smithi116.stdout:[client.3] 2023-05-12T09:06:47.446 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCGAV5kk6YGIhAAd7BpJidPjMShUekaTp9BBQ== 2023-05-12T09:06:47.484 INFO:teuthology.orchestra.run.smithi182.stdout:[mgr.y] 2023-05-12T09:06:47.485 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCFAV5kkOiGEBAApvnwqZdbB63Th503DTLm7g== 2023-05-12T09:06:47.485 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.a] 2023-05-12T09:06:47.485 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCFAV5knyv0HhAA+XePiQqvMxnfYR+yOfudbg== 2023-05-12T09:06:47.485 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.c] 2023-05-12T09:06:47.485 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCFAV5kCS+TKRAADCeMHCgcUsxE9Iijf6u2RA== 2023-05-12T09:06:47.485 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.0] 2023-05-12T09:06:47.485 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCJAV5kUNdyNRAAKmmQh3xDLMTWae3RWSV6Ug== 2023-05-12T09:06:47.486 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.1] 2023-05-12T09:06:47.486 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCMAV5ku243OBAATyNYA1E0yXYDC1lBFeTWCQ== 2023-05-12T09:06:47.486 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.2] 2023-05-12T09:06:47.486 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCPAV5kseYSOxAAwaPHFLjD4nL2boFN0js7hg== 2023-05-12T09:06:47.486 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.3] 2023-05-12T09:06:47.486 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCTAV5kPK5IAhAAY5TbKM6lLkU4lvv7FuZFDg== 2023-05-12T09:06:47.487 INFO:teuthology.orchestra.run.smithi182.stdout:[mgr.x] 2023-05-12T09:06:47.487 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCFAV5kJjTmFxAAuwDFdATx/ekdgl4Mi3Ffxg== 2023-05-12T09:06:47.487 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.b] 2023-05-12T09:06:47.487 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCFAV5kj1R5NBAALVHNgQgMjSUunPGKS8yM2Q== 2023-05-12T09:06:47.487 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.d] 2023-05-12T09:06:47.487 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCGAV5kWbLnAxAA4U72yQhgPsrqEXg4hTODxw== 2023-05-12T09:06:47.487 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.4] 2023-05-12T09:06:47.487 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCZAV5kMg4wGxAAZSFSHdVBNhbK5VUE69YdwQ== 2023-05-12T09:06:47.488 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.5] 2023-05-12T09:06:47.488 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCcAV5k0M50IBAATnqlN/oBFXIwflJKZPpxDQ== 2023-05-12T09:06:47.488 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.6] 2023-05-12T09:06:47.488 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCfAV5k0GbWJhAA4e8aeLD6w+/zrcP0IbbJqA== 2023-05-12T09:06:47.488 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.7] 2023-05-12T09:06:47.488 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCiAV5kLgXtLRAALJOHDthSL7I5XLS4PzsgLA== 2023-05-12T09:06:47.488 INFO:teuthology.orchestra.run.smithi182.stdout:[client.0] 2023-05-12T09:06:47.489 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCGAV5k6b9ODRAA+Q01ixNIFwqKlPUUfO6alg== 2023-05-12T09:06:47.489 INFO:teuthology.orchestra.run.smithi182.stdout:[client.2] 2023-05-12T09:06:47.489 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCGAV5kCjgWFBAAqZG/4pP70B9jSzEoNJZdrw== 2023-05-12T09:06:47.489 INFO:teuthology.orchestra.run.smithi182.stdout:[client.1] 2023-05-12T09:06:47.489 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCGAV5k04UcGxAArh2Fhcjg16KDQe6hzKaHxg== 2023-05-12T09:06:47.489 INFO:teuthology.orchestra.run.smithi182.stdout:[client.3] 2023-05-12T09:06:47.489 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCGAV5kk6YGIhAAd7BpJidPjMShUekaTp9BBQ== 2023-05-12T09:06:47.490 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-12T09:06:47.494 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-12T09:06:47.634 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-12T09:06:47.639 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-12T09:06:47.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-12T09:06:47.748 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-12T09:06:47.853 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:47.857 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:47.960 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:47.964 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.066 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.070 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.177 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.281 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-12T09:06:48.285 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-12T09:06:48.387 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-12T09:06:48.391 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-12T09:06:48.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-12T09:06:48.505 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-12T09:06:48.609 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.613 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.720 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.820 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.824 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.925 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:48.929 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-12T09:06:49.029 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-12T09:06:49.033 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-12T09:06:49.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-12T09:06:49.145 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-12T09:06:49.251 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-12T09:06:49.255 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-12T09:06:49.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-12T09:06:49.365 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-12T09:06:49.470 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-12T09:06:49.471 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-12T09:06:49.532 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-12T09:06:49.646 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-12T09:06:49.708 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-12T09:06:49.771 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-12T09:06:49.886 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-12T09:06:49.951 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-12T09:06:50.015 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-12T09:06:50.129 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-12T09:06:50.194 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:50.198 DEBUG:teuthology.orchestra.run.smithi182:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-12T09:06:50.239 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-12T09:06:50.240 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-12T09:06:50.241 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-12T09:06:50.280 INFO:tasks.ceph.mon.a:Started 2023-05-12T09:06:50.280 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-12T09:06:50.281 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-12T09:06:50.284 INFO:tasks.ceph.mon.b:Started 2023-05-12T09:06:50.285 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-12T09:06:50.285 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-12T09:06:50.289 INFO:tasks.ceph.mon.c:Started 2023-05-12T09:06:50.289 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-12T09:06:50.289 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-12T09:06:50.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-12T09:06:50.294 INFO:tasks.ceph.mgr.y:Started 2023-05-12T09:06:50.294 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-12T09:06:50.295 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-12T09:06:50.298 INFO:tasks.ceph.mgr.x:Started 2023-05-12T09:06:50.299 INFO:tasks.ceph:Setting crush tunables to default 2023-05-12T09:06:50.299 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd crush tunables default 2023-05-12T09:06:50.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.486+0000 7fe0de9ff700 1 Processor -- start 2023-05-12T09:06:50.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.486+0000 7fe0de9ff700 1 -- start start 2023-05-12T09:06:50.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.487+0000 7fe0de9ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fe0d80cfff0 0x7fe0d80b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:50.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.487+0000 7fe0de9ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d815d660 con 0x7fe0d815a140 2023-05-12T09:06:50.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.487+0000 7fe0de9ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d815cd70 con 0x7fe0d80cd520 2023-05-12T09:06:50.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.487+0000 7fe0de9ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d815d010 con 0x7fe0d80cfff0 2023-05-12T09:06:50.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.488+0000 7fe0d7fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe0d815a140 0x7fe0d8160ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:45136/0 (socket says 172.21.15.116:45136) 2023-05-12T09:06:50.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.488+0000 7fe0d7fff700 1 -- 172.21.15.116:0/1562530921 learned_addr learned my addr 172.21.15.116:0/1562530921 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:06:50.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.488+0000 7fe0dcf9c700 1 --2- 172.21.15.116:0/1562530921 >> v2:172.21.15.182:3300/0 conn(0x7fe0d80cfff0 0x7fe0d80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:50.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.488+0000 7fe0dcf9c700 1 -- 172.21.15.116:0/1562530921 >> v2:172.21.15.182:3300/0 conn(0x7fe0d80cfff0 msgr2=0x7fe0d80b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-12T09:06:50.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.488+0000 7fe0dcf9c700 1 -- 172.21.15.116:0/1562530921 >> v2:172.21.15.182:3300/0 conn(0x7fe0d80cfff0 msgr2=0x7fe0d80b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-12T09:06:50.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.488+0000 7fe0dcf9c700 1 --2- 172.21.15.116:0/1562530921 >> v2:172.21.15.182:3300/0 conn(0x7fe0d80cfff0 0x7fe0d80b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-12T09:06:50.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.488+0000 7fe0dcf9c700 1 --2- 172.21.15.116:0/1562530921 >> v2:172.21.15.182:3300/0 conn(0x7fe0d80cfff0 0x7fe0d80b1b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-12T09:06:50.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.676+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522216820 0 0) 0x7fe0d815d660 con 0x7fe0d815a140 2023-05-12T09:06:50.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.676+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c00035b0 con 0x7fe0d815a140 2023-05-12T09:06:50.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893211176 0 0) 0x7fe0d815cd70 con 0x7fe0d80cd520 2023-05-12T09:06:50.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d815d660 con 0x7fe0d80cd520 2023-05-12T09:06:50.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3311677651 0 0) 0x7fe0c00035b0 con 0x7fe0d815a140 2023-05-12T09:06:50.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 >> v2:172.21.15.182:3300/0 conn(0x7fe0d80cfff0 msgr2=0x7fe0d80b1b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-12T09:06:50.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 --2- 172.21.15.116:0/1562530921 >> v2:172.21.15.182:3300/0 conn(0x7fe0d80cfff0 0x7fe0d80b1b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:50.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 >> v1:172.21.15.182:6789/0 conn(0x7fe0d80cd520 legacy=0x7fe0d80cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:50.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d815d2f0 con 0x7fe0d815a140 2023-05-12T09:06:50.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7fe0c8001670 con 0x7fe0d815a140 2023-05-12T09:06:50.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 >> v1:172.21.15.116:6789/0 conn(0x7fe0d815a140 legacy=0x7fe0d8160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:50.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0c0003be0 0x7fe0c0003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:50.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe0c0004850 0x7fe0c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:50.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0c0005250 0x7fe0c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:50.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d815d010 con 0x7fe0c0005250 2023-05-12T09:06:50.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c000c160 con 0x7fe0c0004850 2023-05-12T09:06:50.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.677+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c000c320 con 0x7fe0c0003be0 2023-05-12T09:06:50.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.678+0000 7fe0d7fff700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0c0003be0 0x7fe0c0003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:50.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.678+0000 7fe0d77fe700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe0c0004850 0x7fe0c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:50.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.678+0000 7fe0dcf9c700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0c0005250 0x7fe0c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:50.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.678+0000 7fe0d7fff700 1 -- 172.21.15.116:0/1562530921 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe0c0004850 msgr2=0x7fe0c0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:50.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.678+0000 7fe0d7fff700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe0c0004850 0x7fe0c0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:50.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.678+0000 7fe0d7fff700 1 -- 172.21.15.116:0/1562530921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0c0005250 msgr2=0x7fe0c000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:50.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.678+0000 7fe0d7fff700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0c0005250 0x7fe0c000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:50.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.678+0000 7fe0d7fff700 1 -- 172.21.15.116:0/1562530921 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00035b0 con 0x7fe0c0003be0 2023-05-12T09:06:50.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.678+0000 7fe0dcf9c700 1 -- 172.21.15.116:0/1562530921 reap_dead start 2023-05-12T09:06:50.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.678+0000 7fe0d7fff700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0c0003be0 0x7fe0c0003fd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c160 tx=0x7fe0c0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2903794ca213e2fb server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:50.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.679+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c800cca0 con 0x7fe0c0003be0 2023-05-12T09:06:50.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.679+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c800ce20 con 0x7fe0c0003be0 2023-05-12T09:06:50.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.679+0000 7fe0d6ffd700 1 -- 172.21.15.116:0/1562530921 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8005ba0 con 0x7fe0c0003be0 2023-05-12T09:06:50.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.679+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1562530921 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0c0003be0 msgr2=0x7fe0c0003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:50.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.679+0000 7fe0de9ff700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0c0003be0 0x7fe0c0003fd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c160 tx=0x7fe0c0005880 comp rx=0 tx=0).stop 2023-05-12T09:06:50.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.680+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1562530921 shutdown_connections 2023-05-12T09:06:50.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.680+0000 7fe0de9ff700 1 --2- 172.21.15.116:0/1562530921 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0c0003be0 0x7fe0c0003fd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:50.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.680+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1562530921 >> 172.21.15.116:0/1562530921 conn(0x7fe0d8071b10 msgr2=0x7fe0d8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:50.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.680+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1562530921 shutdown_connections 2023-05-12T09:06:50.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.680+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1562530921 wait complete. 2023-05-12T09:06:50.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.682+0000 7fe0de9ff700 1 Processor -- start 2023-05-12T09:06:50.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.682+0000 7fe0de9ff700 1 -- start start 2023-05-12T09:06:50.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0de9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0c0003be0 0x7fe0d80c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:50.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0de9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe0d81f1ed0 0x7fe0d80b7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:50.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0de9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0d8156260 0x7fe0d8156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:50.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0de9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8156c40 con 0x7fe0c0003be0 2023-05-12T09:06:50.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0de9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8151830 con 0x7fe0d81f1ed0 2023-05-12T09:06:50.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0de9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d80ca610 con 0x7fe0d8156260 2023-05-12T09:06:50.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0dcf9c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0d8156260 0x7fe0d8156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:50.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0d7fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0c0003be0 0x7fe0d80c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:50.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0d77fe700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe0d81f1ed0 0x7fe0d80b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:50.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0dcf9c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0d8156260 0x7fe0d8156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:60232/0 (socket says 172.21.15.116:60232) 2023-05-12T09:06:50.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0dcf9c700 1 -- 172.21.15.116:0/1005613083 learned_addr learned my addr 172.21.15.116:0/1005613083 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:06:50.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0dcf9c700 1 -- 172.21.15.116:0/1005613083 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe0d81f1ed0 msgr2=0x7fe0d80b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:50.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.683+0000 7fe0dcf9c700 1 --2- 172.21.15.116:0/1005613083 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe0d81f1ed0 0x7fe0d80b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:50.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.684+0000 7fe0dcf9c700 1 -- 172.21.15.116:0/1005613083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0c0003be0 msgr2=0x7fe0d80c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:50.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.684+0000 7fe0dcf9c700 1 --2- 172.21.15.116:0/1005613083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0c0003be0 0x7fe0d80c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:50.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.684+0000 7fe0dcf9c700 1 -- 172.21.15.116:0/1005613083 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80cdb00 con 0x7fe0d8156260 2023-05-12T09:06:50.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.684+0000 7fe0dcf9c700 1 --2- 172.21.15.116:0/1005613083 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0d8156260 0x7fe0d8156700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009610 tx=0x7fe0d000f430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:50.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.684+0000 7fe0d4ff9700 1 -- 172.21.15.116:0/1005613083 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000fd70 con 0x7fe0d8156260 2023-05-12T09:06:50.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.684+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1005613083 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d815daf0 con 0x7fe0d8156260 2023-05-12T09:06:50.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.684+0000 7fe0d4ff9700 1 -- 172.21.15.116:0/1005613083 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d0009a90 con 0x7fe0d8156260 2023-05-12T09:06:50.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.684+0000 7fe0d4ff9700 1 -- 172.21.15.116:0/1005613083 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0009e40 con 0x7fe0d8156260 2023-05-12T09:06:50.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.684+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1005613083 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d815a510 con 0x7fe0d8156260 2023-05-12T09:06:50.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.685+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1005613083 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d8151a50 con 0x7fe0d8156260 2023-05-12T09:06:50.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.688+0000 7fe0d4ff9700 1 -- 172.21.15.116:0/1005613083 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe0d0003a20 con 0x7fe0d8156260 2023-05-12T09:06:50.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.688+0000 7fe0d4ff9700 1 -- 172.21.15.116:0/1005613083 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe0d0004740 con 0x7fe0d8156260 2023-05-12T09:06:50.694 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.691+0000 7fe0d4ff9700 1 -- 172.21.15.116:0/1005613083 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe0d0003cd0 con 0x7fe0d8156260 2023-05-12T09:06:50.773 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.770+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1005613083 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe0d80b51f0 con 0x7fe0d8156260 2023-05-12T09:06:50.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.774+0000 7fe0d4ff9700 1 -- 172.21.15.116:0/1005613083 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe0d0004030 con 0x7fe0d8156260 2023-05-12T09:06:50.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.775+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1005613083 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0d8156260 msgr2=0x7fe0d8156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:50.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.775+0000 7fe0de9ff700 1 --2- 172.21.15.116:0/1005613083 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0d8156260 0x7fe0d8156700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009610 tx=0x7fe0d000f430 comp rx=0 tx=0).stop 2023-05-12T09:06:50.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.775+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1005613083 shutdown_connections 2023-05-12T09:06:50.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.775+0000 7fe0de9ff700 1 --2- 172.21.15.116:0/1005613083 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe0d8156260 0x7fe0d8156700 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:50.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.775+0000 7fe0de9ff700 1 --2- 172.21.15.116:0/1005613083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0c0003be0 0x7fe0d80c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:50.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.775+0000 7fe0de9ff700 1 --2- 172.21.15.116:0/1005613083 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe0d81f1ed0 0x7fe0d80b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:50.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.775+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1005613083 >> 172.21.15.116:0/1005613083 conn(0x7fe0d8071b10 msgr2=0x7fe0d81608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:50.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.775+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1005613083 shutdown_connections 2023-05-12T09:06:50.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:50.775+0000 7fe0de9ff700 1 -- 172.21.15.116:0/1005613083 wait complete. 2023-05-12T09:06:50.780 INFO:teuthology.orchestra.run.smithi116.stderr:adjusted tunables profile to default 2023-05-12T09:06:50.794 INFO:tasks.ceph:check_enable_crimson: False 2023-05-12T09:06:50.795 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-12T09:06:50.795 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:50.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-12T09:06:50.844 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:50.841+0000 7fa49d7bd200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-12T09:06:50.859 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:50.859 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-12T09:06:50.866 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:50.863+0000 7ff5b325a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-12T09:06:50.928 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:50.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-12T09:06:51.064 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:06:51.065 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-12T09:06:51.076 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:51.074+0000 7ff5b325a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-12T09:06:51.082 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:51.079+0000 7fa49d7bd200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-12T09:06:51.128 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:51.129 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-12T09:06:51.195 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:51.195 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-12T09:06:51.298 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:51.298 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-12T09:06:51.403 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:06:51.404 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-12T09:06:51.469 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:51.467+0000 7ff5b325a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-12T09:06:51.509 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new a895b977-4507-46be-abf8-494fe2e88561 0 2023-05-12T09:06:51.529 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:51.526+0000 7fa49d7bd200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-12T09:06:51.719 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.716+0000 7f886cbff700 1 Processor -- start 2023-05-12T09:06:51.719 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.716+0000 7f886cbff700 1 -- start start 2023-05-12T09:06:51.720 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.717+0000 7f886cbff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f886815c590 0x7f8868160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:51.721 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886cbff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f88680cff50 0x7f88680d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:51.721 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886cbff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88680cd520 con 0x7f88680cf010 2023-05-12T09:06:51.721 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886cbff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88680d2640 con 0x7f88680cff50 2023-05-12T09:06:51.721 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886cbff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88681610d0 con 0x7f886815c590 2023-05-12T09:06:51.722 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886659c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f886815c590 0x7f8868160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:51.722 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886659c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f886815c590 0x7f8868160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:48600/0 (socket says 172.21.15.182:48600) 2023-05-12T09:06:51.722 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886659c700 1 -- 172.21.15.182:0/1603706954 learned_addr learned my addr 172.21.15.182:0/1603706954 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:51.722 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f8866d9d700 1 --2- 172.21.15.182:0/1603706954 >> v2:172.21.15.116:3300/0 conn(0x7f88680cff50 0x7f88680d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:51.723 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886659c700 1 -- 172.21.15.182:0/1603706954 >> v2:172.21.15.116:3300/0 conn(0x7f88680cff50 msgr2=0x7f88680d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:51.723 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886659c700 1 --2- 172.21.15.182:0/1603706954 >> v2:172.21.15.116:3300/0 conn(0x7f88680cff50 0x7f88680d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:51.723 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886659c700 1 -- 172.21.15.182:0/1603706954 >> v1:172.21.15.182:6789/0 conn(0x7f88680cf010 legacy=0x7f88680cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:51.723 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f886659c700 1 -- 172.21.15.182:0/1603706954 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88680b23c0 con 0x7f886815c590 2023-05-12T09:06:51.723 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.718+0000 7f8866d9d700 1 --2- 172.21.15.182:0/1603706954 >> v2:172.21.15.116:3300/0 conn(0x7f88680cff50 0x7f88680d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:51.723 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.719+0000 7f886659c700 1 --2- 172.21.15.182:0/1603706954 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f886815c590 0x7f8868160b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88580098f0 tx=0x7f8858009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad82d59e1b38dcc server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:51.723 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.719+0000 7f886559a700 1 -- 172.21.15.182:0/1603706954 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858011830 con 0x7f886815c590 2023-05-12T09:06:51.723 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.719+0000 7f886559a700 1 -- 172.21.15.182:0/1603706954 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8858011990 con 0x7f886815c590 2023-05-12T09:06:51.724 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.719+0000 7f886559a700 1 -- 172.21.15.182:0/1603706954 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858011d20 con 0x7f886815c590 2023-05-12T09:06:51.724 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.720+0000 7f886cbff700 1 -- 172.21.15.182:0/1603706954 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f886815c590 msgr2=0x7f8868160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:51.725 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.720+0000 7f886cbff700 1 --2- 172.21.15.182:0/1603706954 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f886815c590 0x7f8868160b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88580098f0 tx=0x7f8858009c00 comp rx=0 tx=0).stop 2023-05-12T09:06:51.725 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.720+0000 7f886cbff700 1 -- 172.21.15.182:0/1603706954 shutdown_connections 2023-05-12T09:06:51.725 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.720+0000 7f886cbff700 1 --2- 172.21.15.182:0/1603706954 >> v2:172.21.15.116:3300/0 conn(0x7f88680cff50 0x7f88680d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:51.725 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.720+0000 7f886cbff700 1 --2- 172.21.15.182:0/1603706954 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f886815c590 0x7f8868160b90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:51.725 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.720+0000 7f886cbff700 1 -- 172.21.15.182:0/1603706954 >> 172.21.15.182:0/1603706954 conn(0x7f8868071b10 msgr2=0x7f8868071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:51.725 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.720+0000 7f886cbff700 1 -- 172.21.15.182:0/1603706954 shutdown_connections 2023-05-12T09:06:51.726 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.720+0000 7f886cbff700 1 -- 172.21.15.182:0/1603706954 wait complete. 2023-05-12T09:06:51.726 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.722+0000 7f886cbff700 1 Processor -- start 2023-05-12T09:06:51.726 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.722+0000 7f886cbff700 1 -- start start 2023-05-12T09:06:51.727 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f886cbff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f88680cf010 0x7f88680c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:51.727 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f886cbff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88680cff50 0x7f88681e8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:51.727 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f886cbff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f886815c590 0x7f88681e8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:51.727 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f886cbff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88680b6b60 con 0x7f88680cff50 2023-05-12T09:06:51.728 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f886cbff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88680b6e00 con 0x7f886815c590 2023-05-12T09:06:51.728 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f886cbff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88680b70e0 con 0x7f88680cf010 2023-05-12T09:06:51.728 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f886659c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f88680cf010 0x7f88680c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:51.728 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f8866d9d700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f886815c590 0x7f88681e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:51.728 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f886659c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f88680cf010 0x7f88680c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:48608/0 (socket says 172.21.15.182:48608) 2023-05-12T09:06:51.728 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f8866d9d700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f886815c590 0x7f88681e8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:34146/0 (socket says 172.21.15.182:34146) 2023-05-12T09:06:51.728 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f886659c700 1 -- 172.21.15.182:0/4157978187 learned_addr learned my addr 172.21.15.182:0/4157978187 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:51.729 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.723+0000 7f8865d9b700 1 --2- 172.21.15.182:0/4157978187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88680cff50 0x7f88681e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:51.729 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.724+0000 7f8866d9d700 1 -- 172.21.15.182:0/4157978187 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f88680cf010 msgr2=0x7f88680c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:51.729 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.724+0000 7f8866d9d700 1 --2- 172.21.15.182:0/4157978187 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f88680cf010 0x7f88680c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:51.729 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.724+0000 7f8866d9d700 1 -- 172.21.15.182:0/4157978187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88680cff50 msgr2=0x7f88681e8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:51.729 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.724+0000 7f8866d9d700 1 --2- 172.21.15.182:0/4157978187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88680cff50 0x7f88681e8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:51.729 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.724+0000 7f8866d9d700 1 -- 172.21.15.182:0/4157978187 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860009a70 con 0x7f886815c590 2023-05-12T09:06:51.729 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.724+0000 7f8865d9b700 1 --2- 172.21.15.182:0/4157978187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88680cff50 0x7f88681e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:51.729 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.724+0000 7f8866d9d700 1 --2- 172.21.15.182:0/4157978187 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f886815c590 0x7f88681e8580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f886000efc0 tx=0x7f886000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:51.730 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.724+0000 7f8856ffd700 1 -- 172.21.15.182:0/4157978187 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000ca90 con 0x7f886815c590 2023-05-12T09:06:51.730 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.724+0000 7f8856ffd700 1 -- 172.21.15.182:0/4157978187 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886000f040 con 0x7f886815c590 2023-05-12T09:06:51.731 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.725+0000 7f886cbff700 1 -- 172.21.15.182:0/4157978187 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8858009550 con 0x7f886815c590 2023-05-12T09:06:51.731 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.725+0000 7f8856ffd700 1 -- 172.21.15.182:0/4157978187 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000ce30 con 0x7f886815c590 2023-05-12T09:06:51.731 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.725+0000 7f886cbff700 1 -- 172.21.15.182:0/4157978187 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88680cd770 con 0x7f886815c590 2023-05-12T09:06:51.731 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.725+0000 7f8856ffd700 1 -- 172.21.15.182:0/4157978187 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8860003d20 con 0x7f886815c590 2023-05-12T09:06:51.731 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.725+0000 7f8856ffd700 1 -- 172.21.15.182:0/4157978187 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8860014850 con 0x7f886815c590 2023-05-12T09:06:51.731 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.726+0000 7f886cbff700 1 -- 172.21.15.182:0/4157978187 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88680cf560 con 0x7f886815c590 2023-05-12T09:06:51.732 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.729+0000 7f8856ffd700 1 -- 172.21.15.182:0/4157978187 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f8860018030 con 0x7f886815c590 2023-05-12T09:06:51.819 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.816+0000 7f886cbff700 1 -- 172.21.15.182:0/4157978187 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a895b977-4507-46be-abf8-494fe2e88561", "id": 0} v 0) v1 -- 0x7f886815c960 con 0x7f886815c590 2023-05-12T09:06:51.826 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.823+0000 7f8856ffd700 1 -- 172.21.15.182:0/4157978187 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a895b977-4507-46be-abf8-494fe2e88561", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f886002b0b0 con 0x7f886815c590 2023-05-12T09:06:51.826 INFO:teuthology.orchestra.run.smithi182.stdout:0 2023-05-12T09:06:51.828 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.825+0000 7f886cbff700 1 -- 172.21.15.182:0/4157978187 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f886815c590 msgr2=0x7f88681e8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:51.828 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.825+0000 7f886cbff700 1 --2- 172.21.15.182:0/4157978187 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f886815c590 0x7f88681e8580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f886000efc0 tx=0x7f886000c3a0 comp rx=0 tx=0).stop 2023-05-12T09:06:51.828 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.825+0000 7f886cbff700 1 -- 172.21.15.182:0/4157978187 shutdown_connections 2023-05-12T09:06:51.828 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.825+0000 7f886cbff700 1 --2- 172.21.15.182:0/4157978187 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f886815c590 0x7f88681e8580 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:51.829 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.825+0000 7f886cbff700 1 --2- 172.21.15.182:0/4157978187 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f88680cf010 0x7f88680c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:51.829 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.825+0000 7f886cbff700 1 --2- 172.21.15.182:0/4157978187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88680cff50 0x7f88681e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:51.829 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.825+0000 7f886cbff700 1 -- 172.21.15.182:0/4157978187 >> 172.21.15.182:0/4157978187 conn(0x7f8868071b10 msgr2=0x7f88680b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:51.829 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.825+0000 7f886cbff700 1 -- 172.21.15.182:0/4157978187 shutdown_connections 2023-05-12T09:06:51.830 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:51.825+0000 7f886cbff700 1 -- 172.21.15.182:0/4157978187 wait complete. 2023-05-12T09:06:51.846 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new d19ccfdf-9409-41c5-807b-8a27593f3e51 1 2023-05-12T09:06:52.036 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.033+0000 7fd33fbff700 1 Processor -- start 2023-05-12T09:06:52.036 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.033+0000 7fd33fbff700 1 -- start start 2023-05-12T09:06:52.037 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.034+0000 7fd33fbff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3381608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.037 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.034+0000 7fd33fbff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd3380d1100 0x7fd3380d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.037 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.034+0000 7fd33fbff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3380d0020 con 0x7fd3380b87a0 2023-05-12T09:06:52.038 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.034+0000 7fd33fbff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3380d02d0 con 0x7fd3380d1100 2023-05-12T09:06:52.038 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.034+0000 7fd33fbff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380d0cb0 con 0x7fd3380cfbf0 2023-05-12T09:06:52.038 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.034+0000 7fd33d19a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3381608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.039 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.034+0000 7fd33d19a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3381608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:48620/0 (socket says 172.21.15.182:48620) 2023-05-12T09:06:52.039 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.034+0000 7fd33d19a700 1 -- 172.21.15.182:0/1241560241 learned_addr learned my addr 172.21.15.182:0/1241560241 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:52.040 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.035+0000 7fd33e19c700 1 --2- 172.21.15.182:0/1241560241 >> v2:172.21.15.116:3300/0 conn(0x7fd3380d1100 0x7fd3380d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.040 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.035+0000 7fd33d19a700 1 -- 172.21.15.182:0/1241560241 >> v2:172.21.15.116:3300/0 conn(0x7fd3380d1100 msgr2=0x7fd3380d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:52.040 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.035+0000 7fd33d19a700 1 --2- 172.21.15.182:0/1241560241 >> v2:172.21.15.116:3300/0 conn(0x7fd3380d1100 0x7fd3380d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.040 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.035+0000 7fd33d19a700 1 -- 172.21.15.182:0/1241560241 >> v1:172.21.15.182:6789/0 conn(0x7fd3380b87a0 legacy=0x7fd3381601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.040 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.035+0000 7fd33d19a700 1 -- 172.21.15.182:0/1241560241 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380cdc60 con 0x7fd3380cfbf0 2023-05-12T09:06:52.040 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.035+0000 7fd33d19a700 1 --2- 172.21.15.182:0/1241560241 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3381608f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3280098f0 tx=0x7fd328009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83c71181f582e84b server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:52.041 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.035+0000 7fd33c999700 1 -- 172.21.15.182:0/1241560241 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32800b8a0 con 0x7fd3380cfbf0 2023-05-12T09:06:52.041 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.035+0000 7fd33c999700 1 -- 172.21.15.182:0/1241560241 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32800ba00 con 0x7fd3380cfbf0 2023-05-12T09:06:52.041 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.035+0000 7fd33c999700 1 -- 172.21.15.182:0/1241560241 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32800bd90 con 0x7fd3380cfbf0 2023-05-12T09:06:52.041 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.036+0000 7fd33fbff700 1 -- 172.21.15.182:0/1241560241 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 msgr2=0x7fd3381608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.041 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.036+0000 7fd33fbff700 1 --2- 172.21.15.182:0/1241560241 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3381608f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3280098f0 tx=0x7fd328009c00 comp rx=0 tx=0).stop 2023-05-12T09:06:52.041 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.036+0000 7fd33fbff700 1 -- 172.21.15.182:0/1241560241 shutdown_connections 2023-05-12T09:06:52.041 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.036+0000 7fd33fbff700 1 --2- 172.21.15.182:0/1241560241 >> v2:172.21.15.116:3300/0 conn(0x7fd3380d1100 0x7fd3380d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.041 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.036+0000 7fd33fbff700 1 --2- 172.21.15.182:0/1241560241 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3381608f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.042 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.036+0000 7fd33fbff700 1 -- 172.21.15.182:0/1241560241 >> 172.21.15.182:0/1241560241 conn(0x7fd338071b10 msgr2=0x7fd338071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:52.042 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.036+0000 7fd33fbff700 1 -- 172.21.15.182:0/1241560241 shutdown_connections 2023-05-12T09:06:52.042 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.037+0000 7fd33fbff700 1 -- 172.21.15.182:0/1241560241 wait complete. 2023-05-12T09:06:52.042 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.039+0000 7fd33fbff700 1 Processor -- start 2023-05-12T09:06:52.043 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.039+0000 7fd33fbff700 1 -- start start 2023-05-12T09:06:52.045 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33fbff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3380b87a0 0x7fd33815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.046 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33fbff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3380c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.046 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33fbff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd3380d1100 0x7fd3380d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.046 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33fbff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33815faf0 con 0x7fd3380b87a0 2023-05-12T09:06:52.046 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33fbff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380c6f00 con 0x7fd3380d1100 2023-05-12T09:06:52.046 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33fbff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380c7130 con 0x7fd3380cfbf0 2023-05-12T09:06:52.046 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33d99b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3380b87a0 0x7fd33815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.046 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33d19a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3380c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.047 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33e19c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd3380d1100 0x7fd3380d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.047 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33d99b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3380b87a0 0x7fd33815dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.182:48520/0 (socket says 172.21.15.182:48520) 2023-05-12T09:06:52.047 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.040+0000 7fd33d99b700 1 -- 172.21.15.182:0/1414187003 learned_addr learned my addr 172.21.15.182:0/1414187003 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:52.047 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.041+0000 7fd33d19a700 1 -- 172.21.15.182:0/1414187003 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd3380d1100 msgr2=0x7fd3380d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.047 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.041+0000 7fd33d19a700 1 --2- 172.21.15.182:0/1414187003 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd3380d1100 0x7fd3380d2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.047 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.041+0000 7fd33d19a700 1 -- 172.21.15.182:0/1414187003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3380b87a0 msgr2=0x7fd33815dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.047 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.041+0000 7fd33d19a700 1 --2- 172.21.15.182:0/1414187003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3380b87a0 0x7fd33815dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.048 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.041+0000 7fd33d19a700 1 -- 172.21.15.182:0/1414187003 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd328009550 con 0x7fd3380cfbf0 2023-05-12T09:06:52.048 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.041+0000 7fd33d19a700 1 --2- 172.21.15.182:0/1414187003 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3380c69c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd328016000 tx=0x7fd328004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:52.048 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.041+0000 7fd32e7fc700 1 -- 172.21.15.182:0/1414187003 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328004300 con 0x7fd3380cfbf0 2023-05-12T09:06:52.048 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.042+0000 7fd32e7fc700 1 -- 172.21.15.182:0/1414187003 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32801f070 con 0x7fd3380cfbf0 2023-05-12T09:06:52.048 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.042+0000 7fd33fbff700 1 -- 172.21.15.182:0/1414187003 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3380cd980 con 0x7fd3380cfbf0 2023-05-12T09:06:52.048 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.042+0000 7fd32e7fc700 1 -- 172.21.15.182:0/1414187003 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280036a0 con 0x7fd3380cfbf0 2023-05-12T09:06:52.048 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.042+0000 7fd33fbff700 1 -- 172.21.15.182:0/1414187003 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3380cd6a0 con 0x7fd3380cfbf0 2023-05-12T09:06:52.049 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.042+0000 7fd32e7fc700 1 -- 172.21.15.182:0/1414187003 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd328021030 con 0x7fd3380cfbf0 2023-05-12T09:06:52.049 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.042+0000 7fd32e7fc700 1 -- 172.21.15.182:0/1414187003 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fd32801a850 con 0x7fd3380cfbf0 2023-05-12T09:06:52.049 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.043+0000 7fd33fbff700 1 -- 172.21.15.182:0/1414187003 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd338160e30 con 0x7fd3380cfbf0 2023-05-12T09:06:52.050 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.047+0000 7fd32e7fc700 1 -- 172.21.15.182:0/1414187003 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fd328015020 con 0x7fd3380cfbf0 2023-05-12T09:06:52.077 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:52.075+0000 7ff5b325a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-12T09:06:52.138 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.135+0000 7fd33fbff700 1 -- 172.21.15.182:0/1414187003 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d19ccfdf-9409-41c5-807b-8a27593f3e51", "id": 1} v 0) v1 -- 0x7fd338074430 con 0x7fd3380cfbf0 2023-05-12T09:06:52.146 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.143+0000 7fd32e7fc700 1 -- 172.21.15.182:0/1414187003 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d19ccfdf-9409-41c5-807b-8a27593f3e51", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd328003c90 con 0x7fd3380cfbf0 2023-05-12T09:06:52.146 INFO:teuthology.orchestra.run.smithi182.stdout:1 2023-05-12T09:06:52.147 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.144+0000 7fd33fbff700 1 -- 172.21.15.182:0/1414187003 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 msgr2=0x7fd3380c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.147 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.144+0000 7fd33fbff700 1 --2- 172.21.15.182:0/1414187003 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3380c69c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd328016000 tx=0x7fd328004750 comp rx=0 tx=0).stop 2023-05-12T09:06:52.147 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.144+0000 7fd33fbff700 1 -- 172.21.15.182:0/1414187003 shutdown_connections 2023-05-12T09:06:52.147 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.144+0000 7fd33fbff700 1 --2- 172.21.15.182:0/1414187003 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd3380d1100 0x7fd3380d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.147 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.144+0000 7fd33fbff700 1 --2- 172.21.15.182:0/1414187003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3380b87a0 0x7fd33815dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.148 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.144+0000 7fd33fbff700 1 --2- 172.21.15.182:0/1414187003 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd3380cfbf0 0x7fd3380c69c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.148 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.144+0000 7fd33fbff700 1 -- 172.21.15.182:0/1414187003 >> 172.21.15.182:0/1414187003 conn(0x7fd338071b10 msgr2=0x7fd3380cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:52.148 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.144+0000 7fd33fbff700 1 -- 172.21.15.182:0/1414187003 shutdown_connections 2023-05-12T09:06:52.148 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.144+0000 7fd33fbff700 1 -- 172.21.15.182:0/1414187003 wait complete. 2023-05-12T09:06:52.165 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new 15b1f7d0-6853-4d4d-ac87-adc73d48b055 2 2023-05-12T09:06:52.219 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:52.216+0000 7fa49d7bd200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-12T09:06:52.308 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:52.306+0000 7ff5b325a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-12T09:06:52.354 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.351+0000 7fcad75ff700 1 Processor -- start 2023-05-12T09:06:52.355 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.351+0000 7fcad75ff700 1 -- start start 2023-05-12T09:06:52.357 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.352+0000 7fcad75ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad00b87a0 0x7fcad00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.357 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.352+0000 7fcad75ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcad01601e0 0x7fcad0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.357 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.352+0000 7fcad75ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fcad0160b70 0x7fcad00d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.357 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.352+0000 7fcad75ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00d02d0 con 0x7fcad01601e0 2023-05-12T09:06:52.357 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.352+0000 7fcad75ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00d0cb0 con 0x7fcad0160b70 2023-05-12T09:06:52.357 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.352+0000 7fcad75ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00b2730 con 0x7fcad00b87a0 2023-05-12T09:06:52.358 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad539b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad00b87a0 0x7fcad00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.358 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad5b9c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fcad0160b70 0x7fcad00d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.358 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad5b9c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fcad0160b70 0x7fcad00d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:34166/0 (socket says 172.21.15.182:34166) 2023-05-12T09:06:52.358 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad4b9a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcad01601e0 0x7fcad0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.358 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad5b9c700 1 -- 172.21.15.182:0/3930485675 learned_addr learned my addr 172.21.15.182:0/3930485675 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:52.358 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad539b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad00b87a0 0x7fcad00cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:48640/0 (socket says 172.21.15.182:48640) 2023-05-12T09:06:52.358 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad5b9c700 1 -- 172.21.15.182:0/3930485675 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad00b87a0 msgr2=0x7fcad00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:52.359 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad5b9c700 1 --2- 172.21.15.182:0/3930485675 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad00b87a0 0x7fcad00cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.360 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad5b9c700 1 -- 172.21.15.182:0/3930485675 >> v2:172.21.15.116:3300/0 conn(0x7fcad01601e0 msgr2=0x7fcad0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:52.360 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad5b9c700 1 --2- 172.21.15.182:0/3930485675 >> v2:172.21.15.116:3300/0 conn(0x7fcad01601e0 0x7fcad0160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.360 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad5b9c700 1 -- 172.21.15.182:0/3930485675 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0160ff0 con 0x7fcad0160b70 2023-05-12T09:06:52.361 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.353+0000 7fcad5b9c700 1 --2- 172.21.15.182:0/3930485675 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad0160b70 0x7fcad00d2de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcad008be30 tx=0x7fcac800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c34dd9b54af5218 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:52.361 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.354+0000 7fcac7fff700 1 -- 172.21.15.182:0/3930485675 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac800e070 con 0x7fcad0160b70 2023-05-12T09:06:52.361 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.354+0000 7fcac7fff700 1 -- 172.21.15.182:0/3930485675 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac800b910 con 0x7fcad0160b70 2023-05-12T09:06:52.361 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.354+0000 7fcac7fff700 1 -- 172.21.15.182:0/3930485675 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac800bcc0 con 0x7fcad0160b70 2023-05-12T09:06:52.364 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.354+0000 7fcad75ff700 1 -- 172.21.15.182:0/3930485675 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad0160b70 msgr2=0x7fcad00d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.364 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.354+0000 7fcad75ff700 1 --2- 172.21.15.182:0/3930485675 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad0160b70 0x7fcad00d2de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcad008be30 tx=0x7fcac800b330 comp rx=0 tx=0).stop 2023-05-12T09:06:52.365 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.355+0000 7fcad75ff700 1 -- 172.21.15.182:0/3930485675 shutdown_connections 2023-05-12T09:06:52.365 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.355+0000 7fcad75ff700 1 --2- 172.21.15.182:0/3930485675 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad0160b70 0x7fcad00d2de0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.365 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.355+0000 7fcad75ff700 1 --2- 172.21.15.182:0/3930485675 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad00b87a0 0x7fcad00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.365 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.355+0000 7fcad75ff700 1 --2- 172.21.15.182:0/3930485675 >> v2:172.21.15.116:3300/0 conn(0x7fcad01601e0 0x7fcad0160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.365 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.355+0000 7fcad75ff700 1 -- 172.21.15.182:0/3930485675 >> 172.21.15.182:0/3930485675 conn(0x7fcad0071b10 msgr2=0x7fcad0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:52.365 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.355+0000 7fcad75ff700 1 -- 172.21.15.182:0/3930485675 shutdown_connections 2023-05-12T09:06:52.365 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.355+0000 7fcad75ff700 1 -- 172.21.15.182:0/3930485675 wait complete. 2023-05-12T09:06:52.366 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.356+0000 7fcad75ff700 1 Processor -- start 2023-05-12T09:06:52.366 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.356+0000 7fcad75ff700 1 -- start start 2023-05-12T09:06:52.366 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.357+0000 7fcad75ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad00b87a0 0x7fcad01f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.366 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.357+0000 7fcad75ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad01601e0 0x7fcad015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.366 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.357+0000 7fcad75ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad0160b70 0x7fcad00b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.366 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.357+0000 7fcad75ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00c7970 con 0x7fcad00b87a0 2023-05-12T09:06:52.366 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.357+0000 7fcad75ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00c6cf0 con 0x7fcad01601e0 2023-05-12T09:06:52.366 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.357+0000 7fcad75ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00c6fd0 con 0x7fcad0160b70 2023-05-12T09:06:52.367 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad4b9a700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad01601e0 0x7fcad015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.367 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad539b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad00b87a0 0x7fcad01f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.367 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad4b9a700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad01601e0 0x7fcad015da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:34174/0 (socket says 172.21.15.182:34174) 2023-05-12T09:06:52.367 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad5b9c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad0160b70 0x7fcad00b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.367 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad4b9a700 1 -- 172.21.15.182:0/1089327888 learned_addr learned my addr 172.21.15.182:0/1089327888 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:52.367 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad5b9c700 1 -- 172.21.15.182:0/1089327888 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad01601e0 msgr2=0x7fcad015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.367 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad5b9c700 1 --2- 172.21.15.182:0/1089327888 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad01601e0 0x7fcad015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.368 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad5b9c700 1 -- 172.21.15.182:0/1089327888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad00b87a0 msgr2=0x7fcad01f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.368 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad5b9c700 1 --2- 172.21.15.182:0/1089327888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad00b87a0 0x7fcad01f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.368 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad5b9c700 1 -- 172.21.15.182:0/1089327888 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac8009b30 con 0x7fcad0160b70 2023-05-12T09:06:52.368 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad4b9a700 1 --2- 172.21.15.182:0/1089327888 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad01601e0 0x7fcad015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:52.368 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad539b700 1 --2- 172.21.15.182:0/1089327888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad00b87a0 0x7fcad01f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:52.368 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.358+0000 7fcad5b9c700 1 --2- 172.21.15.182:0/1089327888 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad0160b70 0x7fcad00b6d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcac8015000 tx=0x7fcac8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:52.368 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.359+0000 7fcac5ffb700 1 -- 172.21.15.182:0/1089327888 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac80099b0 con 0x7fcad0160b70 2023-05-12T09:06:52.369 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.359+0000 7fcac5ffb700 1 -- 172.21.15.182:0/1089327888 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac800ce80 con 0x7fcad0160b70 2023-05-12T09:06:52.369 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.359+0000 7fcac5ffb700 1 -- 172.21.15.182:0/1089327888 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8004490 con 0x7fcad0160b70 2023-05-12T09:06:52.369 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.359+0000 7fcad75ff700 1 -- 172.21.15.182:0/1089327888 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad00cd6a0 con 0x7fcad0160b70 2023-05-12T09:06:52.369 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.359+0000 7fcad75ff700 1 -- 172.21.15.182:0/1089327888 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad00cdc60 con 0x7fcad0160b70 2023-05-12T09:06:52.369 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.359+0000 7fcac5ffb700 1 -- 172.21.15.182:0/1089327888 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcac801c440 con 0x7fcad0160b70 2023-05-12T09:06:52.369 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.359+0000 7fcac5ffb700 1 -- 172.21.15.182:0/1089327888 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fcac8025830 con 0x7fcad0160b70 2023-05-12T09:06:52.369 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.360+0000 7fcad75ff700 1 -- 172.21.15.182:0/1089327888 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad00cd980 con 0x7fcad0160b70 2023-05-12T09:06:52.370 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.363+0000 7fcac5ffb700 1 -- 172.21.15.182:0/1089327888 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fcac8043b10 con 0x7fcad0160b70 2023-05-12T09:06:52.452 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.449+0000 7fcad75ff700 1 -- 172.21.15.182:0/1089327888 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15b1f7d0-6853-4d4d-ac87-adc73d48b055", "id": 2} v 0) v1 -- 0x7fcad00c7ab0 con 0x7fcad0160b70 2023-05-12T09:06:52.460 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.457+0000 7fcac5ffb700 1 -- 172.21.15.182:0/1089327888 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15b1f7d0-6853-4d4d-ac87-adc73d48b055", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcad00c7ab0 con 0x7fcad0160b70 2023-05-12T09:06:52.460 INFO:teuthology.orchestra.run.smithi182.stdout:2 2023-05-12T09:06:52.461 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.458+0000 7fcad75ff700 1 -- 172.21.15.182:0/1089327888 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad0160b70 msgr2=0x7fcad00b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.461 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.458+0000 7fcad75ff700 1 --2- 172.21.15.182:0/1089327888 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad0160b70 0x7fcad00b6d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcac8015000 tx=0x7fcac8004ad0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.462 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.458+0000 7fcad75ff700 1 -- 172.21.15.182:0/1089327888 shutdown_connections 2023-05-12T09:06:52.462 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.458+0000 7fcad75ff700 1 --2- 172.21.15.182:0/1089327888 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcad0160b70 0x7fcad00b6d30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.462 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.458+0000 7fcad75ff700 1 --2- 172.21.15.182:0/1089327888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad00b87a0 0x7fcad01f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.462 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.458+0000 7fcad75ff700 1 --2- 172.21.15.182:0/1089327888 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcad01601e0 0x7fcad015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.462 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.458+0000 7fcad75ff700 1 -- 172.21.15.182:0/1089327888 >> 172.21.15.182:0/1089327888 conn(0x7fcad0071b10 msgr2=0x7fcad00d3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:52.462 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.458+0000 7fcad75ff700 1 -- 172.21.15.182:0/1089327888 shutdown_connections 2023-05-12T09:06:52.462 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.459+0000 7fcad75ff700 1 -- 172.21.15.182:0/1089327888 wait complete. 2023-05-12T09:06:52.469 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:52.467+0000 7fa49d7bd200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-12T09:06:52.479 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new e8e98cd8-d7fd-4307-ad89-c70964d64c21 3 2023-05-12T09:06:52.664 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.661+0000 7f3b05bff700 1 Processor -- start 2023-05-12T09:06:52.664 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.661+0000 7f3b05bff700 1 -- start start 2023-05-12T09:06:52.666 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.662+0000 7f3b05bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b000cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.666 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.662+0000 7f3b05bff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3b001601e0 0x7f3b00160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.666 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.662+0000 7f3b05bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f3b00160b70 0x7f3b000d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.666 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.662+0000 7f3b05bff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b000d02d0 con 0x7f3b001601e0 2023-05-12T09:06:52.666 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.662+0000 7f3b05bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b000d0cb0 con 0x7f3b00160b70 2023-05-12T09:06:52.667 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.662+0000 7f3b05bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000b2730 con 0x7f3b000b87a0 2023-05-12T09:06:52.667 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.662+0000 7f3afffff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f3b00160b70 0x7f3b000d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.667 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.662+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b000cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.667 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.663+0000 7f3afffff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f3b00160b70 0x7f3b000d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:34176/0 (socket says 172.21.15.182:34176) 2023-05-12T09:06:52.667 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.663+0000 7f3afffff700 1 -- 172.21.15.182:0/969214223 learned_addr learned my addr 172.21.15.182:0/969214223 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:52.667 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.663+0000 7f3afeffd700 1 --2- 172.21.15.182:0/969214223 >> v2:172.21.15.116:3300/0 conn(0x7f3b001601e0 0x7f3b00160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.667 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.663+0000 7f3afffff700 1 -- 172.21.15.182:0/969214223 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 msgr2=0x7f3b000cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:52.668 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.663+0000 7f3afffff700 1 --2- 172.21.15.182:0/969214223 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b000cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.668 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.663+0000 7f3afffff700 1 -- 172.21.15.182:0/969214223 >> v2:172.21.15.116:3300/0 conn(0x7f3b001601e0 msgr2=0x7f3b00160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:52.668 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.663+0000 7f3afffff700 1 --2- 172.21.15.182:0/969214223 >> v2:172.21.15.116:3300/0 conn(0x7f3b001601e0 0x7f3b00160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.668 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.663+0000 7f3afffff700 1 -- 172.21.15.182:0/969214223 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b00160ff0 con 0x7f3b00160b70 2023-05-12T09:06:52.668 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.663+0000 7f3aff7fe700 1 --2- 172.21.15.182:0/969214223 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b000cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:52.669 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.663+0000 7f3afffff700 1 --2- 172.21.15.182:0/969214223 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b00160b70 0x7f3b000d2de0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b0008be30 tx=0x7f3af800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72e0aea52e52a8c6 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:52.670 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.664+0000 7f3afe7fc700 1 -- 172.21.15.182:0/969214223 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800e070 con 0x7f3b00160b70 2023-05-12T09:06:52.670 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.664+0000 7f3afe7fc700 1 -- 172.21.15.182:0/969214223 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af800b910 con 0x7f3b00160b70 2023-05-12T09:06:52.670 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.664+0000 7f3afe7fc700 1 -- 172.21.15.182:0/969214223 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800bcc0 con 0x7f3b00160b70 2023-05-12T09:06:52.670 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.664+0000 7f3b05bff700 1 -- 172.21.15.182:0/969214223 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b00160b70 msgr2=0x7f3b000d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.670 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.664+0000 7f3b05bff700 1 --2- 172.21.15.182:0/969214223 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b00160b70 0x7f3b000d2de0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b0008be30 tx=0x7f3af800b330 comp rx=0 tx=0).stop 2023-05-12T09:06:52.670 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.664+0000 7f3b05bff700 1 -- 172.21.15.182:0/969214223 shutdown_connections 2023-05-12T09:06:52.670 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.664+0000 7f3b05bff700 1 --2- 172.21.15.182:0/969214223 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b00160b70 0x7f3b000d2de0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.671 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.664+0000 7f3b05bff700 1 --2- 172.21.15.182:0/969214223 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b000cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.671 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.664+0000 7f3b05bff700 1 --2- 172.21.15.182:0/969214223 >> v2:172.21.15.116:3300/0 conn(0x7f3b001601e0 0x7f3b00160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.671 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.664+0000 7f3b05bff700 1 -- 172.21.15.182:0/969214223 >> 172.21.15.182:0/969214223 conn(0x7f3b00071b10 msgr2=0x7f3b00071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:52.671 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.665+0000 7f3b05bff700 1 -- 172.21.15.182:0/969214223 shutdown_connections 2023-05-12T09:06:52.671 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.665+0000 7f3b05bff700 1 -- 172.21.15.182:0/969214223 wait complete. 2023-05-12T09:06:52.673 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.667+0000 7f3b05bff700 1 Processor -- start 2023-05-12T09:06:52.673 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.668+0000 7f3b05bff700 1 -- start start 2023-05-12T09:06:52.673 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3b05bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b00151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.673 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3b05bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b001601e0 0x7f3b001525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.674 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3b05bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b00160b70 0x7f3b00152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.674 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3b05bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000d3850 con 0x7f3b00160b70 2023-05-12T09:06:52.674 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3b05bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00156270 con 0x7f3b001601e0 2023-05-12T09:06:52.674 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3b05bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00156550 con 0x7f3b000b87a0 2023-05-12T09:06:52.674 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b00151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.674 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3afeffd700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b001601e0 0x7f3b001525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.675 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b00151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:48650/0 (socket says 172.21.15.182:48650) 2023-05-12T09:06:52.675 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3afeffd700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b001601e0 0x7f3b001525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:34182/0 (socket says 172.21.15.182:34182) 2023-05-12T09:06:52.675 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.669+0000 7f3aff7fe700 1 -- 172.21.15.182:0/1958169987 learned_addr learned my addr 172.21.15.182:0/1958169987 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:52.675 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.670+0000 7f3afffff700 1 --2- 172.21.15.182:0/1958169987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b00160b70 0x7f3b00152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.675 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.670+0000 7f3afeffd700 1 -- 172.21.15.182:0/1958169987 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 msgr2=0x7f3b00151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.675 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.670+0000 7f3afeffd700 1 --2- 172.21.15.182:0/1958169987 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b00151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.676 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.670+0000 7f3afeffd700 1 -- 172.21.15.182:0/1958169987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b00160b70 msgr2=0x7f3b00152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.676 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.670+0000 7f3afeffd700 1 --2- 172.21.15.182:0/1958169987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b00160b70 0x7f3b00152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.676 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.670+0000 7f3afeffd700 1 -- 172.21.15.182:0/1958169987 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00094a0 con 0x7f3b001601e0 2023-05-12T09:06:52.676 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.670+0000 7f3aff7fe700 1 --2- 172.21.15.182:0/1958169987 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b00151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:52.676 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.670+0000 7f3afffff700 1 --2- 172.21.15.182:0/1958169987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b00160b70 0x7f3b00152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:52.678 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.670+0000 7f3afeffd700 1 --2- 172.21.15.182:0/1958169987 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b001601e0 0x7f3b001525f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3af400e900 tx=0x7f3af400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:52.678 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.671+0000 7f3ae7fff700 1 -- 172.21.15.182:0/1958169987 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4013680 con 0x7f3b001601e0 2023-05-12T09:06:52.678 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.671+0000 7f3ae7fff700 1 -- 172.21.15.182:0/1958169987 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af40137e0 con 0x7f3b001601e0 2023-05-12T09:06:52.678 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.671+0000 7f3ae7fff700 1 -- 172.21.15.182:0/1958169987 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4013b50 con 0x7f3b001601e0 2023-05-12T09:06:52.679 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.671+0000 7f3b05bff700 1 -- 172.21.15.182:0/1958169987 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af8009b30 con 0x7f3b001601e0 2023-05-12T09:06:52.679 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.671+0000 7f3b05bff700 1 -- 172.21.15.182:0/1958169987 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b000cd6a0 con 0x7f3b001601e0 2023-05-12T09:06:52.679 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.671+0000 7f3ae7fff700 1 -- 172.21.15.182:0/1958169987 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3af4005a20 con 0x7f3b001601e0 2023-05-12T09:06:52.679 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.671+0000 7f3ae7fff700 1 -- 172.21.15.182:0/1958169987 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f3af4006910 con 0x7f3b001601e0 2023-05-12T09:06:52.679 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.672+0000 7f3b05bff700 1 -- 172.21.15.182:0/1958169987 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b000cdc60 con 0x7f3b001601e0 2023-05-12T09:06:52.680 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.676+0000 7f3ae7fff700 1 -- 172.21.15.182:0/1958169987 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f3af403bb10 con 0x7f3b001601e0 2023-05-12T09:06:52.738 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:52.735+0000 7ff5b325a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-12T09:06:52.773 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.770+0000 7f3b05bff700 1 -- 172.21.15.182:0/1958169987 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e8e98cd8-d7fd-4307-ad89-c70964d64c21", "id": 3} v 0) v1 -- 0x7f3b000cd980 con 0x7f3b001601e0 2023-05-12T09:06:52.779 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.776+0000 7f3ae7fff700 1 -- 172.21.15.182:0/1958169987 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e8e98cd8-d7fd-4307-ad89-c70964d64c21", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3af402a070 con 0x7f3b001601e0 2023-05-12T09:06:52.780 INFO:teuthology.orchestra.run.smithi182.stdout:3 2023-05-12T09:06:52.780 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.777+0000 7f3b05bff700 1 -- 172.21.15.182:0/1958169987 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b001601e0 msgr2=0x7f3b001525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.781 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.777+0000 7f3b05bff700 1 --2- 172.21.15.182:0/1958169987 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b001601e0 0x7f3b001525f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3af400e900 tx=0x7f3af400ec10 comp rx=0 tx=0).stop 2023-05-12T09:06:52.781 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.777+0000 7f3b05bff700 1 -- 172.21.15.182:0/1958169987 shutdown_connections 2023-05-12T09:06:52.781 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.777+0000 7f3b05bff700 1 --2- 172.21.15.182:0/1958169987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b00160b70 0x7f3b00152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.781 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.777+0000 7f3b05bff700 1 --2- 172.21.15.182:0/1958169987 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b000b87a0 0x7f3b00151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.781 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.777+0000 7f3b05bff700 1 --2- 172.21.15.182:0/1958169987 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b001601e0 0x7f3b001525f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.781 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.777+0000 7f3b05bff700 1 -- 172.21.15.182:0/1958169987 >> 172.21.15.182:0/1958169987 conn(0x7f3b00071b10 msgr2=0x7f3b0015ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:52.782 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.777+0000 7f3b05bff700 1 -- 172.21.15.182:0/1958169987 shutdown_connections 2023-05-12T09:06:52.782 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.778+0000 7f3b05bff700 1 -- 172.21.15.182:0/1958169987 wait complete. 2023-05-12T09:06:52.798 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new 73ace088-82d8-4fba-9170-09b4d10f7b87 4 2023-05-12T09:06:52.982 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:52.979+0000 7fa49d7bd200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-12T09:06:52.984 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.981+0000 7fc9b05ff700 1 Processor -- start 2023-05-12T09:06:52.985 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.982+0000 7fc9b05ff700 1 -- start start 2023-05-12T09:06:52.987 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9b05ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc9a80b87a0 0x7fc9a80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.988 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9b05ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a81601e0 0x7fc9a8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.988 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9b05ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc9a8160b70 0x7fc9a80d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.988 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9b05ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a80d02d0 con 0x7fc9a80b87a0 2023-05-12T09:06:52.988 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9b05ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a80d0cb0 con 0x7fc9a8160b70 2023-05-12T09:06:52.988 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9b05ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80b2730 con 0x7fc9a81601e0 2023-05-12T09:06:52.989 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9aeb9c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc9a8160b70 0x7fc9a80d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.989 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9adb9a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a81601e0 0x7fc9a8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.989 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9aeb9c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc9a8160b70 0x7fc9a80d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:34186/0 (socket says 172.21.15.182:34186) 2023-05-12T09:06:52.989 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9aeb9c700 1 -- 172.21.15.182:0/3473675287 learned_addr learned my addr 172.21.15.182:0/3473675287 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:52.989 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.984+0000 7fc9ae39b700 1 --2- 172.21.15.182:0/3473675287 >> v2:172.21.15.116:3300/0 conn(0x7fc9a80b87a0 0x7fc9a80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.989 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9aeb9c700 1 -- 172.21.15.182:0/3473675287 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a81601e0 msgr2=0x7fc9a8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:52.989 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9aeb9c700 1 --2- 172.21.15.182:0/3473675287 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a81601e0 0x7fc9a8160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.990 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9aeb9c700 1 -- 172.21.15.182:0/3473675287 >> v2:172.21.15.116:3300/0 conn(0x7fc9a80b87a0 msgr2=0x7fc9a80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:52.990 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9aeb9c700 1 --2- 172.21.15.182:0/3473675287 >> v2:172.21.15.116:3300/0 conn(0x7fc9a80b87a0 0x7fc9a80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.990 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9aeb9c700 1 -- 172.21.15.182:0/3473675287 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a8160ff0 con 0x7fc9a8160b70 2023-05-12T09:06:52.990 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9adb9a700 1 --2- 172.21.15.182:0/3473675287 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a81601e0 0x7fc9a8160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:52.990 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9ae39b700 1 --2- 172.21.15.182:0/3473675287 >> v2:172.21.15.116:3300/0 conn(0x7fc9a80b87a0 0x7fc9a80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:52.990 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9aeb9c700 1 --2- 172.21.15.182:0/3473675287 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9a8160b70 0x7fc9a80d2de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc9a808be30 tx=0x7fc9a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4187411aa76aaaf9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:52.992 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9ad399700 1 -- 172.21.15.182:0/3473675287 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000e070 con 0x7fc9a8160b70 2023-05-12T09:06:52.992 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9ad399700 1 -- 172.21.15.182:0/3473675287 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a000b910 con 0x7fc9a8160b70 2023-05-12T09:06:52.992 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.985+0000 7fc9ad399700 1 -- 172.21.15.182:0/3473675287 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000bcc0 con 0x7fc9a8160b70 2023-05-12T09:06:52.992 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.986+0000 7fc9b05ff700 1 -- 172.21.15.182:0/3473675287 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9a8160b70 msgr2=0x7fc9a80d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.993 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.986+0000 7fc9b05ff700 1 --2- 172.21.15.182:0/3473675287 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9a8160b70 0x7fc9a80d2de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc9a808be30 tx=0x7fc9a000b330 comp rx=0 tx=0).stop 2023-05-12T09:06:52.993 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.986+0000 7fc9b05ff700 1 -- 172.21.15.182:0/3473675287 shutdown_connections 2023-05-12T09:06:52.993 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.986+0000 7fc9b05ff700 1 --2- 172.21.15.182:0/3473675287 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9a8160b70 0x7fc9a80d2de0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.993 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.986+0000 7fc9b05ff700 1 --2- 172.21.15.182:0/3473675287 >> v2:172.21.15.116:3300/0 conn(0x7fc9a80b87a0 0x7fc9a80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.993 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.986+0000 7fc9b05ff700 1 --2- 172.21.15.182:0/3473675287 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a81601e0 0x7fc9a8160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.993 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.986+0000 7fc9b05ff700 1 -- 172.21.15.182:0/3473675287 >> 172.21.15.182:0/3473675287 conn(0x7fc9a8071b10 msgr2=0x7fc9a8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:52.993 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.986+0000 7fc9b05ff700 1 -- 172.21.15.182:0/3473675287 shutdown_connections 2023-05-12T09:06:52.994 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.986+0000 7fc9b05ff700 1 -- 172.21.15.182:0/3473675287 wait complete. 2023-05-12T09:06:52.994 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.988+0000 7fc9b05ff700 1 Processor -- start 2023-05-12T09:06:52.994 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.988+0000 7fc9b05ff700 1 -- start start 2023-05-12T09:06:52.994 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9b05ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a80b87a0 0x7fc9a80cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.994 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9b05ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9a81601e0 0x7fc9a8151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.994 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9b05ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9a8160b70 0x7fc9a815f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:52.995 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9b05ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80cb320 con 0x7fc9a8160b70 2023-05-12T09:06:52.995 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9b05ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80ca950 con 0x7fc9a81601e0 2023-05-12T09:06:52.995 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9b05ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a81516b0 con 0x7fc9a80b87a0 2023-05-12T09:06:52.995 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9ae39b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a80b87a0 0x7fc9a80cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.995 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9adb9a700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9a81601e0 0x7fc9a8151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.995 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9ae39b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a80b87a0 0x7fc9a80cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:48664/0 (socket says 172.21.15.182:48664) 2023-05-12T09:06:52.995 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9ae39b700 1 -- 172.21.15.182:0/312077178 learned_addr learned my addr 172.21.15.182:0/312077178 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:52.996 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9aeb9c700 1 --2- 172.21.15.182:0/312077178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9a8160b70 0x7fc9a815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:52.997 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9ae39b700 1 -- 172.21.15.182:0/312077178 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9a81601e0 msgr2=0x7fc9a8151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.997 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9ae39b700 1 --2- 172.21.15.182:0/312077178 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9a81601e0 0x7fc9a8151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.997 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9ae39b700 1 -- 172.21.15.182:0/312077178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9a8160b70 msgr2=0x7fc9a815f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:52.997 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9ae39b700 1 --2- 172.21.15.182:0/312077178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9a8160b70 0x7fc9a815f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:52.998 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.989+0000 7fc9ae39b700 1 -- 172.21.15.182:0/312077178 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40094a0 con 0x7fc9a80b87a0 2023-05-12T09:06:52.998 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.990+0000 7fc9ae39b700 1 --2- 172.21.15.182:0/312077178 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a80b87a0 0x7fc9a80cade0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400e980 tx=0x7fc9a400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:52.998 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.990+0000 7fc99effd700 1 -- 172.21.15.182:0/312077178 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40096e0 con 0x7fc9a80b87a0 2023-05-12T09:06:52.998 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.990+0000 7fc99effd700 1 -- 172.21.15.182:0/312077178 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4013680 con 0x7fc9a80b87a0 2023-05-12T09:06:52.998 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.990+0000 7fc9b05ff700 1 -- 172.21.15.182:0/312077178 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9980094a0 con 0x7fc9a80b87a0 2023-05-12T09:06:52.998 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.990+0000 7fc99effd700 1 -- 172.21.15.182:0/312077178 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4013a10 con 0x7fc9a80b87a0 2023-05-12T09:06:52.998 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.990+0000 7fc9b05ff700 1 -- 172.21.15.182:0/312077178 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a0009b30 con 0x7fc9a80b87a0 2023-05-12T09:06:52.999 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.991+0000 7fc99effd700 1 -- 172.21.15.182:0/312077178 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc9a4005a20 con 0x7fc9a80b87a0 2023-05-12T09:06:52.999 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.991+0000 7fc99effd700 1 -- 172.21.15.182:0/312077178 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc9a40066b0 con 0x7fc9a80b87a0 2023-05-12T09:06:52.999 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.991+0000 7fc9b05ff700 1 -- 172.21.15.182:0/312077178 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a80cd6a0 con 0x7fc9a80b87a0 2023-05-12T09:06:52.999 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:52.994+0000 7fc99effd700 1 -- 172.21.15.182:0/312077178 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fc9a4021060 con 0x7fc9a80b87a0 2023-05-12T09:06:53.087 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.084+0000 7fc9b05ff700 1 -- 172.21.15.182:0/312077178 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd new", "uuid": "73ace088-82d8-4fba-9170-09b4d10f7b87", "id": 4} v 0) v1 -- 0x7fc9a80cac30 con 0x7fc9a80b87a0 2023-05-12T09:06:53.094 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.092+0000 7fc99effd700 1 -- 172.21.15.182:0/312077178 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "73ace088-82d8-4fba-9170-09b4d10f7b87", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9a4017070 con 0x7fc9a80b87a0 2023-05-12T09:06:53.095 INFO:teuthology.orchestra.run.smithi182.stdout:4 2023-05-12T09:06:53.096 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.093+0000 7fc9b05ff700 1 -- 172.21.15.182:0/312077178 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a80b87a0 msgr2=0x7fc9a80cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.096 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.093+0000 7fc9b05ff700 1 --2- 172.21.15.182:0/312077178 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a80b87a0 0x7fc9a80cade0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400e980 tx=0x7fc9a400ec90 comp rx=0 tx=0).stop 2023-05-12T09:06:53.096 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.093+0000 7fc9b05ff700 1 -- 172.21.15.182:0/312077178 shutdown_connections 2023-05-12T09:06:53.097 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.093+0000 7fc9b05ff700 1 --2- 172.21.15.182:0/312077178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9a8160b70 0x7fc9a815f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.097 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.093+0000 7fc9b05ff700 1 --2- 172.21.15.182:0/312077178 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9a80b87a0 0x7fc9a80cade0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.097 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.093+0000 7fc9b05ff700 1 --2- 172.21.15.182:0/312077178 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9a81601e0 0x7fc9a8151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.097 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.093+0000 7fc9b05ff700 1 -- 172.21.15.182:0/312077178 >> 172.21.15.182:0/312077178 conn(0x7fc9a8071b10 msgr2=0x7fc9a80b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:53.097 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.093+0000 7fc9b05ff700 1 -- 172.21.15.182:0/312077178 shutdown_connections 2023-05-12T09:06:53.097 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.093+0000 7fc9b05ff700 1 -- 172.21.15.182:0/312077178 wait complete. 2023-05-12T09:06:53.113 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new 2c936693-f8a7-4184-8198-a1c9fe3bd3a4 5 2023-05-12T09:06:53.297 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.294+0000 7fa0c47ff700 1 Processor -- start 2023-05-12T09:06:53.298 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.294+0000 7fa0c47ff700 1 -- start start 2023-05-12T09:06:53.298 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.295+0000 7fa0c47ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa0bc0b87a0 0x7fa0bc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.299 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.295+0000 7fa0c47ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fa0bc1601e0 0x7fa0bc160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.299 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.295+0000 7fa0c47ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0bc0cdc60 con 0x7fa0bc160b70 2023-05-12T09:06:53.299 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.295+0000 7fa0c47ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0bc0d02d0 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.299 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.295+0000 7fa0c47ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0bc0d0cb0 con 0x7fa0bc1601e0 2023-05-12T09:06:53.299 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.296+0000 7fa0c1d9a700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fa0bc1601e0 0x7fa0bc160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.299 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.296+0000 7fa0c1d9a700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fa0bc1601e0 0x7fa0bc160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:34196/0 (socket says 172.21.15.182:34196) 2023-05-12T09:06:53.299 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.296+0000 7fa0c1d9a700 1 -- 172.21.15.182:0/190777579 learned_addr learned my addr 172.21.15.182:0/190777579 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:53.300 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.296+0000 7fa0c259b700 1 --2- 172.21.15.182:0/190777579 >> v2:172.21.15.116:3300/0 conn(0x7fa0bc0b87a0 0x7fa0bc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.301 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.296+0000 7fa0c1d9a700 1 -- 172.21.15.182:0/190777579 >> v2:172.21.15.116:3300/0 conn(0x7fa0bc0b87a0 msgr2=0x7fa0bc0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:53.301 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.296+0000 7fa0c1d9a700 1 --2- 172.21.15.182:0/190777579 >> v2:172.21.15.116:3300/0 conn(0x7fa0bc0b87a0 0x7fa0bc0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.301 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.296+0000 7fa0c1d9a700 1 -- 172.21.15.182:0/190777579 >> v1:172.21.15.182:6789/0 conn(0x7fa0bc160b70 legacy=0x7fa0bc0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.301 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.296+0000 7fa0c1d9a700 1 -- 172.21.15.182:0/190777579 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc0cd6a0 con 0x7fa0bc1601e0 2023-05-12T09:06:53.302 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.296+0000 7fa0c1d9a700 1 --2- 172.21.15.182:0/190777579 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0bc1601e0 0x7fa0bc160630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0b8f60 tx=0x7fa0ac009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ff8437ae84c270f server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:53.302 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c1599700 1 -- 172.21.15.182:0/190777579 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac011830 con 0x7fa0bc1601e0 2023-05-12T09:06:53.302 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c1599700 1 -- 172.21.15.182:0/190777579 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac011990 con 0x7fa0bc1601e0 2023-05-12T09:06:53.302 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c1599700 1 -- 172.21.15.182:0/190777579 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac011d20 con 0x7fa0bc1601e0 2023-05-12T09:06:53.302 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c47ff700 1 -- 172.21.15.182:0/190777579 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0bc1601e0 msgr2=0x7fa0bc160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.302 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c47ff700 1 --2- 172.21.15.182:0/190777579 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0bc1601e0 0x7fa0bc160630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0b8f60 tx=0x7fa0ac009bd0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.302 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c47ff700 1 -- 172.21.15.182:0/190777579 shutdown_connections 2023-05-12T09:06:53.302 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c47ff700 1 --2- 172.21.15.182:0/190777579 >> v2:172.21.15.116:3300/0 conn(0x7fa0bc0b87a0 0x7fa0bc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.303 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c47ff700 1 --2- 172.21.15.182:0/190777579 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0bc1601e0 0x7fa0bc160630 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.303 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c47ff700 1 -- 172.21.15.182:0/190777579 >> 172.21.15.182:0/190777579 conn(0x7fa0bc071b10 msgr2=0x7fa0bc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:53.303 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c47ff700 1 -- 172.21.15.182:0/190777579 shutdown_connections 2023-05-12T09:06:53.303 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.297+0000 7fa0c47ff700 1 -- 172.21.15.182:0/190777579 wait complete. 2023-05-12T09:06:53.305 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.299+0000 7fa0c47ff700 1 Processor -- start 2023-05-12T09:06:53.306 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.299+0000 7fa0c47ff700 1 -- start start 2023-05-12T09:06:53.306 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.300+0000 7fa0c47ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0bc0b87a0 0x7fa0bc150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.306 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.300+0000 7fa0c47ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0bc1601e0 0x7fa0bc0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.306 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.300+0000 7fa0c47ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0bc160b70 0x7fa0bc0d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.306 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.300+0000 7fa0c47ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc15ddd0 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.306 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.300+0000 7fa0c47ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc151420 con 0x7fa0bc160b70 2023-05-12T09:06:53.307 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.300+0000 7fa0c47ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc15d1c0 con 0x7fa0bc1601e0 2023-05-12T09:06:53.307 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.300+0000 7fa0c259b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0bc0b87a0 0x7fa0bc150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.307 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.300+0000 7fa0c2d9c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0bc160b70 0x7fa0bc0d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.307 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.300+0000 7fa0c259b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0bc0b87a0 0x7fa0bc150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.182:48596/0 (socket says 172.21.15.182:48596) 2023-05-12T09:06:53.307 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.300+0000 7fa0c259b700 1 -- 172.21.15.182:0/1152495980 learned_addr learned my addr 172.21.15.182:0/1152495980 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:53.307 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.301+0000 7fa0c1d9a700 1 --2- 172.21.15.182:0/1152495980 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0bc1601e0 0x7fa0bc0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.307 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.301+0000 7fa0c259b700 1 -- 172.21.15.182:0/1152495980 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0bc1601e0 msgr2=0x7fa0bc0cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.308 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.301+0000 7fa0c259b700 1 --2- 172.21.15.182:0/1152495980 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0bc1601e0 0x7fa0bc0cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.308 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.301+0000 7fa0c259b700 1 -- 172.21.15.182:0/1152495980 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0bc160b70 msgr2=0x7fa0bc0d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.308 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.301+0000 7fa0c259b700 1 --2- 172.21.15.182:0/1152495980 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0bc160b70 0x7fa0bc0d2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.308 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.301+0000 7fa0c259b700 1 -- 172.21.15.182:0/1152495980 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac009550 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.308 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.301+0000 7fa0c259b700 1 --2- 172.21.15.182:0/1152495980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0bc0b87a0 0x7fa0bc150ee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800e9e0 tx=0x7fa0b800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:53.308 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.301+0000 7fa0b2ffd700 1 -- 172.21.15.182:0/1152495980 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8009710 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.308 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.301+0000 7fa0b2ffd700 1 -- 172.21.15.182:0/1152495980 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b800ee80 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.309 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.302+0000 7fa0c47ff700 1 -- 172.21.15.182:0/1152495980 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc160f90 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.309 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.302+0000 7fa0b2ffd700 1 -- 172.21.15.182:0/1152495980 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800ca50 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.309 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.302+0000 7fa0c47ff700 1 -- 172.21.15.182:0/1152495980 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0bc0cd980 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.309 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.302+0000 7fa0b2ffd700 1 -- 172.21.15.182:0/1152495980 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa0b8005a20 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.309 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.302+0000 7fa0b2ffd700 1 -- 172.21.15.182:0/1152495980 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa0b8005cd0 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.310 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.303+0000 7fa0c47ff700 1 -- 172.21.15.182:0/1152495980 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0bc0d2110 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.310 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.306+0000 7fa0b2ffd700 1 -- 172.21.15.182:0/1152495980 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fa0b8021060 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.396 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.393+0000 7fa0c47ff700 1 -- 172.21.15.182:0/1152495980 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2c936693-f8a7-4184-8198-a1c9fe3bd3a4", "id": 5} v 0) v1 -- 0x7fa0bc160930 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.402 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.399+0000 7fa0b2ffd700 1 -- 172.21.15.182:0/1152495980 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c936693-f8a7-4184-8198-a1c9fe3bd3a4", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa0b8029020 con 0x7fa0bc0b87a0 2023-05-12T09:06:53.402 INFO:teuthology.orchestra.run.smithi182.stdout:5 2023-05-12T09:06:53.403 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.400+0000 7fa0c47ff700 1 -- 172.21.15.182:0/1152495980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0bc0b87a0 msgr2=0x7fa0bc150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.403 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.400+0000 7fa0c47ff700 1 --2- 172.21.15.182:0/1152495980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0bc0b87a0 0x7fa0bc150ee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800e9e0 tx=0x7fa0b800ecf0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.403 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.400+0000 7fa0c47ff700 1 -- 172.21.15.182:0/1152495980 shutdown_connections 2023-05-12T09:06:53.404 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.400+0000 7fa0c47ff700 1 --2- 172.21.15.182:0/1152495980 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0bc160b70 0x7fa0bc0d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.404 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.400+0000 7fa0c47ff700 1 --2- 172.21.15.182:0/1152495980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0bc0b87a0 0x7fa0bc150ee0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.404 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.400+0000 7fa0c47ff700 1 --2- 172.21.15.182:0/1152495980 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0bc1601e0 0x7fa0bc0cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.404 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.400+0000 7fa0c47ff700 1 -- 172.21.15.182:0/1152495980 >> 172.21.15.182:0/1152495980 conn(0x7fa0bc071b10 msgr2=0x7fa0bc0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:53.404 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.400+0000 7fa0c47ff700 1 -- 172.21.15.182:0/1152495980 shutdown_connections 2023-05-12T09:06:53.404 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.400+0000 7fa0c47ff700 1 -- 172.21.15.182:0/1152495980 wait complete. 2023-05-12T09:06:53.420 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new fb07de79-ab57-4163-9fc4-850e2af91d27 6 2023-05-12T09:06:53.520 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:53.518+0000 7ff5b325a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-12T09:06:53.607 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:53.605+0000 7ff5b325a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-12T09:06:53.618 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.615+0000 7f4d5b7ff700 1 Processor -- start 2023-05-12T09:06:53.619 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.615+0000 7f4d5b7ff700 1 -- start start 2023-05-12T09:06:53.619 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.616+0000 7f4d5b7ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4d5406aaf0 0x7f4d54070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.619 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d5b7ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f4d54071030 0x7f4d5406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.620 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d5b7ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d540cb280 con 0x7f4d5415a5a0 2023-05-12T09:06:53.620 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d5b7ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5415a970 con 0x7f4d5406aaf0 2023-05-12T09:06:53.620 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d5b7ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d54071700 con 0x7f4d54071030 2023-05-12T09:06:53.621 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d5959b700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f4d5415a5a0 0x7f4d5406a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.182:56560/0 (socket says 172.21.15.182:56560) 2023-05-12T09:06:53.622 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d5959b700 1 -- 172.21.15.182:0/4085404375 learned_addr learned my addr 172.21.15.182:0/4085404375 (peer_addr_for_me v1:172.21.15.182:0/0) 2023-05-12T09:06:53.622 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d59d9c700 1 --2- 172.21.15.182:0/4085404375 >> v2:172.21.15.182:3300/0 conn(0x7f4d54071030 0x7f4d5406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.622 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d58d9a700 1 --2- 172.21.15.182:0/4085404375 >> v2:172.21.15.116:3300/0 conn(0x7f4d5406aaf0 0x7f4d54070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.622 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d59d9c700 1 -- 172.21.15.182:0/4085404375 >> v2:172.21.15.116:3300/0 conn(0x7f4d5406aaf0 msgr2=0x7f4d54070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:53.622 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d59d9c700 1 --2- 172.21.15.182:0/4085404375 >> v2:172.21.15.116:3300/0 conn(0x7f4d5406aaf0 0x7f4d54070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.622 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d59d9c700 1 -- 172.21.15.182:0/4085404375 >> v1:172.21.15.182:6789/0 conn(0x7f4d5415a5a0 legacy=0x7f4d5406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.623 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d59d9c700 1 -- 172.21.15.182:0/4085404375 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540719e0 con 0x7f4d54071030 2023-05-12T09:06:53.623 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.617+0000 7f4d4bfff700 1 -- 172.21.15.182:0/4085404375 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046341148 0 0) 0x7f4d50001490 con 0x7f4d5415a5a0 2023-05-12T09:06:53.623 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.618+0000 7f4d59d9c700 1 --2- 172.21.15.182:0/4085404375 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4d54071030 0x7f4d5406d1a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4d540cbc90 tx=0x7f4d4c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93a7183bafb5d6b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:53.623 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.618+0000 7f4d4bfff700 1 -- 172.21.15.182:0/4085404375 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c011830 con 0x7f4d54071030 2023-05-12T09:06:53.623 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.618+0000 7f4d4bfff700 1 -- 172.21.15.182:0/4085404375 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c011990 con 0x7f4d54071030 2023-05-12T09:06:53.623 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.618+0000 7f4d4bfff700 1 -- 172.21.15.182:0/4085404375 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c011d20 con 0x7f4d54071030 2023-05-12T09:06:53.623 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.618+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/4085404375 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4d54071030 msgr2=0x7f4d5406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.623 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.619+0000 7f4d5b7ff700 1 --2- 172.21.15.182:0/4085404375 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4d54071030 0x7f4d5406d1a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4d540cbc90 tx=0x7f4d4c009b20 comp rx=0 tx=0).stop 2023-05-12T09:06:53.624 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.619+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/4085404375 shutdown_connections 2023-05-12T09:06:53.624 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.619+0000 7f4d5b7ff700 1 --2- 172.21.15.182:0/4085404375 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4d54071030 0x7f4d5406d1a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.624 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.619+0000 7f4d5b7ff700 1 --2- 172.21.15.182:0/4085404375 >> v2:172.21.15.116:3300/0 conn(0x7f4d5406aaf0 0x7f4d54070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.624 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.619+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/4085404375 >> 172.21.15.182:0/4085404375 conn(0x7f4d540cf720 msgr2=0x7f4d540cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:53.625 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.619+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/4085404375 shutdown_connections 2023-05-12T09:06:53.625 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.619+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/4085404375 wait complete. 2023-05-12T09:06:53.627 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.621+0000 7f4d5b7ff700 1 Processor -- start 2023-05-12T09:06:53.627 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.621+0000 7f4d5b7ff700 1 -- start start 2023-05-12T09:06:53.628 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d5b7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4d5406aaf0 0x7f4d54156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.628 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d5b7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4d54071030 0x7f4d540c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.628 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d5b7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d5415a5a0 0x7f4d54153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.628 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d5b7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540c5ad0 con 0x7f4d5415a5a0 2023-05-12T09:06:53.628 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d5b7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540c5db0 con 0x7f4d5406aaf0 2023-05-12T09:06:53.628 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d5b7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540c6090 con 0x7f4d54071030 2023-05-12T09:06:53.628 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d58d9a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4d54071030 0x7f4d540c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.629 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d58d9a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4d54071030 0x7f4d540c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:48680/0 (socket says 172.21.15.182:48680) 2023-05-12T09:06:53.629 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d58d9a700 1 -- 172.21.15.182:0/1722405128 learned_addr learned my addr 172.21.15.182:0/1722405128 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:53.629 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d59d9c700 1 --2- 172.21.15.182:0/1722405128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d5415a5a0 0x7f4d54153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.629 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.622+0000 7f4d5959b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4d5406aaf0 0x7f4d54156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.629 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.623+0000 7f4d58d9a700 1 -- 172.21.15.182:0/1722405128 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4d5406aaf0 msgr2=0x7f4d54156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.629 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.623+0000 7f4d58d9a700 1 --2- 172.21.15.182:0/1722405128 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4d5406aaf0 0x7f4d54156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.629 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.623+0000 7f4d58d9a700 1 -- 172.21.15.182:0/1722405128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d5415a5a0 msgr2=0x7f4d54153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.630 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.623+0000 7f4d58d9a700 1 --2- 172.21.15.182:0/1722405128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d5415a5a0 0x7f4d54153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.630 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.623+0000 7f4d58d9a700 1 -- 172.21.15.182:0/1722405128 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0094a0 con 0x7f4d54071030 2023-05-12T09:06:53.630 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.623+0000 7f4d59d9c700 1 --2- 172.21.15.182:0/1722405128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d5415a5a0 0x7f4d54153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:53.630 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.623+0000 7f4d58d9a700 1 --2- 172.21.15.182:0/1722405128 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4d54071030 0x7f4d540c6e50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400e990 tx=0x7f4d4400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:53.630 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.623+0000 7f4d49ffb700 1 -- 172.21.15.182:0/1722405128 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d440096f0 con 0x7f4d54071030 2023-05-12T09:06:53.630 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.624+0000 7f4d49ffb700 1 -- 172.21.15.182:0/1722405128 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400c690 con 0x7f4d54071030 2023-05-12T09:06:53.630 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.624+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/1722405128 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5406c9a0 con 0x7f4d54071030 2023-05-12T09:06:53.630 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.624+0000 7f4d49ffb700 1 -- 172.21.15.182:0/1722405128 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400ca00 con 0x7f4d54071030 2023-05-12T09:06:53.631 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.624+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/1722405128 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5406c6c0 con 0x7f4d54071030 2023-05-12T09:06:53.631 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.624+0000 7f4d49ffb700 1 -- 172.21.15.182:0/1722405128 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4d44013470 con 0x7f4d54071030 2023-05-12T09:06:53.631 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.624+0000 7f4d49ffb700 1 -- 172.21.15.182:0/1722405128 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4d44013d10 con 0x7f4d54071030 2023-05-12T09:06:53.631 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.625+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/1722405128 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5406cc80 con 0x7f4d54071030 2023-05-12T09:06:53.631 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.628+0000 7f4d49ffb700 1 -- 172.21.15.182:0/1722405128 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f4d44021060 con 0x7f4d54071030 2023-05-12T09:06:53.734 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.731+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/1722405128 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fb07de79-ab57-4163-9fc4-850e2af91d27", "id": 6} v 0) v1 -- 0x7f4d5406b2a0 con 0x7f4d54071030 2023-05-12T09:06:53.739 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.736+0000 7f4d49ffb700 1 -- 172.21.15.182:0/1722405128 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb07de79-ab57-4163-9fc4-850e2af91d27", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4d4402a020 con 0x7f4d54071030 2023-05-12T09:06:53.739 INFO:teuthology.orchestra.run.smithi182.stdout:6 2023-05-12T09:06:53.740 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.737+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/1722405128 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4d54071030 msgr2=0x7f4d540c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.740 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.737+0000 7f4d5b7ff700 1 --2- 172.21.15.182:0/1722405128 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4d54071030 0x7f4d540c6e50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400e990 tx=0x7f4d4400eca0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.740 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.737+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/1722405128 shutdown_connections 2023-05-12T09:06:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.737+0000 7f4d5b7ff700 1 --2- 172.21.15.182:0/1722405128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d5415a5a0 0x7f4d54153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.737+0000 7f4d5b7ff700 1 --2- 172.21.15.182:0/1722405128 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4d5406aaf0 0x7f4d54156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.737+0000 7f4d5b7ff700 1 --2- 172.21.15.182:0/1722405128 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4d54071030 0x7f4d540c6e50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.737+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/1722405128 >> 172.21.15.182:0/1722405128 conn(0x7f4d540cf720 msgr2=0x7f4d5406ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.737+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/1722405128 shutdown_connections 2023-05-12T09:06:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.737+0000 7f4d5b7ff700 1 -- 172.21.15.182:0/1722405128 wait complete. 2023-05-12T09:06:53.757 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new 34996781-b72a-4aa1-88b2-9945c6dcd356 7 2023-05-12T09:06:53.768 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:53.766+0000 7ff5b325a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-12T09:06:53.853 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:53.851+0000 7ff5b325a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-12T09:06:53.873 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:53.870+0000 7fa49d7bd200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-12T09:06:53.951 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.948+0000 7f0e8d5ff700 1 Processor -- start 2023-05-12T09:06:53.951 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.948+0000 7f0e8d5ff700 1 -- start start 2023-05-12T09:06:53.953 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.949+0000 7f0e8d5ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0e880b87a0 0x7f0e880cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.953 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.949+0000 7f0e8d5ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0e88160d40 0x7f0e880d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.953 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.949+0000 7f0e8d5ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e880cdc60 con 0x7f0e881601e0 2023-05-12T09:06:53.954 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.949+0000 7f0e8d5ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880d02d0 con 0x7f0e880b87a0 2023-05-12T09:06:53.954 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.949+0000 7f0e8d5ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880d0cb0 con 0x7f0e88160d40 2023-05-12T09:06:53.954 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.949+0000 7f0e877fe700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0e88160d40 0x7f0e880d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.954 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.949+0000 7f0e877fe700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0e88160d40 0x7f0e880d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:34228/0 (socket says 172.21.15.182:34228) 2023-05-12T09:06:53.954 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.949+0000 7f0e877fe700 1 -- 172.21.15.182:0/2392511003 learned_addr learned my addr 172.21.15.182:0/2392511003 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:53.954 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.949+0000 7f0e86ffd700 1 --2- 172.21.15.182:0/2392511003 >> v2:172.21.15.116:3300/0 conn(0x7f0e880b87a0 0x7f0e880cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.954 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.950+0000 7f0e877fe700 1 -- 172.21.15.182:0/2392511003 >> v2:172.21.15.116:3300/0 conn(0x7f0e880b87a0 msgr2=0x7f0e880cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:53.955 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.950+0000 7f0e877fe700 1 --2- 172.21.15.182:0/2392511003 >> v2:172.21.15.116:3300/0 conn(0x7f0e880b87a0 0x7f0e880cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.955 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.950+0000 7f0e877fe700 1 -- 172.21.15.182:0/2392511003 >> v1:172.21.15.116:6789/0 conn(0x7f0e881601e0 legacy=0x7f0e88160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.955 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.950+0000 7f0e877fe700 1 -- 172.21.15.182:0/2392511003 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880cd6a0 con 0x7f0e88160d40 2023-05-12T09:06:53.955 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.950+0000 7f0e877fe700 1 --2- 172.21.15.182:0/2392511003 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 0x7f0e880d1100 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0e880d0820 tx=0x7f0e8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc2a5cecb1ce7ee server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:53.955 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.950+0000 7f0e85ffb700 1 -- 172.21.15.182:0/2392511003 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000e070 con 0x7f0e88160d40 2023-05-12T09:06:53.955 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.950+0000 7f0e85ffb700 1 -- 172.21.15.182:0/2392511003 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8000b910 con 0x7f0e88160d40 2023-05-12T09:06:53.955 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.950+0000 7f0e85ffb700 1 -- 172.21.15.182:0/2392511003 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000bcc0 con 0x7f0e88160d40 2023-05-12T09:06:53.961 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.951+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/2392511003 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 msgr2=0x7f0e880d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.961 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.951+0000 7f0e8d5ff700 1 --2- 172.21.15.182:0/2392511003 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 0x7f0e880d1100 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0e880d0820 tx=0x7f0e8000b330 comp rx=0 tx=0).stop 2023-05-12T09:06:53.961 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.951+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/2392511003 shutdown_connections 2023-05-12T09:06:53.961 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.951+0000 7f0e8d5ff700 1 --2- 172.21.15.182:0/2392511003 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 0x7f0e880d1100 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.961 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.951+0000 7f0e8d5ff700 1 --2- 172.21.15.182:0/2392511003 >> v2:172.21.15.116:3300/0 conn(0x7f0e880b87a0 0x7f0e880cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.962 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.951+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/2392511003 >> 172.21.15.182:0/2392511003 conn(0x7f0e88071b10 msgr2=0x7f0e88071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:53.962 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.951+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/2392511003 shutdown_connections 2023-05-12T09:06:53.962 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.951+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/2392511003 wait complete. 2023-05-12T09:06:53.962 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.953+0000 7f0e8d5ff700 1 Processor -- start 2023-05-12T09:06:53.962 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.953+0000 7f0e8d5ff700 1 -- start start 2023-05-12T09:06:53.962 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e8d5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e880b87a0 0x7f0e88150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.962 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e8d5ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e881601e0 0x7f0e880cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.963 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e8d5ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 0x7f0e88159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:53.963 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e8d5ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880cb690 con 0x7f0e881601e0 2023-05-12T09:06:53.963 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e8d5ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880ca0b0 con 0x7f0e88160d40 2023-05-12T09:06:53.963 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e8d5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880ca390 con 0x7f0e880b87a0 2023-05-12T09:06:53.963 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e877fe700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 0x7f0e88159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.963 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e86ffd700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e880b87a0 0x7f0e88150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.963 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e877fe700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 0x7f0e88159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:34234/0 (socket says 172.21.15.182:34234) 2023-05-12T09:06:53.964 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e877fe700 1 -- 172.21.15.182:0/3743805256 learned_addr learned my addr 172.21.15.182:0/3743805256 (peer_addr_for_me v2:172.21.15.182:0/0) 2023-05-12T09:06:53.964 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e867fc700 1 --2- 172.21.15.182:0/3743805256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e881601e0 0x7f0e880cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:53.964 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e877fe700 1 -- 172.21.15.182:0/3743805256 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e880b87a0 msgr2=0x7f0e88150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.964 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e877fe700 1 --2- 172.21.15.182:0/3743805256 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e880b87a0 0x7f0e88150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.964 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e877fe700 1 -- 172.21.15.182:0/3743805256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e881601e0 msgr2=0x7f0e880cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:53.964 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e877fe700 1 --2- 172.21.15.182:0/3743805256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e881601e0 0x7f0e880cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:53.964 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.954+0000 7f0e877fe700 1 -- 172.21.15.182:0/3743805256 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80009b30 con 0x7f0e88160d40 2023-05-12T09:06:53.965 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.955+0000 7f0e877fe700 1 --2- 172.21.15.182:0/3743805256 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 0x7f0e88159d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000b680 tx=0x7f0e80004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:53.965 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.955+0000 7f0e6f7fe700 1 -- 172.21.15.182:0/3743805256 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80004870 con 0x7f0e88160d40 2023-05-12T09:06:53.965 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.955+0000 7f0e6f7fe700 1 -- 172.21.15.182:0/3743805256 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800099b0 con 0x7f0e88160d40 2023-05-12T09:06:53.965 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.955+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/3743805256 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e880d1640 con 0x7f0e88160d40 2023-05-12T09:06:53.965 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.955+0000 7f0e6f7fe700 1 -- 172.21.15.182:0/3743805256 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8001b670 con 0x7f0e88160d40 2023-05-12T09:06:53.965 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.955+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/3743805256 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e880cd980 con 0x7f0e88160d40 2023-05-12T09:06:53.965 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.955+0000 7f0e6f7fe700 1 -- 172.21.15.182:0/3743805256 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0e8001bad0 con 0x7f0e88160d40 2023-05-12T09:06:53.965 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.955+0000 7f0e6f7fe700 1 -- 172.21.15.182:0/3743805256 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f0e8001bd80 con 0x7f0e88160d40 2023-05-12T09:06:53.966 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.956+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/3743805256 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e880d17d0 con 0x7f0e88160d40 2023-05-12T09:06:53.966 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:53.959+0000 7f0e6f7fe700 1 -- 172.21.15.182:0/3743805256 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f0e80042b10 con 0x7f0e88160d40 2023-05-12T09:06:53.971 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:53.968+0000 7fa49d7bd200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-12T09:06:54.049 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.046+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/3743805256 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd new", "uuid": "34996781-b72a-4aa1-88b2-9945c6dcd356", "id": 7} v 0) v1 -- 0x7f0e88074430 con 0x7f0e88160d40 2023-05-12T09:06:54.055 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.052+0000 7f0e6f7fe700 1 -- 172.21.15.182:0/3743805256 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34996781-b72a-4aa1-88b2-9945c6dcd356", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0e80031070 con 0x7f0e88160d40 2023-05-12T09:06:54.056 INFO:teuthology.orchestra.run.smithi182.stdout:7 2023-05-12T09:06:54.057 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.053+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/3743805256 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 msgr2=0x7f0e88159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:54.057 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.053+0000 7f0e8d5ff700 1 --2- 172.21.15.182:0/3743805256 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 0x7f0e88159d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000b680 tx=0x7f0e80004ad0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.057 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.054+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/3743805256 shutdown_connections 2023-05-12T09:06:54.057 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.054+0000 7f0e8d5ff700 1 --2- 172.21.15.182:0/3743805256 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e88160d40 0x7f0e88159d80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.057 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.054+0000 7f0e8d5ff700 1 --2- 172.21.15.182:0/3743805256 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e880b87a0 0x7f0e88150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.058 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.054+0000 7f0e8d5ff700 1 --2- 172.21.15.182:0/3743805256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e881601e0 0x7f0e880cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.058 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.054+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/3743805256 >> 172.21.15.182:0/3743805256 conn(0x7f0e88071b10 msgr2=0x7f0e88071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:54.058 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.054+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/3743805256 shutdown_connections 2023-05-12T09:06:54.058 INFO:teuthology.orchestra.run.smithi182.stderr:2023-05-12T09:06:54.054+0000 7f0e8d5ff700 1 -- 172.21.15.182:0/3743805256 wait complete. 2023-05-12T09:06:54.060 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:54.059+0000 7ff5b325a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-12T09:06:54.074 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-12T09:06:54.074 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-12T09:06:54.078 INFO:tasks.ceph.osd.0:Started 2023-05-12T09:06:54.079 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-12T09:06:54.080 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-12T09:06:54.083 INFO:tasks.ceph.osd.1:Started 2023-05-12T09:06:54.083 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-12T09:06:54.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-12T09:06:54.087 INFO:tasks.ceph.osd.2:Started 2023-05-12T09:06:54.088 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-12T09:06:54.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-12T09:06:54.092 INFO:tasks.ceph.osd.3:Started 2023-05-12T09:06:54.092 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-12T09:06:54.093 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-12T09:06:54.097 INFO:tasks.ceph.osd.4:Started 2023-05-12T09:06:54.097 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-12T09:06:54.098 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-12T09:06:54.102 INFO:tasks.ceph.osd.5:Started 2023-05-12T09:06:54.103 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-12T09:06:54.103 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-12T09:06:54.108 INFO:tasks.ceph.osd.6:Started 2023-05-12T09:06:54.108 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-12T09:06:54.109 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-12T09:06:54.114 INFO:tasks.ceph.osd.7:Started 2023-05-12T09:06:54.115 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:06:54.161 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:54.158+0000 7fa49d7bd200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-12T09:06:54.196 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:54.194+0000 7ff5b325a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-12T09:06:54.269 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:54.266+0000 7fa49d7bd200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-12T09:06:54.332 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:54.330+0000 7ff5b325a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-12T09:06:54.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.344+0000 7f6ce93ff700 1 Processor -- start 2023-05-12T09:06:54.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.345+0000 7f6ce93ff700 1 -- start start 2023-05-12T09:06:54.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce93ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6ce415c590 0x7f6ce4160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:54.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce93ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f6ce40cff50 0x7f6ce40d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:54.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce93ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce40cd520 con 0x7f6ce40cf010 2023-05-12T09:06:54.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce93ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40d2640 con 0x7f6ce415c590 2023-05-12T09:06:54.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce93ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce41610d0 con 0x7f6ce40cff50 2023-05-12T09:06:54.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce2ffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6ce415c590 0x7f6ce4160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:54.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce2ffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6ce415c590 0x7f6ce4160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38804/0 (socket says 172.21.15.116:38804) 2023-05-12T09:06:54.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce2ffd700 1 -- 172.21.15.116:0/1888699706 learned_addr learned my addr 172.21.15.116:0/1888699706 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:06:54.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce37fe700 1 --2- 172.21.15.116:0/1888699706 >> v2:172.21.15.182:3300/0 conn(0x7f6ce40cff50 0x7f6ce40d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:54.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce2ffd700 1 -- 172.21.15.116:0/1888699706 >> v2:172.21.15.182:3300/0 conn(0x7f6ce40cff50 msgr2=0x7f6ce40d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:06:54.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.346+0000 7f6ce2ffd700 1 --2- 172.21.15.116:0/1888699706 >> v2:172.21.15.182:3300/0 conn(0x7f6ce40cff50 0x7f6ce40d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.347+0000 7f6ce2ffd700 1 -- 172.21.15.116:0/1888699706 >> v1:172.21.15.182:6789/0 conn(0x7f6ce40cf010 legacy=0x7f6ce40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:54.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.347+0000 7f6ce2ffd700 1 -- 172.21.15.116:0/1888699706 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40b23c0 con 0x7f6ce415c590 2023-05-12T09:06:54.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.347+0000 7f6ce2ffd700 1 --2- 172.21.15.116:0/1888699706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce415c590 0x7f6ce4160b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40b20b0 tx=0x7f6cd4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd918a1ee5c6412 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:54.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.347+0000 7f6ce1ffb700 1 -- 172.21.15.116:0/1888699706 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4011830 con 0x7f6ce415c590 2023-05-12T09:06:54.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.347+0000 7f6ce1ffb700 1 -- 172.21.15.116:0/1888699706 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd4011990 con 0x7f6ce415c590 2023-05-12T09:06:54.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.347+0000 7f6ce1ffb700 1 -- 172.21.15.116:0/1888699706 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4011d20 con 0x7f6ce415c590 2023-05-12T09:06:54.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.347+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1888699706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce415c590 msgr2=0x7f6ce4160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:54.356 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.348+0000 7f6ce93ff700 1 --2- 172.21.15.116:0/1888699706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce415c590 0x7f6ce4160b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40b20b0 tx=0x7f6cd4009bd0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.356 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.348+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1888699706 shutdown_connections 2023-05-12T09:06:54.356 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.348+0000 7f6ce93ff700 1 --2- 172.21.15.116:0/1888699706 >> v2:172.21.15.182:3300/0 conn(0x7f6ce40cff50 0x7f6ce40d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.348+0000 7f6ce93ff700 1 --2- 172.21.15.116:0/1888699706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce415c590 0x7f6ce4160b90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.348+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1888699706 >> 172.21.15.116:0/1888699706 conn(0x7f6ce4071b10 msgr2=0x7f6ce4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:54.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.348+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1888699706 shutdown_connections 2023-05-12T09:06:54.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.348+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1888699706 wait complete. 2023-05-12T09:06:54.359 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.349+0000 7f6ce93ff700 1 Processor -- start 2023-05-12T09:06:54.359 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.349+0000 7f6ce93ff700 1 -- start start 2023-05-12T09:06:54.359 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.350+0000 7f6ce93ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6ce40cf010 0x7f6ce4157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:54.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.350+0000 7f6ce93ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce40cff50 0x7f6ce40b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:54.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.350+0000 7f6ce93ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ce415c590 0x7f6ce40b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:54.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.350+0000 7f6ce93ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40b7170 con 0x7f6ce40cff50 2023-05-12T09:06:54.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.350+0000 7f6ce93ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce415f250 con 0x7f6ce415c590 2023-05-12T09:06:54.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.350+0000 7f6ce93ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40b6e30 con 0x7f6ce40cf010 2023-05-12T09:06:54.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce27fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce40cff50 0x7f6ce40b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:54.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce27fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce40cff50 0x7f6ce40b5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38814/0 (socket says 172.21.15.116:38814) 2023-05-12T09:06:54.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce27fc700 1 -- 172.21.15.116:0/1272507065 learned_addr learned my addr 172.21.15.116:0/1272507065 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:06:54.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce2ffd700 1 --2- 172.21.15.116:0/1272507065 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6ce40cf010 0x7f6ce4157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:54.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce37fe700 1 --2- 172.21.15.116:0/1272507065 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ce415c590 0x7f6ce40b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:54.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce27fc700 1 -- 172.21.15.116:0/1272507065 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6ce40cf010 msgr2=0x7f6ce4157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:54.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce27fc700 1 --2- 172.21.15.116:0/1272507065 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6ce40cf010 0x7f6ce4157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce27fc700 1 -- 172.21.15.116:0/1272507065 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ce415c590 msgr2=0x7f6ce40b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:54.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce27fc700 1 --2- 172.21.15.116:0/1272507065 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ce415c590 0x7f6ce40b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce27fc700 1 -- 172.21.15.116:0/1272507065 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009550 con 0x7f6ce40cff50 2023-05-12T09:06:54.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ce27fc700 1 --2- 172.21.15.116:0/1272507065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce40cff50 0x7f6ce40b5d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c450 tx=0x7f6cd800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:54.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.351+0000 7f6ccb7fe700 1 -- 172.21.15.116:0/1272507065 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80052d0 con 0x7f6ce40cff50 2023-05-12T09:06:54.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.352+0000 7f6ccb7fe700 1 -- 172.21.15.116:0/1272507065 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd8005430 con 0x7f6ce40cff50 2023-05-12T09:06:54.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.352+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1272507065 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce40cd770 con 0x7f6ce40cff50 2023-05-12T09:06:54.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.352+0000 7f6ccb7fe700 1 -- 172.21.15.116:0/1272507065 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80038c0 con 0x7f6ce40cff50 2023-05-12T09:06:54.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.352+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1272507065 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce40cf560 con 0x7f6ce40cff50 2023-05-12T09:06:54.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.352+0000 7f6ccb7fe700 1 -- 172.21.15.116:0/1272507065 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6cd8003d20 con 0x7f6ce40cff50 2023-05-12T09:06:54.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.352+0000 7f6ccb7fe700 1 -- 172.21.15.116:0/1272507065 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6cd8011e30 con 0x7f6ce40cff50 2023-05-12T09:06:54.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.353+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1272507065 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce415c960 con 0x7f6ce40cff50 2023-05-12T09:06:54.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.355+0000 7f6ccb7fe700 1 -- 172.21.15.116:0/1272507065 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f6cd8021060 con 0x7f6ce40cff50 2023-05-12T09:06:54.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.426+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1272507065 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ce40b51f0 con 0x7f6ce40cff50 2023-05-12T09:06:54.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.427+0000 7f6ccb7fe700 1 -- 172.21.15.116:0/1272507065 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6cd8017070 con 0x7f6ce40cff50 2023-05-12T09:06:54.430 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:06:54.430 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":10,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:06:54.048302+0000","last_up_change":"0.000000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:06:54.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.428+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1272507065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce40cff50 msgr2=0x7f6ce40b5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:54.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.428+0000 7f6ce93ff700 1 --2- 172.21.15.116:0/1272507065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce40cff50 0x7f6ce40b5d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c450 tx=0x7f6cd800c760 comp rx=0 tx=0).stop 2023-05-12T09:06:54.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.428+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1272507065 shutdown_connections 2023-05-12T09:06:54.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.428+0000 7f6ce93ff700 1 --2- 172.21.15.116:0/1272507065 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ce415c590 0x7f6ce40b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.428+0000 7f6ce93ff700 1 --2- 172.21.15.116:0/1272507065 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6ce40cf010 0x7f6ce4157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.428+0000 7f6ce93ff700 1 --2- 172.21.15.116:0/1272507065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce40cff50 0x7f6ce40b5d00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:54.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.428+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1272507065 >> 172.21.15.116:0/1272507065 conn(0x7f6ce4071b10 msgr2=0x7f6ce415b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:54.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.428+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1272507065 shutdown_connections 2023-05-12T09:06:54.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:06:54.428+0000 7f6ce93ff700 1 -- 172.21.15.116:0/1272507065 wait complete. 2023-05-12T09:06:54.447 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-12T09:06:54.448 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-12T09:06:54.448 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:54.447+0000 7ff5b325a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-12T09:06:54.498 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:54.495+0000 7fa49d7bd200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-12T09:06:54.552 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T09:06:54.550+0000 7f4e8fd34640 -1 Falling back to public interface 2023-05-12T09:06:54.602 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:54.599+0000 7fa49d7bd200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-12T09:06:54.669 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:54.667+0000 7ff5b325a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-12T09:06:54.698 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:54.695+0000 7fa49d7bd200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-12T09:06:54.766 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:54.764+0000 7ff5b325a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-12T09:06:54.793 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T09:06:54.791+0000 7f9b70b67640 -1 Falling back to public interface 2023-05-12T09:06:54.797 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T09:06:54.795+0000 7f3f44ea2640 -1 Falling back to public interface 2023-05-12T09:06:54.797 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T09:06:54.795+0000 7f9fab742640 -1 Falling back to public interface 2023-05-12T09:06:54.811 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T09:06:54.808+0000 7fb015a13640 -1 Falling back to public interface 2023-05-12T09:06:54.811 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:54.808+0000 7fa49d7bd200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-12T09:06:54.812 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T09:06:54.810+0000 7f448ad12640 -1 Falling back to public interface 2023-05-12T09:06:54.819 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T09:06:54.816+0000 7fe45e44a640 -1 Falling back to public interface 2023-05-12T09:06:54.820 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T09:06:54.816+0000 7f0265b5b640 -1 Falling back to public interface 2023-05-12T09:06:55.037 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:55.034+0000 7fa49d7bd200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-12T09:06:55.108 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:55.107+0000 7ff5b325a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-12T09:06:55.138 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:55.135+0000 7fa49d7bd200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-12T09:06:55.196 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:55.194+0000 7ff5b325a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-12T09:06:55.254 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-12T09:06:55.421 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.418+0000 7fb9b11ff700 1 Processor -- start 2023-05-12T09:06:55.421 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.419+0000 7fb9b11ff700 1 -- start start 2023-05-12T09:06:55.423 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9b11ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb9ac0cd710 0x7fb9ac1598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:55.423 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9b11ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac15a250 con 0x7fb9ac15a6e0 2023-05-12T09:06:55.423 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9b11ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac15ab20 con 0x7fb9ac1594e0 2023-05-12T09:06:55.423 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9b11ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac0cabf0 con 0x7fb9ac0cd710 2023-05-12T09:06:55.424 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9aa59c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb9ac0cd710 0x7fb9ac1598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:55.424 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9aa59c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb9ac0cd710 0x7fb9ac1598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38822/0 (socket says 172.21.15.116:38822) 2023-05-12T09:06:55.424 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9aa59c700 1 -- 172.21.15.116:0/76348668 learned_addr learned my addr 172.21.15.116:0/76348668 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:06:55.424 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9ab59e700 1 --1- 172.21.15.116:0/76348668 >> v1:172.21.15.116:6789/0 conn(0x7fb9ac15a6e0 0x7fb9ac070d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47182/0 (socket says 172.21.15.116:47182) 2023-05-12T09:06:55.424 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9aa59c700 1 -- 172.21.15.116:0/76348668 >> v1:172.21.15.182:6789/0 conn(0x7fb9ac1594e0 legacy=0x7fb9ac0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:55.424 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9aa59c700 1 -- 172.21.15.116:0/76348668 >> v1:172.21.15.116:6789/0 conn(0x7fb9ac15a6e0 legacy=0x7fb9ac070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:55.424 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.421+0000 7fb9aa59c700 1 -- 172.21.15.116:0/76348668 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0cadd0 con 0x7fb9ac0cd710 2023-05-12T09:06:55.425 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.420+0000 7fb9a9d9b700 1 -- 172.21.15.116:0/76348668 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807619554 0 0) 0x7fb9ac15ab20 con 0x7fb9ac1594e0 2023-05-12T09:06:55.425 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.421+0000 7fb9aa59c700 1 --2- 172.21.15.116:0/76348668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac0cd710 0x7fb9ac1598b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000bb90 tx=0x7fb9a000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec11e2ff6471423 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:55.425 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.421+0000 7fb9a9d9b700 1 -- 172.21.15.116:0/76348668 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a000dd50 con 0x7fb9ac0cd710 2023-05-12T09:06:55.425 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.421+0000 7fb9a9d9b700 1 -- 172.21.15.116:0/76348668 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0010470 con 0x7fb9ac0cd710 2023-05-12T09:06:55.425 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.421+0000 7fb9a9d9b700 1 -- 172.21.15.116:0/76348668 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0010800 con 0x7fb9ac0cd710 2023-05-12T09:06:55.426 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.422+0000 7fb9b11ff700 1 -- 172.21.15.116:0/76348668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac0cd710 msgr2=0x7fb9ac1598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:55.426 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.422+0000 7fb9b11ff700 1 --2- 172.21.15.116:0/76348668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac0cd710 0x7fb9ac1598b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000bb90 tx=0x7fb9a000bea0 comp rx=0 tx=0).stop 2023-05-12T09:06:55.427 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.422+0000 7fb9b11ff700 1 -- 172.21.15.116:0/76348668 shutdown_connections 2023-05-12T09:06:55.427 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.422+0000 7fb9b11ff700 1 --2- 172.21.15.116:0/76348668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac0cd710 0x7fb9ac1598b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:55.427 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.422+0000 7fb9b11ff700 1 -- 172.21.15.116:0/76348668 >> 172.21.15.116:0/76348668 conn(0x7fb9ac06b050 msgr2=0x7fb9ac0b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:55.427 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.422+0000 7fb9b11ff700 1 -- 172.21.15.116:0/76348668 shutdown_connections 2023-05-12T09:06:55.427 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.422+0000 7fb9b11ff700 1 -- 172.21.15.116:0/76348668 wait complete. 2023-05-12T09:06:55.427 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.423+0000 7fb9b11ff700 1 Processor -- start 2023-05-12T09:06:55.427 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.424+0000 7fb9b11ff700 1 -- start start 2023-05-12T09:06:55.428 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.424+0000 7fb9b11ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9ac0cd710 0x7fb9ac0c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:55.428 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.424+0000 7fb9b11ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac1594e0 0x7fb9ac15bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:55.428 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9b11ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9ac15a6e0 0x7fb9ac15c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:06:55.428 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9b11ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0c4dc0 con 0x7fb9ac1594e0 2023-05-12T09:06:55.428 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9b11ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0c4930 con 0x7fb9ac0cd710 2023-05-12T09:06:55.428 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9b11ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0c3d20 con 0x7fb9ac15a6e0 2023-05-12T09:06:55.430 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9aa59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac1594e0 0x7fb9ac15bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:55.430 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9aad9d700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9ac0cd710 0x7fb9ac0c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:55.430 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9aa59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac1594e0 0x7fb9ac15bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38834/0 (socket says 172.21.15.116:38834) 2023-05-12T09:06:55.430 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9aa59c700 1 -- 172.21.15.116:0/750909950 learned_addr learned my addr 172.21.15.116:0/750909950 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:06:55.430 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9ab59e700 1 --2- 172.21.15.116:0/750909950 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9ac15a6e0 0x7fb9ac15c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:06:55.430 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9aa59c700 1 -- 172.21.15.116:0/750909950 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9ac15a6e0 msgr2=0x7fb9ac15c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:55.430 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9aa59c700 1 --2- 172.21.15.116:0/750909950 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9ac15a6e0 0x7fb9ac15c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:55.431 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9aa59c700 1 -- 172.21.15.116:0/750909950 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9ac0cd710 msgr2=0x7fb9ac0c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:55.431 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9aa59c700 1 --2- 172.21.15.116:0/750909950 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9ac0cd710 0x7fb9ac0c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:55.431 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9aa59c700 1 -- 172.21.15.116:0/750909950 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a000b7f0 con 0x7fb9ac1594e0 2023-05-12T09:06:55.431 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.425+0000 7fb9aad9d700 1 --2- 172.21.15.116:0/750909950 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9ac0cd710 0x7fb9ac0c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:06:55.431 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.426+0000 7fb9aa59c700 1 --2- 172.21.15.116:0/750909950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac1594e0 0x7fb9ac15bca0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac070780 tx=0x7fb9a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:06:55.431 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.426+0000 7fb9937fe700 1 -- 172.21.15.116:0/750909950 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0023640 con 0x7fb9ac1594e0 2023-05-12T09:06:55.431 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.426+0000 7fb9937fe700 1 -- 172.21.15.116:0/750909950 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a00237a0 con 0x7fb9ac1594e0 2023-05-12T09:06:55.432 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.426+0000 7fb9937fe700 1 -- 172.21.15.116:0/750909950 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0023b30 con 0x7fb9ac1594e0 2023-05-12T09:06:55.432 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.426+0000 7fb9b11ff700 1 -- 172.21.15.116:0/750909950 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac159ee0 con 0x7fb9ac1594e0 2023-05-12T09:06:55.432 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.426+0000 7fb9b11ff700 1 -- 172.21.15.116:0/750909950 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac0cb0b0 con 0x7fb9ac1594e0 2023-05-12T09:06:55.432 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.426+0000 7fb9937fe700 1 -- 172.21.15.116:0/750909950 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb9a002c730 con 0x7fb9ac1594e0 2023-05-12T09:06:55.432 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.426+0000 7fb9937fe700 1 -- 172.21.15.116:0/750909950 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb9a00223e0 con 0x7fb9ac1594e0 2023-05-12T09:06:55.432 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.427+0000 7fb9b11ff700 1 -- 172.21.15.116:0/750909950 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac071480 con 0x7fb9ac1594e0 2023-05-12T09:06:55.433 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.429+0000 7fb9937fe700 1 -- 172.21.15.116:0/750909950 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fb9a0019400 con 0x7fb9ac1594e0 2023-05-12T09:06:55.481 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:55.479+0000 7fa49d7bd200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-12T09:06:55.503 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.501+0000 7fb9b11ff700 1 -- 172.21.15.116:0/750909950 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9ac0743d0 con 0x7fb9ac1594e0 2023-05-12T09:06:55.504 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.502+0000 7fb9937fe700 1 -- 172.21.15.116:0/750909950 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb9a00198b0 con 0x7fb9ac1594e0 2023-05-12T09:06:55.504 INFO:teuthology.misc.health.smithi116.stdout: 2023-05-12T09:06:55.505 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":10,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:06:54.048302+0000","last_up_change":"0.000000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:06:55.505 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.503+0000 7fb9b11ff700 1 -- 172.21.15.116:0/750909950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac1594e0 msgr2=0x7fb9ac15bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:06:55.506 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.503+0000 7fb9b11ff700 1 --2- 172.21.15.116:0/750909950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac1594e0 0x7fb9ac15bca0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac070780 tx=0x7fb9a0004750 comp rx=0 tx=0).stop 2023-05-12T09:06:55.506 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.503+0000 7fb9b11ff700 1 -- 172.21.15.116:0/750909950 shutdown_connections 2023-05-12T09:06:55.506 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.503+0000 7fb9b11ff700 1 --2- 172.21.15.116:0/750909950 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9ac15a6e0 0x7fb9ac15c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:55.506 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.503+0000 7fb9b11ff700 1 --2- 172.21.15.116:0/750909950 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9ac0cd710 0x7fb9ac0c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:55.506 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.503+0000 7fb9b11ff700 1 --2- 172.21.15.116:0/750909950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9ac1594e0 0x7fb9ac15bca0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:06:55.506 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.503+0000 7fb9b11ff700 1 -- 172.21.15.116:0/750909950 >> 172.21.15.116:0/750909950 conn(0x7fb9ac06b050 msgr2=0x7fb9ac0ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:06:55.506 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.503+0000 7fb9b11ff700 1 -- 172.21.15.116:0/750909950 shutdown_connections 2023-05-12T09:06:55.507 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:06:55.503+0000 7fb9b11ff700 1 -- 172.21.15.116:0/750909950 wait complete. 2023-05-12T09:06:55.519 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-12T09:06:55.568 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:55.565+0000 7fa49d7bd200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-12T09:06:55.814 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:55.811+0000 7ff5b325a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-12T09:06:56.176 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:56.173+0000 7fa49d7bd200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-12T09:06:56.182 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:56.179+0000 7ff5b325a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-12T09:06:56.355 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:56.351+0000 7ff5b325a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-12T09:06:56.549 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:56.546+0000 7fa49d7bd200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-12T09:06:56.724 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:56.721+0000 7fa49d7bd200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-12T09:06:56.788 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:56.785+0000 7ff5b325a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-12T09:06:56.978 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:56.975+0000 7ff5b325a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-12T09:06:57.165 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:57.162+0000 7ff5b325a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-12T09:06:57.167 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:57.165+0000 7fa49d7bd200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-12T09:06:57.367 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:57.364+0000 7fa49d7bd200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-12T09:06:57.544 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:57.540+0000 7ff5b325a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-12T09:06:57.566 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:57.563+0000 7fa49d7bd200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-12T09:06:57.996 INFO:tasks.ceph.mgr.x.smithi182.stderr:2023-05-12T09:06:57.993+0000 7fa49d7bd200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-12T09:06:58.117 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T09:06:58.114+0000 7f4e8fd34640 -1 osd.5 0 log_to_monitors true 2023-05-12T09:06:58.344 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T09:06:58.341+0000 7fb015a13640 -1 osd.7 0 log_to_monitors true 2023-05-12T09:06:58.348 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T09:06:58.345+0000 7f3f44ea2640 -1 osd.1 0 log_to_monitors true 2023-05-12T09:06:58.383 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T09:06:58.380+0000 7f9fab742640 -1 osd.0 0 log_to_monitors true 2023-05-12T09:06:58.388 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T09:06:58.385+0000 7f9b70b67640 -1 osd.3 0 log_to_monitors true 2023-05-12T09:06:58.395 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T09:06:58.393+0000 7fe45e44a640 -1 osd.4 0 log_to_monitors true 2023-05-12T09:06:58.400 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T09:06:58.397+0000 7f448ad12640 -1 osd.2 0 log_to_monitors true 2023-05-12T09:06:58.407 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T09:06:58.404+0000 7f0265b5b640 -1 osd.6 0 log_to_monitors true 2023-05-12T09:06:58.564 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:58.561+0000 7ff56cbfa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-12T09:06:58.565 INFO:tasks.ceph.mgr.y.smithi116.stderr:2023-05-12T09:06:58.562+0000 7ff56cbfa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-12T09:07:01.676 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T09:07:01.672+0000 7f4479bf7700 -1 osd.2 0 waiting for initial osdmap 2023-05-12T09:07:01.686 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T09:07:01.682+0000 7f9b5f9f7700 -1 osd.3 0 waiting for initial osdmap 2023-05-12T09:07:01.704 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T09:07:01.701+0000 7f44713fa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-12T09:07:01.716 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T09:07:01.713+0000 7f9b571fa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-12T09:07:01.730 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T09:07:01.727+0000 7f4e7ebf7700 -1 osd.5 0 waiting for initial osdmap 2023-05-12T09:07:01.746 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T09:07:01.743+0000 7f4e763fa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-12T09:07:01.779 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T09:07:01.776+0000 7f9f9a5f7700 -1 osd.0 0 waiting for initial osdmap 2023-05-12T09:07:01.807 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T09:07:01.804+0000 7f9f91dfa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-12T09:07:01.814 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T09:07:01.810+0000 7fe44d3f7700 -1 osd.4 0 waiting for initial osdmap 2023-05-12T09:07:01.826 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T09:07:01.822+0000 7fb0049f7700 -1 osd.7 0 waiting for initial osdmap 2023-05-12T09:07:01.830 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T09:07:01.827+0000 7fe444bfa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-12T09:07:01.840 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T09:07:01.836+0000 7f02549f7700 -1 osd.6 0 waiting for initial osdmap 2023-05-12T09:07:01.843 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T09:07:01.840+0000 7faffc1fa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-12T09:07:01.855 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T09:07:01.852+0000 7f024c1fa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-12T09:07:02.327 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:02.528 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.525+0000 7f8cd23ff700 1 Processor -- start 2023-05-12T09:07:02.529 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.526+0000 7f8cd23ff700 1 -- start start 2023-05-12T09:07:02.530 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.527+0000 7f8cd23ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 0x7f8ccc0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.530 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.527+0000 7f8cd23ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f8ccc15c9d0 0x7f8ccc0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.530 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.527+0000 7f8cd23ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc0cd660 con 0x7f8ccc0b62e0 2023-05-12T09:07:02.530 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.527+0000 7f8cd23ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc0cdc20 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.530 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.527+0000 7f8cd23ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0cd940 con 0x7f8ccc0d2a50 2023-05-12T09:07:02.531 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.527+0000 7f8cd099c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8ccc0b62e0 0x7f8ccc0d1e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48394/0 (socket says 172.21.15.116:48394) 2023-05-12T09:07:02.531 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.527+0000 7f8cd099c700 1 -- 172.21.15.116:0/869366806 learned_addr learned my addr 172.21.15.116:0/869366806 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:02.531 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.527+0000 7f8ccbfff700 1 --2- 172.21.15.116:0/869366806 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 0x7f8ccc0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.531 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.527+0000 7f8ccb7fe700 1 --2- 172.21.15.116:0/869366806 >> v2:172.21.15.182:3300/0 conn(0x7f8ccc15c9d0 0x7f8ccc0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.532 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.528+0000 7f8ccaffd700 1 -- 172.21.15.116:0/869366806 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001000392 0 0) 0x7f8ccc0cd660 con 0x7f8ccc0b62e0 2023-05-12T09:07:02.532 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.528+0000 7f8ccb7fe700 1 -- 172.21.15.116:0/869366806 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 msgr2=0x7f8ccc0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:02.532 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.528+0000 7f8ccb7fe700 1 --2- 172.21.15.116:0/869366806 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 0x7f8ccc0cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.532 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.528+0000 7f8ccb7fe700 1 -- 172.21.15.116:0/869366806 >> v1:172.21.15.116:6789/0 conn(0x7f8ccc0b62e0 legacy=0x7f8ccc0d1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:02.532 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.528+0000 7f8ccb7fe700 1 -- 172.21.15.116:0/869366806 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0d1660 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.533 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.528+0000 7f8ccb7fe700 1 --2- 172.21.15.116:0/869366806 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8ccc15c9d0 0x7f8ccc0b5da0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009840 tx=0x7f8cc0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b714c9de8f55d79 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:02.533 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.528+0000 7f8ccaffd700 1 -- 172.21.15.116:0/869366806 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0011830 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.534 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.528+0000 7f8ccaffd700 1 -- 172.21.15.116:0/869366806 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc0011990 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.535 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.528+0000 7f8ccaffd700 1 -- 172.21.15.116:0/869366806 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0011d20 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.535 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.529+0000 7f8cd23ff700 1 -- 172.21.15.116:0/869366806 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8ccc15c9d0 msgr2=0x7f8ccc0b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:02.535 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.529+0000 7f8cd23ff700 1 --2- 172.21.15.116:0/869366806 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8ccc15c9d0 0x7f8ccc0b5da0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009840 tx=0x7f8cc0009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:02.535 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.529+0000 7f8cd23ff700 1 -- 172.21.15.116:0/869366806 shutdown_connections 2023-05-12T09:07:02.536 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.529+0000 7f8cd23ff700 1 --2- 172.21.15.116:0/869366806 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 0x7f8ccc0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.536 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.529+0000 7f8cd23ff700 1 --2- 172.21.15.116:0/869366806 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8ccc15c9d0 0x7f8ccc0b5da0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.536 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.529+0000 7f8cd23ff700 1 -- 172.21.15.116:0/869366806 >> 172.21.15.116:0/869366806 conn(0x7f8ccc071af0 msgr2=0x7f8ccc071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:02.536 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.529+0000 7f8cd23ff700 1 -- 172.21.15.116:0/869366806 shutdown_connections 2023-05-12T09:07:02.536 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.529+0000 7f8cd23ff700 1 -- 172.21.15.116:0/869366806 wait complete. 2023-05-12T09:07:02.538 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.531+0000 7f8cd23ff700 1 Processor -- start 2023-05-12T09:07:02.538 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.531+0000 7f8cd23ff700 1 -- start start 2023-05-12T09:07:02.538 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.532+0000 7f8cd23ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8ccc0b62e0 0x7f8ccc15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.538 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.532+0000 7f8cd23ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 0x7f8ccc1f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.538 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.532+0000 7f8cd23ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ccc15c9d0 0x7f8ccc147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.539 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.532+0000 7f8cd23ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b6a80 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.539 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.532+0000 7f8cd23ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0c92b0 con 0x7f8ccc0b62e0 2023-05-12T09:07:02.539 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.532+0000 7f8cd23ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0c9590 con 0x7f8ccc0d2a50 2023-05-12T09:07:02.539 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.532+0000 7f8cd099c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ccc15c9d0 0x7f8ccc147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.539 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.532+0000 7f8cd099c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ccc15c9d0 0x7f8ccc147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35392/0 (socket says 172.21.15.116:35392) 2023-05-12T09:07:02.539 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8cd099c700 1 -- 172.21.15.116:0/567063881 learned_addr learned my addr 172.21.15.116:0/567063881 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:02.539 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8ccb7fe700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 0x7f8ccc1f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.540 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8ccbfff700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8ccc0b62e0 0x7f8ccc15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.540 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8cd099c700 1 -- 172.21.15.116:0/567063881 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 msgr2=0x7f8ccc1f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:02.540 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8cd099c700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 0x7f8ccc1f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.540 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8cd099c700 1 -- 172.21.15.116:0/567063881 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8ccc0b62e0 msgr2=0x7f8ccc15f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:02.540 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8cd099c700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8ccc0b62e0 0x7f8ccc15f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.540 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8cd099c700 1 -- 172.21.15.116:0/567063881 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00094a0 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.540 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8ccbfff700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8ccc0b62e0 0x7f8ccc15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:02.541 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8ccb7fe700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 0x7f8ccc1f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:02.541 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8cd099c700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ccc15c9d0 0x7f8ccc147fa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400cbe0 tx=0x7f8cc400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:02.541 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.533+0000 7f8cc8ff9700 1 -- 172.21.15.116:0/567063881 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400aaa0 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.541 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.534+0000 7f8cc8ff9700 1 -- 172.21.15.116:0/567063881 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc400ac20 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.541 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.534+0000 7f8cc8ff9700 1 -- 172.21.15.116:0/567063881 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40070d0 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.541 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.534+0000 7f8cd23ff700 1 -- 172.21.15.116:0/567063881 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc0b2740 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.541 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.534+0000 7f8cd23ff700 1 -- 172.21.15.116:0/567063881 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc0d1940 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.542 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.535+0000 7f8cd23ff700 1 -- 172.21.15.116:0/567063881 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc0d2570 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.542 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.536+0000 7f8cc8ff9700 1 -- 172.21.15.116:0/567063881 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f8cc4007230 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.542 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.538+0000 7f8cc8ff9700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cb806ac50 0x7f8cb806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.543 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.538+0000 7f8cc8ff9700 1 -- 172.21.15.116:0/567063881 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f8cc4087fd0 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.543 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.538+0000 7f8ccbfff700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cb806ac50 0x7f8cb806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.543 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.538+0000 7f8ccbfff700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cb806ac50 0x7f8cb806d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009fd0 tx=0x7f8cbc009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:02.546 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.543+0000 7f8cc8ff9700 1 -- 172.21.15.116:0/567063881 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8cc4053fb0 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.667 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T09:07:02.662+0000 7f3f33df7700 -1 osd.1 0 waiting for initial osdmap 2023-05-12T09:07:02.676 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T09:07:02.673+0000 7f3f2b5fa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-12T09:07:02.769 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.766+0000 7f8cd23ff700 1 -- 172.21.15.116:0/567063881 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ccc0743d0 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.770 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.767+0000 7f8cc8ff9700 1 -- 172.21.15.116:0/567063881 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10932 (secure 0 0 0) 0x7f8cc4018070 con 0x7f8ccc15c9d0 2023-05-12T09:07:02.770 INFO:teuthology.misc.health.smithi116.stdout: 2023-05-12T09:07:02.771 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":13,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:02.690568+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:02.773 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 -- 172.21.15.116:0/567063881 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cb806ac50 msgr2=0x7f8cb806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:02.773 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cb806ac50 0x7f8cb806d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009fd0 tx=0x7f8cbc009210 comp rx=0 tx=0).stop 2023-05-12T09:07:02.773 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 -- 172.21.15.116:0/567063881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ccc15c9d0 msgr2=0x7f8ccc147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:02.773 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ccc15c9d0 0x7f8ccc147fa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400cbe0 tx=0x7f8cc400cef0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.773 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 -- 172.21.15.116:0/567063881 shutdown_connections 2023-05-12T09:07:02.774 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ccc15c9d0 0x7f8ccc147fa0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.774 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8ccc0b62e0 0x7f8ccc15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.774 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cb806ac50 0x7f8cb806d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.774 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 --2- 172.21.15.116:0/567063881 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8ccc0d2a50 0x7f8ccc1f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.774 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 -- 172.21.15.116:0/567063881 >> 172.21.15.116:0/567063881 conn(0x7f8ccc071af0 msgr2=0x7f8ccc0cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:02.774 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 -- 172.21.15.116:0/567063881 shutdown_connections 2023-05-12T09:07:02.775 INFO:teuthology.misc.health.smithi116.stderr:2023-05-12T09:07:02.769+0000 7f8cd23ff700 1 -- 172.21.15.116:0/567063881 wait complete. 2023-05-12T09:07:02.788 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-12T09:07:02.789 INFO:tasks.ceph:Creating RBD pool 2023-05-12T09:07:02.789 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-12T09:07:02.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.970+0000 7f75b31ff700 1 Processor -- start 2023-05-12T09:07:02.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.970+0000 7f75b31ff700 1 -- start start 2023-05-12T09:07:02.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b31ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f75ac15d460 0x7f75ac0d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b31ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f75ac15d8d0 0x7f75ac0d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b31ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0cd4c0 con 0x7f75ac15d090 2023-05-12T09:07:02.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b31ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0cd7a0 con 0x7f75ac15d8d0 2023-05-12T09:07:02.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b31ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0cda80 con 0x7f75ac15d460 2023-05-12T09:07:02.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b179c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f75ac15d8d0 0x7f75ac0d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b0f9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f75ac15d090 0x7f75ac0cfc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48404/0 (socket says 172.21.15.116:48404) 2023-05-12T09:07:02.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b0f9b700 1 -- 172.21.15.116:0/937868443 learned_addr learned my addr 172.21.15.116:0/937868443 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:02.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75abfff700 1 --2- 172.21.15.116:0/937868443 >> v2:172.21.15.182:3300/0 conn(0x7f75ac15d460 0x7f75ac0d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b179c700 1 -- 172.21.15.116:0/937868443 >> v2:172.21.15.182:3300/0 conn(0x7f75ac15d460 msgr2=0x7f75ac0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:02.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b179c700 1 --2- 172.21.15.116:0/937868443 >> v2:172.21.15.182:3300/0 conn(0x7f75ac15d460 0x7f75ac0d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b179c700 1 -- 172.21.15.116:0/937868443 >> v1:172.21.15.116:6789/0 conn(0x7f75ac15d090 legacy=0x7f75ac0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:02.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75b179c700 1 -- 172.21.15.116:0/937868443 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0cf440 con 0x7f75ac15d8d0 2023-05-12T09:07:02.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.972+0000 7f75ab7fe700 1 -- 172.21.15.116:0/937868443 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683598585 0 0) 0x7f75ac0cd4c0 con 0x7f75ac15d090 2023-05-12T09:07:02.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.973+0000 7f75b179c700 1 --2- 172.21.15.116:0/937868443 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d8d0 0x7f75ac0d3340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0726e0 tx=0x7f75a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce3eb9ebb753ab8 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:02.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.973+0000 7f75ab7fe700 1 -- 172.21.15.116:0/937868443 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400e070 con 0x7f75ac15d8d0 2023-05-12T09:07:02.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.973+0000 7f75ab7fe700 1 -- 172.21.15.116:0/937868443 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a400bb20 con 0x7f75ac15d8d0 2023-05-12T09:07:02.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.973+0000 7f75ab7fe700 1 -- 172.21.15.116:0/937868443 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4012430 con 0x7f75ac15d8d0 2023-05-12T09:07:02.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.973+0000 7f75b31ff700 1 -- 172.21.15.116:0/937868443 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d8d0 msgr2=0x7f75ac0d3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:02.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.973+0000 7f75b31ff700 1 --2- 172.21.15.116:0/937868443 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d8d0 0x7f75ac0d3340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0726e0 tx=0x7f75a400b330 comp rx=0 tx=0).stop 2023-05-12T09:07:02.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.973+0000 7f75b31ff700 1 -- 172.21.15.116:0/937868443 shutdown_connections 2023-05-12T09:07:02.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.973+0000 7f75b31ff700 1 --2- 172.21.15.116:0/937868443 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d8d0 0x7f75ac0d3340 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.973+0000 7f75b31ff700 1 --2- 172.21.15.116:0/937868443 >> v2:172.21.15.182:3300/0 conn(0x7f75ac15d460 0x7f75ac0d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.973+0000 7f75b31ff700 1 -- 172.21.15.116:0/937868443 >> 172.21.15.116:0/937868443 conn(0x7f75ac071b10 msgr2=0x7f75ac071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:02.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.974+0000 7f75b31ff700 1 -- 172.21.15.116:0/937868443 shutdown_connections 2023-05-12T09:07:02.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.974+0000 7f75b31ff700 1 -- 172.21.15.116:0/937868443 wait complete. 2023-05-12T09:07:02.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.975+0000 7f75b31ff700 1 Processor -- start 2023-05-12T09:07:02.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.975+0000 7f75b31ff700 1 -- start start 2023-05-12T09:07:02.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.976+0000 7f75b31ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75ac15d090 0x7f75ac14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.976+0000 7f75b31ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d460 0x7f75ac159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.976+0000 7f75b31ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75ac0cc900 0x7f75ac1e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.976+0000 7f75b31ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0cd0c0 con 0x7f75ac15d460 2023-05-12T09:07:02.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.976+0000 7f75b31ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0ccde0 con 0x7f75ac0cc900 2023-05-12T09:07:02.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.976+0000 7f75b31ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0b7f60 con 0x7f75ac15d090 2023-05-12T09:07:02.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.976+0000 7f75abfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d460 0x7f75ac159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75abfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d460 0x7f75ac159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35398/0 (socket says 172.21.15.116:35398) 2023-05-12T09:07:02.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75abfff700 1 -- 172.21.15.116:0/2682467475 learned_addr learned my addr 172.21.15.116:0/2682467475 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:02.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75b0f9b700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75ac15d090 0x7f75ac14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75b179c700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75ac0cc900 0x7f75ac1e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75abfff700 1 -- 172.21.15.116:0/2682467475 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75ac15d090 msgr2=0x7f75ac14d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:02.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75abfff700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75ac15d090 0x7f75ac14d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75abfff700 1 -- 172.21.15.116:0/2682467475 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75ac0cc900 msgr2=0x7f75ac1e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:02.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75abfff700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75ac0cc900 0x7f75ac1e74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:02.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75abfff700 1 -- 172.21.15.116:0/2682467475 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4009a70 con 0x7f75ac15d460 2023-05-12T09:07:02.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75abfff700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d460 0x7f75ac159620 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f759800e9b0 tx=0x7f759800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:02.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75a97fa700 1 -- 172.21.15.116:0/2682467475 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598009710 con 0x7f75ac15d460 2023-05-12T09:07:02.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75a97fa700 1 -- 172.21.15.116:0/2682467475 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759800c850 con 0x7f75ac15d460 2023-05-12T09:07:02.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75a97fa700 1 -- 172.21.15.116:0/2682467475 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800cbc0 con 0x7f75ac15d460 2023-05-12T09:07:02.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.977+0000 7f75b31ff700 1 -- 172.21.15.116:0/2682467475 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac0cf0c0 con 0x7f75ac15d460 2023-05-12T09:07:02.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.978+0000 7f75b31ff700 1 -- 172.21.15.116:0/2682467475 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac0cf720 con 0x7f75ac15d460 2023-05-12T09:07:02.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.979+0000 7f75b31ff700 1 -- 172.21.15.116:0/2682467475 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac0b2500 con 0x7f75ac15d460 2023-05-12T09:07:02.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.979+0000 7f75a97fa700 1 -- 172.21.15.116:0/2682467475 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f759800cd20 con 0x7f75ac15d460 2023-05-12T09:07:02.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.980+0000 7f75a97fa700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f759006ac50 0x7f759006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:02.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.981+0000 7f75a97fa700 1 -- 172.21.15.116:0/2682467475 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f7598088e50 con 0x7f75ac15d460 2023-05-12T09:07:02.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.981+0000 7f75b0f9b700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f759006ac50 0x7f759006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:02.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.981+0000 7f75b0f9b700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f759006ac50 0x7f759006d100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75a0000f60 tx=0x7f75a0007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:02.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:02.985+0000 7f75a97fa700 1 -- 172.21.15.116:0/2682467475 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7598054610 con 0x7f75ac15d460 2023-05-12T09:07:03.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.181+0000 7f75b31ff700 1 -- 172.21.15.116:0/2682467475 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f75ac074430 con 0x7f75ac15d460 2023-05-12T09:07:03.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.819+0000 7f75a97fa700 1 -- 172.21.15.116:0/2682467475 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f7598057c30 con 0x7f75ac15d460 2023-05-12T09:07:03.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.822+0000 7f75b31ff700 1 -- 172.21.15.116:0/2682467475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f759006ac50 msgr2=0x7f759006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:03.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.822+0000 7f75b31ff700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f759006ac50 0x7f759006d100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75a0000f60 tx=0x7f75a0007c00 comp rx=0 tx=0).stop 2023-05-12T09:07:03.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.822+0000 7f75b31ff700 1 -- 172.21.15.116:0/2682467475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d460 msgr2=0x7f75ac159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:03.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.822+0000 7f75b31ff700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d460 0x7f75ac159620 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f759800e9b0 tx=0x7f759800ed70 comp rx=0 tx=0).stop 2023-05-12T09:07:03.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.822+0000 7f75b31ff700 1 -- 172.21.15.116:0/2682467475 shutdown_connections 2023-05-12T09:07:03.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.822+0000 7f75b31ff700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75ac0cc900 0x7f75ac1e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:03.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.822+0000 7f75b31ff700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f759006ac50 0x7f759006d100 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:03.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.822+0000 7f75b31ff700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75ac15d090 0x7f75ac14d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:03.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.822+0000 7f75b31ff700 1 --2- 172.21.15.116:0/2682467475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75ac15d460 0x7f75ac159620 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:03.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.822+0000 7f75b31ff700 1 -- 172.21.15.116:0/2682467475 >> 172.21.15.116:0/2682467475 conn(0x7f75ac071b10 msgr2=0x7f75ac0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:03.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.823+0000 7f75b31ff700 1 -- 172.21.15.116:0/2682467475 shutdown_connections 2023-05-12T09:07:03.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:03.823+0000 7f75b31ff700 1 -- 172.21.15.116:0/2682467475 wait complete. 2023-05-12T09:07:03.828 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'rbd' created 2023-05-12T09:07:03.844 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-12T09:07:04.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.021+0000 7f5bfcbff700 1 Processor -- start 2023-05-12T09:07:04.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.021+0000 7f5bfcbff700 1 -- start start 2023-05-12T09:07:04.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.022+0000 7f5bfcbff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5bf80cfbf0 0x7f5bf81608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:04.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5bfcbff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5bf80d1100 0x7f5bf80d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:04.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5bfcbff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf80d0020 con 0x7f5bf80b87a0 2023-05-12T09:07:04.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5bfcbff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf80d02d0 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5bfcbff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80d0cb0 con 0x7f5bf80d1100 2023-05-12T09:07:04.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5beffff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5bf80cfbf0 0x7f5bf81608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:04.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5bf659c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f5bf80b87a0 0x7f5bf81601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48412/0 (socket says 172.21.15.116:48412) 2023-05-12T09:07:04.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5bf659c700 1 -- 172.21.15.116:0/2156168296 learned_addr learned my addr 172.21.15.116:0/2156168296 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:04.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5bf6d9d700 1 --2- 172.21.15.116:0/2156168296 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5bf80d1100 0x7f5bf80d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:04.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5beffff700 1 -- 172.21.15.116:0/2156168296 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5bf80d1100 msgr2=0x7f5bf80d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:04.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5beffff700 1 --2- 172.21.15.116:0/2156168296 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5bf80d1100 0x7f5bf80d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:04.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5beffff700 1 -- 172.21.15.116:0/2156168296 >> v1:172.21.15.116:6789/0 conn(0x7f5bf80b87a0 legacy=0x7f5bf81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:04.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5beffff700 1 -- 172.21.15.116:0/2156168296 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf80cdc60 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5bf5d9b700 1 -- 172.21.15.116:0/2156168296 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440235796 0 0) 0x7f5bf80d0020 con 0x7f5bf80b87a0 2023-05-12T09:07:04.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.023+0000 7f5beffff700 1 --2- 172.21.15.116:0/2156168296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 0x7f5bf81608f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009840 tx=0x7f5be0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a87835f039d991 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:04.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bf5d9b700 1 -- 172.21.15.116:0/2156168296 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0011830 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bf5d9b700 1 -- 172.21.15.116:0/2156168296 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be0011990 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bf5d9b700 1 -- 172.21.15.116:0/2156168296 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0011d20 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bfcbff700 1 -- 172.21.15.116:0/2156168296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 msgr2=0x7f5bf81608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:04.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bfcbff700 1 --2- 172.21.15.116:0/2156168296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 0x7f5bf81608f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009840 tx=0x7f5be0009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:04.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bfcbff700 1 -- 172.21.15.116:0/2156168296 shutdown_connections 2023-05-12T09:07:04.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bfcbff700 1 --2- 172.21.15.116:0/2156168296 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5bf80d1100 0x7f5bf80d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:04.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bfcbff700 1 --2- 172.21.15.116:0/2156168296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 0x7f5bf81608f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:04.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bfcbff700 1 -- 172.21.15.116:0/2156168296 >> 172.21.15.116:0/2156168296 conn(0x7f5bf8071b10 msgr2=0x7f5bf8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:04.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bfcbff700 1 -- 172.21.15.116:0/2156168296 shutdown_connections 2023-05-12T09:07:04.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.024+0000 7f5bfcbff700 1 -- 172.21.15.116:0/2156168296 wait complete. 2023-05-12T09:07:04.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.027+0000 7f5bfcbff700 1 Processor -- start 2023-05-12T09:07:04.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.027+0000 7f5bfcbff700 1 -- start start 2023-05-12T09:07:04.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.028+0000 7f5bfcbff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5bf80b87a0 0x7f5bf814a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:04.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.028+0000 7f5bfcbff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 0x7f5bf815f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:04.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.028+0000 7f5bfcbff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5bf80d1100 0x7f5bf80d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:04.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.028+0000 7f5bfcbff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf815e950 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.028+0000 7f5bfcbff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf815f0d0 con 0x7f5bf80d1100 2023-05-12T09:07:04.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.028+0000 7f5bfcbff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf815e3d0 con 0x7f5bf80b87a0 2023-05-12T09:07:04.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5beffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 0x7f5bf815f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:04.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5beffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 0x7f5bf815f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35402/0 (socket says 172.21.15.116:35402) 2023-05-12T09:07:04.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5bf659c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5bf80b87a0 0x7f5bf814a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:04.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5beffff700 1 -- 172.21.15.116:0/3543026355 learned_addr learned my addr 172.21.15.116:0/3543026355 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:04.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5bf6d9d700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5bf80d1100 0x7f5bf80d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:04.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5beffff700 1 -- 172.21.15.116:0/3543026355 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5bf80b87a0 msgr2=0x7f5bf814a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:04.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5beffff700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5bf80b87a0 0x7f5bf814a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:04.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5beffff700 1 -- 172.21.15.116:0/3543026355 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5bf80d1100 msgr2=0x7f5bf80d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:04.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5beffff700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5bf80d1100 0x7f5bf80d25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:04.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5beffff700 1 -- 172.21.15.116:0/3543026355 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00094a0 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.029+0000 7f5beffff700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 0x7f5bf815f560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5be00090b0 tx=0x7f5be0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:04.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.030+0000 7f5beeffd700 1 -- 172.21.15.116:0/3543026355 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be00036a0 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.030+0000 7f5beeffd700 1 -- 172.21.15.116:0/3543026355 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be001f070 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.030+0000 7f5bfcbff700 1 -- 172.21.15.116:0/3543026355 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf80cd980 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.030+0000 7f5beeffd700 1 -- 172.21.15.116:0/3543026355 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0003a60 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.030+0000 7f5bfcbff700 1 -- 172.21.15.116:0/3543026355 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf80cd6a0 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.031+0000 7f5bfcbff700 1 -- 172.21.15.116:0/3543026355 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf8160e30 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.032+0000 7f5beeffd700 1 -- 172.21.15.116:0/3543026355 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f5be0003bc0 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.032+0000 7f5beeffd700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bd806ac50 0x7f5bd806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:04.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.033+0000 7f5beeffd700 1 -- 172.21.15.116:0/3543026355 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f5be0021070 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.033+0000 7f5bf659c700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bd806ac50 0x7f5bd806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:04.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.033+0000 7f5bf659c700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bd806ac50 0x7f5bd806d100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5be8007fd0 tx=0x7f5be8007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:04.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.037+0000 7f5beeffd700 1 -- 172.21.15.116:0/3543026355 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5be0055e40 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.229+0000 7f5bfcbff700 1 -- 172.21.15.116:0/3543026355 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5bf8074430 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.821+0000 7f5beeffd700 1 -- 172.21.15.116:0/3543026355 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5be0059460 con 0x7f5bf80cfbf0 2023-05-12T09:07:04.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.824+0000 7f5bfcbff700 1 -- 172.21.15.116:0/3543026355 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bd806ac50 msgr2=0x7f5bd806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:04.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.824+0000 7f5bfcbff700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bd806ac50 0x7f5bd806d100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5be8007fd0 tx=0x7f5be8007de0 comp rx=0 tx=0).stop 2023-05-12T09:07:04.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.824+0000 7f5bfcbff700 1 -- 172.21.15.116:0/3543026355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 msgr2=0x7f5bf815f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:04.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.824+0000 7f5bfcbff700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 0x7f5bf815f560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5be00090b0 tx=0x7f5be0004750 comp rx=0 tx=0).stop 2023-05-12T09:07:04.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.825+0000 7f5bfcbff700 1 -- 172.21.15.116:0/3543026355 shutdown_connections 2023-05-12T09:07:04.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.825+0000 7f5bfcbff700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5bf80d1100 0x7f5bf80d25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:04.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.825+0000 7f5bfcbff700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bd806ac50 0x7f5bd806d100 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:04.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.825+0000 7f5bfcbff700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5bf80b87a0 0x7f5bf814a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:04.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.825+0000 7f5bfcbff700 1 --2- 172.21.15.116:0/3543026355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5bf80cfbf0 0x7f5bf815f560 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:04.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.825+0000 7f5bfcbff700 1 -- 172.21.15.116:0/3543026355 >> 172.21.15.116:0/3543026355 conn(0x7f5bf8071b10 msgr2=0x7f5bf80b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:04.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.825+0000 7f5bfcbff700 1 -- 172.21.15.116:0/3543026355 shutdown_connections 2023-05-12T09:07:04.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:04.825+0000 7f5bfcbff700 1 -- 172.21.15.116:0/3543026355 wait complete. 2023-05-12T09:07:04.831 INFO:teuthology.orchestra.run.smithi116.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-12T09:07:04.850 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-12T09:07:04.850 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-12T09:07:04.851 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-12T09:07:04.854 INFO:tasks.ceph.mds.a:Started 2023-05-12T09:07:04.855 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-12T09:07:04.855 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-12T09:07:04.859 INFO:tasks.ceph.mds.c:Started 2023-05-12T09:07:04.860 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-12T09:07:04.860 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-12T09:07:04.864 INFO:tasks.ceph.mds.b:Started 2023-05-12T09:07:04.864 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-12T09:07:04.865 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-12T09:07:04.868 INFO:tasks.ceph.mds.d:Started 2023-05-12T09:07:04.869 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-12T09:07:04.869 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:05.010 INFO:tasks.ceph.mds.a.smithi116.stdout:starting mds.a at 2023-05-12T09:07:05.016 INFO:tasks.ceph.mds.b.smithi182.stdout:starting mds.b at 2023-05-12T09:07:05.017 INFO:tasks.ceph.mds.d.smithi182.stdout:starting mds.d at 2023-05-12T09:07:05.025 INFO:tasks.ceph.mds.c.smithi116.stdout:starting mds.c at 2023-05-12T09:07:05.089 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.086+0000 7f161f5ff700 1 Processor -- start 2023-05-12T09:07:05.090 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.086+0000 7f161f5ff700 1 -- start start 2023-05-12T09:07:05.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161f5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 0x7f16180cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161f5ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f16181601e0 0x7f1618160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161f5ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1618160b70 0x7f16180d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161f5ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16180d02d0 con 0x7f1618160b70 2023-05-12T09:07:05.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161f5ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16180d0cb0 con 0x7f16181601e0 2023-05-12T09:07:05.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161f5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16180b2730 con 0x7f16180b87a0 2023-05-12T09:07:05.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161db9c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1618160b70 0x7f16180d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161d39b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 0x7f16180cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161cb9a700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f16181601e0 0x7f1618160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161db9c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1618160b70 0x7f16180d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35462/0 (socket says 172.21.15.116:35462) 2023-05-12T09:07:05.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.087+0000 7f161db9c700 1 -- 172.21.15.116:0/3773341644 learned_addr learned my addr 172.21.15.116:0/3773341644 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:05.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f161d39b700 1 -- 172.21.15.116:0/3773341644 >> v2:172.21.15.182:3300/0 conn(0x7f16181601e0 msgr2=0x7f1618160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:05.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f161d39b700 1 --2- 172.21.15.116:0/3773341644 >> v2:172.21.15.182:3300/0 conn(0x7f16181601e0 0x7f1618160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f161d39b700 1 -- 172.21.15.116:0/3773341644 >> v2:172.21.15.116:3300/0 conn(0x7f1618160b70 msgr2=0x7f16180d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:05.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f161d39b700 1 --2- 172.21.15.116:0/3773341644 >> v2:172.21.15.116:3300/0 conn(0x7f1618160b70 0x7f16180d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f161d39b700 1 -- 172.21.15.116:0/3773341644 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618160ff0 con 0x7f16180b87a0 2023-05-12T09:07:05.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f161db9c700 1 --2- 172.21.15.116:0/3773341644 >> v2:172.21.15.116:3300/0 conn(0x7f1618160b70 0x7f16180d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:05.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f161cb9a700 1 --2- 172.21.15.116:0/3773341644 >> v2:172.21.15.182:3300/0 conn(0x7f16181601e0 0x7f1618160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:05.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f161d39b700 1 --2- 172.21.15.116:0/3773341644 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 0x7f16180cfbf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f161808be90 tx=0x7f1614009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=448aaf25c7b81e3e server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:05.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f160ffff700 1 -- 172.21.15.116:0/3773341644 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614011830 con 0x7f16180b87a0 2023-05-12T09:07:05.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f160ffff700 1 -- 172.21.15.116:0/3773341644 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614011990 con 0x7f16180b87a0 2023-05-12T09:07:05.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.088+0000 7f160ffff700 1 -- 172.21.15.116:0/3773341644 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614011d20 con 0x7f16180b87a0 2023-05-12T09:07:05.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.089+0000 7f161f5ff700 1 -- 172.21.15.116:0/3773341644 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 msgr2=0x7f16180cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.089+0000 7f161f5ff700 1 --2- 172.21.15.116:0/3773341644 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 0x7f16180cfbf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f161808be90 tx=0x7f1614009b20 comp rx=0 tx=0).stop 2023-05-12T09:07:05.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.089+0000 7f161f5ff700 1 -- 172.21.15.116:0/3773341644 shutdown_connections 2023-05-12T09:07:05.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.089+0000 7f161f5ff700 1 --2- 172.21.15.116:0/3773341644 >> v2:172.21.15.116:3300/0 conn(0x7f1618160b70 0x7f16180d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.089+0000 7f161f5ff700 1 --2- 172.21.15.116:0/3773341644 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 0x7f16180cfbf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.089+0000 7f161f5ff700 1 --2- 172.21.15.116:0/3773341644 >> v2:172.21.15.182:3300/0 conn(0x7f16181601e0 0x7f1618160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.089+0000 7f161f5ff700 1 -- 172.21.15.116:0/3773341644 >> 172.21.15.116:0/3773341644 conn(0x7f1618071b10 msgr2=0x7f1618071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:05.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.089+0000 7f161f5ff700 1 -- 172.21.15.116:0/3773341644 shutdown_connections 2023-05-12T09:07:05.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.089+0000 7f161f5ff700 1 -- 172.21.15.116:0/3773341644 wait complete. 2023-05-12T09:07:05.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.091+0000 7f161f5ff700 1 Processor -- start 2023-05-12T09:07:05.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.091+0000 7f161f5ff700 1 -- start start 2023-05-12T09:07:05.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.092+0000 7f161f5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 0x7f161815f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.092+0000 7f161f5ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f16181601e0 0x7f161815de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.092+0000 7f161f5ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1618160b70 0x7f1618150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.092+0000 7f161f5ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161815da50 con 0x7f1618160b70 2023-05-12T09:07:05.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.092+0000 7f161f5ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161815cdd0 con 0x7f16181601e0 2023-05-12T09:07:05.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.092+0000 7f161f5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161815d0b0 con 0x7f16180b87a0 2023-05-12T09:07:05.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.092+0000 7f161db9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1618160b70 0x7f1618150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.092+0000 7f161db9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1618160b70 0x7f1618150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35470/0 (socket says 172.21.15.116:35470) 2023-05-12T09:07:05.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.092+0000 7f161db9c700 1 -- 172.21.15.116:0/1286970845 learned_addr learned my addr 172.21.15.116:0/1286970845 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:05.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161d39b700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 0x7f161815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161cb9a700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f16181601e0 0x7f161815de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161db9c700 1 -- 172.21.15.116:0/1286970845 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 msgr2=0x7f161815f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161db9c700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 0x7f161815f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161db9c700 1 -- 172.21.15.116:0/1286970845 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f16181601e0 msgr2=0x7f161815de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161db9c700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f16181601e0 0x7f161815de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161db9c700 1 -- 172.21.15.116:0/1286970845 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16080094a0 con 0x7f1618160b70 2023-05-12T09:07:05.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161d39b700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 0x7f161815f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:05.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161cb9a700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f16181601e0 0x7f161815de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:05.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161db9c700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1618160b70 0x7f1618150a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f161000efc0 tx=0x7f161000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:05.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f160dffb700 1 -- 172.21.15.116:0/1286970845 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610018070 con 0x7f1618160b70 2023-05-12T09:07:05.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f160dffb700 1 -- 172.21.15.116:0/1286970845 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000f040 con 0x7f1618160b70 2023-05-12T09:07:05.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161f5ff700 1 -- 172.21.15.116:0/1286970845 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1610009b30 con 0x7f1618160b70 2023-05-12T09:07:05.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f160dffb700 1 -- 172.21.15.116:0/1286970845 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610003c40 con 0x7f1618160b70 2023-05-12T09:07:05.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.093+0000 7f161f5ff700 1 -- 172.21.15.116:0/1286970845 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16140094a0 con 0x7f1618160b70 2023-05-12T09:07:05.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.095+0000 7f161f5ff700 1 -- 172.21.15.116:0/1286970845 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16180cd6a0 con 0x7f1618160b70 2023-05-12T09:07:05.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.095+0000 7f160dffb700 1 -- 172.21.15.116:0/1286970845 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f161000c9f0 con 0x7f1618160b70 2023-05-12T09:07:05.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.096+0000 7f160dffb700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f15fc06ac50 0x7f15fc06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.096+0000 7f160dffb700 1 -- 172.21.15.116:0/1286970845 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1610089230 con 0x7f1618160b70 2023-05-12T09:07:05.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.096+0000 7f161d39b700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f15fc06ac50 0x7f15fc06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.097+0000 7f161d39b700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f15fc06ac50 0x7f15fc06d100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16140090b0 tx=0x7f1614008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:05.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.101+0000 7f160dffb700 1 -- 172.21.15.116:0/1286970845 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f16100547b0 con 0x7f1618160b70 2023-05-12T09:07:05.317 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.315+0000 7f161f5ff700 1 -- 172.21.15.116:0/1286970845 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16180cd980 con 0x7f1618160b70 2023-05-12T09:07:05.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.316+0000 7f160dffb700 1 -- 172.21.15.116:0/1286970845 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+14629 (secure 0 0 0) 0x7f1610057dd0 con 0x7f1618160b70 2023-05-12T09:07:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:05.319 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":15,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:04.817669+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:05.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 -- 172.21.15.116:0/1286970845 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f15fc06ac50 msgr2=0x7f15fc06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f15fc06ac50 0x7f15fc06d100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16140090b0 tx=0x7f1614008030 comp rx=0 tx=0).stop 2023-05-12T09:07:05.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 -- 172.21.15.116:0/1286970845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1618160b70 msgr2=0x7f1618150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1618160b70 0x7f1618150a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f161000efc0 tx=0x7f161000c3a0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 -- 172.21.15.116:0/1286970845 shutdown_connections 2023-05-12T09:07:05.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1618160b70 0x7f1618150a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f15fc06ac50 0x7f15fc06d100 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f16180b87a0 0x7f161815f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 --2- 172.21.15.116:0/1286970845 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f16181601e0 0x7f161815de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 -- 172.21.15.116:0/1286970845 >> 172.21.15.116:0/1286970845 conn(0x7f1618071b10 msgr2=0x7f16180b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:05.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.318+0000 7f161f5ff700 1 -- 172.21.15.116:0/1286970845 shutdown_connections 2023-05-12T09:07:05.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.319+0000 7f161f5ff700 1 -- 172.21.15.116:0/1286970845 wait complete. 2023-05-12T09:07:05.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-12T09:07:05.340 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:07:05.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.530+0000 7f43d0bff700 1 Processor -- start 2023-05-12T09:07:05.534 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.531+0000 7f43d0bff700 1 -- start start 2023-05-12T09:07:05.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.532+0000 7f43d0bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f43cc15c590 0x7f43cc160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.532+0000 7f43d0bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f43cc0cff50 0x7f43cc0d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.532+0000 7f43d0bff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc0cd520 con 0x7f43cc0cf010 2023-05-12T09:07:05.536 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.532+0000 7f43d0bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc0d2640 con 0x7f43cc0cff50 2023-05-12T09:07:05.536 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.532+0000 7f43d0bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc1610d0 con 0x7f43cc15c590 2023-05-12T09:07:05.536 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.532+0000 7f43c9d9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f43cc0cf010 0x7f43cc0cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48432/0 (socket says 172.21.15.116:48432) 2023-05-12T09:07:05.536 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.532+0000 7f43c9d9b700 1 -- 172.21.15.116:0/2601766172 learned_addr learned my addr 172.21.15.116:0/2601766172 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:05.536 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.533+0000 7f43ca59c700 1 --2- 172.21.15.116:0/2601766172 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f43cc15c590 0x7f43cc160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.533+0000 7f43cad9d700 1 --2- 172.21.15.116:0/2601766172 >> v2:172.21.15.182:3300/0 conn(0x7f43cc0cff50 0x7f43cc0d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.533+0000 7f43c959a700 1 -- 172.21.15.116:0/2601766172 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449869165 0 0) 0x7f43cc0cd520 con 0x7f43cc0cf010 2023-05-12T09:07:05.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.533+0000 7f43c959a700 1 -- 172.21.15.116:0/2601766172 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b40035b0 con 0x7f43cc0cf010 2023-05-12T09:07:05.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.533+0000 7f43cad9d700 1 -- 172.21.15.116:0/2601766172 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f43cc15c590 msgr2=0x7f43cc160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:05.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.533+0000 7f43cad9d700 1 --2- 172.21.15.116:0/2601766172 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f43cc15c590 0x7f43cc160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.533+0000 7f43cad9d700 1 -- 172.21.15.116:0/2601766172 >> v1:172.21.15.116:6789/0 conn(0x7f43cc0cf010 legacy=0x7f43cc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.533+0000 7f43cad9d700 1 -- 172.21.15.116:0/2601766172 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0b23c0 con 0x7f43cc0cff50 2023-05-12T09:07:05.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.533+0000 7f43ca59c700 1 --2- 172.21.15.116:0/2601766172 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f43cc15c590 0x7f43cc160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:05.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.533+0000 7f43cad9d700 1 --2- 172.21.15.116:0/2601766172 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f43cc0cff50 0x7f43cc0d2ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009d90 tx=0x7f43c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc6e564fae1355b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:05.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43c959a700 1 -- 172.21.15.116:0/2601766172 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c400e070 con 0x7f43cc0cff50 2023-05-12T09:07:05.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43c959a700 1 -- 172.21.15.116:0/2601766172 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c400bb20 con 0x7f43cc0cff50 2023-05-12T09:07:05.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43c959a700 1 -- 172.21.15.116:0/2601766172 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4012430 con 0x7f43cc0cff50 2023-05-12T09:07:05.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43d0bff700 1 -- 172.21.15.116:0/2601766172 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f43cc0cff50 msgr2=0x7f43cc0d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.540 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43d0bff700 1 --2- 172.21.15.116:0/2601766172 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f43cc0cff50 0x7f43cc0d2ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009d90 tx=0x7f43c400b330 comp rx=0 tx=0).stop 2023-05-12T09:07:05.540 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43d0bff700 1 -- 172.21.15.116:0/2601766172 shutdown_connections 2023-05-12T09:07:05.540 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43d0bff700 1 --2- 172.21.15.116:0/2601766172 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f43cc0cff50 0x7f43cc0d2ad0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.540 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43d0bff700 1 --2- 172.21.15.116:0/2601766172 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f43cc15c590 0x7f43cc160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.540 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43d0bff700 1 -- 172.21.15.116:0/2601766172 >> 172.21.15.116:0/2601766172 conn(0x7f43cc071b10 msgr2=0x7f43cc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:05.540 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43d0bff700 1 -- 172.21.15.116:0/2601766172 shutdown_connections 2023-05-12T09:07:05.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.534+0000 7f43d0bff700 1 -- 172.21.15.116:0/2601766172 wait complete. 2023-05-12T09:07:05.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.536+0000 7f43d0bff700 1 Processor -- start 2023-05-12T09:07:05.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.536+0000 7f43d0bff700 1 -- start start 2023-05-12T09:07:05.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.537+0000 7f43d0bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f43cc0cf010 0x7f43cc14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.537+0000 7f43d0bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f43cc0cff50 0x7f43cc0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.537+0000 7f43d0bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc15c590 0x7f43cc0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.537+0000 7f43d0bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0b7260 con 0x7f43cc15c590 2023-05-12T09:07:05.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.537+0000 7f43d0bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc14a800 con 0x7f43cc0cf010 2023-05-12T09:07:05.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.537+0000 7f43d0bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc15e2d0 con 0x7f43cc0cff50 2023-05-12T09:07:05.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.537+0000 7f43cad9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc15c590 0x7f43cc0c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.537+0000 7f43cad9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc15c590 0x7f43cc0c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35480/0 (socket says 172.21.15.116:35480) 2023-05-12T09:07:05.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.537+0000 7f43cad9d700 1 -- 172.21.15.116:0/769958134 learned_addr learned my addr 172.21.15.116:0/769958134 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:05.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43cad9d700 1 -- 172.21.15.116:0/769958134 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f43cc0cff50 msgr2=0x7f43cc0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43cad9d700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f43cc0cff50 0x7f43cc0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43cad9d700 1 -- 172.21.15.116:0/769958134 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f43cc0cf010 msgr2=0x7f43cc14a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43cad9d700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f43cc0cf010 0x7f43cc14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43cad9d700 1 -- 172.21.15.116:0/769958134 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0094a0 con 0x7f43cc15c590 2023-05-12T09:07:05.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43cad9d700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc15c590 0x7f43cc0c9110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43c400b370 tx=0x7f43c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:05.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43baffd700 1 -- 172.21.15.116:0/769958134 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4012430 con 0x7f43cc15c590 2023-05-12T09:07:05.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43baffd700 1 -- 172.21.15.116:0/769958134 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4020070 con 0x7f43cc15c590 2023-05-12T09:07:05.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43d0bff700 1 -- 172.21.15.116:0/769958134 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c4009a70 con 0x7f43cc15c590 2023-05-12T09:07:05.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43baffd700 1 -- 172.21.15.116:0/769958134 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4004280 con 0x7f43cc15c590 2023-05-12T09:07:05.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.538+0000 7f43d0bff700 1 -- 172.21.15.116:0/769958134 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc0cd770 con 0x7f43cc15c590 2023-05-12T09:07:05.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.539+0000 7f43d0bff700 1 -- 172.21.15.116:0/769958134 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc0cf560 con 0x7f43cc15c590 2023-05-12T09:07:05.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.540+0000 7f43baffd700 1 -- 172.21.15.116:0/769958134 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f43c40043e0 con 0x7f43cc15c590 2023-05-12T09:07:05.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.541+0000 7f43baffd700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f43ac06ac50 0x7f43ac06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.541+0000 7f43baffd700 1 -- 172.21.15.116:0/769958134 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f43c4022070 con 0x7f43cc15c590 2023-05-12T09:07:05.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.541+0000 7f43ca59c700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f43ac06ac50 0x7f43ac06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.542+0000 7f43ca59c700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f43ac06ac50 0x7f43ac06d100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f43bc006f10 tx=0x7f43bc006e60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:05.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.546+0000 7f43baffd700 1 -- 172.21.15.116:0/769958134 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f43c4056600 con 0x7f43cc15c590 2023-05-12T09:07:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.744+0000 7f43d0bff700 1 -- 172.21.15.116:0/769958134 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43cc15c960 con 0x7f43cc15c590 2023-05-12T09:07:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.744+0000 7f43baffd700 1 -- 172.21.15.116:0/769958134 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43c4059c20 con 0x7f43cc15c590 2023-05-12T09:07:05.748 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:07:05.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.746+0000 7f43d0bff700 1 -- 172.21.15.116:0/769958134 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f43ac06ac50 msgr2=0x7f43ac06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.746+0000 7f43d0bff700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f43ac06ac50 0x7f43ac06d100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f43bc006f10 tx=0x7f43bc006e60 comp rx=0 tx=0).stop 2023-05-12T09:07:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.746+0000 7f43d0bff700 1 -- 172.21.15.116:0/769958134 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc15c590 msgr2=0x7f43cc0c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.746+0000 7f43d0bff700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc15c590 0x7f43cc0c9110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43c400b370 tx=0x7f43c4004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.746+0000 7f43d0bff700 1 -- 172.21.15.116:0/769958134 shutdown_connections 2023-05-12T09:07:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.746+0000 7f43d0bff700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc15c590 0x7f43cc0c9110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.746+0000 7f43d0bff700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f43cc0cf010 0x7f43cc14a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.746+0000 7f43d0bff700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f43ac06ac50 0x7f43ac06d100 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.746+0000 7f43d0bff700 1 --2- 172.21.15.116:0/769958134 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f43cc0cff50 0x7f43cc0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.746+0000 7f43d0bff700 1 -- 172.21.15.116:0/769958134 >> 172.21.15.116:0/769958134 conn(0x7f43cc071b10 msgr2=0x7f43cc0b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:05.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.747+0000 7f43d0bff700 1 -- 172.21.15.116:0/769958134 shutdown_connections 2023-05-12T09:07:05.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.747+0000 7f43d0bff700 1 -- 172.21.15.116:0/769958134 wait complete. 2023-05-12T09:07:05.767 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:07:05.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.954+0000 7f11cc9ff700 1 Processor -- start 2023-05-12T09:07:05.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.954+0000 7f11cc9ff700 1 -- start start 2023-05-12T09:07:05.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.955+0000 7f11cc9ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f11c80cf010 0x7f11c8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.955+0000 7f11cc9ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f11c80cff50 0x7f11c80d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.955+0000 7f11cc9ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80cd520 con 0x7f11c815c590 2023-05-12T09:07:05.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.955+0000 7f11cc9ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c80d2640 con 0x7f11c80cf010 2023-05-12T09:07:05.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.955+0000 7f11cc9ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c81610d0 con 0x7f11c80cff50 2023-05-12T09:07:05.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.955+0000 7f11c5d9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f11c80cf010 0x7f11c8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c5d9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f11c80cf010 0x7f11c8160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35492/0 (socket says 172.21.15.116:35492) 2023-05-12T09:07:05.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c5d9b700 1 -- 172.21.15.116:0/1928409899 learned_addr learned my addr 172.21.15.116:0/1928409899 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:05.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c6d9d700 1 --2- 172.21.15.116:0/1928409899 >> v2:172.21.15.182:3300/0 conn(0x7f11c80cff50 0x7f11c80d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c5d9b700 1 -- 172.21.15.116:0/1928409899 >> v2:172.21.15.182:3300/0 conn(0x7f11c80cff50 msgr2=0x7f11c80d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:05.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c5d9b700 1 --2- 172.21.15.116:0/1928409899 >> v2:172.21.15.182:3300/0 conn(0x7f11c80cff50 0x7f11c80d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c559a700 1 -- 172.21.15.116:0/1928409899 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719761779 0 0) 0x7f11c80cd520 con 0x7f11c815c590 2023-05-12T09:07:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c5d9b700 1 -- 172.21.15.116:0/1928409899 >> v1:172.21.15.182:6789/0 conn(0x7f11c815c590 legacy=0x7f11c80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c5d9b700 1 -- 172.21.15.116:0/1928409899 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c80b23c0 con 0x7f11c80cf010 2023-05-12T09:07:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c5d9b700 1 --2- 172.21.15.116:0/1928409899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 0x7f11c8160b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f11c80b20b0 tx=0x7f11bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f76dae20a5d9f50 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c559a700 1 -- 172.21.15.116:0/1928409899 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc011830 con 0x7f11c80cf010 2023-05-12T09:07:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c559a700 1 -- 172.21.15.116:0/1928409899 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc011990 con 0x7f11c80cf010 2023-05-12T09:07:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.956+0000 7f11c559a700 1 -- 172.21.15.116:0/1928409899 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc011d20 con 0x7f11c80cf010 2023-05-12T09:07:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.957+0000 7f11cc9ff700 1 -- 172.21.15.116:0/1928409899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 msgr2=0x7f11c8160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.957+0000 7f11cc9ff700 1 --2- 172.21.15.116:0/1928409899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 0x7f11c8160b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f11c80b20b0 tx=0x7f11bc009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.957+0000 7f11cc9ff700 1 -- 172.21.15.116:0/1928409899 shutdown_connections 2023-05-12T09:07:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.957+0000 7f11cc9ff700 1 --2- 172.21.15.116:0/1928409899 >> v2:172.21.15.182:3300/0 conn(0x7f11c80cff50 0x7f11c80d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.957+0000 7f11cc9ff700 1 --2- 172.21.15.116:0/1928409899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 0x7f11c8160b90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.957+0000 7f11cc9ff700 1 -- 172.21.15.116:0/1928409899 >> 172.21.15.116:0/1928409899 conn(0x7f11c8071b10 msgr2=0x7f11c8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.957+0000 7f11cc9ff700 1 -- 172.21.15.116:0/1928409899 shutdown_connections 2023-05-12T09:07:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.957+0000 7f11cc9ff700 1 -- 172.21.15.116:0/1928409899 wait complete. 2023-05-12T09:07:05.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.959+0000 7f11cc9ff700 1 Processor -- start 2023-05-12T09:07:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.959+0000 7f11cc9ff700 1 -- start start 2023-05-12T09:07:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11cc9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 0x7f11c81e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11cc9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11c80cff50 0x7f11c81e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11cc9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f11c815c590 0x7f11c80c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11cc9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81584c0 con 0x7f11c80cf010 2023-05-12T09:07:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11cc9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81e79a0 con 0x7f11c80cff50 2023-05-12T09:07:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11cc9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81e6d90 con 0x7f11c815c590 2023-05-12T09:07:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11c659c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 0x7f11c81e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11c659c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 0x7f11c81e6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35494/0 (socket says 172.21.15.116:35494) 2023-05-12T09:07:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11c659c700 1 -- 172.21.15.116:0/63928327 learned_addr learned my addr 172.21.15.116:0/63928327 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11c5d9b700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11c80cff50 0x7f11c81e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11c6d9d700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f11c815c590 0x7f11c80c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11c659c700 1 -- 172.21.15.116:0/63928327 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f11c815c590 msgr2=0x7f11c80c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11c659c700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f11c815c590 0x7f11c80c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11c659c700 1 -- 172.21.15.116:0/63928327 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11c80cff50 msgr2=0x7f11c81e6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11c659c700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11c80cff50 0x7f11c81e6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.960+0000 7f11c659c700 1 -- 172.21.15.116:0/63928327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc009550 con 0x7f11c80cf010 2023-05-12T09:07:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.961+0000 7f11c659c700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 0x7f11c81e6010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f11b8001eb0 tx=0x7f11b800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.961+0000 7f11b6ffd700 1 -- 172.21.15.116:0/63928327 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b80054e0 con 0x7f11c80cf010 2023-05-12T09:07:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.961+0000 7f11b6ffd700 1 -- 172.21.15.116:0/63928327 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b8003680 con 0x7f11c80cf010 2023-05-12T09:07:05.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.961+0000 7f11b6ffd700 1 -- 172.21.15.116:0/63928327 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b80039f0 con 0x7f11c80cf010 2023-05-12T09:07:05.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.961+0000 7f11cc9ff700 1 -- 172.21.15.116:0/63928327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c80cd770 con 0x7f11c80cf010 2023-05-12T09:07:05.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.961+0000 7f11cc9ff700 1 -- 172.21.15.116:0/63928327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c80cf560 con 0x7f11c80cf010 2023-05-12T09:07:05.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.962+0000 7f11cc9ff700 1 -- 172.21.15.116:0/63928327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c815c960 con 0x7f11c80cf010 2023-05-12T09:07:05.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.963+0000 7f11b6ffd700 1 -- 172.21.15.116:0/63928327 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f11b8003b50 con 0x7f11c80cf010 2023-05-12T09:07:05.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.964+0000 7f11b6ffd700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11a806ac50 0x7f11a806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:05.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.964+0000 7f11b6ffd700 1 -- 172.21.15.116:0/63928327 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f11b80883c0 con 0x7f11c80cf010 2023-05-12T09:07:05.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.964+0000 7f11c5d9b700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11a806ac50 0x7f11a806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:05.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.965+0000 7f11c5d9b700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11a806ac50 0x7f11a806d100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009840 tx=0x7f11bc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:05.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:05.969+0000 7f11b6ffd700 1 -- 172.21.15.116:0/63928327 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f11b80538b0 con 0x7f11c80cf010 2023-05-12T09:07:06.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.166+0000 7f11cc9ff700 1 -- 172.21.15.116:0/63928327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11c815d180 con 0x7f11c80cf010 2023-05-12T09:07:06.170 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.167+0000 7f11b6ffd700 1 -- 172.21.15.116:0/63928327 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11b8017020 con 0x7f11c80cf010 2023-05-12T09:07:06.170 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:07:06.172 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 -- 172.21.15.116:0/63928327 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11a806ac50 msgr2=0x7f11a806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.172 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11a806ac50 0x7f11a806d100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009840 tx=0x7f11bc008030 comp rx=0 tx=0).stop 2023-05-12T09:07:06.173 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 -- 172.21.15.116:0/63928327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 msgr2=0x7f11c81e6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.173 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 0x7f11c81e6010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f11b8001eb0 tx=0x7f11b800c800 comp rx=0 tx=0).stop 2023-05-12T09:07:06.173 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 -- 172.21.15.116:0/63928327 shutdown_connections 2023-05-12T09:07:06.173 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11a806ac50 0x7f11a806d100 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.173 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f11c815c590 0x7f11c80c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.173 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80cf010 0x7f11c81e6010 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.173 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 --2- 172.21.15.116:0/63928327 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11c80cff50 0x7f11c81e6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.174 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 -- 172.21.15.116:0/63928327 >> 172.21.15.116:0/63928327 conn(0x7f11c8071b10 msgr2=0x7f11c80b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:06.174 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 -- 172.21.15.116:0/63928327 shutdown_connections 2023-05-12T09:07:06.174 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.169+0000 7f11cc9ff700 1 -- 172.21.15.116:0/63928327 wait complete. 2023-05-12T09:07:06.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:07:06.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.377+0000 7f1dac3ff700 1 Processor -- start 2023-05-12T09:07:06.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.378+0000 7f1dac3ff700 1 -- start start 2023-05-12T09:07:06.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.379+0000 7f1dac3ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1da406b4f0 0x7f1da406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.379+0000 7f1dac3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 0x7f1da40cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.379+0000 7f1dac3ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da406be80 con 0x7f1da40d0930 2023-05-12T09:07:06.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.379+0000 7f1dac3ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da40aeed0 con 0x7f1da406b4f0 2023-05-12T09:07:06.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.379+0000 7f1dac3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40af1b0 con 0x7f1da40ceb50 2023-05-12T09:07:06.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.379+0000 7f1da999a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1da406b4f0 0x7f1da406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:06.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.379+0000 7f1daa19b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1da40d0930 0x7f1da40ae3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48444/0 (socket says 172.21.15.116:48444) 2023-05-12T09:07:06.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.379+0000 7f1daa19b700 1 -- 172.21.15.116:0/638011325 learned_addr learned my addr 172.21.15.116:0/638011325 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:06.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.379+0000 7f1daa99c700 1 --2- 172.21.15.116:0/638011325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 0x7f1da40cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:06.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.380+0000 7f1daa99c700 1 -- 172.21.15.116:0/638011325 >> v2:172.21.15.116:3300/0 conn(0x7f1da406b4f0 msgr2=0x7f1da406b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:06.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.380+0000 7f1daa99c700 1 --2- 172.21.15.116:0/638011325 >> v2:172.21.15.116:3300/0 conn(0x7f1da406b4f0 0x7f1da406b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.380+0000 7f1daa99c700 1 -- 172.21.15.116:0/638011325 >> v1:172.21.15.116:6789/0 conn(0x7f1da40d0930 legacy=0x7f1da40ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.380+0000 7f1daa99c700 1 -- 172.21.15.116:0/638011325 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40af490 con 0x7f1da40ceb50 2023-05-12T09:07:06.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.380+0000 7f1da999a700 1 --2- 172.21.15.116:0/638011325 >> v2:172.21.15.116:3300/0 conn(0x7f1da406b4f0 0x7f1da406b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:06.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.380+0000 7f1da9199700 1 -- 172.21.15.116:0/638011325 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539933794 0 0) 0x7f1da0001110 con 0x7f1da40d0930 2023-05-12T09:07:06.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.380+0000 7f1daa99c700 1 --2- 172.21.15.116:0/638011325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 0x7f1da40cefd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009d90 tx=0x7f1d9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe1fb0dd2cae4f55 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:06.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.380+0000 7f1da9199700 1 -- 172.21.15.116:0/638011325 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00e070 con 0x7f1da40ceb50 2023-05-12T09:07:06.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.380+0000 7f1da9199700 1 -- 172.21.15.116:0/638011325 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c00bb20 con 0x7f1da40ceb50 2023-05-12T09:07:06.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.380+0000 7f1da9199700 1 -- 172.21.15.116:0/638011325 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c012430 con 0x7f1da40ceb50 2023-05-12T09:07:06.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.381+0000 7f1dac3ff700 1 -- 172.21.15.116:0/638011325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 msgr2=0x7f1da40cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.381+0000 7f1dac3ff700 1 --2- 172.21.15.116:0/638011325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 0x7f1da40cefd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009d90 tx=0x7f1d9c00b330 comp rx=0 tx=0).stop 2023-05-12T09:07:06.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.381+0000 7f1dac3ff700 1 -- 172.21.15.116:0/638011325 shutdown_connections 2023-05-12T09:07:06.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.381+0000 7f1dac3ff700 1 --2- 172.21.15.116:0/638011325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 0x7f1da40cefd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.381+0000 7f1dac3ff700 1 --2- 172.21.15.116:0/638011325 >> v2:172.21.15.116:3300/0 conn(0x7f1da406b4f0 0x7f1da406b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.381+0000 7f1dac3ff700 1 -- 172.21.15.116:0/638011325 >> 172.21.15.116:0/638011325 conn(0x7f1da409a0a0 msgr2=0x7f1da40d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:06.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.381+0000 7f1dac3ff700 1 -- 172.21.15.116:0/638011325 shutdown_connections 2023-05-12T09:07:06.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.381+0000 7f1dac3ff700 1 -- 172.21.15.116:0/638011325 wait complete. 2023-05-12T09:07:06.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.382+0000 7f1dac3ff700 1 Processor -- start 2023-05-12T09:07:06.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.383+0000 7f1dac3ff700 1 -- start start 2023-05-12T09:07:06.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.383+0000 7f1dac3ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da406b4f0 0x7f1da4147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.383+0000 7f1dac3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 0x7f1da40c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.383+0000 7f1dac3ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1da40d0930 0x7f1da40c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.383+0000 7f1dac3ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40c75b0 con 0x7f1da406b4f0 2023-05-12T09:07:06.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1dac3ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40b4cf0 con 0x7f1da40d0930 2023-05-12T09:07:06.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1dac3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40b4fd0 con 0x7f1da40ceb50 2023-05-12T09:07:06.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1daa19b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da406b4f0 0x7f1da4147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:06.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1daa19b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da406b4f0 0x7f1da4147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35516/0 (socket says 172.21.15.116:35516) 2023-05-12T09:07:06.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1daa19b700 1 -- 172.21.15.116:0/503910982 learned_addr learned my addr 172.21.15.116:0/503910982 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:06.399 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1da999a700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 0x7f1da40c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:06.399 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1daa19b700 1 -- 172.21.15.116:0/503910982 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 msgr2=0x7f1da40c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.399 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1daa19b700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 0x7f1da40c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.399 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1daa19b700 1 -- 172.21.15.116:0/503910982 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1da40d0930 msgr2=0x7f1da40c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1daa19b700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1da40d0930 0x7f1da40c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1daa19b700 1 -- 172.21.15.116:0/503910982 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94009430 con 0x7f1da406b4f0 2023-05-12T09:07:06.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1daa19b700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da406b4f0 0x7f1da4147600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1da000c730 tx=0x7f1da000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:06.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.384+0000 7f1d9affd700 1 -- 172.21.15.116:0/503910982 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0007560 con 0x7f1da406b4f0 2023-05-12T09:07:06.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.385+0000 7f1d9affd700 1 -- 172.21.15.116:0/503910982 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da00076e0 con 0x7f1da406b4f0 2023-05-12T09:07:06.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.385+0000 7f1d9affd700 1 -- 172.21.15.116:0/503910982 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0004ab0 con 0x7f1da406b4f0 2023-05-12T09:07:06.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.385+0000 7f1dac3ff700 1 -- 172.21.15.116:0/503910982 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c009a70 con 0x7f1da406b4f0 2023-05-12T09:07:06.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.385+0000 7f1dac3ff700 1 -- 172.21.15.116:0/503910982 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da40b0060 con 0x7f1da406b4f0 2023-05-12T09:07:06.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.386+0000 7f1dac3ff700 1 -- 172.21.15.116:0/503910982 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da40af770 con 0x7f1da406b4f0 2023-05-12T09:07:06.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.387+0000 7f1d9affd700 1 -- 172.21.15.116:0/503910982 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f1da0004c10 con 0x7f1da406b4f0 2023-05-12T09:07:06.403 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.388+0000 7f1d9affd700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d8806ac50 0x7f1d8806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.403 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.388+0000 7f1d9affd700 1 -- 172.21.15.116:0/503910982 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1da0088c10 con 0x7f1da406b4f0 2023-05-12T09:07:06.403 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.388+0000 7f1da999a700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d8806ac50 0x7f1d8806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:06.403 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.388+0000 7f1da999a700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d8806ac50 0x7f1d8806d100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1da40ce520 tx=0x7f1d940091c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:06.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.392+0000 7f1d9affd700 1 -- 172.21.15.116:0/503910982 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1da00540e0 con 0x7f1da406b4f0 2023-05-12T09:07:06.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.635+0000 7f1dac3ff700 1 -- 172.21.15.116:0/503910982 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1da40aeab0 con 0x7f1da406b4f0 2023-05-12T09:07:06.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.636+0000 7f1d9affd700 1 -- 172.21.15.116:0/503910982 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1da00544b0 con 0x7f1da406b4f0 2023-05-12T09:07:06.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.638+0000 7f1d9affd700 1 -- 172.21.15.116:0/503910982 <== mon.0 v2:172.21.15.116:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f1da004d560 con 0x7f1da406b4f0 2023-05-12T09:07:06.642 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:06.642 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-05-12T09:07:06.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 -- 172.21.15.116:0/503910982 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d8806ac50 msgr2=0x7f1d8806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d8806ac50 0x7f1d8806d100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1da40ce520 tx=0x7f1d940091c0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 -- 172.21.15.116:0/503910982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da406b4f0 msgr2=0x7f1da4147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da406b4f0 0x7f1da4147600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1da000c730 tx=0x7f1da000ca40 comp rx=0 tx=0).stop 2023-05-12T09:07:06.645 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 -- 172.21.15.116:0/503910982 shutdown_connections 2023-05-12T09:07:06.645 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1da40d0930 0x7f1da40c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.645 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da406b4f0 0x7f1da4147600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.645 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d8806ac50 0x7f1d8806d100 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 --2- 172.21.15.116:0/503910982 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1da40ceb50 0x7f1da40c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 -- 172.21.15.116:0/503910982 >> 172.21.15.116:0/503910982 conn(0x7f1da409a0a0 msgr2=0x7f1da40b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:06.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.641+0000 7f1dac3ff700 1 -- 172.21.15.116:0/503910982 shutdown_connections 2023-05-12T09:07:06.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.642+0000 7f1dac3ff700 1 -- 172.21.15.116:0/503910982 wait complete. 2023-05-12T09:07:06.646 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 3 2023-05-12T09:07:06.662 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:06.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.842+0000 7fc5065ff700 1 Processor -- start 2023-05-12T09:07:06.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.843+0000 7fc5065ff700 1 -- start start 2023-05-12T09:07:06.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc5065ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000d2110 0x7fc500167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc5065ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc500161000 con 0x7fc5000cfbf0 2023-05-12T09:07:06.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc5065ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5000d0020 con 0x7fc5000b87a0 2023-05-12T09:07:06.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc5065ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000d02d0 con 0x7fc5000d2110 2023-05-12T09:07:06.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc4ff7fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc5000cfbf0 0x7fc5001608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48456/0 (socket says 172.21.15.116:48456) 2023-05-12T09:07:06.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc4ff7fe700 1 -- 172.21.15.116:0/1578551283 learned_addr learned my addr 172.21.15.116:0/1578551283 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:06.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc504b9c700 1 --2- 172.21.15.116:0/1578551283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000d2110 0x7fc500167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:06.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc4feffd700 1 -- 172.21.15.116:0/1578551283 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199854558 0 0) 0x7fc500161000 con 0x7fc5000cfbf0 2023-05-12T09:07:06.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc4feffd700 1 -- 172.21.15.116:0/1578551283 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4e80035b0 con 0x7fc5000cfbf0 2023-05-12T09:07:06.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc4feffd700 1 -- 172.21.15.116:0/1578551283 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033324619 0 0) 0x7fc5000d0020 con 0x7fc5000b87a0 2023-05-12T09:07:06.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.844+0000 7fc4feffd700 1 -- 172.21.15.116:0/1578551283 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc500161000 con 0x7fc5000b87a0 2023-05-12T09:07:06.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.845+0000 7fc504b9c700 1 -- 172.21.15.116:0/1578551283 >> v1:172.21.15.182:6789/0 conn(0x7fc5000b87a0 legacy=0x7fc5001601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.845+0000 7fc504b9c700 1 -- 172.21.15.116:0/1578551283 >> v1:172.21.15.116:6789/0 conn(0x7fc5000cfbf0 legacy=0x7fc5001608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.845+0000 7fc504b9c700 1 -- 172.21.15.116:0/1578551283 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5000cdc60 con 0x7fc5000d2110 2023-05-12T09:07:06.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.845+0000 7fc504b9c700 1 --2- 172.21.15.116:0/1578551283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000d2110 0x7fc500167550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009dc0 tx=0x7fc4f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeee45997e806b7f server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:06.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.845+0000 7fc4feffd700 1 -- 172.21.15.116:0/1578551283 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800e070 con 0x7fc5000d2110 2023-05-12T09:07:06.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.845+0000 7fc4feffd700 1 -- 172.21.15.116:0/1578551283 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f800bb20 con 0x7fc5000d2110 2023-05-12T09:07:06.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.845+0000 7fc4feffd700 1 -- 172.21.15.116:0/1578551283 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800be90 con 0x7fc5000d2110 2023-05-12T09:07:06.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.846+0000 7fc5065ff700 1 -- 172.21.15.116:0/1578551283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000d2110 msgr2=0x7fc500167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.846+0000 7fc5065ff700 1 --2- 172.21.15.116:0/1578551283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000d2110 0x7fc500167550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009dc0 tx=0x7fc4f800b330 comp rx=0 tx=0).stop 2023-05-12T09:07:06.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.846+0000 7fc5065ff700 1 -- 172.21.15.116:0/1578551283 shutdown_connections 2023-05-12T09:07:06.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.846+0000 7fc5065ff700 1 --2- 172.21.15.116:0/1578551283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000d2110 0x7fc500167550 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.846+0000 7fc5065ff700 1 -- 172.21.15.116:0/1578551283 >> 172.21.15.116:0/1578551283 conn(0x7fc500071b10 msgr2=0x7fc500071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:06.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.846+0000 7fc5065ff700 1 -- 172.21.15.116:0/1578551283 shutdown_connections 2023-05-12T09:07:06.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.846+0000 7fc5065ff700 1 -- 172.21.15.116:0/1578551283 wait complete. 2023-05-12T09:07:06.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.847+0000 7fc5065ff700 1 Processor -- start 2023-05-12T09:07:06.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.848+0000 7fc5065ff700 1 -- start start 2023-05-12T09:07:06.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.848+0000 7fc5065ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5000b87a0 0x7fc5001552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.848+0000 7fc5065ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000cfbf0 0x7fc500157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.848+0000 7fc5065ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5000d2110 0x7fc50014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.848+0000 7fc5065ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc500151b60 con 0x7fc5000b87a0 2023-05-12T09:07:06.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.848+0000 7fc5065ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc500152330 con 0x7fc5000d2110 2023-05-12T09:07:06.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.848+0000 7fc5065ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc500152610 con 0x7fc5000cfbf0 2023-05-12T09:07:06.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4fffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5000b87a0 0x7fc5001552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:06.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4fffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5000b87a0 0x7fc5001552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35524/0 (socket says 172.21.15.116:35524) 2023-05-12T09:07:06.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4fffff700 1 -- 172.21.15.116:0/2655459867 learned_addr learned my addr 172.21.15.116:0/2655459867 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:06.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4ff7fe700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000cfbf0 0x7fc500157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:06.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc504b9c700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5000d2110 0x7fc50014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:06.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4fffff700 1 -- 172.21.15.116:0/2655459867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000cfbf0 msgr2=0x7fc500157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4fffff700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000cfbf0 0x7fc500157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4fffff700 1 -- 172.21.15.116:0/2655459867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5000d2110 msgr2=0x7fc50014f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:06.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4fffff700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5000d2110 0x7fc50014f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:06.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4fffff700 1 -- 172.21.15.116:0/2655459867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f8009a70 con 0x7fc5000b87a0 2023-05-12T09:07:06.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4fffff700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5000b87a0 0x7fc5001552f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c520 tx=0x7fc4f000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:06.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.849+0000 7fc4fcff9700 1 -- 172.21.15.116:0/2655459867 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00052d0 con 0x7fc5000b87a0 2023-05-12T09:07:06.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.850+0000 7fc4fcff9700 1 -- 172.21.15.116:0/2655459867 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f0005430 con 0x7fc5000b87a0 2023-05-12T09:07:06.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.850+0000 7fc4fcff9700 1 -- 172.21.15.116:0/2655459867 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00038c0 con 0x7fc5000b87a0 2023-05-12T09:07:06.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.850+0000 7fc5065ff700 1 -- 172.21.15.116:0/2655459867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5000cd980 con 0x7fc5000b87a0 2023-05-12T09:07:06.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.850+0000 7fc5065ff700 1 -- 172.21.15.116:0/2655459867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5000cd6a0 con 0x7fc5000b87a0 2023-05-12T09:07:06.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.851+0000 7fc5065ff700 1 -- 172.21.15.116:0/2655459867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc500167a90 con 0x7fc5000b87a0 2023-05-12T09:07:06.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.851+0000 7fc4fcff9700 1 -- 172.21.15.116:0/2655459867 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4f0003a20 con 0x7fc5000b87a0 2023-05-12T09:07:06.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.852+0000 7fc4fcff9700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc4ec06ace0 0x7fc4ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:06.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.852+0000 7fc4fcff9700 1 -- 172.21.15.116:0/2655459867 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc4f0088620 con 0x7fc5000b87a0 2023-05-12T09:07:06.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.852+0000 7fc4ff7fe700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc4ec06ace0 0x7fc4ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:06.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.853+0000 7fc4ff7fe700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc4ec06ace0 0x7fc4ec06d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc500154230 tx=0x7fc4f4007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:06.860 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:06.857+0000 7fc4fcff9700 1 -- 172.21.15.116:0/2655459867 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc4f0053980 con 0x7fc5000b87a0 2023-05-12T09:07:07.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.053+0000 7fc5065ff700 1 -- 172.21.15.116:0/2655459867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5000b52f0 con 0x7fc5000b87a0 2023-05-12T09:07:07.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.054+0000 7fc4fcff9700 1 -- 172.21.15.116:0/2655459867 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14603 (secure 0 0 0) 0x7fc4f0056fa0 con 0x7fc5000b87a0 2023-05-12T09:07:07.057 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:07.057 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":16,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:05.829475+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:07.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 -- 172.21.15.116:0/2655459867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc4ec06ace0 msgr2=0x7fc4ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc4ec06ace0 0x7fc4ec06d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc500154230 tx=0x7fc4f4007dc0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 -- 172.21.15.116:0/2655459867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5000b87a0 msgr2=0x7fc5001552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5000b87a0 0x7fc5001552f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c520 tx=0x7fc4f000c830 comp rx=0 tx=0).stop 2023-05-12T09:07:07.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 -- 172.21.15.116:0/2655459867 shutdown_connections 2023-05-12T09:07:07.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5000d2110 0x7fc50014f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5000b87a0 0x7fc5001552f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc4ec06ace0 0x7fc4ec06d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 --2- 172.21.15.116:0/2655459867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5000cfbf0 0x7fc500157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 -- 172.21.15.116:0/2655459867 >> 172.21.15.116:0/2655459867 conn(0x7fc500071b10 msgr2=0x7fc500157740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:07.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 -- 172.21.15.116:0/2655459867 shutdown_connections 2023-05-12T09:07:07.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.056+0000 7fc5065ff700 1 -- 172.21.15.116:0/2655459867 wait complete. 2023-05-12T09:07:07.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-12T09:07:07.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:07:07.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.260+0000 7f97791ff700 1 Processor -- start 2023-05-12T09:07:07.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.260+0000 7f97791ff700 1 -- start start 2023-05-12T09:07:07.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.261+0000 7f97791ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740cfbf0 0x7f97741608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:07.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.261+0000 7f97791ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97740d0020 con 0x7f97740d1100 2023-05-12T09:07:07.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.261+0000 7f97791ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97740cdc60 con 0x7f97740b87a0 2023-05-12T09:07:07.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.261+0000 7f97791ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740d02d0 con 0x7f97740cfbf0 2023-05-12T09:07:07.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.261+0000 7f977359e700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f97740d1100 0x7f97740d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48458/0 (socket says 172.21.15.116:48458) 2023-05-12T09:07:07.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.261+0000 7f977359e700 1 -- 172.21.15.116:0/3964113109 learned_addr learned my addr 172.21.15.116:0/3964113109 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:07.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.261+0000 7f976bfff700 1 --2- 172.21.15.116:0/3964113109 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740cfbf0 0x7f97741608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:07.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f977259c700 1 -- 172.21.15.116:0/3964113109 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085713134 0 0) 0x7f97740d0020 con 0x7f97740d1100 2023-05-12T09:07:07.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f977259c700 1 -- 172.21.15.116:0/3964113109 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97600035b0 con 0x7f97740d1100 2023-05-12T09:07:07.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f977259c700 1 -- 172.21.15.116:0/3964113109 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274561661 0 0) 0x7f97740cdc60 con 0x7f97740b87a0 2023-05-12T09:07:07.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f977259c700 1 -- 172.21.15.116:0/3964113109 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97740d0020 con 0x7f97740b87a0 2023-05-12T09:07:07.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f976bfff700 1 -- 172.21.15.116:0/3964113109 >> v1:172.21.15.182:6789/0 conn(0x7f97740b87a0 legacy=0x7f97741601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f976bfff700 1 -- 172.21.15.116:0/3964113109 >> v1:172.21.15.116:6789/0 conn(0x7f97740d1100 legacy=0x7f97740d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f976bfff700 1 -- 172.21.15.116:0/3964113109 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740cd6a0 con 0x7f97740cfbf0 2023-05-12T09:07:07.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f976bfff700 1 --2- 172.21.15.116:0/3964113109 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740cfbf0 0x7f97741608f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f975c009870 tx=0x7f975c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cba301b147266c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:07.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f977259c700 1 -- 172.21.15.116:0/3964113109 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c011830 con 0x7f97740cfbf0 2023-05-12T09:07:07.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f977259c700 1 -- 172.21.15.116:0/3964113109 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c011990 con 0x7f97740cfbf0 2023-05-12T09:07:07.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.262+0000 7f977259c700 1 -- 172.21.15.116:0/3964113109 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c011d20 con 0x7f97740cfbf0 2023-05-12T09:07:07.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.263+0000 7f97791ff700 1 -- 172.21.15.116:0/3964113109 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740cfbf0 msgr2=0x7f97741608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.263+0000 7f97791ff700 1 --2- 172.21.15.116:0/3964113109 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740cfbf0 0x7f97741608f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f975c009870 tx=0x7f975c009b80 comp rx=0 tx=0).stop 2023-05-12T09:07:07.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.263+0000 7f97791ff700 1 -- 172.21.15.116:0/3964113109 shutdown_connections 2023-05-12T09:07:07.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.263+0000 7f97791ff700 1 --2- 172.21.15.116:0/3964113109 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740cfbf0 0x7f97741608f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.263+0000 7f97791ff700 1 -- 172.21.15.116:0/3964113109 >> 172.21.15.116:0/3964113109 conn(0x7f9774071b10 msgr2=0x7f9774071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:07.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.263+0000 7f97791ff700 1 -- 172.21.15.116:0/3964113109 shutdown_connections 2023-05-12T09:07:07.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.263+0000 7f97791ff700 1 -- 172.21.15.116:0/3964113109 wait complete. 2023-05-12T09:07:07.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.265+0000 7f97791ff700 1 Processor -- start 2023-05-12T09:07:07.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.265+0000 7f97791ff700 1 -- start start 2023-05-12T09:07:07.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.265+0000 7f97791ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740b87a0 0x7f97740c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:07.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f97791ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97740cfbf0 0x7f97741e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:07.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f97791ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f97740d1100 0x7f97741e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:07.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f97791ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740c6da0 con 0x7f97740cfbf0 2023-05-12T09:07:07.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f97791ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740c7080 con 0x7f97740d1100 2023-05-12T09:07:07.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f97791ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740c7360 con 0x7f97740b87a0 2023-05-12T09:07:07.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f976bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97740cfbf0 0x7f97741e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:07.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f976bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97740cfbf0 0x7f97741e61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35528/0 (socket says 172.21.15.116:35528) 2023-05-12T09:07:07.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f976bfff700 1 -- 172.21.15.116:0/3552501917 learned_addr learned my addr 172.21.15.116:0/3552501917 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:07.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f977359e700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f97740d1100 0x7f97741e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:07.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f9772d9d700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740b87a0 0x7f97740c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:07.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f976bfff700 1 -- 172.21.15.116:0/3552501917 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740b87a0 msgr2=0x7f97740c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f976bfff700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740b87a0 0x7f97740c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f976bfff700 1 -- 172.21.15.116:0/3552501917 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f97740d1100 msgr2=0x7f97741e66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f976bfff700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f97740d1100 0x7f97741e66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f976bfff700 1 -- 172.21.15.116:0/3552501917 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c0094a0 con 0x7f97740cfbf0 2023-05-12T09:07:07.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.266+0000 7f976bfff700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97740cfbf0 0x7f97741e61a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f975c0090b0 tx=0x7f975c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:07.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.267+0000 7f976b7fe700 1 -- 172.21.15.116:0/3552501917 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c01a6e0 con 0x7f97740cfbf0 2023-05-12T09:07:07.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.267+0000 7f976b7fe700 1 -- 172.21.15.116:0/3552501917 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c01a840 con 0x7f97740cfbf0 2023-05-12T09:07:07.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.267+0000 7f976b7fe700 1 -- 172.21.15.116:0/3552501917 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c01abb0 con 0x7f97740cfbf0 2023-05-12T09:07:07.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.267+0000 7f97791ff700 1 -- 172.21.15.116:0/3552501917 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9774160e30 con 0x7f97740cfbf0 2023-05-12T09:07:07.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.267+0000 7f97791ff700 1 -- 172.21.15.116:0/3552501917 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97740cd980 con 0x7f97740cfbf0 2023-05-12T09:07:07.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.268+0000 7f97791ff700 1 -- 172.21.15.116:0/3552501917 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9774160fc0 con 0x7f97740cfbf0 2023-05-12T09:07:07.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.269+0000 7f976b7fe700 1 -- 172.21.15.116:0/3552501917 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f975c022070 con 0x7f97740cfbf0 2023-05-12T09:07:07.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.269+0000 7f976b7fe700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f975406ace0 0x7f975406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:07.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.270+0000 7f976b7fe700 1 -- 172.21.15.116:0/3552501917 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f975c089d70 con 0x7f97740cfbf0 2023-05-12T09:07:07.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.270+0000 7f9772d9d700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f975406ace0 0x7f975406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:07.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.270+0000 7f9772d9d700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f975406ace0 0x7f975406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97640011e0 tx=0x7f9764009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:07.277 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.274+0000 7f976b7fe700 1 -- 172.21.15.116:0/3552501917 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f975c055210 con 0x7f97740cfbf0 2023-05-12T09:07:07.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.465+0000 7f97791ff700 1 -- 172.21.15.116:0/3552501917 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97740cfa10 con 0x7f97740cfbf0 2023-05-12T09:07:07.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.465+0000 7f976b7fe700 1 -- 172.21.15.116:0/3552501917 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f975c029020 con 0x7f97740cfbf0 2023-05-12T09:07:07.469 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:07:07.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 -- 172.21.15.116:0/3552501917 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f975406ace0 msgr2=0x7f975406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f975406ace0 0x7f975406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97640011e0 tx=0x7f9764009040 comp rx=0 tx=0).stop 2023-05-12T09:07:07.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 -- 172.21.15.116:0/3552501917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97740cfbf0 msgr2=0x7f97741e61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97740cfbf0 0x7f97741e61a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f975c0090b0 tx=0x7f975c004750 comp rx=0 tx=0).stop 2023-05-12T09:07:07.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 -- 172.21.15.116:0/3552501917 shutdown_connections 2023-05-12T09:07:07.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f97740d1100 0x7f97741e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f975406ace0 0x7f975406d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97740b87a0 0x7f97740c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 --2- 172.21.15.116:0/3552501917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97740cfbf0 0x7f97741e61a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 -- 172.21.15.116:0/3552501917 >> 172.21.15.116:0/3552501917 conn(0x7f9774071b10 msgr2=0x7f97740d3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 -- 172.21.15.116:0/3552501917 shutdown_connections 2023-05-12T09:07:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.468+0000 7f97791ff700 1 -- 172.21.15.116:0/3552501917 wait complete. 2023-05-12T09:07:07.488 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:07:07.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.674+0000 7f0b359ff700 1 Processor -- start 2023-05-12T09:07:07.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.674+0000 7f0b359ff700 1 -- start start 2023-05-12T09:07:07.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.675+0000 7f0b359ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0b300b87a0 0x7f0b300cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:07.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.675+0000 7f0b359ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b300cdc60 con 0x7f0b30160d40 2023-05-12T09:07:07.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.675+0000 7f0b359ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b300cd6a0 con 0x7f0b301601e0 2023-05-12T09:07:07.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.675+0000 7f0b359ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b300d02d0 con 0x7f0b300b87a0 2023-05-12T09:07:07.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.676+0000 7f0b2f7fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f0b30160d40 0x7f0b300d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48460/0 (socket says 172.21.15.116:48460) 2023-05-12T09:07:07.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.676+0000 7f0b2f7fe700 1 -- 172.21.15.116:0/1015671044 learned_addr learned my addr 172.21.15.116:0/1015671044 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:07.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.676+0000 7f0b2effd700 1 --2- 172.21.15.116:0/1015671044 >> v2:172.21.15.182:3300/0 conn(0x7f0b300b87a0 0x7f0b300cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:07.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.676+0000 7f0b2dffb700 1 -- 172.21.15.116:0/1015671044 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682188168 0 0) 0x7f0b300cdc60 con 0x7f0b30160d40 2023-05-12T09:07:07.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.676+0000 7f0b2dffb700 1 -- 172.21.15.116:0/1015671044 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b180035b0 con 0x7f0b30160d40 2023-05-12T09:07:07.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.676+0000 7f0b2effd700 1 -- 172.21.15.116:0/1015671044 >> v1:172.21.15.182:6789/0 conn(0x7f0b301601e0 legacy=0x7f0b30160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.676+0000 7f0b2effd700 1 -- 172.21.15.116:0/1015671044 >> v1:172.21.15.116:6789/0 conn(0x7f0b30160d40 legacy=0x7f0b300d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.676+0000 7f0b2effd700 1 -- 172.21.15.116:0/1015671044 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b300cd980 con 0x7f0b300b87a0 2023-05-12T09:07:07.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.676+0000 7f0b2effd700 1 --2- 172.21.15.116:0/1015671044 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0b300b87a0 0x7f0b300cfbf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009840 tx=0x7f0b20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ad645c067a622c server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:07.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.677+0000 7f0b2dffb700 1 -- 172.21.15.116:0/1015671044 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20011830 con 0x7f0b300b87a0 2023-05-12T09:07:07.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.677+0000 7f0b2dffb700 1 -- 172.21.15.116:0/1015671044 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b20011990 con 0x7f0b300b87a0 2023-05-12T09:07:07.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.677+0000 7f0b2dffb700 1 -- 172.21.15.116:0/1015671044 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20011d20 con 0x7f0b300b87a0 2023-05-12T09:07:07.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.677+0000 7f0b359ff700 1 -- 172.21.15.116:0/1015671044 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0b300b87a0 msgr2=0x7f0b300cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.677+0000 7f0b359ff700 1 --2- 172.21.15.116:0/1015671044 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0b300b87a0 0x7f0b300cfbf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009840 tx=0x7f0b20009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:07.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.677+0000 7f0b359ff700 1 -- 172.21.15.116:0/1015671044 shutdown_connections 2023-05-12T09:07:07.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.677+0000 7f0b359ff700 1 --2- 172.21.15.116:0/1015671044 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0b300b87a0 0x7f0b300cfbf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.677+0000 7f0b359ff700 1 -- 172.21.15.116:0/1015671044 >> 172.21.15.116:0/1015671044 conn(0x7f0b30071b10 msgr2=0x7f0b30071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:07.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.677+0000 7f0b359ff700 1 -- 172.21.15.116:0/1015671044 shutdown_connections 2023-05-12T09:07:07.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.677+0000 7f0b359ff700 1 -- 172.21.15.116:0/1015671044 wait complete. 2023-05-12T09:07:07.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.679+0000 7f0b359ff700 1 Processor -- start 2023-05-12T09:07:07.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.679+0000 7f0b359ff700 1 -- start start 2023-05-12T09:07:07.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.680+0000 7f0b359ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0b300b87a0 0x7f0b30159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:07.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.680+0000 7f0b359ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b301601e0 0x7f0b301597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:07.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.680+0000 7f0b359ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0b30160d40 0x7f0b300c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:07.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.680+0000 7f0b359ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300ca4c0 con 0x7f0b301601e0 2023-05-12T09:07:07.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.680+0000 7f0b359ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3015a6e0 con 0x7f0b300b87a0 2023-05-12T09:07:07.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.680+0000 7f0b359ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300ca6d0 con 0x7f0b30160d40 2023-05-12T09:07:07.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.680+0000 7f0b2e7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b301601e0 0x7f0b301597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:07.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.680+0000 7f0b2e7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b301601e0 0x7f0b301597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35536/0 (socket says 172.21.15.116:35536) 2023-05-12T09:07:07.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.680+0000 7f0b2e7fc700 1 -- 172.21.15.116:0/3485186820 learned_addr learned my addr 172.21.15.116:0/3485186820 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:07.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b2effd700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0b300b87a0 0x7f0b30159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:07.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b2f7fe700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0b30160d40 0x7f0b300c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b2e7fc700 1 -- 172.21.15.116:0/3485186820 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0b30160d40 msgr2=0x7f0b300c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b2e7fc700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0b30160d40 0x7f0b300c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b2e7fc700 1 -- 172.21.15.116:0/3485186820 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0b300b87a0 msgr2=0x7f0b30159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b2e7fc700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0b300b87a0 0x7f0b30159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b2e7fc700 1 -- 172.21.15.116:0/3485186820 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200094a0 con 0x7f0b301601e0 2023-05-12T09:07:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b2effd700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0b300b87a0 0x7f0b30159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b2f7fe700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0b30160d40 0x7f0b300c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b2e7fc700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b301601e0 0x7f0b301597d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400c510 tx=0x7f0b2400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b17fff700 1 -- 172.21.15.116:0/3485186820 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240052d0 con 0x7f0b301601e0 2023-05-12T09:07:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b17fff700 1 -- 172.21.15.116:0/3485186820 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b24005430 con 0x7f0b301601e0 2023-05-12T09:07:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b359ff700 1 -- 172.21.15.116:0/3485186820 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b300d19a0 con 0x7f0b301601e0 2023-05-12T09:07:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b17fff700 1 -- 172.21.15.116:0/3485186820 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240038c0 con 0x7f0b301601e0 2023-05-12T09:07:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.681+0000 7f0b359ff700 1 -- 172.21.15.116:0/3485186820 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b300d1810 con 0x7f0b301601e0 2023-05-12T09:07:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.682+0000 7f0b359ff700 1 -- 172.21.15.116:0/3485186820 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b300d1b30 con 0x7f0b301601e0 2023-05-12T09:07:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.683+0000 7f0b17fff700 1 -- 172.21.15.116:0/3485186820 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b24003a20 con 0x7f0b301601e0 2023-05-12T09:07:07.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.684+0000 7f0b17fff700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0b1c06ace0 0x7f0b1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:07.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.685+0000 7f0b17fff700 1 -- 172.21.15.116:0/3485186820 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0b240886f0 con 0x7f0b301601e0 2023-05-12T09:07:07.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.685+0000 7f0b2effd700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0b1c06ace0 0x7f0b1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:07.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.685+0000 7f0b2effd700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0b1c06ace0 0x7f0b1c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b20000c00 tx=0x7f0b20008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:07.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.689+0000 7f0b17fff700 1 -- 172.21.15.116:0/3485186820 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0b24053a50 con 0x7f0b301601e0 2023-05-12T09:07:07.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.883+0000 7f0b359ff700 1 -- 172.21.15.116:0/3485186820 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b300d3be0 con 0x7f0b301601e0 2023-05-12T09:07:07.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.883+0000 7f0b17fff700 1 -- 172.21.15.116:0/3485186820 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b24057070 con 0x7f0b301601e0 2023-05-12T09:07:07.887 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:07:07.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.885+0000 7f0b359ff700 1 -- 172.21.15.116:0/3485186820 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0b1c06ace0 msgr2=0x7f0b1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.885+0000 7f0b359ff700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0b1c06ace0 0x7f0b1c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b20000c00 tx=0x7f0b20008030 comp rx=0 tx=0).stop 2023-05-12T09:07:07.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.885+0000 7f0b359ff700 1 -- 172.21.15.116:0/3485186820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b301601e0 msgr2=0x7f0b301597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:07.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.885+0000 7f0b359ff700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b301601e0 0x7f0b301597d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400c510 tx=0x7f0b2400c8d0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.885+0000 7f0b359ff700 1 -- 172.21.15.116:0/3485186820 shutdown_connections 2023-05-12T09:07:07.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.885+0000 7f0b359ff700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0b1c06ace0 0x7f0b1c06d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.885+0000 7f0b359ff700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0b30160d40 0x7f0b300c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.885+0000 7f0b359ff700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0b300b87a0 0x7f0b30159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.885+0000 7f0b359ff700 1 --2- 172.21.15.116:0/3485186820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b301601e0 0x7f0b301597d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:07.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.885+0000 7f0b359ff700 1 -- 172.21.15.116:0/3485186820 >> 172.21.15.116:0/3485186820 conn(0x7f0b30071b10 msgr2=0x7f0b300d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:07.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.886+0000 7f0b359ff700 1 -- 172.21.15.116:0/3485186820 shutdown_connections 2023-05-12T09:07:07.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:07.886+0000 7f0b359ff700 1 -- 172.21.15.116:0/3485186820 wait complete. 2023-05-12T09:07:07.906 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-12T09:07:08.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.088+0000 7feb96dff700 1 Processor -- start 2023-05-12T09:07:08.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.088+0000 7feb96dff700 1 -- start start 2023-05-12T09:07:08.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.089+0000 7feb96dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900cfbf0 0x7feb901608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.089+0000 7feb96dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7feb900d1100 0x7feb900d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.089+0000 7feb96dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb900d0020 con 0x7feb900b87a0 2023-05-12T09:07:08.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.089+0000 7feb96dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb900d02d0 con 0x7feb900d1100 2023-05-12T09:07:08.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.089+0000 7feb96dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb900d0cb0 con 0x7feb900cfbf0 2023-05-12T09:07:08.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.089+0000 7feb9539c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7feb900d1100 0x7feb900d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.089+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900cfbf0 0x7feb901608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.090+0000 7feb9539c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7feb900d1100 0x7feb900d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:33108/0 (socket says 172.21.15.116:33108) 2023-05-12T09:07:08.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.090+0000 7feb9539c700 1 -- 172.21.15.116:0/781322422 learned_addr learned my addr 172.21.15.116:0/781322422 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:08.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.090+0000 7feb8ffff700 1 -- 172.21.15.116:0/781322422 >> v2:172.21.15.182:3300/0 conn(0x7feb900d1100 msgr2=0x7feb900d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:08.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.090+0000 7feb8ffff700 1 --2- 172.21.15.116:0/781322422 >> v2:172.21.15.182:3300/0 conn(0x7feb900d1100 0x7feb900d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.090+0000 7feb8ffff700 1 -- 172.21.15.116:0/781322422 >> v1:172.21.15.182:6789/0 conn(0x7feb900b87a0 legacy=0x7feb901601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:08.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.090+0000 7feb8ffff700 1 -- 172.21.15.116:0/781322422 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900cdc60 con 0x7feb900cfbf0 2023-05-12T09:07:08.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.090+0000 7feb9539c700 1 --2- 172.21.15.116:0/781322422 >> v2:172.21.15.182:3300/0 conn(0x7feb900d1100 0x7feb900d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:08.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.090+0000 7feb8ffff700 1 --2- 172.21.15.116:0/781322422 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900cfbf0 0x7feb901608f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009840 tx=0x7feb7c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81e45f9d68f34b29 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:08.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.090+0000 7feb8f7fe700 1 -- 172.21.15.116:0/781322422 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c011830 con 0x7feb900cfbf0 2023-05-12T09:07:08.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.091+0000 7feb8f7fe700 1 -- 172.21.15.116:0/781322422 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c011990 con 0x7feb900cfbf0 2023-05-12T09:07:08.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.091+0000 7feb8f7fe700 1 -- 172.21.15.116:0/781322422 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c011d20 con 0x7feb900cfbf0 2023-05-12T09:07:08.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.091+0000 7feb96dff700 1 -- 172.21.15.116:0/781322422 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900cfbf0 msgr2=0x7feb901608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:08.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.091+0000 7feb96dff700 1 --2- 172.21.15.116:0/781322422 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900cfbf0 0x7feb901608f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009840 tx=0x7feb7c009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:08.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.091+0000 7feb96dff700 1 -- 172.21.15.116:0/781322422 shutdown_connections 2023-05-12T09:07:08.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.091+0000 7feb96dff700 1 --2- 172.21.15.116:0/781322422 >> v2:172.21.15.182:3300/0 conn(0x7feb900d1100 0x7feb900d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.091+0000 7feb96dff700 1 --2- 172.21.15.116:0/781322422 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900cfbf0 0x7feb901608f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.091+0000 7feb96dff700 1 -- 172.21.15.116:0/781322422 >> 172.21.15.116:0/781322422 conn(0x7feb90071b10 msgr2=0x7feb90071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:08.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.091+0000 7feb96dff700 1 -- 172.21.15.116:0/781322422 shutdown_connections 2023-05-12T09:07:08.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.091+0000 7feb96dff700 1 -- 172.21.15.116:0/781322422 wait complete. 2023-05-12T09:07:08.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.093+0000 7feb96dff700 1 Processor -- start 2023-05-12T09:07:08.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.093+0000 7feb96dff700 1 -- start start 2023-05-12T09:07:08.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb96dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900b87a0 0x7feb90158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb96dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb900cfbf0 0x7feb9015ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb96dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7feb900d1100 0x7feb9015f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb96dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb901e8160 con 0x7feb900cfbf0 2023-05-12T09:07:08.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb96dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb901e7550 con 0x7feb900d1100 2023-05-12T09:07:08.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb96dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb901e7830 con 0x7feb900b87a0 2023-05-12T09:07:08.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb900cfbf0 0x7feb9015ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb900cfbf0 0x7feb9015ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35538/0 (socket says 172.21.15.116:35538) 2023-05-12T09:07:08.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb8ffff700 1 -- 172.21.15.116:0/3464032472 learned_addr learned my addr 172.21.15.116:0/3464032472 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:08.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb9539c700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7feb900d1100 0x7feb9015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb94b9b700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900b87a0 0x7feb90158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb8ffff700 1 -- 172.21.15.116:0/3464032472 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900b87a0 msgr2=0x7feb90158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:08.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb8ffff700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900b87a0 0x7feb90158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb8ffff700 1 -- 172.21.15.116:0/3464032472 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7feb900d1100 msgr2=0x7feb9015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:08.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb8ffff700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7feb900d1100 0x7feb9015f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.094+0000 7feb8ffff700 1 -- 172.21.15.116:0/3464032472 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009b30 con 0x7feb900cfbf0 2023-05-12T09:07:08.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.095+0000 7feb8ffff700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb900cfbf0 0x7feb9015ecc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009fd0 tx=0x7feb7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:08.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.095+0000 7feb8d7fa700 1 -- 172.21.15.116:0/3464032472 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0036a0 con 0x7feb900cfbf0 2023-05-12T09:07:08.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.095+0000 7feb8d7fa700 1 -- 172.21.15.116:0/3464032472 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c01f070 con 0x7feb900cfbf0 2023-05-12T09:07:08.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.095+0000 7feb96dff700 1 -- 172.21.15.116:0/3464032472 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c0094a0 con 0x7feb900cfbf0 2023-05-12T09:07:08.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.095+0000 7feb8d7fa700 1 -- 172.21.15.116:0/3464032472 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c003a60 con 0x7feb900cfbf0 2023-05-12T09:07:08.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.095+0000 7feb96dff700 1 -- 172.21.15.116:0/3464032472 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb900cd980 con 0x7feb900cfbf0 2023-05-12T09:07:08.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.096+0000 7feb96dff700 1 -- 172.21.15.116:0/3464032472 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb900cd6a0 con 0x7feb900cfbf0 2023-05-12T09:07:08.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.097+0000 7feb8d7fa700 1 -- 172.21.15.116:0/3464032472 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb7c003bc0 con 0x7feb900cfbf0 2023-05-12T09:07:08.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.099+0000 7feb8d7fa700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7feb7406ace0 0x7feb7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.099+0000 7feb8d7fa700 1 -- 172.21.15.116:0/3464032472 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feb7c021070 con 0x7feb900cfbf0 2023-05-12T09:07:08.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.099+0000 7feb94b9b700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7feb7406ace0 0x7feb7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.099+0000 7feb94b9b700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7feb7406ace0 0x7feb7406d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb84000f60 tx=0x7feb84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:08.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.103+0000 7feb8d7fa700 1 -- 172.21.15.116:0/3464032472 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7feb7c055e90 con 0x7feb900cfbf0 2023-05-12T09:07:08.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.299+0000 7feb96dff700 1 -- 172.21.15.116:0/3464032472 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feb90160e30 con 0x7feb900cfbf0 2023-05-12T09:07:08.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.300+0000 7feb8d7fa700 1 -- 172.21.15.116:0/3464032472 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7feb7c0594b0 con 0x7feb900cfbf0 2023-05-12T09:07:08.303 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:08.303 INFO:teuthology.orchestra.run.smithi116.stdout:[ 2023-05-12T09:07:08.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:07:08.304 INFO:teuthology.orchestra.run.smithi116.stdout: "poolnum": 1, 2023-05-12T09:07:08.304 INFO:teuthology.orchestra.run.smithi116.stdout: "poolname": "rbd" 2023-05-12T09:07:08.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:08.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:07:08.304 INFO:teuthology.orchestra.run.smithi116.stdout: "poolnum": 2, 2023-05-12T09:07:08.304 INFO:teuthology.orchestra.run.smithi116.stdout: "poolname": ".mgr" 2023-05-12T09:07:08.304 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:07:08.305 INFO:teuthology.orchestra.run.smithi116.stdout:] 2023-05-12T09:07:08.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 -- 172.21.15.116:0/3464032472 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7feb7406ace0 msgr2=0x7feb7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:08.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7feb7406ace0 0x7feb7406d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb84000f60 tx=0x7feb84009040 comp rx=0 tx=0).stop 2023-05-12T09:07:08.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 -- 172.21.15.116:0/3464032472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb900cfbf0 msgr2=0x7feb9015ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:08.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb900cfbf0 0x7feb9015ecc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009fd0 tx=0x7feb7c004750 comp rx=0 tx=0).stop 2023-05-12T09:07:08.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 -- 172.21.15.116:0/3464032472 shutdown_connections 2023-05-12T09:07:08.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7feb900d1100 0x7feb9015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7feb7406ace0 0x7feb7406d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feb900b87a0 0x7feb90158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 --2- 172.21.15.116:0/3464032472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb900cfbf0 0x7feb9015ecc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 -- 172.21.15.116:0/3464032472 >> 172.21.15.116:0/3464032472 conn(0x7feb90071b10 msgr2=0x7feb900b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:08.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 -- 172.21.15.116:0/3464032472 shutdown_connections 2023-05-12T09:07:08.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.302+0000 7feb96dff700 1 -- 172.21.15.116:0/3464032472 wait complete. 2023-05-12T09:07:08.322 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-12T09:07:08.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-12T09:07:08.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.507+0000 7fec147ff700 1 Processor -- start 2023-05-12T09:07:08.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.507+0000 7fec147ff700 1 -- start start 2023-05-12T09:07:08.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.508+0000 7fec147ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c0b87a0 0x7fec0c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.508+0000 7fec147ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fec0c160d40 0x7fec0c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.508+0000 7fec147ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c0cdc60 con 0x7fec0c1601e0 2023-05-12T09:07:08.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.508+0000 7fec147ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c0d02d0 con 0x7fec0c160d40 2023-05-12T09:07:08.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.508+0000 7fec147ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0d0cb0 con 0x7fec0c0b87a0 2023-05-12T09:07:08.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.508+0000 7fec11d9a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fec0c1601e0 0x7fec0c160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48474/0 (socket says 172.21.15.116:48474) 2023-05-12T09:07:08.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.508+0000 7fec11d9a700 1 -- 172.21.15.116:0/1284118809 learned_addr learned my addr 172.21.15.116:0/1284118809 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:08.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324492545 0 0) 0x7fec0c0cdc60 con 0x7fec0c1601e0 2023-05-12T09:07:08.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec12d9c700 1 --2- 172.21.15.116:0/1284118809 >> v2:172.21.15.182:3300/0 conn(0x7fec0c160d40 0x7fec0c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf80035b0 con 0x7fec0c1601e0 2023-05-12T09:07:08.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec1259b700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c0b87a0 0x7fec0c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 242185911 0 0) 0x7febf80035b0 con 0x7fec0c1601e0 2023-05-12T09:07:08.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c0b87a0 msgr2=0x7fec0c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:08.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c0b87a0 0x7fec0c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 >> v2:172.21.15.182:3300/0 conn(0x7fec0c160d40 msgr2=0x7fec0c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:08.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 --2- 172.21.15.116:0/1284118809 >> v2:172.21.15.182:3300/0 conn(0x7fec0c160d40 0x7fec0c0d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0cd6a0 con 0x7fec0c1601e0 2023-05-12T09:07:08.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7febfc001670 con 0x7fec0c1601e0 2023-05-12T09:07:08.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 >> v1:172.21.15.116:6789/0 conn(0x7fec0c1601e0 legacy=0x7fec0c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:08.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febf8003a00 0x7febf8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7febf8004850 0x7febf8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c0b87a0 0x7febf8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0d02d0 con 0x7febf8003a00 2023-05-12T09:07:08.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf800ba10 con 0x7febf8004850 2023-05-12T09:07:08.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf800bb50 con 0x7fec0c0b87a0 2023-05-12T09:07:08.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec1259b700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febf8003a00 0x7febf8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.509+0000 7fec11d9a700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7febf8004850 0x7febf8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.510+0000 7fec12d9c700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c0b87a0 0x7febf8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.510+0000 7fec1259b700 1 -- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c0b87a0 msgr2=0x7febf8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:08.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.510+0000 7fec1259b700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c0b87a0 0x7febf8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.510+0000 7fec1259b700 1 -- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7febf8004850 msgr2=0x7febf8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:08.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.510+0000 7fec1259b700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7febf8004850 0x7febf8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.510+0000 7fec1259b700 1 -- 172.21.15.116:0/1284118809 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80035b0 con 0x7febf8003a00 2023-05-12T09:07:08.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.510+0000 7fec1259b700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febf8003a00 0x7febf8003e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec08009b90 tx=0x7febf8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7b5d9c3093fbe9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:08.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.510+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800e6c0 con 0x7febf8003a00 2023-05-12T09:07:08.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.510+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800e820 con 0x7febf8003a00 2023-05-12T09:07:08.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.510+0000 7fec11599700 1 -- 172.21.15.116:0/1284118809 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800eb90 con 0x7febf8003a00 2023-05-12T09:07:08.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.511+0000 7fec147ff700 1 -- 172.21.15.116:0/1284118809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febf8003a00 msgr2=0x7febf8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:08.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.511+0000 7fec147ff700 1 --2- 172.21.15.116:0/1284118809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febf8003a00 0x7febf8003e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec08009b90 tx=0x7febf8005880 comp rx=0 tx=0).stop 2023-05-12T09:07:08.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.511+0000 7fec12d9c700 1 -- 172.21.15.116:0/1284118809 reap_dead start 2023-05-12T09:07:08.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.511+0000 7fec147ff700 1 -- 172.21.15.116:0/1284118809 shutdown_connections 2023-05-12T09:07:08.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.511+0000 7fec147ff700 1 -- 172.21.15.116:0/1284118809 >> 172.21.15.116:0/1284118809 conn(0x7fec0c071b10 msgr2=0x7fec0c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:08.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.511+0000 7fec147ff700 1 -- 172.21.15.116:0/1284118809 shutdown_connections 2023-05-12T09:07:08.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.511+0000 7fec147ff700 1 -- 172.21.15.116:0/1284118809 wait complete. 2023-05-12T09:07:08.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.513+0000 7fec147ff700 1 Processor -- start 2023-05-12T09:07:08.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.513+0000 7fec147ff700 1 -- start start 2023-05-12T09:07:08.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec147ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7febf8003a00 0x7fec0c0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec147ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c15f470 0x7fec0c0d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec147ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c15f8e0 0x7fec0c0d2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec147ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0c69c0 con 0x7fec0c15f470 2023-05-12T09:07:08.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec147ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0c6c10 con 0x7febf8003a00 2023-05-12T09:07:08.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec147ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0c6ef0 con 0x7fec0c15f8e0 2023-05-12T09:07:08.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec11d9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c15f470 0x7fec0c0d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec11d9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c15f470 0x7fec0c0d2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35548/0 (socket says 172.21.15.116:35548) 2023-05-12T09:07:08.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec11d9a700 1 -- 172.21.15.116:0/2541185179 learned_addr learned my addr 172.21.15.116:0/2541185179 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:08.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec1259b700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7febf8003a00 0x7fec0c0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec12d9c700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c15f8e0 0x7fec0c0d2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec11d9a700 1 -- 172.21.15.116:0/2541185179 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c15f8e0 msgr2=0x7fec0c0d2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:08.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec11d9a700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c15f8e0 0x7fec0c0d2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec11d9a700 1 -- 172.21.15.116:0/2541185179 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7febf8003a00 msgr2=0x7fec0c0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:08.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec11d9a700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7febf8003a00 0x7fec0c0c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec11d9a700 1 -- 172.21.15.116:0/2541185179 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0cfbf0 con 0x7fec0c15f470 2023-05-12T09:07:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.514+0000 7fec11d9a700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c15f470 0x7fec0c0d2aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7febfc007fd0 tx=0x7febfc0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.515+0000 7fec02ffd700 1 -- 172.21.15.116:0/2541185179 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc011580 con 0x7fec0c15f470 2023-05-12T09:07:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.515+0000 7fec02ffd700 1 -- 172.21.15.116:0/2541185179 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc011740 con 0x7fec0c15f470 2023-05-12T09:07:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.515+0000 7fec02ffd700 1 -- 172.21.15.116:0/2541185179 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc011af0 con 0x7fec0c15f470 2023-05-12T09:07:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.515+0000 7fec147ff700 1 -- 172.21.15.116:0/2541185179 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c0cd980 con 0x7fec0c15f470 2023-05-12T09:07:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.515+0000 7fec147ff700 1 -- 172.21.15.116:0/2541185179 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c0cfd80 con 0x7fec0c15f470 2023-05-12T09:07:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.516+0000 7fec147ff700 1 -- 172.21.15.116:0/2541185179 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c0d1000 con 0x7fec0c15f470 2023-05-12T09:07:08.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.517+0000 7fec02ffd700 1 -- 172.21.15.116:0/2541185179 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febfc011c50 con 0x7fec0c15f470 2023-05-12T09:07:08.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.518+0000 7fec02ffd700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7febf006ace0 0x7febf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:08.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.518+0000 7fec02ffd700 1 -- 172.21.15.116:0/2541185179 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7febfc089200 con 0x7fec0c15f470 2023-05-12T09:07:08.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.518+0000 7fec1259b700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7febf006ace0 0x7febf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:08.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.518+0000 7fec1259b700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7febf006ace0 0x7febf006d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec080090b0 tx=0x7fec0801f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:08.527 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.522+0000 7fec02ffd700 1 -- 172.21.15.116:0/2541185179 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7febfc0545f0 con 0x7fec0c15f470 2023-05-12T09:07:08.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:08.715+0000 7fec147ff700 1 -- 172.21.15.116:0/2541185179 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fec0c074430 con 0x7fec0c15f470 2023-05-12T09:07:09.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.045+0000 7fec02ffd700 1 -- 172.21.15.116:0/2541185179 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7febfc057c10 con 0x7fec0c15f470 2023-05-12T09:07:09.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.049+0000 7fec147ff700 1 -- 172.21.15.116:0/2541185179 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7febf006ace0 msgr2=0x7febf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:09.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.049+0000 7fec147ff700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7febf006ace0 0x7febf006d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec080090b0 tx=0x7fec0801f040 comp rx=0 tx=0).stop 2023-05-12T09:07:09.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.049+0000 7fec147ff700 1 -- 172.21.15.116:0/2541185179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c15f470 msgr2=0x7fec0c0d2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:09.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.049+0000 7fec147ff700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c15f470 0x7fec0c0d2aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7febfc007fd0 tx=0x7febfc0075f0 comp rx=0 tx=0).stop 2023-05-12T09:07:09.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.050+0000 7fec147ff700 1 -- 172.21.15.116:0/2541185179 shutdown_connections 2023-05-12T09:07:09.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.050+0000 7fec147ff700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7febf006ace0 0x7febf006d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:09.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.050+0000 7fec147ff700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fec0c15f8e0 0x7fec0c0d2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:09.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.050+0000 7fec147ff700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7febf8003a00 0x7fec0c0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:09.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.050+0000 7fec147ff700 1 --2- 172.21.15.116:0/2541185179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c15f470 0x7fec0c0d2aa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:09.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.050+0000 7fec147ff700 1 -- 172.21.15.116:0/2541185179 >> 172.21.15.116:0/2541185179 conn(0x7fec0c071b10 msgr2=0x7fec0c0b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:09.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.050+0000 7fec147ff700 1 -- 172.21.15.116:0/2541185179 shutdown_connections 2023-05-12T09:07:09.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.050+0000 7fec147ff700 1 -- 172.21.15.116:0/2541185179 wait complete. 2023-05-12T09:07:09.057 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_metadata' created 2023-05-12T09:07:09.073 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-05-12T09:07:09.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.262+0000 7efe9e7ff700 1 Processor -- start 2023-05-12T09:07:09.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.262+0000 7efe9e7ff700 1 -- start start 2023-05-12T09:07:09.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.263+0000 7efe9e7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980b87a0 0x7efe980cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:09.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.263+0000 7efe9e7ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980cdc60 con 0x7efe981601e0 2023-05-12T09:07:09.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.263+0000 7efe9e7ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980cd6a0 con 0x7efe98160d40 2023-05-12T09:07:09.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.263+0000 7efe9e7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe980d02d0 con 0x7efe980b87a0 2023-05-12T09:07:09.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.263+0000 7efe8ffff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7efe981601e0 0x7efe98160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48482/0 (socket says 172.21.15.116:48482) 2023-05-12T09:07:09.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.263+0000 7efe8ffff700 1 -- 172.21.15.116:0/3848009231 learned_addr learned my addr 172.21.15.116:0/3848009231 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:09.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.263+0000 7efe97fff700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980b87a0 0x7efe980cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:09.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983041797 0 0) 0x7efe980cdc60 con 0x7efe981601e0 2023-05-12T09:07:09.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe840035b0 con 0x7efe981601e0 2023-05-12T09:07:09.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796224176 0 0) 0x7efe980cd6a0 con 0x7efe98160d40 2023-05-12T09:07:09.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe980cdc60 con 0x7efe98160d40 2023-05-12T09:07:09.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3849782512 0 0) 0x7efe840035b0 con 0x7efe981601e0 2023-05-12T09:07:09.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980b87a0 msgr2=0x7efe980cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:09.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980b87a0 0x7efe980cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:09.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 >> v1:172.21.15.182:6789/0 conn(0x7efe98160d40 legacy=0x7efe980d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:09.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980cd980 con 0x7efe981601e0 2023-05-12T09:07:09.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7efe80001670 con 0x7efe981601e0 2023-05-12T09:07:09.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 >> v1:172.21.15.116:6789/0 conn(0x7efe981601e0 legacy=0x7efe98160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:09.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe84003bc0 0x7efe84003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:09.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe84004850 0x7efe84004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:09.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980b87a0 0x7efe84005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:09.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe980d02d0 con 0x7efe84003bc0 2023-05-12T09:07:09.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8400bac0 con 0x7efe84004850 2023-05-12T09:07:09.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8400bc30 con 0x7efe980b87a0 2023-05-12T09:07:09.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe97fff700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe84003bc0 0x7efe84003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:09.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.264+0000 7efe9cd9c700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980b87a0 0x7efe84005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:09.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.265+0000 7efe8ffff700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe84004850 0x7efe84004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:09.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.265+0000 7efe97fff700 1 -- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980b87a0 msgr2=0x7efe84005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:09.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.265+0000 7efe97fff700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980b87a0 0x7efe84005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:09.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.265+0000 7efe97fff700 1 -- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe84004850 msgr2=0x7efe84004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:09.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.265+0000 7efe97fff700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe84004850 0x7efe84004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:09.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.265+0000 7efe97fff700 1 -- 172.21.15.116:0/3848009231 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840035b0 con 0x7efe84003bc0 2023-05-12T09:07:09.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.265+0000 7efe97fff700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe84003bc0 0x7efe84003fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe88009b60 tx=0x7efe84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e08cd85afcef2e server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:09.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.265+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8800e6c0 con 0x7efe84003bc0 2023-05-12T09:07:09.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.265+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8800e820 con 0x7efe84003bc0 2023-05-12T09:07:09.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.265+0000 7efe977fe700 1 -- 172.21.15.116:0/3848009231 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8800eb90 con 0x7efe84003bc0 2023-05-12T09:07:09.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.266+0000 7efe9e7ff700 1 -- 172.21.15.116:0/3848009231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe84003bc0 msgr2=0x7efe84003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:09.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.266+0000 7efe9e7ff700 1 --2- 172.21.15.116:0/3848009231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe84003bc0 0x7efe84003fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe88009b60 tx=0x7efe84005880 comp rx=0 tx=0).stop 2023-05-12T09:07:09.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.266+0000 7efe9cd9c700 1 -- 172.21.15.116:0/3848009231 reap_dead start 2023-05-12T09:07:09.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.266+0000 7efe9e7ff700 1 -- 172.21.15.116:0/3848009231 shutdown_connections 2023-05-12T09:07:09.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.266+0000 7efe9e7ff700 1 -- 172.21.15.116:0/3848009231 >> 172.21.15.116:0/3848009231 conn(0x7efe98071b10 msgr2=0x7efe98071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:09.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.266+0000 7efe9e7ff700 1 -- 172.21.15.116:0/3848009231 shutdown_connections 2023-05-12T09:07:09.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.266+0000 7efe9e7ff700 1 -- 172.21.15.116:0/3848009231 wait complete. 2023-05-12T09:07:09.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.268+0000 7efe9e7ff700 1 Processor -- start 2023-05-12T09:07:09.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.268+0000 7efe9e7ff700 1 -- start start 2023-05-12T09:07:09.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9e7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe84003bc0 0x7efe98150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:09.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9e7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980cc760 0x7efe9815e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:09.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9e7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe9815e560 0x7efe980d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:09.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9e7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c6650 con 0x7efe9815e560 2023-05-12T09:07:09.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9e7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe980cbb60 con 0x7efe84003bc0 2023-05-12T09:07:09.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9e7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9815cca0 con 0x7efe980cc760 2023-05-12T09:07:09.277 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9cd9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe9815e560 0x7efe980d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:09.277 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9cd9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe9815e560 0x7efe980d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35566/0 (socket says 172.21.15.116:35566) 2023-05-12T09:07:09.277 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9cd9c700 1 -- 172.21.15.116:0/1047023908 learned_addr learned my addr 172.21.15.116:0/1047023908 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:09.277 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe8ffff700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980cc760 0x7efe9815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:09.277 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe97fff700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe84003bc0 0x7efe98150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:09.277 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9cd9c700 1 -- 172.21.15.116:0/1047023908 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980cc760 msgr2=0x7efe9815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:09.277 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9cd9c700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980cc760 0x7efe9815e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:09.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9cd9c700 1 -- 172.21.15.116:0/1047023908 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe84003bc0 msgr2=0x7efe98150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:09.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9cd9c700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe84003bc0 0x7efe98150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:09.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.269+0000 7efe9cd9c700 1 -- 172.21.15.116:0/1047023908 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980cfd80 con 0x7efe9815e560 2023-05-12T09:07:09.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.270+0000 7efe9cd9c700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe9815e560 0x7efe980d2680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe980d0820 tx=0x7efe9000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:09.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.270+0000 7efe957fa700 1 -- 172.21.15.116:0/1047023908 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90003c10 con 0x7efe9815e560 2023-05-12T09:07:09.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.270+0000 7efe957fa700 1 -- 172.21.15.116:0/1047023908 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe90003d70 con 0x7efe9815e560 2023-05-12T09:07:09.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.270+0000 7efe9e7ff700 1 -- 172.21.15.116:0/1047023908 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe980cfbf0 con 0x7efe9815e560 2023-05-12T09:07:09.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.270+0000 7efe957fa700 1 -- 172.21.15.116:0/1047023908 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9000dbd0 con 0x7efe9815e560 2023-05-12T09:07:09.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.270+0000 7efe9e7ff700 1 -- 172.21.15.116:0/1047023908 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe980cff10 con 0x7efe9815e560 2023-05-12T09:07:09.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.271+0000 7efe9e7ff700 1 -- 172.21.15.116:0/1047023908 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe980b52f0 con 0x7efe9815e560 2023-05-12T09:07:09.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.272+0000 7efe957fa700 1 -- 172.21.15.116:0/1047023908 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe9000dd30 con 0x7efe9815e560 2023-05-12T09:07:09.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.273+0000 7efe957fa700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7806ad10 0x7efe7806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:09.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.273+0000 7efe957fa700 1 -- 172.21.15.116:0/1047023908 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5580+0+0 (secure 0 0 0) 0x7efe90089680 con 0x7efe9815e560 2023-05-12T09:07:09.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.273+0000 7efe97fff700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7806ad10 0x7efe7806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:09.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.274+0000 7efe97fff700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7806ad10 0x7efe7806d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe880090b0 tx=0x7efe88008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:09.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.278+0000 7efe957fa700 1 -- 172.21.15.116:0/1047023908 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efe90054870 con 0x7efe9815e560 2023-05-12T09:07:09.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:09.473+0000 7efe9e7ff700 1 -- 172.21.15.116:0/1047023908 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7efe980b6580 con 0x7efe9815e560 2023-05-12T09:07:09.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:07:09.785 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:07:10.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.052+0000 7efe957fa700 1 -- 172.21.15.116:0/1047023908 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7efe90057e90 con 0x7efe9815e560 2023-05-12T09:07:10.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.056+0000 7efe9e7ff700 1 -- 172.21.15.116:0/1047023908 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7806ad10 msgr2=0x7efe7806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.056+0000 7efe9e7ff700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7806ad10 0x7efe7806d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe880090b0 tx=0x7efe88008030 comp rx=0 tx=0).stop 2023-05-12T09:07:10.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.057+0000 7efe9e7ff700 1 -- 172.21.15.116:0/1047023908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe9815e560 msgr2=0x7efe980d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.057+0000 7efe9e7ff700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe9815e560 0x7efe980d2680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe980d0820 tx=0x7efe9000d430 comp rx=0 tx=0).stop 2023-05-12T09:07:10.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.059+0000 7efe9e7ff700 1 -- 172.21.15.116:0/1047023908 shutdown_connections 2023-05-12T09:07:10.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.059+0000 7efe9e7ff700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe9815e560 0x7efe980d2680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.059+0000 7efe9e7ff700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe84003bc0 0x7efe98150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.059+0000 7efe9e7ff700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7806ad10 0x7efe7806d1c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.059+0000 7efe9e7ff700 1 --2- 172.21.15.116:0/1047023908 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe980cc760 0x7efe9815e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.059+0000 7efe9e7ff700 1 -- 172.21.15.116:0/1047023908 >> 172.21.15.116:0/1047023908 conn(0x7efe98071b10 msgr2=0x7efe980b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:10.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.063+0000 7efe9e7ff700 1 -- 172.21.15.116:0/1047023908 shutdown_connections 2023-05-12T09:07:10.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.064+0000 7efe9e7ff700 1 -- 172.21.15.116:0/1047023908 wait complete. 2023-05-12T09:07:10.076 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_data' created 2023-05-12T09:07:10.093 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-12T09:07:10.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.277+0000 7f1a03dff700 1 Processor -- start 2023-05-12T09:07:10.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.277+0000 7f1a03dff700 1 -- start start 2023-05-12T09:07:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.278+0000 7f1a03dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f19fc0cfbf0 0x7f19fc1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.278+0000 7f1a03dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0d1100 0x7f19fc0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.278+0000 7f1a03dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19fc0d0020 con 0x7f19fc0b87a0 2023-05-12T09:07:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.278+0000 7f1a03dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19fc0d02d0 con 0x7f19fc0cfbf0 2023-05-12T09:07:10.282 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.278+0000 7f1a03dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0d0cb0 con 0x7f19fc0d1100 2023-05-12T09:07:10.282 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.278+0000 7f1a0139a700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f19fc0cfbf0 0x7f19fc1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.283 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.278+0000 7f1a0239c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0d1100 0x7f19fc0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.283 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.279+0000 7f1a0139a700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f19fc0cfbf0 0x7f19fc1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:33172/0 (socket says 172.21.15.116:33172) 2023-05-12T09:07:10.283 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.279+0000 7f1a0139a700 1 -- 172.21.15.116:0/557959186 learned_addr learned my addr 172.21.15.116:0/557959186 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:10.283 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.279+0000 7f1a0139a700 1 -- 172.21.15.116:0/557959186 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0d1100 msgr2=0x7f19fc0d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:10.283 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.279+0000 7f1a0139a700 1 --2- 172.21.15.116:0/557959186 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0d1100 0x7f19fc0d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.283 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.279+0000 7f1a0139a700 1 -- 172.21.15.116:0/557959186 >> v1:172.21.15.182:6789/0 conn(0x7f19fc0b87a0 legacy=0x7f19fc1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.279+0000 7f1a0139a700 1 -- 172.21.15.116:0/557959186 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0cdc60 con 0x7f19fc0cfbf0 2023-05-12T09:07:10.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.279+0000 7f1a0139a700 1 --2- 172.21.15.116:0/557959186 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f19fc0cfbf0 0x7f19fc1608f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0098f0 tx=0x7f19ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c56f0bc7e523d92c server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:10.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.279+0000 7f1a00b99700 1 -- 172.21.15.116:0/557959186 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec011830 con 0x7f19fc0cfbf0 2023-05-12T09:07:10.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.279+0000 7f1a00b99700 1 -- 172.21.15.116:0/557959186 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ec011990 con 0x7f19fc0cfbf0 2023-05-12T09:07:10.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.279+0000 7f1a00b99700 1 -- 172.21.15.116:0/557959186 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec011d20 con 0x7f19fc0cfbf0 2023-05-12T09:07:10.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.280+0000 7f1a03dff700 1 -- 172.21.15.116:0/557959186 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f19fc0cfbf0 msgr2=0x7f19fc1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.280+0000 7f1a03dff700 1 --2- 172.21.15.116:0/557959186 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f19fc0cfbf0 0x7f19fc1608f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0098f0 tx=0x7f19ec009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:10.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.280+0000 7f1a03dff700 1 -- 172.21.15.116:0/557959186 shutdown_connections 2023-05-12T09:07:10.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.280+0000 7f1a03dff700 1 --2- 172.21.15.116:0/557959186 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0d1100 0x7f19fc0d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.280+0000 7f1a03dff700 1 --2- 172.21.15.116:0/557959186 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f19fc0cfbf0 0x7f19fc1608f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.286 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.280+0000 7f1a03dff700 1 -- 172.21.15.116:0/557959186 >> 172.21.15.116:0/557959186 conn(0x7f19fc071b10 msgr2=0x7f19fc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:10.286 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.280+0000 7f1a03dff700 1 -- 172.21.15.116:0/557959186 shutdown_connections 2023-05-12T09:07:10.286 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.280+0000 7f1a03dff700 1 -- 172.21.15.116:0/557959186 wait complete. 2023-05-12T09:07:10.286 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.282+0000 7f1a03dff700 1 Processor -- start 2023-05-12T09:07:10.286 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.282+0000 7f1a03dff700 1 -- start start 2023-05-12T09:07:10.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a03dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f19fc0b87a0 0x7f19fc153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a03dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0cfbf0 0x7f19fc0cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a03dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19fc0d1100 0x7f19fc159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a03dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0cafb0 con 0x7f19fc0d1100 2023-05-12T09:07:10.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a03dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0ca3a0 con 0x7f19fc0b87a0 2023-05-12T09:07:10.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a03dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc0ca680 con 0x7f19fc0cfbf0 2023-05-12T09:07:10.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a0239c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19fc0d1100 0x7f19fc159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a0239c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19fc0d1100 0x7f19fc159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35576/0 (socket says 172.21.15.116:35576) 2023-05-12T09:07:10.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a0239c700 1 -- 172.21.15.116:0/4194368973 learned_addr learned my addr 172.21.15.116:0/4194368973 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:10.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a0139a700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0cfbf0 0x7f19fc0cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.283+0000 7f1a01b9b700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f19fc0b87a0 0x7f19fc153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f1a0239c700 1 -- 172.21.15.116:0/4194368973 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0cfbf0 msgr2=0x7f19fc0cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f1a0239c700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0cfbf0 0x7f19fc0cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f1a0239c700 1 -- 172.21.15.116:0/4194368973 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f19fc0b87a0 msgr2=0x7f19fc153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.290 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f1a0239c700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f19fc0b87a0 0x7f19fc153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.290 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f1a0239c700 1 -- 172.21.15.116:0/4194368973 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec009550 con 0x7f19fc0d1100 2023-05-12T09:07:10.290 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f1a01b9b700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f19fc0b87a0 0x7f19fc153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:10.290 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f1a0139a700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0cfbf0 0x7f19fc0cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:10.290 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f1a0239c700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19fc0d1100 0x7f19fc159270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19f400efc0 tx=0x7f19f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:10.290 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f19f27fc700 1 -- 172.21.15.116:0/4194368973 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4009ba0 con 0x7f19fc0d1100 2023-05-12T09:07:10.291 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f19f27fc700 1 -- 172.21.15.116:0/4194368973 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f400f040 con 0x7f19fc0d1100 2023-05-12T09:07:10.291 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f19f27fc700 1 -- 172.21.15.116:0/4194368973 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4014480 con 0x7f19fc0d1100 2023-05-12T09:07:10.291 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f1a03dff700 1 -- 172.21.15.116:0/4194368973 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19fc0cd980 con 0x7f19fc0d1100 2023-05-12T09:07:10.291 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.284+0000 7f1a03dff700 1 -- 172.21.15.116:0/4194368973 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19fc0cd6a0 con 0x7f19fc0d1100 2023-05-12T09:07:10.292 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.285+0000 7f1a03dff700 1 -- 172.21.15.116:0/4194368973 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19fc160e30 con 0x7f19fc0d1100 2023-05-12T09:07:10.292 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.286+0000 7f19f27fc700 1 -- 172.21.15.116:0/4194368973 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19f40145e0 con 0x7f19fc0d1100 2023-05-12T09:07:10.292 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.287+0000 7f19f27fc700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f19e006ace0 0x7f19e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.292 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.287+0000 7f19f27fc700 1 -- 172.21.15.116:0/4194368973 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f19f4089d80 con 0x7f19fc0d1100 2023-05-12T09:07:10.292 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.288+0000 7f1a01b9b700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f19e006ace0 0x7f19e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.292 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.288+0000 7f1a01b9b700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f19e006ace0 0x7f19e006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19f8000f60 tx=0x7f19f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:10.295 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.292+0000 7f19f27fc700 1 -- 172.21.15.116:0/4194368973 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f19f4054df0 con 0x7f19fc0d1100 2023-05-12T09:07:10.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.527+0000 7f1a03dff700 1 -- 172.21.15.116:0/4194368973 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f19fc074430 con 0x7f19fc0d1100 2023-05-12T09:07:10.536 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.533+0000 7f19f27fc700 1 -- 172.21.15.116:0/4194368973 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f19f4058410 con 0x7f19fc0d1100 2023-05-12T09:07:10.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.538+0000 7f1a03dff700 1 -- 172.21.15.116:0/4194368973 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f19e006ace0 msgr2=0x7f19e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.538+0000 7f1a03dff700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f19e006ace0 0x7f19e006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19f8000f60 tx=0x7f19f8009040 comp rx=0 tx=0).stop 2023-05-12T09:07:10.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.538+0000 7f1a03dff700 1 -- 172.21.15.116:0/4194368973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19fc0d1100 msgr2=0x7f19fc159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.538+0000 7f1a03dff700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19fc0d1100 0x7f19fc159270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19f400efc0 tx=0x7f19f400c3a0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.539+0000 7f1a03dff700 1 -- 172.21.15.116:0/4194368973 shutdown_connections 2023-05-12T09:07:10.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.539+0000 7f1a03dff700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19fc0d1100 0x7f19fc159270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.539+0000 7f1a03dff700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f19fc0b87a0 0x7f19fc153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.539+0000 7f1a03dff700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f19e006ace0 0x7f19e006d190 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19f8000f60 tx=0x7f19f8009040 comp rx=0 tx=0).stop 2023-05-12T09:07:10.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.539+0000 7f1a03dff700 1 --2- 172.21.15.116:0/4194368973 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f19fc0cfbf0 0x7f19fc0cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.539+0000 7f1a03dff700 1 -- 172.21.15.116:0/4194368973 >> 172.21.15.116:0/4194368973 conn(0x7f19fc071b10 msgr2=0x7f19fc15ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:10.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.542+0000 7f1a03dff700 1 -- 172.21.15.116:0/4194368973 shutdown_connections 2023-05-12T09:07:10.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.543+0000 7f1a03dff700 1 -- 172.21.15.116:0/4194368973 wait complete. 2023-05-12T09:07:10.548 INFO:teuthology.orchestra.run.smithi116.stderr:new fs with metadata pool 3 and data pool 4 2023-05-12T09:07:10.576 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-05-12T09:07:10.577 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-05-12T09:07:10.766 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.763+0000 7f79397ff700 1 Processor -- start 2023-05-12T09:07:10.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.763+0000 7f79397ff700 1 -- start start 2023-05-12T09:07:10.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.764+0000 7f79397ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f79340b87a0 0x7f79340cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79397ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7934160d40 0x7f79340d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79397ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79340cdc60 con 0x7f79341601e0 2023-05-12T09:07:10.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79397ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79340d02d0 con 0x7f7934160d40 2023-05-12T09:07:10.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79397ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79340d0cb0 con 0x7f79340b87a0 2023-05-12T09:07:10.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79337fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7934160d40 0x7f79340d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.769 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79337fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7934160d40 0x7f79340d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35582/0 (socket says 172.21.15.116:35582) 2023-05-12T09:07:10.769 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79337fe700 1 -- 172.21.15.116:0/3864305336 learned_addr learned my addr 172.21.15.116:0/3864305336 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:10.769 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f7932ffd700 1 --2- 172.21.15.116:0/3864305336 >> v2:172.21.15.182:3300/0 conn(0x7f79340b87a0 0x7f79340cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.770 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79337fe700 1 -- 172.21.15.116:0/3864305336 >> v2:172.21.15.182:3300/0 conn(0x7f79340b87a0 msgr2=0x7f79340cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:10.770 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79337fe700 1 --2- 172.21.15.116:0/3864305336 >> v2:172.21.15.182:3300/0 conn(0x7f79340b87a0 0x7f79340cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.770 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79337fe700 1 -- 172.21.15.116:0/3864305336 >> v1:172.21.15.182:6789/0 conn(0x7f79341601e0 legacy=0x7f7934160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.771 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79327fc700 1 -- 172.21.15.116:0/3864305336 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384031315 0 0) 0x7f79340cdc60 con 0x7f79341601e0 2023-05-12T09:07:10.771 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.765+0000 7f79337fe700 1 -- 172.21.15.116:0/3864305336 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79340cd6a0 con 0x7f7934160d40 2023-05-12T09:07:10.771 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79337fe700 1 --2- 172.21.15.116:0/3864305336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 0x7f79340d1100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79340b4ac0 tx=0x7f792c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd93a525da582db server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:10.771 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79327fc700 1 -- 172.21.15.116:0/3864305336 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00e070 con 0x7f7934160d40 2023-05-12T09:07:10.771 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79327fc700 1 -- 172.21.15.116:0/3864305336 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c00b8d0 con 0x7f7934160d40 2023-05-12T09:07:10.771 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79327fc700 1 -- 172.21.15.116:0/3864305336 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00bc80 con 0x7f7934160d40 2023-05-12T09:07:10.772 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79397ff700 1 -- 172.21.15.116:0/3864305336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 msgr2=0x7f79340d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.772 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79397ff700 1 --2- 172.21.15.116:0/3864305336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 0x7f79340d1100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79340b4ac0 tx=0x7f792c00b330 comp rx=0 tx=0).stop 2023-05-12T09:07:10.772 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79397ff700 1 -- 172.21.15.116:0/3864305336 shutdown_connections 2023-05-12T09:07:10.772 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79397ff700 1 --2- 172.21.15.116:0/3864305336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 0x7f79340d1100 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.772 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79397ff700 1 --2- 172.21.15.116:0/3864305336 >> v2:172.21.15.182:3300/0 conn(0x7f79340b87a0 0x7f79340cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.772 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79397ff700 1 -- 172.21.15.116:0/3864305336 >> 172.21.15.116:0/3864305336 conn(0x7f7934071b10 msgr2=0x7f7934071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:10.773 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.766+0000 7f79397ff700 1 -- 172.21.15.116:0/3864305336 shutdown_connections 2023-05-12T09:07:10.773 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.767+0000 7f79397ff700 1 -- 172.21.15.116:0/3864305336 wait complete. 2023-05-12T09:07:10.775 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.769+0000 7f79397ff700 1 Processor -- start 2023-05-12T09:07:10.775 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.769+0000 7f79397ff700 1 -- start start 2023-05-12T09:07:10.775 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.770+0000 7f79397ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79340b87a0 0x7f793415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.775 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.770+0000 7f79397ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79341601e0 0x7f79341f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.770+0000 7f79397ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 0x7f79340cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.770+0000 7f79397ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79341f1c90 con 0x7f7934160d40 2023-05-12T09:07:10.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.770+0000 7f79397ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793415dd90 con 0x7f79340b87a0 2023-05-12T09:07:10.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.770+0000 7f79397ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793415e070 con 0x7f79341601e0 2023-05-12T09:07:10.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.770+0000 7f79337fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 0x7f79340cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f79337fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 0x7f79340cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35586/0 (socket says 172.21.15.116:35586) 2023-05-12T09:07:10.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f79337fe700 1 -- 172.21.15.116:0/2435646534 learned_addr learned my addr 172.21.15.116:0/2435646534 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:10.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f7932ffd700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79340b87a0 0x7f793415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f792bfff700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79341601e0 0x7f79341f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f79337fe700 1 -- 172.21.15.116:0/2435646534 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79341601e0 msgr2=0x7f79341f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f79337fe700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79341601e0 0x7f79341f1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f79337fe700 1 -- 172.21.15.116:0/2435646534 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79340b87a0 msgr2=0x7f793415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:10.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f79337fe700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79340b87a0 0x7f793415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:10.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f79337fe700 1 -- 172.21.15.116:0/2435646534 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c009b30 con 0x7f7934160d40 2023-05-12T09:07:10.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f792bfff700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79341601e0 0x7f79341f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:10.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f79337fe700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 0x7f79340cb230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7934072760 tx=0x7f792c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:10.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f792b7fe700 1 -- 172.21.15.116:0/2435646534 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c004930 con 0x7f7934160d40 2023-05-12T09:07:10.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f792b7fe700 1 -- 172.21.15.116:0/2435646534 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c0099b0 con 0x7f7934160d40 2023-05-12T09:07:10.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f792b7fe700 1 -- 172.21.15.116:0/2435646534 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c01b650 con 0x7f7934160d40 2023-05-12T09:07:10.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.771+0000 7f79397ff700 1 -- 172.21.15.116:0/2435646534 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79340d1640 con 0x7f7934160d40 2023-05-12T09:07:10.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.772+0000 7f79397ff700 1 -- 172.21.15.116:0/2435646534 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79340cd980 con 0x7f7934160d40 2023-05-12T09:07:10.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.773+0000 7f79397ff700 1 -- 172.21.15.116:0/2435646534 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79340d17d0 con 0x7f7934160d40 2023-05-12T09:07:10.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.773+0000 7f792b7fe700 1 -- 172.21.15.116:0/2435646534 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f792c01b7b0 con 0x7f7934160d40 2023-05-12T09:07:10.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.774+0000 7f792b7fe700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f791406ace0 0x7f791406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:10.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.774+0000 7f792b7fe700 1 -- 172.21.15.116:0/2435646534 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f792c08aa90 con 0x7f7934160d40 2023-05-12T09:07:10.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.774+0000 7f7932ffd700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f791406ace0 0x7f791406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:10.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.775+0000 7f7932ffd700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f791406ace0 0x7f791406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7924009be0 tx=0x7f7924009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:10.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.779+0000 7f792b7fe700 1 -- 172.21.15.116:0/2435646534 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f792c055b30 con 0x7f7934160d40 2023-05-12T09:07:10.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:10.982+0000 7f79397ff700 1 -- 172.21.15.116:0/2435646534 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f7934074430 con 0x7f7934160d40 2023-05-12T09:07:11.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.545+0000 7f792b7fe700 1 -- 172.21.15.116:0/2435646534 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f792c059150 con 0x7f7934160d40 2023-05-12T09:07:11.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.548+0000 7f79397ff700 1 -- 172.21.15.116:0/2435646534 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f791406ace0 msgr2=0x7f791406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:11.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.548+0000 7f79397ff700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f791406ace0 0x7f791406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7924009be0 tx=0x7f7924009210 comp rx=0 tx=0).stop 2023-05-12T09:07:11.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.548+0000 7f79397ff700 1 -- 172.21.15.116:0/2435646534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 msgr2=0x7f79340cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:11.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.548+0000 7f79397ff700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 0x7f79340cb230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7934072760 tx=0x7f792c004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:11.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.548+0000 7f79397ff700 1 -- 172.21.15.116:0/2435646534 shutdown_connections 2023-05-12T09:07:11.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.548+0000 7f79397ff700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7934160d40 0x7f79340cb230 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:11.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.548+0000 7f79397ff700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79340b87a0 0x7f793415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:11.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.548+0000 7f79397ff700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f791406ace0 0x7f791406d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:11.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.548+0000 7f79397ff700 1 --2- 172.21.15.116:0/2435646534 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79341601e0 0x7f79341f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:11.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.548+0000 7f79397ff700 1 -- 172.21.15.116:0/2435646534 >> 172.21.15.116:0/2435646534 conn(0x7f7934071b10 msgr2=0x7f7934160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:11.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.549+0000 7f79397ff700 1 -- 172.21.15.116:0/2435646534 shutdown_connections 2023-05-12T09:07:11.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.549+0000 7f79397ff700 1 -- 172.21.15.116:0/2435646534 wait complete. 2023-05-12T09:07:11.569 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-05-12T09:07:11.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.759+0000 7f94dc5ff700 1 Processor -- start 2023-05-12T09:07:11.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.759+0000 7f94dc5ff700 1 -- start start 2023-05-12T09:07:11.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.760+0000 7f94dc5ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f94d4089b20 0x7f94d416d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:11.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.760+0000 7f94dc5ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f94d4169770 0x7f94d4169b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:11.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.760+0000 7f94dc5ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d416a760 con 0x7f94d406a3e0 2023-05-12T09:07:11.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.760+0000 7f94dc5ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d416a1a0 con 0x7f94d4089b20 2023-05-12T09:07:11.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.760+0000 7f94dc5ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d416a480 con 0x7f94d4169770 2023-05-12T09:07:11.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.761+0000 7f94da39b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f94d406a3e0 0x7f94d406a7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48490/0 (socket says 172.21.15.116:48490) 2023-05-12T09:07:11.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.761+0000 7f94da39b700 1 -- 172.21.15.116:0/3936450935 learned_addr learned my addr 172.21.15.116:0/3936450935 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:11.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.761+0000 7f94d9b9a700 1 --2- 172.21.15.116:0/3936450935 >> v2:172.21.15.116:3300/0 conn(0x7f94d4089b20 0x7f94d416d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:11.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.761+0000 7f94d9399700 1 -- 172.21.15.116:0/3936450935 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117467433 0 0) 0x7f94d416a760 con 0x7f94d406a3e0 2023-05-12T09:07:11.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.761+0000 7f94dab9c700 1 --2- 172.21.15.116:0/3936450935 >> v2:172.21.15.182:3300/0 conn(0x7f94d4169770 0x7f94d4169b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:11.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.816+0000 7f94d9399700 1 -- 172.21.15.116:0/3936450935 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c0003590 con 0x7f94d406a3e0 2023-05-12T09:07:11.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.817+0000 7f94d9b9a700 1 -- 172.21.15.116:0/3936450935 >> v2:172.21.15.182:3300/0 conn(0x7f94d4169770 msgr2=0x7f94d4169b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:11.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.817+0000 7f94d9399700 1 -- 172.21.15.116:0/3936450935 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3697754611 0 0) 0x7f94c0003590 con 0x7f94d406a3e0 2023-05-12T09:07:11.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.817+0000 7f94d9b9a700 1 --2- 172.21.15.116:0/3936450935 >> v2:172.21.15.182:3300/0 conn(0x7f94d4169770 0x7f94d4169b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:11.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.817+0000 7f94d9b9a700 1 -- 172.21.15.116:0/3936450935 >> v1:172.21.15.116:6789/0 conn(0x7f94d406a3e0 legacy=0x7f94d406a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:11.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.817+0000 7f94d9b9a700 1 -- 172.21.15.116:0/3936450935 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d416ce60 con 0x7f94d4089b20 2023-05-12T09:07:11.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.817+0000 7f94d9b9a700 1 --2- 172.21.15.116:0/3936450935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 0x7f94d416d660 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f94d406b460 tx=0x7f94c400b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0da350aa850f7d server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:11.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.817+0000 7f94d9399700 1 -- 172.21.15.116:0/3936450935 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0001670 con 0x7f94d4089b20 2023-05-12T09:07:11.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.817+0000 7f94d9399700 1 -- 172.21.15.116:0/3936450935 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c4004030 con 0x7f94d4089b20 2023-05-12T09:07:11.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.817+0000 7f94d9399700 1 -- 172.21.15.116:0/3936450935 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40043a0 con 0x7f94d4089b20 2023-05-12T09:07:11.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.818+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3936450935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 msgr2=0x7f94d416d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:11.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.818+0000 7f94dc5ff700 1 --2- 172.21.15.116:0/3936450935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 0x7f94d416d660 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f94d406b460 tx=0x7f94c400b710 comp rx=0 tx=0).stop 2023-05-12T09:07:11.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.818+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3936450935 shutdown_connections 2023-05-12T09:07:11.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.818+0000 7f94dc5ff700 1 --2- 172.21.15.116:0/3936450935 >> v2:172.21.15.182:3300/0 conn(0x7f94d4169770 0x7f94d4169b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:11.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.818+0000 7f94dc5ff700 1 --2- 172.21.15.116:0/3936450935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 0x7f94d416d660 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:11.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.818+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3936450935 >> 172.21.15.116:0/3936450935 conn(0x7f94d40cf6e0 msgr2=0x7f94d40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:11.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.818+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3936450935 shutdown_connections 2023-05-12T09:07:11.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.818+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3936450935 wait complete. 2023-05-12T09:07:11.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.821+0000 7f94dc5ff700 1 Processor -- start 2023-05-12T09:07:11.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.821+0000 7f94dc5ff700 1 -- start start 2023-05-12T09:07:11.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.822+0000 7f94dc5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f94d406a3e0 0x7f94d4088b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:11.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.822+0000 7f94dc5ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 0x7f94d42024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:11.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.822+0000 7f94dc5ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94d4169770 0x7f94d41ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:11.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.822+0000 7f94dc5ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d406dfb0 con 0x7f94d4089b20 2023-05-12T09:07:11.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.822+0000 7f94dc5ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40aff10 con 0x7f94d4169770 2023-05-12T09:07:11.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.822+0000 7f94dc5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40af5e0 con 0x7f94d406a3e0 2023-05-12T09:07:11.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.822+0000 7f94d9b9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 0x7f94d42024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:11.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.822+0000 7f94d9b9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 0x7f94d42024d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35610/0 (socket says 172.21.15.116:35610) 2023-05-12T09:07:11.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.822+0000 7f94d9b9a700 1 -- 172.21.15.116:0/3265953557 learned_addr learned my addr 172.21.15.116:0/3265953557 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:11.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94da39b700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f94d406a3e0 0x7f94d4088b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:11.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94dab9c700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94d4169770 0x7f94d41ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:11.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94d9b9a700 1 -- 172.21.15.116:0/3265953557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f94d406a3e0 msgr2=0x7f94d4088b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:11.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94d9b9a700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f94d406a3e0 0x7f94d4088b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:11.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94d9b9a700 1 -- 172.21.15.116:0/3265953557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94d4169770 msgr2=0x7f94d41ff5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:11.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94d9b9a700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94d4169770 0x7f94d41ff5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:11.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94d9b9a700 1 -- 172.21.15.116:0/3265953557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4014c10 con 0x7f94d4089b20 2023-05-12T09:07:11.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94dab9c700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94d4169770 0x7f94d41ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:11.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94d9b9a700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 0x7f94d42024d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f94c40090b0 tx=0x7f94c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:11.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94caffd700 1 -- 172.21.15.116:0/3265953557 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c4003e80 con 0x7f94d4089b20 2023-05-12T09:07:11.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94caffd700 1 -- 172.21.15.116:0/3265953557 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c4026460 con 0x7f94d4089b20 2023-05-12T09:07:11.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3265953557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d416dba0 con 0x7f94d4089b20 2023-05-12T09:07:11.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.823+0000 7f94caffd700 1 -- 172.21.15.116:0/3265953557 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c4026810 con 0x7f94d4089b20 2023-05-12T09:07:11.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.824+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3265953557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d416d140 con 0x7f94d4089b20 2023-05-12T09:07:11.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.825+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3265953557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d416dd30 con 0x7f94d4089b20 2023-05-12T09:07:11.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.826+0000 7f94caffd700 1 -- 172.21.15.116:0/3265953557 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94c4026970 con 0x7f94d4089b20 2023-05-12T09:07:11.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.827+0000 7f94caffd700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f94b806ace0 0x7f94b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:11.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.827+0000 7f94caffd700 1 -- 172.21.15.116:0/3265953557 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f94c4093390 con 0x7f94d4089b20 2023-05-12T09:07:11.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.827+0000 7f94da39b700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f94b806ace0 0x7f94b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:11.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.828+0000 7f94da39b700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f94b806ace0 0x7f94b806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f94d00011e0 tx=0x7f94d0001550 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:11.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:11.831+0000 7f94caffd700 1 -- 172.21.15.116:0/3265953557 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f94c405e490 con 0x7f94d4089b20 2023-05-12T09:07:12.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:12.036+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3265953557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f94d40cdad0 con 0x7f94d4089b20 2023-05-12T09:07:13.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.554+0000 7f94caffd700 1 -- 172.21.15.116:0/3265953557 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f94c4061ab0 con 0x7f94d4089b20 2023-05-12T09:07:13.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.560+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3265953557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f94b806ace0 msgr2=0x7f94b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:13.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.560+0000 7f94dc5ff700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f94b806ace0 0x7f94b806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f94d00011e0 tx=0x7f94d0001550 comp rx=0 tx=0).stop 2023-05-12T09:07:13.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.560+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3265953557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 msgr2=0x7f94d42024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:13.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.560+0000 7f94dc5ff700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 0x7f94d42024d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f94c40090b0 tx=0x7f94c4004750 comp rx=0 tx=0).stop 2023-05-12T09:07:13.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.561+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3265953557 shutdown_connections 2023-05-12T09:07:13.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.561+0000 7f94dc5ff700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94d4169770 0x7f94d41ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:13.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.561+0000 7f94dc5ff700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f94b806ace0 0x7f94b806d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:13.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.561+0000 7f94dc5ff700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f94d406a3e0 0x7f94d4088b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:13.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.561+0000 7f94dc5ff700 1 --2- 172.21.15.116:0/3265953557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d4089b20 0x7f94d42024d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:13.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.561+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3265953557 >> 172.21.15.116:0/3265953557 conn(0x7f94d40cf6e0 msgr2=0x7f94d416c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:13.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.562+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3265953557 shutdown_connections 2023-05-12T09:07:13.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.562+0000 7f94dc5ff700 1 -- 172.21.15.116:0/3265953557 wait complete. 2023-05-12T09:07:13.572 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_data_ec' created 2023-05-12T09:07:13.590 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-05-12T09:07:13.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.779+0000 7f17f0fff700 1 Processor -- start 2023-05-12T09:07:13.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.780+0000 7f17f0fff700 1 -- start start 2023-05-12T09:07:13.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.781+0000 7f17f0fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec0b87a0 0x7f17ec0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:13.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.781+0000 7f17f0fff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec0cdc60 con 0x7f17ec1601e0 2023-05-12T09:07:13.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.781+0000 7f17f0fff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec0cd6a0 con 0x7f17ec160d40 2023-05-12T09:07:13.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.781+0000 7f17f0fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0d02d0 con 0x7f17ec0b87a0 2023-05-12T09:07:13.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.781+0000 7f17e3fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f17ec1601e0 0x7f17ec160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:43478/0 (socket says 172.21.15.116:43478) 2023-05-12T09:07:13.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.781+0000 7f17e3fff700 1 -- 172.21.15.116:0/1808517859 learned_addr learned my addr 172.21.15.116:0/1808517859 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:13.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.781+0000 7f17ea59c700 1 --2- 172.21.15.116:0/1808517859 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec0b87a0 0x7f17ec0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:13.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.781+0000 7f17e9d9b700 1 -- 172.21.15.116:0/1808517859 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893130131 0 0) 0x7f17ec0cdc60 con 0x7f17ec1601e0 2023-05-12T09:07:13.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.781+0000 7f17e9d9b700 1 -- 172.21.15.116:0/1808517859 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d80035b0 con 0x7f17ec1601e0 2023-05-12T09:07:13.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.782+0000 7f17e9d9b700 1 -- 172.21.15.116:0/1808517859 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149826541 0 0) 0x7f17ec0cd6a0 con 0x7f17ec160d40 2023-05-12T09:07:13.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.782+0000 7f17e9d9b700 1 -- 172.21.15.116:0/1808517859 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17ec0cdc60 con 0x7f17ec160d40 2023-05-12T09:07:13.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.782+0000 7f17e9d9b700 1 -- 172.21.15.116:0/1808517859 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 464765713 0 0) 0x7f17d80035b0 con 0x7f17ec1601e0 2023-05-12T09:07:13.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.782+0000 7f17ea59c700 1 -- 172.21.15.116:0/1808517859 >> v1:172.21.15.182:6789/0 conn(0x7f17ec160d40 legacy=0x7f17ec0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:13.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.782+0000 7f17ea59c700 1 -- 172.21.15.116:0/1808517859 >> v1:172.21.15.116:6789/0 conn(0x7f17ec1601e0 legacy=0x7f17ec160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:13.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.782+0000 7f17ea59c700 1 -- 172.21.15.116:0/1808517859 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec0cd980 con 0x7f17ec0b87a0 2023-05-12T09:07:13.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.782+0000 7f17ea59c700 1 --2- 172.21.15.116:0/1808517859 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec0b87a0 0x7f17ec0cfbf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009870 tx=0x7f17dc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfeca2dfd1c32aee server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:13.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.782+0000 7f17e9d9b700 1 -- 172.21.15.116:0/1808517859 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4001670 con 0x7f17ec0b87a0 2023-05-12T09:07:13.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.782+0000 7f17e9d9b700 1 -- 172.21.15.116:0/1808517859 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc004030 con 0x7f17ec0b87a0 2023-05-12T09:07:13.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.782+0000 7f17e9d9b700 1 -- 172.21.15.116:0/1808517859 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0043c0 con 0x7f17ec0b87a0 2023-05-12T09:07:13.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.783+0000 7f17f0fff700 1 -- 172.21.15.116:0/1808517859 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec0b87a0 msgr2=0x7f17ec0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:13.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.783+0000 7f17f0fff700 1 --2- 172.21.15.116:0/1808517859 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec0b87a0 0x7f17ec0cfbf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009870 tx=0x7f17dc009b80 comp rx=0 tx=0).stop 2023-05-12T09:07:13.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.783+0000 7f17f0fff700 1 -- 172.21.15.116:0/1808517859 shutdown_connections 2023-05-12T09:07:13.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.783+0000 7f17f0fff700 1 --2- 172.21.15.116:0/1808517859 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec0b87a0 0x7f17ec0cfbf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:13.789 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.783+0000 7f17f0fff700 1 -- 172.21.15.116:0/1808517859 >> 172.21.15.116:0/1808517859 conn(0x7f17ec071b10 msgr2=0x7f17ec071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:13.789 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.783+0000 7f17f0fff700 1 -- 172.21.15.116:0/1808517859 shutdown_connections 2023-05-12T09:07:13.789 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.783+0000 7f17f0fff700 1 -- 172.21.15.116:0/1808517859 wait complete. 2023-05-12T09:07:13.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.785+0000 7f17f0fff700 1 Processor -- start 2023-05-12T09:07:13.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.785+0000 7f17f0fff700 1 -- start start 2023-05-12T09:07:13.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17f0fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17ec0b87a0 0x7f17ec15a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:13.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17f0fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec1601e0 0x7f17ec0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:13.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17f0fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f17ec160d40 0x7f17ec1f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:13.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17f0fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0cb1e0 con 0x7f17ec0b87a0 2023-05-12T09:07:13.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17f0fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0ca960 con 0x7f17ec160d40 2023-05-12T09:07:13.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17f0fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0cac20 con 0x7f17ec1601e0 2023-05-12T09:07:13.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17ea59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17ec0b87a0 0x7f17ec15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:13.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17ea59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17ec0b87a0 0x7f17ec15a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42270/0 (socket says 172.21.15.116:42270) 2023-05-12T09:07:13.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17ea59c700 1 -- 172.21.15.116:0/2124104974 learned_addr learned my addr 172.21.15.116:0/2124104974 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:13.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17e3fff700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec1601e0 0x7f17ec0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:13.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17ead9d700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f17ec160d40 0x7f17ec1f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:13.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17ea59c700 1 -- 172.21.15.116:0/2124104974 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec1601e0 msgr2=0x7f17ec0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:13.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17ea59c700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec1601e0 0x7f17ec0c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:13.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17ea59c700 1 -- 172.21.15.116:0/2124104974 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f17ec160d40 msgr2=0x7f17ec1f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:13.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17ea59c700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f17ec160d40 0x7f17ec1f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:13.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.786+0000 7f17ea59c700 1 -- 172.21.15.116:0/2124104974 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc0094a0 con 0x7f17ec0b87a0 2023-05-12T09:07:13.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.787+0000 7f17ea59c700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17ec0b87a0 0x7f17ec15a220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0097c0 tx=0x7f17dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:13.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.787+0000 7f17e2ffd700 1 -- 172.21.15.116:0/2124104974 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc011830 con 0x7f17ec0b87a0 2023-05-12T09:07:13.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.787+0000 7f17e2ffd700 1 -- 172.21.15.116:0/2124104974 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc01f070 con 0x7f17ec0b87a0 2023-05-12T09:07:13.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.787+0000 7f17f0fff700 1 -- 172.21.15.116:0/2124104974 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec0d19a0 con 0x7f17ec0b87a0 2023-05-12T09:07:13.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.787+0000 7f17e2ffd700 1 -- 172.21.15.116:0/2124104974 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc011bd0 con 0x7f17ec0b87a0 2023-05-12T09:07:13.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.787+0000 7f17f0fff700 1 -- 172.21.15.116:0/2124104974 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec0d1810 con 0x7f17ec0b87a0 2023-05-12T09:07:13.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.788+0000 7f17f0fff700 1 -- 172.21.15.116:0/2124104974 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec0d1b30 con 0x7f17ec0b87a0 2023-05-12T09:07:13.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.789+0000 7f17e2ffd700 1 -- 172.21.15.116:0/2124104974 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17dc011d30 con 0x7f17ec0b87a0 2023-05-12T09:07:13.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.790+0000 7f17e2ffd700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f17cc06ace0 0x7f17cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:13.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.790+0000 7f17e2ffd700 1 -- 172.21.15.116:0/2124104974 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f17dc021070 con 0x7f17ec0b87a0 2023-05-12T09:07:13.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.790+0000 7f17e3fff700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f17cc06ace0 0x7f17cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:13.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.791+0000 7f17e3fff700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f17cc06ace0 0x7f17cc06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0b6b50 tx=0x7f17d4001c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:13.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.795+0000 7f17e2ffd700 1 -- 172.21.15.116:0/2124104974 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f17dc055ee0 con 0x7f17ec0b87a0 2023-05-12T09:07:13.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:13.988+0000 7f17f0fff700 1 -- 172.21.15.116:0/2124104974 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f17ec074430 con 0x7f17ec0b87a0 2023-05-12T09:07:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.561+0000 7f17e2ffd700 1 -- 172.21.15.116:0/2124104974 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f17dc059500 con 0x7f17ec0b87a0 2023-05-12T09:07:14.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.570+0000 7f17f0fff700 1 -- 172.21.15.116:0/2124104974 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f17cc06ace0 msgr2=0x7f17cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.570+0000 7f17f0fff700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f17cc06ace0 0x7f17cc06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0b6b50 tx=0x7f17d4001c00 comp rx=0 tx=0).stop 2023-05-12T09:07:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.570+0000 7f17f0fff700 1 -- 172.21.15.116:0/2124104974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17ec0b87a0 msgr2=0x7f17ec15a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.570+0000 7f17f0fff700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17ec0b87a0 0x7f17ec15a220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0097c0 tx=0x7f17dc004750 comp rx=0 tx=0).stop 2023-05-12T09:07:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.570+0000 7f17f0fff700 1 -- 172.21.15.116:0/2124104974 shutdown_connections 2023-05-12T09:07:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.570+0000 7f17f0fff700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f17ec160d40 0x7f17ec1f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.570+0000 7f17f0fff700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17ec0b87a0 0x7f17ec15a220 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0097c0 tx=0x7f17dc004750 comp rx=0 tx=0).stop 2023-05-12T09:07:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.570+0000 7f17f0fff700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f17cc06ace0 0x7f17cc06d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.570+0000 7f17f0fff700 1 --2- 172.21.15.116:0/2124104974 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f17ec1601e0 0x7f17ec0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.570+0000 7f17f0fff700 1 -- 172.21.15.116:0/2124104974 >> 172.21.15.116:0/2124104974 conn(0x7f17ec071b10 msgr2=0x7f17ec0b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.572+0000 7f17f0fff700 1 -- 172.21.15.116:0/2124104974 shutdown_connections 2023-05-12T09:07:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.572+0000 7f17f0fff700 1 -- 172.21.15.116:0/2124104974 wait complete. 2023-05-12T09:07:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:set pool 5 allow_ec_overwrites to true 2023-05-12T09:07:14.610 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-05-12T09:07:14.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.796+0000 7fc71dfff700 1 Processor -- start 2023-05-12T09:07:14.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.796+0000 7fc71dfff700 1 -- start start 2023-05-12T09:07:14.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.797+0000 7fc71dfff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc7180b87a0 0x7fc7180cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:14.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.797+0000 7fc71dfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 0x7fc718160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:14.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.797+0000 7fc71dfff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc718160ff0 con 0x7fc718160b70 2023-05-12T09:07:14.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.797+0000 7fc71dfff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7180d02d0 con 0x7fc7180b87a0 2023-05-12T09:07:14.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.797+0000 7fc71dfff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180d0cb0 con 0x7fc7181601e0 2023-05-12T09:07:14.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc716ffd700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 0x7fc718160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:14.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc7177fe700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc7180b87a0 0x7fc7180cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:14.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc717fff700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7fc718160b70 0x7fc7180d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:43906/0 (socket says 172.21.15.116:43906) 2023-05-12T09:07:14.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc7177fe700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc7180b87a0 0x7fc7180cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:49204/0 (socket says 172.21.15.116:49204) 2023-05-12T09:07:14.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc716ffd700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 0x7fc718160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:50136/0 (socket says 172.21.15.116:50136) 2023-05-12T09:07:14.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc717fff700 1 -- 172.21.15.116:0/4136106678 learned_addr learned my addr 172.21.15.116:0/4136106678 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:14.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc7177fe700 1 -- 172.21.15.116:0/4136106678 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 msgr2=0x7fc718160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:14.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc7177fe700 1 --2- 172.21.15.116:0/4136106678 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 0x7fc718160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:14.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc7177fe700 1 -- 172.21.15.116:0/4136106678 >> v1:172.21.15.182:6789/0 conn(0x7fc718160b70 legacy=0x7fc7180d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:14.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc7177fe700 1 -- 172.21.15.116:0/4136106678 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7180cdc60 con 0x7fc7180b87a0 2023-05-12T09:07:14.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc716ffd700 1 --2- 172.21.15.116:0/4136106678 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 0x7fc718160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:14.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.798+0000 7fc7177fe700 1 --2- 172.21.15.116:0/4136106678 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc7180b87a0 0x7fc7180cfbf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc708009840 tx=0x7fc708009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44fd3e0b07f4dd8b server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:14.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc7167fc700 1 -- 172.21.15.116:0/4136106678 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708011830 con 0x7fc7180b87a0 2023-05-12T09:07:14.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc7167fc700 1 -- 172.21.15.116:0/4136106678 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc708011990 con 0x7fc7180b87a0 2023-05-12T09:07:14.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc7167fc700 1 -- 172.21.15.116:0/4136106678 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708011d20 con 0x7fc7180b87a0 2023-05-12T09:07:14.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc71dfff700 1 -- 172.21.15.116:0/4136106678 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc7180b87a0 msgr2=0x7fc7180cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:14.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc71dfff700 1 --2- 172.21.15.116:0/4136106678 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc7180b87a0 0x7fc7180cfbf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc708009840 tx=0x7fc708009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:14.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc71dfff700 1 -- 172.21.15.116:0/4136106678 shutdown_connections 2023-05-12T09:07:14.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc71dfff700 1 --2- 172.21.15.116:0/4136106678 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc7180b87a0 0x7fc7180cfbf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:14.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc71dfff700 1 --2- 172.21.15.116:0/4136106678 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 0x7fc718160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:14.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc71dfff700 1 -- 172.21.15.116:0/4136106678 >> 172.21.15.116:0/4136106678 conn(0x7fc718071b10 msgr2=0x7fc718071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:14.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc71dfff700 1 -- 172.21.15.116:0/4136106678 shutdown_connections 2023-05-12T09:07:14.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.799+0000 7fc71dfff700 1 -- 172.21.15.116:0/4136106678 wait complete. 2023-05-12T09:07:14.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.801+0000 7fc71dfff700 1 Processor -- start 2023-05-12T09:07:14.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.801+0000 7fc71dfff700 1 -- start start 2023-05-12T09:07:14.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc71dfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7180b87a0 0x7fc71815b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:14.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc71dfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 0x7fc7181f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:14.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc71dfff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc718160b70 0x7fc718149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:14.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc71dfff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180cb400 con 0x7fc7180b87a0 2023-05-12T09:07:14.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc71dfff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180cbf40 con 0x7fc718160b70 2023-05-12T09:07:14.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc71dfff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180cb610 con 0x7fc7181601e0 2023-05-12T09:07:14.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc7177fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7180b87a0 0x7fc71815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:14.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc7177fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7180b87a0 0x7fc71815b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42284/0 (socket says 172.21.15.116:42284) 2023-05-12T09:07:14.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc7177fe700 1 -- 172.21.15.116:0/2090647047 learned_addr learned my addr 172.21.15.116:0/2090647047 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:14.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc716ffd700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 0x7fc7181f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:14.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.802+0000 7fc717fff700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc718160b70 0x7fc718149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:14.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc7177fe700 1 -- 172.21.15.116:0/2090647047 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 msgr2=0x7fc7181f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:14.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc7177fe700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 0x7fc7181f1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:14.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc7177fe700 1 -- 172.21.15.116:0/2090647047 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc718160b70 msgr2=0x7fc718149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:14.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc7177fe700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc718160b70 0x7fc718149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:14.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc7177fe700 1 -- 172.21.15.116:0/2090647047 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c0094a0 con 0x7fc7180b87a0 2023-05-12T09:07:14.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc7177fe700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7180b87a0 0x7fc71815b430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc708009fd0 tx=0x7fc708004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:14.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc6fffff700 1 -- 172.21.15.116:0/2090647047 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7080036a0 con 0x7fc7180b87a0 2023-05-12T09:07:14.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc6fffff700 1 -- 172.21.15.116:0/2090647047 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70801f070 con 0x7fc7180b87a0 2023-05-12T09:07:14.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc71dfff700 1 -- 172.21.15.116:0/2090647047 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7080094a0 con 0x7fc7180b87a0 2023-05-12T09:07:14.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc6fffff700 1 -- 172.21.15.116:0/2090647047 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708003a60 con 0x7fc7180b87a0 2023-05-12T09:07:14.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.803+0000 7fc71dfff700 1 -- 172.21.15.116:0/2090647047 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7180cd980 con 0x7fc7180b87a0 2023-05-12T09:07:14.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.805+0000 7fc71dfff700 1 -- 172.21.15.116:0/2090647047 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7180cd6a0 con 0x7fc7180b87a0 2023-05-12T09:07:14.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.805+0000 7fc6fffff700 1 -- 172.21.15.116:0/2090647047 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc708003bc0 con 0x7fc7180b87a0 2023-05-12T09:07:14.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.806+0000 7fc6fffff700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc70406ace0 0x7fc70406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:14.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.806+0000 7fc6fffff700 1 -- 172.21.15.116:0/2090647047 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fc708021070 con 0x7fc7180b87a0 2023-05-12T09:07:14.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.806+0000 7fc716ffd700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc70406ace0 0x7fc70406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:14.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.807+0000 7fc716ffd700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc70406ace0 0x7fc70406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7180b84d0 tx=0x7fc70c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:14.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:14.811+0000 7fc6fffff700 1 -- 172.21.15.116:0/2090647047 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc708055d10 con 0x7fc7180b87a0 2023-05-12T09:07:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.050+0000 7fc71dfff700 1 -- 172.21.15.116:0/2090647047 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fc7180d2110 con 0x7fc7180b87a0 2023-05-12T09:07:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.056+0000 7fc6fffff700 1 -- 172.21.15.116:0/2090647047 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fc7080150b0 con 0x7fc7180b87a0 2023-05-12T09:07:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.058+0000 7fc71dfff700 1 -- 172.21.15.116:0/2090647047 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc70406ace0 msgr2=0x7fc70406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc70406ace0 0x7fc70406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7180b84d0 tx=0x7fc70c009210 comp rx=0 tx=0).stop 2023-05-12T09:07:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 -- 172.21.15.116:0/2090647047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7180b87a0 msgr2=0x7fc71815b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7180b87a0 0x7fc71815b430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc708009fd0 tx=0x7fc708004750 comp rx=0 tx=0).stop 2023-05-12T09:07:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 -- 172.21.15.116:0/2090647047 shutdown_connections 2023-05-12T09:07:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc718160b70 0x7fc718149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7180b87a0 0x7fc71815b430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc70406ace0 0x7fc70406d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 --2- 172.21.15.116:0/2090647047 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7181601e0 0x7fc7181f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 -- 172.21.15.116:0/2090647047 >> 172.21.15.116:0/2090647047 conn(0x7fc718071b10 msgr2=0x7fc718071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 -- 172.21.15.116:0/2090647047 shutdown_connections 2023-05-12T09:07:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.059+0000 7fc71dfff700 1 -- 172.21.15.116:0/2090647047 wait complete. 2023-05-12T09:07:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:added data pool 5 to fsmap 2023-05-12T09:07:15.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:07:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.261+0000 7fcc719ff700 1 Processor -- start 2023-05-12T09:07:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.262+0000 7fcc719ff700 1 -- start start 2023-05-12T09:07:15.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc719ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fcc6c0cfbf0 0x7fcc6c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc719ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c0d1100 0x7fcc6c0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc719ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc6c0d0020 con 0x7fcc6c0b87a0 2023-05-12T09:07:15.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc719ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6c0d02d0 con 0x7fcc6c0cfbf0 2023-05-12T09:07:15.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc719ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0d0cb0 con 0x7fcc6c0d1100 2023-05-12T09:07:15.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc6affd700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fcc6c0b87a0 0x7fcc6c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:43484/0 (socket says 172.21.15.116:43484) 2023-05-12T09:07:15.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc6affd700 1 -- 172.21.15.116:0/970432034 learned_addr learned my addr 172.21.15.116:0/970432034 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139764089 0 0) 0x7fcc6c0d0020 con 0x7fcc6c0b87a0 2023-05-12T09:07:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc580035b0 con 0x7fcc6c0b87a0 2023-05-12T09:07:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc6b7fe700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c0d1100 0x7fcc6c0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.263+0000 7fcc63fff700 1 --2- 172.21.15.116:0/970432034 >> v2:172.21.15.182:3300/0 conn(0x7fcc6c0cfbf0 0x7fcc6c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 340034334 0 0) 0x7fcc580035b0 con 0x7fcc6c0b87a0 2023-05-12T09:07:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c0d1100 msgr2=0x7fcc6c0d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c0d1100 0x7fcc6c0d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 >> v2:172.21.15.182:3300/0 conn(0x7fcc6c0cfbf0 msgr2=0x7fcc6c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 --2- 172.21.15.116:0/970432034 >> v2:172.21.15.182:3300/0 conn(0x7fcc6c0cfbf0 0x7fcc6c1608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c0cdc60 con 0x7fcc6c0b87a0 2023-05-12T09:07:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7fcc5c001670 con 0x7fcc6c0b87a0 2023-05-12T09:07:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 >> v1:172.21.15.116:6789/0 conn(0x7fcc6c0b87a0 legacy=0x7fcc6c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcc58003a00 0x7fcc58003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 0x7fcc58004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c0d1100 0x7fcc58005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0d02d0 con 0x7fcc58004850 2023-05-12T09:07:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5800ba10 con 0x7fcc58003a00 2023-05-12T09:07:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5800bb50 con 0x7fcc6c0d1100 2023-05-12T09:07:15.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc63fff700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 0x7fcc58004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6affd700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcc58003a00 0x7fcc58003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc6b7fe700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c0d1100 0x7fcc58005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc63fff700 1 -- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c0d1100 msgr2=0x7fcc58005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:15.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc63fff700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c0d1100 0x7fcc58005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc63fff700 1 -- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcc58003a00 msgr2=0x7fcc58003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:15.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc63fff700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcc58003a00 0x7fcc58003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.264+0000 7fcc63fff700 1 -- 172.21.15.116:0/970432034 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc580035b0 con 0x7fcc58004850 2023-05-12T09:07:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.265+0000 7fcc63fff700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 0x7fcc58004cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009b90 tx=0x7fcc58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6c414b12b74fc4 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.265+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400e6c0 con 0x7fcc58004850 2023-05-12T09:07:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.265+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5400e820 con 0x7fcc58004850 2023-05-12T09:07:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.265+0000 7fcc6a7fc700 1 -- 172.21.15.116:0/970432034 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400eb90 con 0x7fcc58004850 2023-05-12T09:07:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.265+0000 7fcc719ff700 1 -- 172.21.15.116:0/970432034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 msgr2=0x7fcc58004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.265+0000 7fcc719ff700 1 --2- 172.21.15.116:0/970432034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 0x7fcc58004cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009b90 tx=0x7fcc58005880 comp rx=0 tx=0).stop 2023-05-12T09:07:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.265+0000 7fcc6b7fe700 1 -- 172.21.15.116:0/970432034 reap_dead start 2023-05-12T09:07:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.265+0000 7fcc719ff700 1 -- 172.21.15.116:0/970432034 shutdown_connections 2023-05-12T09:07:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.266+0000 7fcc719ff700 1 -- 172.21.15.116:0/970432034 >> 172.21.15.116:0/970432034 conn(0x7fcc6c071b10 msgr2=0x7fcc6c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.266+0000 7fcc719ff700 1 -- 172.21.15.116:0/970432034 shutdown_connections 2023-05-12T09:07:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.266+0000 7fcc719ff700 1 -- 172.21.15.116:0/970432034 wait complete. 2023-05-12T09:07:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.267+0000 7fcc719ff700 1 Processor -- start 2023-05-12T09:07:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.267+0000 7fcc719ff700 1 -- start start 2023-05-12T09:07:15.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.268+0000 7fcc719ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 0x7fcc6c0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.268+0000 7fcc719ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcc6c151240 0x7fcc6c15ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.268+0000 7fcc719ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c150a00 0x7fcc6c0d2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.268+0000 7fcc719ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c15da00 con 0x7fcc58004850 2023-05-12T09:07:15.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.268+0000 7fcc719ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0ca4c0 con 0x7fcc6c151240 2023-05-12T09:07:15.278 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.268+0000 7fcc719ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c15d720 con 0x7fcc6c150a00 2023-05-12T09:07:15.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc6affd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 0x7fcc6c0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc6affd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 0x7fcc6c0c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42310/0 (socket says 172.21.15.116:42310) 2023-05-12T09:07:15.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc6affd700 1 -- 172.21.15.116:0/1122661297 learned_addr learned my addr 172.21.15.116:0/1122661297 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:15.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc6affd700 1 -- 172.21.15.116:0/1122661297 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c150a00 msgr2=0x7fcc6c0d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc6affd700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c150a00 0x7fcc6c0d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc6affd700 1 -- 172.21.15.116:0/1122661297 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcc6c151240 msgr2=0x7fcc6c15ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.279 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc6affd700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcc6c151240 0x7fcc6c15ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc6affd700 1 -- 172.21.15.116:0/1122661297 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c0cd980 con 0x7fcc58004850 2023-05-12T09:07:15.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc6affd700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 0x7fcc6c0c9f80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c007060 tx=0x7fcc5c007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:15.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc68ff9700 1 -- 172.21.15.116:0/1122661297 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c011580 con 0x7fcc58004850 2023-05-12T09:07:15.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc68ff9700 1 -- 172.21.15.116:0/1122661297 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c011720 con 0x7fcc58004850 2023-05-12T09:07:15.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc719ff700 1 -- 172.21.15.116:0/1122661297 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c0cd6a0 con 0x7fcc58004850 2023-05-12T09:07:15.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.269+0000 7fcc68ff9700 1 -- 172.21.15.116:0/1122661297 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c011ad0 con 0x7fcc58004850 2023-05-12T09:07:15.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.270+0000 7fcc719ff700 1 -- 172.21.15.116:0/1122661297 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6c160e30 con 0x7fcc58004850 2023-05-12T09:07:15.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.270+0000 7fcc719ff700 1 -- 172.21.15.116:0/1122661297 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6c0b52f0 con 0x7fcc58004850 2023-05-12T09:07:15.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.271+0000 7fcc68ff9700 1 -- 172.21.15.116:0/1122661297 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc5c011c30 con 0x7fcc58004850 2023-05-12T09:07:15.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.272+0000 7fcc68ff9700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fcc4c06ace0 0x7fcc4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.282 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.272+0000 7fcc68ff9700 1 -- 172.21.15.116:0/1122661297 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc5c089700 con 0x7fcc58004850 2023-05-12T09:07:15.282 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.273+0000 7fcc63fff700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fcc4c06ace0 0x7fcc4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.282 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.273+0000 7fcc63fff700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fcc4c06ace0 0x7fcc4c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0cc940 tx=0x7fcc54013000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:15.282 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.276+0000 7fcc68ff9700 1 -- 172.21.15.116:0/1122661297 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fcc5c054420 con 0x7fcc58004850 2023-05-12T09:07:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.515+0000 7fcc719ff700 1 -- 172.21.15.116:0/1122661297 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc6c0b8180 con 0x7fcc58004850 2023-05-12T09:07:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.515+0000 7fcc68ff9700 1 -- 172.21.15.116:0/1122661297 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4676 (secure 0 0 0) 0x7fcc5c057a40 con 0x7fcc58004850 2023-05-12T09:07:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:15.519 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:07:10.529423+0000","modified":"2023-05-12T09:07:15.052409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-12T09:07:15.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 -- 172.21.15.116:0/1122661297 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fcc4c06ace0 msgr2=0x7fcc4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fcc4c06ace0 0x7fcc4c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0cc940 tx=0x7fcc54013000 comp rx=0 tx=0).stop 2023-05-12T09:07:15.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 -- 172.21.15.116:0/1122661297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 msgr2=0x7fcc6c0c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 0x7fcc6c0c9f80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c007060 tx=0x7fcc5c007420 comp rx=0 tx=0).stop 2023-05-12T09:07:15.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 -- 172.21.15.116:0/1122661297 shutdown_connections 2023-05-12T09:07:15.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fcc4c06ace0 0x7fcc4c06d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fcc6c150a00 0x7fcc6c0d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc58004850 0x7fcc6c0c9f80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 --2- 172.21.15.116:0/1122661297 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fcc6c151240 0x7fcc6c15ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 -- 172.21.15.116:0/1122661297 >> 172.21.15.116:0/1122661297 conn(0x7fcc6c071b10 msgr2=0x7fcc6c0ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:15.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 -- 172.21.15.116:0/1122661297 shutdown_connections 2023-05-12T09:07:15.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.518+0000 7fcc719ff700 1 -- 172.21.15.116:0/1122661297 wait complete. 2023-05-12T09:07:15.523 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 7 2023-05-12T09:07:15.538 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:15.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.720+0000 7f00ea7ff700 1 Processor -- start 2023-05-12T09:07:15.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.720+0000 7f00ea7ff700 1 -- start start 2023-05-12T09:07:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.721+0000 7f00ea7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40d2110 0x7f00e4167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.721+0000 7f00ea7ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e4161000 con 0x7f00e40b87a0 2023-05-12T09:07:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.721+0000 7f00ea7ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e40d0020 con 0x7f00e40cfbf0 2023-05-12T09:07:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.721+0000 7f00ea7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40d02d0 con 0x7f00e40d2110 2023-05-12T09:07:15.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.721+0000 7f00e3fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f00e40b87a0 0x7f00e41601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:43490/0 (socket says 172.21.15.116:43490) 2023-05-12T09:07:15.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.721+0000 7f00e3fff700 1 -- 172.21.15.116:0/2131498400 learned_addr learned my addr 172.21.15.116:0/2131498400 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:15.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.721+0000 7f00e8d9c700 1 --2- 172.21.15.116:0/2131498400 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40d2110 0x7f00e4167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.722+0000 7f00e2ffd700 1 -- 172.21.15.116:0/2131498400 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49543905 0 0) 0x7f00e4161000 con 0x7f00e40b87a0 2023-05-12T09:07:15.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.722+0000 7f00e2ffd700 1 -- 172.21.15.116:0/2131498400 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00cc0035b0 con 0x7f00e40b87a0 2023-05-12T09:07:15.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.722+0000 7f00e2ffd700 1 -- 172.21.15.116:0/2131498400 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950936792 0 0) 0x7f00e40d0020 con 0x7f00e40cfbf0 2023-05-12T09:07:15.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.722+0000 7f00e2ffd700 1 -- 172.21.15.116:0/2131498400 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e4161000 con 0x7f00e40cfbf0 2023-05-12T09:07:15.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.722+0000 7f00e8d9c700 1 -- 172.21.15.116:0/2131498400 >> v1:172.21.15.182:6789/0 conn(0x7f00e40cfbf0 legacy=0x7f00e41608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.722+0000 7f00e8d9c700 1 -- 172.21.15.116:0/2131498400 >> v1:172.21.15.116:6789/0 conn(0x7f00e40b87a0 legacy=0x7f00e41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.722+0000 7f00e8d9c700 1 -- 172.21.15.116:0/2131498400 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e40cdc60 con 0x7f00e40d2110 2023-05-12T09:07:15.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.722+0000 7f00e8d9c700 1 --2- 172.21.15.116:0/2131498400 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40d2110 0x7f00e4167550 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009dc0 tx=0x7f00dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b42763c23b7e313 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:15.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.722+0000 7f00e2ffd700 1 -- 172.21.15.116:0/2131498400 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00e070 con 0x7f00e40d2110 2023-05-12T09:07:15.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.723+0000 7f00e2ffd700 1 -- 172.21.15.116:0/2131498400 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc00bb20 con 0x7f00e40d2110 2023-05-12T09:07:15.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.723+0000 7f00e2ffd700 1 -- 172.21.15.116:0/2131498400 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00be90 con 0x7f00e40d2110 2023-05-12T09:07:15.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.723+0000 7f00ea7ff700 1 -- 172.21.15.116:0/2131498400 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40d2110 msgr2=0x7f00e4167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.723+0000 7f00ea7ff700 1 --2- 172.21.15.116:0/2131498400 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40d2110 0x7f00e4167550 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009dc0 tx=0x7f00dc00b330 comp rx=0 tx=0).stop 2023-05-12T09:07:15.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.723+0000 7f00ea7ff700 1 -- 172.21.15.116:0/2131498400 shutdown_connections 2023-05-12T09:07:15.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.723+0000 7f00ea7ff700 1 --2- 172.21.15.116:0/2131498400 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40d2110 0x7f00e4167550 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.723+0000 7f00ea7ff700 1 -- 172.21.15.116:0/2131498400 >> 172.21.15.116:0/2131498400 conn(0x7f00e4071b10 msgr2=0x7f00e4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:15.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.723+0000 7f00ea7ff700 1 -- 172.21.15.116:0/2131498400 shutdown_connections 2023-05-12T09:07:15.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.723+0000 7f00ea7ff700 1 -- 172.21.15.116:0/2131498400 wait complete. 2023-05-12T09:07:15.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.725+0000 7f00ea7ff700 1 Processor -- start 2023-05-12T09:07:15.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.725+0000 7f00ea7ff700 1 -- start start 2023-05-12T09:07:15.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00ea7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40b87a0 0x7f00e40cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00ea7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00e40cfbf0 0x7f00e41578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00ea7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00e40d2110 0x7f00e4157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00ea7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40cc190 con 0x7f00e40cfbf0 2023-05-12T09:07:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00ea7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40c9f80 con 0x7f00e40d2110 2023-05-12T09:07:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00ea7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40ca260 con 0x7f00e40b87a0 2023-05-12T09:07:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00e37fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00e40cfbf0 0x7f00e41578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00e37fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00e40cfbf0 0x7f00e41578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42312/0 (socket says 172.21.15.116:42312) 2023-05-12T09:07:15.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00e37fe700 1 -- 172.21.15.116:0/3675897800 learned_addr learned my addr 172.21.15.116:0/3675897800 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:15.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00e3fff700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40b87a0 0x7f00e40cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00e8d9c700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00e40d2110 0x7f00e4157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00e37fe700 1 -- 172.21.15.116:0/3675897800 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40b87a0 msgr2=0x7f00e40cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00e37fe700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40b87a0 0x7f00e40cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00e37fe700 1 -- 172.21.15.116:0/3675897800 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00e40d2110 msgr2=0x7f00e4157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00e37fe700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00e40d2110 0x7f00e4157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.726+0000 7f00e37fe700 1 -- 172.21.15.116:0/3675897800 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc009a70 con 0x7f00e40cfbf0 2023-05-12T09:07:15.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.727+0000 7f00e37fe700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00e40cfbf0 0x7f00e41578e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c520 tx=0x7f00d800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:15.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.727+0000 7f00e0ff9700 1 -- 172.21.15.116:0/3675897800 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80052d0 con 0x7f00e40cfbf0 2023-05-12T09:07:15.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.727+0000 7f00e0ff9700 1 -- 172.21.15.116:0/3675897800 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d8005430 con 0x7f00e40cfbf0 2023-05-12T09:07:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.727+0000 7f00ea7ff700 1 -- 172.21.15.116:0/3675897800 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e40cd980 con 0x7f00e40cfbf0 2023-05-12T09:07:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.727+0000 7f00e0ff9700 1 -- 172.21.15.116:0/3675897800 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80038c0 con 0x7f00e40cfbf0 2023-05-12T09:07:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.727+0000 7f00ea7ff700 1 -- 172.21.15.116:0/3675897800 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e40cd6a0 con 0x7f00e40cfbf0 2023-05-12T09:07:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.728+0000 7f00ea7ff700 1 -- 172.21.15.116:0/3675897800 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e4167a90 con 0x7f00e40cfbf0 2023-05-12T09:07:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.729+0000 7f00e0ff9700 1 -- 172.21.15.116:0/3675897800 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00d8003a20 con 0x7f00e40cfbf0 2023-05-12T09:07:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.730+0000 7f00e0ff9700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00d006ace0 0x7f00d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.730+0000 7f00e0ff9700 1 -- 172.21.15.116:0/3675897800 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00d8088c00 con 0x7f00e40cfbf0 2023-05-12T09:07:15.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.730+0000 7f00e3fff700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00d006ace0 0x7f00d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:15.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.730+0000 7f00e3fff700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00d006ace0 0x7f00d006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f00d4007fd0 tx=0x7f00d4007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:15.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.734+0000 7f00e0ff9700 1 -- 172.21.15.116:0/3675897800 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f00d80539b0 con 0x7f00e40cfbf0 2023-05-12T09:07:15.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.929+0000 7f00ea7ff700 1 -- 172.21.15.116:0/3675897800 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00e40cc2d0 con 0x7f00e40cfbf0 2023-05-12T09:07:15.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.931+0000 7f00e0ff9700 1 -- 172.21.15.116:0/3675897800 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7f00d8056fd0 con 0x7f00e40cfbf0 2023-05-12T09:07:15.934 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:15.934 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:15.936 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 -- 172.21.15.116:0/3675897800 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00d006ace0 msgr2=0x7f00d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.936 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00d006ace0 0x7f00d006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f00d4007fd0 tx=0x7f00d4007dc0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 -- 172.21.15.116:0/3675897800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00e40cfbf0 msgr2=0x7f00e41578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:15.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00e40cfbf0 0x7f00e41578e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c520 tx=0x7f00d800c830 comp rx=0 tx=0).stop 2023-05-12T09:07:15.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 -- 172.21.15.116:0/3675897800 shutdown_connections 2023-05-12T09:07:15.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00e40d2110 0x7f00e4157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00d006ace0 0x7f00d006d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00e40b87a0 0x7f00e40cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 --2- 172.21.15.116:0/3675897800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00e40cfbf0 0x7f00e41578e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:15.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 -- 172.21.15.116:0/3675897800 >> 172.21.15.116:0/3675897800 conn(0x7f00e4071b10 msgr2=0x7f00e40b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:15.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 -- 172.21.15.116:0/3675897800 shutdown_connections 2023-05-12T09:07:15.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:15.933+0000 7f00ea7ff700 1 -- 172.21.15.116:0/3675897800 wait complete. 2023-05-12T09:07:15.954 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:16.038 INFO:tasks.ceph.mds.b.smithi182.stderr:2023-05-12T09:07:16.035+0000 7f5521ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-12T09:07:16.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.134+0000 7fdecafff700 1 Processor -- start 2023-05-12T09:07:16.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.134+0000 7fdecafff700 1 -- start start 2023-05-12T09:07:16.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.135+0000 7fdecafff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdec40b87a0 0x7fdec40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.135+0000 7fdecafff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdec4160d40 0x7fdec40d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.135+0000 7fdecafff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec40cdc60 con 0x7fdec41601e0 2023-05-12T09:07:16.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.135+0000 7fdecafff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec40d02d0 con 0x7fdec4160d40 2023-05-12T09:07:16.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.135+0000 7fdecafff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40d0cb0 con 0x7fdec40b87a0 2023-05-12T09:07:16.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.135+0000 7fdec959c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdec4160d40 0x7fdec40d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.135+0000 7fdec959c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdec4160d40 0x7fdec40d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42322/0 (socket says 172.21.15.116:42322) 2023-05-12T09:07:16.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.135+0000 7fdec959c700 1 -- 172.21.15.116:0/2700498593 learned_addr learned my addr 172.21.15.116:0/2700498593 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:16.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.135+0000 7fdec8d9b700 1 --2- 172.21.15.116:0/2700498593 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdec40b87a0 0x7fdec40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.136+0000 7fdec959c700 1 -- 172.21.15.116:0/2700498593 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdec40b87a0 msgr2=0x7fdec40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:16.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.136+0000 7fdec959c700 1 --2- 172.21.15.116:0/2700498593 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdec40b87a0 0x7fdec40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.136+0000 7fdec959c700 1 -- 172.21.15.116:0/2700498593 >> v1:172.21.15.182:6789/0 conn(0x7fdec41601e0 legacy=0x7fdec4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.136+0000 7fdec959c700 1 -- 172.21.15.116:0/2700498593 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40cd6a0 con 0x7fdec4160d40 2023-05-12T09:07:16.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.136+0000 7fdec959c700 1 --2- 172.21.15.116:0/2700498593 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 0x7fdec40d1100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009e50 tx=0x7fdebc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a1a67cf0ef8f10 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:16.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.136+0000 7fdec37fe700 1 -- 172.21.15.116:0/2700498593 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc00e070 con 0x7fdec4160d40 2023-05-12T09:07:16.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.136+0000 7fdec37fe700 1 -- 172.21.15.116:0/2700498593 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc00b910 con 0x7fdec4160d40 2023-05-12T09:07:16.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.136+0000 7fdec37fe700 1 -- 172.21.15.116:0/2700498593 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc00bcc0 con 0x7fdec4160d40 2023-05-12T09:07:16.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.137+0000 7fdecafff700 1 -- 172.21.15.116:0/2700498593 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 msgr2=0x7fdec40d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.137+0000 7fdecafff700 1 --2- 172.21.15.116:0/2700498593 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 0x7fdec40d1100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009e50 tx=0x7fdebc00b330 comp rx=0 tx=0).stop 2023-05-12T09:07:16.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.137+0000 7fdecafff700 1 -- 172.21.15.116:0/2700498593 shutdown_connections 2023-05-12T09:07:16.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.137+0000 7fdecafff700 1 --2- 172.21.15.116:0/2700498593 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 0x7fdec40d1100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.137+0000 7fdecafff700 1 --2- 172.21.15.116:0/2700498593 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdec40b87a0 0x7fdec40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.137+0000 7fdecafff700 1 -- 172.21.15.116:0/2700498593 >> 172.21.15.116:0/2700498593 conn(0x7fdec4071b10 msgr2=0x7fdec4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:16.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.137+0000 7fdecafff700 1 -- 172.21.15.116:0/2700498593 shutdown_connections 2023-05-12T09:07:16.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.137+0000 7fdecafff700 1 -- 172.21.15.116:0/2700498593 wait complete. 2023-05-12T09:07:16.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.138+0000 7fdecafff700 1 Processor -- start 2023-05-12T09:07:16.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.139+0000 7fdecafff700 1 -- start start 2023-05-12T09:07:16.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.139+0000 7fdecafff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdec40b87a0 0x7fdec4151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.139+0000 7fdecafff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdec41601e0 0x7fdec4159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.139+0000 7fdecafff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 0x7fdec415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdecafff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40c7990 con 0x7fdec4160d40 2023-05-12T09:07:16.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdecafff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40c7c70 con 0x7fdec41601e0 2023-05-12T09:07:16.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdecafff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40c7f50 con 0x7fdec40b87a0 2023-05-12T09:07:16.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec959c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 0x7fdec415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec959c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 0x7fdec415a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42332/0 (socket says 172.21.15.116:42332) 2023-05-12T09:07:16.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec959c700 1 -- 172.21.15.116:0/1970030565 learned_addr learned my addr 172.21.15.116:0/1970030565 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:16.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec8d9b700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdec40b87a0 0x7fdec4151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec3fff700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdec41601e0 0x7fdec4159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec959c700 1 -- 172.21.15.116:0/1970030565 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdec40b87a0 msgr2=0x7fdec4151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec959c700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdec40b87a0 0x7fdec4151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec959c700 1 -- 172.21.15.116:0/1970030565 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdec41601e0 msgr2=0x7fdec4159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec959c700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdec41601e0 0x7fdec4159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec959c700 1 -- 172.21.15.116:0/1970030565 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc009b30 con 0x7fdec4160d40 2023-05-12T09:07:16.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.140+0000 7fdec959c700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 0x7fdec415a3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdec4072760 tx=0x7fdebc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:16.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.141+0000 7fdec17fa700 1 -- 172.21.15.116:0/1970030565 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc004800 con 0x7fdec4160d40 2023-05-12T09:07:16.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.141+0000 7fdec17fa700 1 -- 172.21.15.116:0/1970030565 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc004960 con 0x7fdec4160d40 2023-05-12T09:07:16.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.141+0000 7fdecafff700 1 -- 172.21.15.116:0/1970030565 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec40d1640 con 0x7fdec4160d40 2023-05-12T09:07:16.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.141+0000 7fdec17fa700 1 -- 172.21.15.116:0/1970030565 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc01b670 con 0x7fdec4160d40 2023-05-12T09:07:16.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.141+0000 7fdecafff700 1 -- 172.21.15.116:0/1970030565 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec40cd980 con 0x7fdec4160d40 2023-05-12T09:07:16.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.142+0000 7fdecafff700 1 -- 172.21.15.116:0/1970030565 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec40d17d0 con 0x7fdec4160d40 2023-05-12T09:07:16.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.142+0000 7fdec17fa700 1 -- 172.21.15.116:0/1970030565 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdebc01b7d0 con 0x7fdec4160d40 2023-05-12T09:07:16.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.144+0000 7fdec17fa700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdea806ace0 0x7fdea806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.144+0000 7fdec17fa700 1 -- 172.21.15.116:0/1970030565 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdebc08af90 con 0x7fdec4160d40 2023-05-12T09:07:16.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.144+0000 7fdec8d9b700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdea806ace0 0x7fdea806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.144+0000 7fdec8d9b700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdea806ace0 0x7fdea806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdec40b1ce0 tx=0x7fdeb8009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:16.151 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.148+0000 7fdec17fa700 1 -- 172.21.15.116:0/1970030565 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdebc055d40 con 0x7fdec4160d40 2023-05-12T09:07:16.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.343+0000 7fdecafff700 1 -- 172.21.15.116:0/1970030565 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdec4074430 con 0x7fdec4160d40 2023-05-12T09:07:16.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.344+0000 7fdec17fa700 1 -- 172.21.15.116:0/1970030565 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7fdebc059360 con 0x7fdec4160d40 2023-05-12T09:07:16.348 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:16.349 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:16.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 -- 172.21.15.116:0/1970030565 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdea806ace0 msgr2=0x7fdea806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdea806ace0 0x7fdea806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdec40b1ce0 tx=0x7fdeb8009210 comp rx=0 tx=0).stop 2023-05-12T09:07:16.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 -- 172.21.15.116:0/1970030565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 msgr2=0x7fdec415a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 0x7fdec415a3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdec4072760 tx=0x7fdebc004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 -- 172.21.15.116:0/1970030565 shutdown_connections 2023-05-12T09:07:16.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdec4160d40 0x7fdec415a3e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdea806ace0 0x7fdea806d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdec40b87a0 0x7fdec4151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 --2- 172.21.15.116:0/1970030565 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdec41601e0 0x7fdec4159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 -- 172.21.15.116:0/1970030565 >> 172.21.15.116:0/1970030565 conn(0x7fdec4071b10 msgr2=0x7fdec4071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:16.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 -- 172.21.15.116:0/1970030565 shutdown_connections 2023-05-12T09:07:16.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.347+0000 7fdecafff700 1 -- 172.21.15.116:0/1970030565 wait complete. 2023-05-12T09:07:16.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:07:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.562+0000 7ff7273ff700 1 Processor -- start 2023-05-12T09:07:16.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.562+0000 7ff7273ff700 1 -- start start 2023-05-12T09:07:16.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.564+0000 7ff7273ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7ff7200cd760 0x7ff7200cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.564+0000 7ff7273ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff72015cf10 0x7ff72006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.564+0000 7ff7273ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7200cc9e0 con 0x7ff7200adf70 2023-05-12T09:07:16.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.564+0000 7ff7273ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7200cd580 con 0x7ff7200cd760 2023-05-12T09:07:16.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.564+0000 7ff7273ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72015de20 con 0x7ff72015cf10 2023-05-12T09:07:16.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.564+0000 7ff72499a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff7200adf70 0x7ff7200cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:43492/0 (socket says 172.21.15.116:43492) 2023-05-12T09:07:16.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.564+0000 7ff72499a700 1 -- 172.21.15.116:0/283747561 learned_addr learned my addr 172.21.15.116:0/283747561 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:16.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.564+0000 7ff72599c700 1 --2- 172.21.15.116:0/283747561 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff72015cf10 0x7ff72006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.564+0000 7ff72519b700 1 --2- 172.21.15.116:0/283747561 >> v2:172.21.15.182:3300/0 conn(0x7ff7200cd760 0x7ff7200cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.565+0000 7ff72599c700 1 -- 172.21.15.116:0/283747561 >> v2:172.21.15.182:3300/0 conn(0x7ff7200cd760 msgr2=0x7ff7200cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:16.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.565+0000 7ff72599c700 1 --2- 172.21.15.116:0/283747561 >> v2:172.21.15.182:3300/0 conn(0x7ff7200cd760 0x7ff7200cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.565+0000 7ff72599c700 1 -- 172.21.15.116:0/283747561 >> v1:172.21.15.116:6789/0 conn(0x7ff7200adf70 legacy=0x7ff7200cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.565+0000 7ff72599c700 1 -- 172.21.15.116:0/283747561 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7200ce070 con 0x7ff72015cf10 2023-05-12T09:07:16.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.565+0000 7ff72599c700 1 --2- 172.21.15.116:0/283747561 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff72015cf10 0x7ff72006c6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff718009d90 tx=0x7ff71800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c7b1b633a9a3421 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:16.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.567+0000 7ff717fff700 1 -- 172.21.15.116:0/283747561 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71800e070 con 0x7ff72015cf10 2023-05-12T09:07:16.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.567+0000 7ff717fff700 1 -- 172.21.15.116:0/283747561 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71800bb20 con 0x7ff72015cf10 2023-05-12T09:07:16.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.567+0000 7ff717fff700 1 -- 172.21.15.116:0/283747561 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718012430 con 0x7ff72015cf10 2023-05-12T09:07:16.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.567+0000 7ff7273ff700 1 -- 172.21.15.116:0/283747561 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff72015cf10 msgr2=0x7ff72006c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.568+0000 7ff7273ff700 1 --2- 172.21.15.116:0/283747561 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff72015cf10 0x7ff72006c6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff718009d90 tx=0x7ff71800b330 comp rx=0 tx=0).stop 2023-05-12T09:07:16.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.568+0000 7ff7273ff700 1 -- 172.21.15.116:0/283747561 shutdown_connections 2023-05-12T09:07:16.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.568+0000 7ff7273ff700 1 --2- 172.21.15.116:0/283747561 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff72015cf10 0x7ff72006c6c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.568+0000 7ff7273ff700 1 --2- 172.21.15.116:0/283747561 >> v2:172.21.15.182:3300/0 conn(0x7ff7200cd760 0x7ff7200cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.568+0000 7ff7273ff700 1 -- 172.21.15.116:0/283747561 >> 172.21.15.116:0/283747561 conn(0x7ff7200cf720 msgr2=0x7ff7200cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:16.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.568+0000 7ff7273ff700 1 -- 172.21.15.116:0/283747561 shutdown_connections 2023-05-12T09:07:16.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.568+0000 7ff7273ff700 1 -- 172.21.15.116:0/283747561 wait complete. 2023-05-12T09:07:16.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.569+0000 7ff7273ff700 1 Processor -- start 2023-05-12T09:07:16.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.570+0000 7ff7273ff700 1 -- start start 2023-05-12T09:07:16.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.570+0000 7ff7273ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7200adf70 0x7ff7201537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.570+0000 7ff7273ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7200cd760 0x7ff720146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.570+0000 7ff7273ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff72015cf10 0x7ff7200aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.570+0000 7ff7273ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff720147030 con 0x7ff7200adf70 2023-05-12T09:07:16.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.570+0000 7ff7273ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200b0450 con 0x7ff72015cf10 2023-05-12T09:07:16.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.570+0000 7ff7273ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200b0700 con 0x7ff7200cd760 2023-05-12T09:07:16.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72519b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7200adf70 0x7ff7201537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72519b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7200adf70 0x7ff7201537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42334/0 (socket says 172.21.15.116:42334) 2023-05-12T09:07:16.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72519b700 1 -- 172.21.15.116:0/968540790 learned_addr learned my addr 172.21.15.116:0/968540790 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:16.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72499a700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7200cd760 0x7ff720146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72599c700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff72015cf10 0x7ff7200aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72519b700 1 -- 172.21.15.116:0/968540790 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7200cd760 msgr2=0x7ff720146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72519b700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7200cd760 0x7ff720146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72519b700 1 -- 172.21.15.116:0/968540790 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff72015cf10 msgr2=0x7ff7200aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72519b700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff72015cf10 0x7ff7200aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72519b700 1 -- 172.21.15.116:0/968540790 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718009a70 con 0x7ff7200adf70 2023-05-12T09:07:16.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff72519b700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7200adf70 0x7ff7201537f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00e9b0 tx=0x7ff71c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:16.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff715ffb700 1 -- 172.21.15.116:0/968540790 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c009710 con 0x7ff7200adf70 2023-05-12T09:07:16.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.571+0000 7ff715ffb700 1 -- 172.21.15.116:0/968540790 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c00c850 con 0x7ff7200adf70 2023-05-12T09:07:16.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.572+0000 7ff7273ff700 1 -- 172.21.15.116:0/968540790 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72015db40 con 0x7ff7200adf70 2023-05-12T09:07:16.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.572+0000 7ff715ffb700 1 -- 172.21.15.116:0/968540790 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00cbc0 con 0x7ff7200adf70 2023-05-12T09:07:16.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.572+0000 7ff7273ff700 1 -- 172.21.15.116:0/968540790 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72015d860 con 0x7ff7200adf70 2023-05-12T09:07:16.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.573+0000 7ff7273ff700 1 -- 172.21.15.116:0/968540790 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7200cc670 con 0x7ff7200adf70 2023-05-12T09:07:16.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.574+0000 7ff715ffb700 1 -- 172.21.15.116:0/968540790 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff71c00cd20 con 0x7ff7200adf70 2023-05-12T09:07:16.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.574+0000 7ff715ffb700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff70406ace0 0x7ff70406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:16.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.575+0000 7ff715ffb700 1 -- 172.21.15.116:0/968540790 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff71c089880 con 0x7ff7200adf70 2023-05-12T09:07:16.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.575+0000 7ff72499a700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff70406ace0 0x7ff70406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:16.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.575+0000 7ff72499a700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff70406ace0 0x7ff70406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff72014ac90 tx=0x7ff710009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:16.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.579+0000 7ff715ffb700 1 -- 172.21.15.116:0/968540790 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff71c0580d0 con 0x7ff7200adf70 2023-05-12T09:07:16.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.813+0000 7ff7273ff700 1 -- 172.21.15.116:0/968540790 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff720164080 con 0x7ff7200adf70 2023-05-12T09:07:16.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.813+0000 7ff715ffb700 1 -- 172.21.15.116:0/968540790 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4676 (secure 0 0 0) 0x7ff71c057c60 con 0x7ff7200adf70 2023-05-12T09:07:16.817 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:16.818 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:07:10.529423+0000","modified":"2023-05-12T09:07:15.052409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-12T09:07:16.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.815+0000 7ff7273ff700 1 -- 172.21.15.116:0/968540790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff70406ace0 msgr2=0x7ff70406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.815+0000 7ff7273ff700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff70406ace0 0x7ff70406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff72014ac90 tx=0x7ff710009040 comp rx=0 tx=0).stop 2023-05-12T09:07:16.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.815+0000 7ff7273ff700 1 -- 172.21.15.116:0/968540790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7200adf70 msgr2=0x7ff7201537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:16.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.815+0000 7ff7273ff700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7200adf70 0x7ff7201537f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00e9b0 tx=0x7ff71c00ed70 comp rx=0 tx=0).stop 2023-05-12T09:07:16.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.815+0000 7ff7273ff700 1 -- 172.21.15.116:0/968540790 shutdown_connections 2023-05-12T09:07:16.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.815+0000 7ff7273ff700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff72015cf10 0x7ff7200aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.815+0000 7ff7273ff700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7200adf70 0x7ff7201537f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.815+0000 7ff7273ff700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff70406ace0 0x7ff70406d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.815+0000 7ff7273ff700 1 --2- 172.21.15.116:0/968540790 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7200cd760 0x7ff720146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:16.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.815+0000 7ff7273ff700 1 -- 172.21.15.116:0/968540790 >> 172.21.15.116:0/968540790 conn(0x7ff7200cf720 msgr2=0x7ff720159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:16.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.816+0000 7ff7273ff700 1 -- 172.21.15.116:0/968540790 shutdown_connections 2023-05-12T09:07:16.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:16.816+0000 7ff7273ff700 1 -- 172.21.15.116:0/968540790 wait complete. 2023-05-12T09:07:16.823 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 7 2023-05-12T09:07:16.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:17.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.018+0000 7f06359ff700 1 Processor -- start 2023-05-12T09:07:17.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.018+0000 7f06359ff700 1 -- start start 2023-05-12T09:07:17.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.019+0000 7f06359ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f06300cfbf0 0x7f06301608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.019+0000 7f06359ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06300d0020 con 0x7f06300d1100 2023-05-12T09:07:17.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.019+0000 7f06359ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06300cdc60 con 0x7f06300b87a0 2023-05-12T09:07:17.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.019+0000 7f06359ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06300d02d0 con 0x7f06300cfbf0 2023-05-12T09:07:17.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.019+0000 7f062f7fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f06300d1100 0x7f06300d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:43504/0 (socket says 172.21.15.116:43504) 2023-05-12T09:07:17.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.019+0000 7f062f7fe700 1 -- 172.21.15.116:0/564569128 learned_addr learned my addr 172.21.15.116:0/564569128 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:17.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.019+0000 7f062e7fc700 1 --2- 172.21.15.116:0/564569128 >> v2:172.21.15.182:3300/0 conn(0x7f06300cfbf0 0x7f06301608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.019+0000 7f062dffb700 1 -- 172.21.15.116:0/564569128 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551705430 0 0) 0x7f06300d0020 con 0x7f06300d1100 2023-05-12T09:07:17.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.020+0000 7f062dffb700 1 -- 172.21.15.116:0/564569128 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06180035b0 con 0x7f06300d1100 2023-05-12T09:07:17.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.020+0000 7f062e7fc700 1 -- 172.21.15.116:0/564569128 >> v1:172.21.15.182:6789/0 conn(0x7f06300b87a0 legacy=0x7f06301601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.020+0000 7f062e7fc700 1 -- 172.21.15.116:0/564569128 >> v1:172.21.15.116:6789/0 conn(0x7f06300d1100 legacy=0x7f06300d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.020+0000 7f062e7fc700 1 -- 172.21.15.116:0/564569128 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300cd6a0 con 0x7f06300cfbf0 2023-05-12T09:07:17.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.020+0000 7f062e7fc700 1 --2- 172.21.15.116:0/564569128 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06300cfbf0 0x7f06301608f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0624009840 tx=0x7f0624009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5584ec4fbd95155 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:17.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.020+0000 7f062dffb700 1 -- 172.21.15.116:0/564569128 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624011830 con 0x7f06300cfbf0 2023-05-12T09:07:17.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.020+0000 7f062dffb700 1 -- 172.21.15.116:0/564569128 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624011990 con 0x7f06300cfbf0 2023-05-12T09:07:17.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.020+0000 7f062dffb700 1 -- 172.21.15.116:0/564569128 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624011d20 con 0x7f06300cfbf0 2023-05-12T09:07:17.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.021+0000 7f06359ff700 1 -- 172.21.15.116:0/564569128 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06300cfbf0 msgr2=0x7f06301608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.021+0000 7f06359ff700 1 --2- 172.21.15.116:0/564569128 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06300cfbf0 0x7f06301608f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0624009840 tx=0x7f0624009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:17.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.021+0000 7f06359ff700 1 -- 172.21.15.116:0/564569128 shutdown_connections 2023-05-12T09:07:17.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.021+0000 7f06359ff700 1 --2- 172.21.15.116:0/564569128 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06300cfbf0 0x7f06301608f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.021+0000 7f06359ff700 1 -- 172.21.15.116:0/564569128 >> 172.21.15.116:0/564569128 conn(0x7f0630071b10 msgr2=0x7f0630071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:17.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.021+0000 7f06359ff700 1 -- 172.21.15.116:0/564569128 shutdown_connections 2023-05-12T09:07:17.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.021+0000 7f06359ff700 1 -- 172.21.15.116:0/564569128 wait complete. 2023-05-12T09:07:17.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.023+0000 7f06359ff700 1 Processor -- start 2023-05-12T09:07:17.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.023+0000 7f06359ff700 1 -- start start 2023-05-12T09:07:17.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f06359ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06300b87a0 0x7f06300cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f06359ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06300cfbf0 0x7f06300c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f06359ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06300d1100 0x7f06301e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f06359ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06300c6da0 con 0x7f06300d1100 2023-05-12T09:07:17.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f06359ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06300c7080 con 0x7f06300b87a0 2023-05-12T09:07:17.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f06359ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06300c7360 con 0x7f06300cfbf0 2023-05-12T09:07:17.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06300d1100 0x7f06301e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06300d1100 0x7f06301e7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42342/0 (socket says 172.21.15.116:42342) 2023-05-12T09:07:17.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062effd700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06300b87a0 0x7f06300cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062f7fe700 1 -- 172.21.15.116:0/757199108 learned_addr learned my addr 172.21.15.116:0/757199108 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:17.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062e7fc700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06300cfbf0 0x7f06300c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062f7fe700 1 -- 172.21.15.116:0/757199108 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06300cfbf0 msgr2=0x7f06300c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062f7fe700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06300cfbf0 0x7f06300c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062f7fe700 1 -- 172.21.15.116:0/757199108 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06300b87a0 msgr2=0x7f06300cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062f7fe700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06300b87a0 0x7f06300cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062f7fe700 1 -- 172.21.15.116:0/757199108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240094a0 con 0x7f06300d1100 2023-05-12T09:07:17.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.024+0000 7f062f7fe700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06300d1100 0x7f06301e7d00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f062800caa0 tx=0x7f062800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:17.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.025+0000 7f0617fff700 1 -- 172.21.15.116:0/757199108 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800a9e0 con 0x7f06300d1100 2023-05-12T09:07:17.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.025+0000 7f0617fff700 1 -- 172.21.15.116:0/757199108 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800ab40 con 0x7f06300d1100 2023-05-12T09:07:17.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.025+0000 7f06359ff700 1 -- 172.21.15.116:0/757199108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0630160e30 con 0x7f06300d1100 2023-05-12T09:07:17.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.025+0000 7f0617fff700 1 -- 172.21.15.116:0/757199108 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628012400 con 0x7f06300d1100 2023-05-12T09:07:17.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.025+0000 7f06359ff700 1 -- 172.21.15.116:0/757199108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06300cd980 con 0x7f06300d1100 2023-05-12T09:07:17.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.026+0000 7f06359ff700 1 -- 172.21.15.116:0/757199108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0630160fc0 con 0x7f06300d1100 2023-05-12T09:07:17.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.027+0000 7f0617fff700 1 -- 172.21.15.116:0/757199108 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f062801b3b0 con 0x7f06300d1100 2023-05-12T09:07:17.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.028+0000 7f0617fff700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f061c06ace0 0x7f061c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.028+0000 7f0617fff700 1 -- 172.21.15.116:0/757199108 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0628089480 con 0x7f06300d1100 2023-05-12T09:07:17.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.028+0000 7f062effd700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f061c06ace0 0x7f061c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.029+0000 7f062effd700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f061c06ace0 0x7f061c06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0620007fd0 tx=0x7f0620009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:17.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.032+0000 7f0617fff700 1 -- 172.21.15.116:0/757199108 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0628054260 con 0x7f06300d1100 2023-05-12T09:07:17.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.230+0000 7f06359ff700 1 -- 172.21.15.116:0/757199108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06301f2930 con 0x7f06300d1100 2023-05-12T09:07:17.235 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.232+0000 7f0617fff700 1 -- 172.21.15.116:0/757199108 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7f06301f2930 con 0x7f06300d1100 2023-05-12T09:07:17.235 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:17.235 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:17.237 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 -- 172.21.15.116:0/757199108 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f061c06ace0 msgr2=0x7f061c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.237 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f061c06ace0 0x7f061c06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0620007fd0 tx=0x7f0620009040 comp rx=0 tx=0).stop 2023-05-12T09:07:17.237 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 -- 172.21.15.116:0/757199108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06300d1100 msgr2=0x7f06301e7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06300d1100 0x7f06301e7d00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f062800caa0 tx=0x7f062800cdb0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 -- 172.21.15.116:0/757199108 shutdown_connections 2023-05-12T09:07:17.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06300d1100 0x7f06301e7d00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06300b87a0 0x7f06300cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f061c06ace0 0x7f061c06d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 --2- 172.21.15.116:0/757199108 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06300cfbf0 0x7f06300c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 -- 172.21.15.116:0/757199108 >> 172.21.15.116:0/757199108 conn(0x7f0630071b10 msgr2=0x7f06300d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:17.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 -- 172.21.15.116:0/757199108 shutdown_connections 2023-05-12T09:07:17.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.234+0000 7f06359ff700 1 -- 172.21.15.116:0/757199108 wait complete. 2023-05-12T09:07:17.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-12T09:07:10.529423+0000', 'modified': '2023-05-12T09:07:15.052409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.182:6833/765908362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.182:6832', 'nonce': 765908362}, {'type': 'v1', 'addr': '172.21.15.182:6833', 'nonce': 765908362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-05-12T09:07:17.658 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-12T09:07:17.658 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-12T09:07:17.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.843+0000 7f0435fff700 1 Processor -- start 2023-05-12T09:07:17.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.843+0000 7f0435fff700 1 -- start start 2023-05-12T09:07:17.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.844+0000 7f0435fff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f04300cfbf0 0x7f04301608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.844+0000 7f0435fff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04300d0020 con 0x7f04300d1100 2023-05-12T09:07:17.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.844+0000 7f0435fff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04300cdc60 con 0x7f04300b87a0 2023-05-12T09:07:17.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.844+0000 7f0435fff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04300d02d0 con 0x7f04300cfbf0 2023-05-12T09:07:17.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.845+0000 7f042ffff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f04300d1100 0x7f04300d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:43510/0 (socket says 172.21.15.116:43510) 2023-05-12T09:07:17.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.845+0000 7f042ffff700 1 -- 172.21.15.116:0/2735951135 learned_addr learned my addr 172.21.15.116:0/2735951135 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:17.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.845+0000 7f042effd700 1 --2- 172.21.15.116:0/2735951135 >> v2:172.21.15.182:3300/0 conn(0x7f04300cfbf0 0x7f04301608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.845+0000 7f042e7fc700 1 -- 172.21.15.116:0/2735951135 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615176533 0 0) 0x7f04300d0020 con 0x7f04300d1100 2023-05-12T09:07:17.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.845+0000 7f042e7fc700 1 -- 172.21.15.116:0/2735951135 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04180035b0 con 0x7f04300d1100 2023-05-12T09:07:17.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.845+0000 7f042effd700 1 -- 172.21.15.116:0/2735951135 >> v1:172.21.15.182:6789/0 conn(0x7f04300b87a0 legacy=0x7f04301601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.845+0000 7f042e7fc700 1 -- 172.21.15.116:0/2735951135 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450282394 0 0) 0x7f04300cdc60 con 0x7f04300b87a0 2023-05-12T09:07:17.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.845+0000 7f042effd700 1 -- 172.21.15.116:0/2735951135 >> v1:172.21.15.116:6789/0 conn(0x7f04300d1100 legacy=0x7f04300d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.845+0000 7f042effd700 1 -- 172.21.15.116:0/2735951135 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04300cd6a0 con 0x7f04300cfbf0 2023-05-12T09:07:17.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.845+0000 7f042effd700 1 --2- 172.21.15.116:0/2735951135 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04300cfbf0 0x7f04301608f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0424009840 tx=0x7f0424009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b23232b33287f19 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:17.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.846+0000 7f042e7fc700 1 -- 172.21.15.116:0/2735951135 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424011830 con 0x7f04300cfbf0 2023-05-12T09:07:17.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.846+0000 7f042e7fc700 1 -- 172.21.15.116:0/2735951135 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0424011990 con 0x7f04300cfbf0 2023-05-12T09:07:17.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.846+0000 7f042e7fc700 1 -- 172.21.15.116:0/2735951135 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424011d00 con 0x7f04300cfbf0 2023-05-12T09:07:17.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.846+0000 7f0435fff700 1 -- 172.21.15.116:0/2735951135 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04300cfbf0 msgr2=0x7f04301608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.846+0000 7f0435fff700 1 --2- 172.21.15.116:0/2735951135 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04300cfbf0 0x7f04301608f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0424009840 tx=0x7f0424009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:17.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.846+0000 7f0435fff700 1 -- 172.21.15.116:0/2735951135 shutdown_connections 2023-05-12T09:07:17.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.846+0000 7f0435fff700 1 --2- 172.21.15.116:0/2735951135 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04300cfbf0 0x7f04301608f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.846+0000 7f0435fff700 1 -- 172.21.15.116:0/2735951135 >> 172.21.15.116:0/2735951135 conn(0x7f0430071b10 msgr2=0x7f0430071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:17.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.846+0000 7f0435fff700 1 -- 172.21.15.116:0/2735951135 shutdown_connections 2023-05-12T09:07:17.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.846+0000 7f0435fff700 1 -- 172.21.15.116:0/2735951135 wait complete. 2023-05-12T09:07:17.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.848+0000 7f0435fff700 1 Processor -- start 2023-05-12T09:07:17.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.848+0000 7f0435fff700 1 -- start start 2023-05-12T09:07:17.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f0435fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04300b87a0 0x7f043015a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f0435fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04300cfbf0 0x7f04300d2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f0435fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04300d1100 0x7f04300d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f0435fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043015e310 con 0x7f04300cfbf0 2023-05-12T09:07:17.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f0435fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04301f2110 con 0x7f04300b87a0 2023-05-12T09:07:17.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f0435fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043015a970 con 0x7f04300d1100 2023-05-12T09:07:17.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f042effd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04300cfbf0 0x7f04300d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f042effd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04300cfbf0 0x7f04300d2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42356/0 (socket says 172.21.15.116:42356) 2023-05-12T09:07:17.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f042effd700 1 -- 172.21.15.116:0/773805380 learned_addr learned my addr 172.21.15.116:0/773805380 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:17.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f042f7fe700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04300b87a0 0x7f043015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.849+0000 7f042ffff700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04300d1100 0x7f04300d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f042effd700 1 -- 172.21.15.116:0/773805380 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04300d1100 msgr2=0x7f04300d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f042effd700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04300d1100 0x7f04300d2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f042effd700 1 -- 172.21.15.116:0/773805380 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04300b87a0 msgr2=0x7f043015a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f042effd700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04300b87a0 0x7f043015a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f042effd700 1 -- 172.21.15.116:0/773805380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240094a0 con 0x7f04300cfbf0 2023-05-12T09:07:17.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f042effd700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04300cfbf0 0x7f04300d2670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04240090b0 tx=0x7f0424004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:17.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f0417fff700 1 -- 172.21.15.116:0/773805380 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424004550 con 0x7f04300cfbf0 2023-05-12T09:07:17.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f0417fff700 1 -- 172.21.15.116:0/773805380 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042401f070 con 0x7f04300cfbf0 2023-05-12T09:07:17.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f0417fff700 1 -- 172.21.15.116:0/773805380 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04240038e0 con 0x7f04300cfbf0 2023-05-12T09:07:17.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f0435fff700 1 -- 172.21.15.116:0/773805380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0430160e30 con 0x7f04300cfbf0 2023-05-12T09:07:17.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.850+0000 7f0435fff700 1 -- 172.21.15.116:0/773805380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04300cd980 con 0x7f04300cfbf0 2023-05-12T09:07:17.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.853+0000 7f0417fff700 1 -- 172.21.15.116:0/773805380 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0424003a40 con 0x7f04300cfbf0 2023-05-12T09:07:17.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.854+0000 7f0417fff700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f041c06ace0 0x7f041c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.854+0000 7f0417fff700 1 -- 172.21.15.116:0/773805380 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0424021070 con 0x7f04300cfbf0 2023-05-12T09:07:17.862 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.854+0000 7f042f7fe700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f041c06ace0 0x7f041c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.862 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.854+0000 7f042f7fe700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f041c06ace0 0x7f041c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0420000f60 tx=0x7f0420009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:17.862 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.855+0000 7f0449958b80 1 Processor -- start 2023-05-12T09:07:17.862 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.855+0000 7f0449958b80 1 -- start start 2023-05-12T09:07:17.862 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.856+0000 7f0449958b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a958230 0x558f9a958600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.863 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.856+0000 7f0449958b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a9592d0 0x558f9a93d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.863 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.856+0000 7f0449958b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a93d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.863 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.856+0000 7f0449958b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a7fc600 con 0x558f9a910740 2023-05-12T09:07:17.863 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.856+0000 7f0449958b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a86b790 con 0x558f9a9592d0 2023-05-12T09:07:17.863 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.856+0000 7f0449958b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f9a864a60 con 0x558f9a958230 2023-05-12T09:07:17.863 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a93d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.863 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a93d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42362/0 (socket says 172.21.15.116:42362) 2023-05-12T09:07:17.864 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042ffff700 1 -- 172.21.15.116:0/1710254354 learned_addr learned my addr 172.21.15.116:0/1710254354 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:17.864 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042f7fe700 1 --2- 172.21.15.116:0/1710254354 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a958230 0x558f9a958600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.864 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042effd700 1 --2- 172.21.15.116:0/1710254354 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a9592d0 0x558f9a93d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.864 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042ffff700 1 -- 172.21.15.116:0/1710254354 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a958230 msgr2=0x558f9a958600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:17.864 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042ffff700 1 --2- 172.21.15.116:0/1710254354 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a958230 0x558f9a958600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.865 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042ffff700 1 -- 172.21.15.116:0/1710254354 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a9592d0 msgr2=0x558f9a93d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:17.865 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042ffff700 1 --2- 172.21.15.116:0/1710254354 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a9592d0 0x558f9a93d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.865 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042ffff700 1 -- 172.21.15.116:0/1710254354 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f9a658790 con 0x558f9a910740 2023-05-12T09:07:17.866 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042effd700 1 --2- 172.21.15.116:0/1710254354 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a9592d0 0x558f9a93d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:17.866 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f042ffff700 1 --2- 172.21.15.116:0/1710254354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a93d6c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0428002140 tx=0x7f0428007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3415bb672d2e997f server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:17.866 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f0415ffb700 1 -- 172.21.15.116:0/1710254354 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428007ba0 con 0x558f9a910740 2023-05-12T09:07:17.866 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f0415ffb700 1 -- 172.21.15.116:0/1710254354 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04280133f0 con 0x558f9a910740 2023-05-12T09:07:17.867 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.857+0000 7f0415ffb700 1 -- 172.21.15.116:0/1710254354 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428013760 con 0x558f9a910740 2023-05-12T09:07:17.867 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.858+0000 7f0449958b80 1 -- 172.21.15.116:0/1710254354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 msgr2=0x558f9a93d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.867 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.858+0000 7f0449958b80 1 --2- 172.21.15.116:0/1710254354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a93d6c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0428002140 tx=0x7f0428007320 comp rx=0 tx=0).stop 2023-05-12T09:07:17.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.858+0000 7f0449958b80 1 -- 172.21.15.116:0/1710254354 shutdown_connections 2023-05-12T09:07:17.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.858+0000 7f0449958b80 1 --2- 172.21.15.116:0/1710254354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a93d6c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.858+0000 7f0449958b80 1 --2- 172.21.15.116:0/1710254354 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a958230 0x558f9a958600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.858+0000 7f0449958b80 1 --2- 172.21.15.116:0/1710254354 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a9592d0 0x558f9a93d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.858+0000 7f0449958b80 1 -- 172.21.15.116:0/1710254354 >> 172.21.15.116:0/1710254354 conn(0x558f9a907b60 msgr2=0x558f9a90d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:17.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.858+0000 7f0449958b80 1 -- 172.21.15.116:0/1710254354 shutdown_connections 2023-05-12T09:07:17.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.858+0000 7f0449958b80 1 -- 172.21.15.116:0/1710254354 wait complete. 2023-05-12T09:07:17.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.859+0000 7f0449958b80 1 -- start start 2023-05-12T09:07:17.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.859+0000 7f0449958b80 1 Processor -- start 2023-05-12T09:07:17.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.860+0000 7f0449958b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a936080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.860+0000 7f0449958b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 0x558f9a929c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.860+0000 7f0449958b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a9592d0 0x558f9a932be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.860+0000 7f0449958b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a800ad0 con 0x558f9a910740 2023-05-12T09:07:17.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.860+0000 7f0449958b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a800770 con 0x558f9a958230 2023-05-12T09:07:17.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.860+0000 7f0449958b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f9a659390 con 0x558f9a9592d0 2023-05-12T09:07:17.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.860+0000 7f0449958b80 10 client.0 _ll_register_callbacks cb 0x558f9a802400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-12T09:07:17.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.860+0000 7f042f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a936080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.860+0000 7f042f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a936080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42364/0 (socket says 172.21.15.116:42364) 2023-05-12T09:07:17.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.860+0000 7f042f7fe700 1 -- 172.21.15.116:0/1456891080 learned_addr learned my addr 172.21.15.116:0/1456891080 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:17.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f042ffff700 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a9592d0 0x558f9a932be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f042effd700 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 0x558f9a929c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f042f7fe700 1 -- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a9592d0 msgr2=0x558f9a932be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:17.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f042f7fe700 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a9592d0 0x558f9a932be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f042f7fe700 1 -- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 msgr2=0x558f9a929c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:17.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f042f7fe700 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 0x558f9a929c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f042f7fe700 1 -- 172.21.15.116:0/1456891080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04180035b0 con 0x558f9a910740 2023-05-12T09:07:17.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f042ffff700 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a9592d0 0x558f9a932be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:17.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f042effd700 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 0x558f9a929c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:17.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f042f7fe700 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a936080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f04200015f0 tx=0x7f0420000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fd9c57ac5408ed server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:17.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f040e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-05-12T09:07:17.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f040e7fc700 1 -- 172.21.15.116:0/1456891080 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420014ba0 con 0x558f9a910740 2023-05-12T09:07:17.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f040e7fc700 1 -- 172.21.15.116:0/1456891080 <== mon.0 v2:172.21.15.116:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f042001c040 con 0x558f9a910740 2023-05-12T09:07:17.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f0449958b80 1 -- 172.21.15.116:0/1456891080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f9a905170 con 0x558f9a910740 2023-05-12T09:07:17.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f040e7fc700 1 -- 172.21.15.116:0/1456891080 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0420014d00 con 0x558f9a910740 2023-05-12T09:07:17.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f0449958b80 10 client.4425 fetch_fsmap learned FSMap version 7 2023-05-12T09:07:17.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.861+0000 7f0449958b80 1 -- 172.21.15.116:0/1456891080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558f9a82b2e0 con 0x558f9a910740 2023-05-12T09:07:17.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.862+0000 7f040e7fc700 1 -- 172.21.15.116:0/1456891080 <== mon.0 v2:172.21.15.116:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f9a905170 con 0x558f9a910740 2023-05-12T09:07:17.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.862+0000 7f040e7fc700 1 -- 172.21.15.116:0/1456891080 <== mon.0 v2:172.21.15.116:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0420029350 con 0x558f9a910740 2023-05-12T09:07:17.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.862+0000 7f0449958b80 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-05-12T09:07:17.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.862+0000 7f0449958b80 10 client.4425 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-12T09:07:17.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.862+0000 7f0449958b80 20 client.4425 populate_metadata read hostname 'smithi116' 2023-05-12T09:07:17.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.862+0000 7f0449958b80 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x558f9a9405f0 0x558f9a9409c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.862+0000 7f0449958b80 4 client.4425 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-12T09:07:17.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.862+0000 7f0449958b80 1 -- 172.21.15.116:0/1456891080 --> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f9a8e22f0 con 0x558f9a9405f0 2023-05-12T09:07:17.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.862+0000 7f042effd700 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x558f9a9405f0 0x558f9a9409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.863+0000 7f040e7fc700 10 client.4425 ms_handle_connect on v2:172.21.15.182:6832/765908362 2023-05-12T09:07:17.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.863+0000 7f042effd700 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x558f9a9405f0 0x558f9a9409c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=915c89fe5f5f7fb7 server_cookie=627d5024183d43ad in_seq=0 out_seq=0 2023-05-12T09:07:17.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.863+0000 7f040e7fc700 1 -- 172.21.15.116:0/1456891080 <== mds.0 v2:172.21.15.182:6832/765908362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18412 (crc 0 0 0) 0x558f9a8e22f0 con 0x558f9a9405f0 2023-05-12T09:07:17.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.863+0000 7f040e7fc700 10 client.4425 handle_command_reply: tid=0 2023-05-12T09:07:17.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 client.4425 shutdown 2023-05-12T09:07:17.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 -- 172.21.15.116:0/1456891080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 msgr2=0x558f9a936080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a936080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f04200015f0 tx=0x7f0420000ed0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 -- 172.21.15.116:0/1456891080 shutdown_connections 2023-05-12T09:07:17.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x558f9a9405f0 0x558f9a9409c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a9592d0 0x558f9a932be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f040e7fc700 0 client.4425 ms_handle_reset on v2:172.21.15.182:6832/765908362 2023-05-12T09:07:17.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a910740 0x558f9a936080 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 --2- 172.21.15.116:0/1456891080 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 0x558f9a929c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 -- 172.21.15.116:0/1456891080 >> 172.21.15.116:0/1456891080 conn(0x558f9a907b60 msgr2=0x558f9a957770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:17.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 -- 172.21.15.116:0/1456891080 shutdown_connections 2023-05-12T09:07:17.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 1 -- 172.21.15.116:0/1456891080 wait complete. 2023-05-12T09:07:17.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.864+0000 7f0449958b80 20 client.4425 trim_cache size 0 max 16384 2023-05-12T09:07:17.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.882+0000 7f0449958b80 1 Processor -- start 2023-05-12T09:07:17.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.882+0000 7f0449958b80 1 -- start start 2023-05-12T09:07:17.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.883+0000 7f0449958b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a907b60 0x558f9a93ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.883+0000 7f0449958b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a910740 0x558f9a97a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.883+0000 7f0449958b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 0x558f9a9409c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.883+0000 7f0449958b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a90cbb0 con 0x558f9a907b60 2023-05-12T09:07:17.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.883+0000 7f0449958b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a912ab0 con 0x558f9a958230 2023-05-12T09:07:17.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.883+0000 7f0449958b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f9a940030 con 0x558f9a910740 2023-05-12T09:07:17.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.883+0000 7f042f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a907b60 0x558f9a93ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.883+0000 7f042f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a907b60 0x558f9a93ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42378/0 (socket says 172.21.15.116:42378) 2023-05-12T09:07:17.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.883+0000 7f042f7fe700 1 -- 172.21.15.116:0/704364802 learned_addr learned my addr 172.21.15.116:0/704364802 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:17.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f042effd700 1 --2- 172.21.15.116:0/704364802 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a910740 0x558f9a97a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f042ffff700 1 --2- 172.21.15.116:0/704364802 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 0x558f9a9409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f042f7fe700 1 -- 172.21.15.116:0/704364802 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a910740 msgr2=0x558f9a97a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:17.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f042f7fe700 1 --2- 172.21.15.116:0/704364802 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a910740 0x558f9a97a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f042f7fe700 1 -- 172.21.15.116:0/704364802 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 msgr2=0x558f9a9409c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:17.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f042f7fe700 1 --2- 172.21.15.116:0/704364802 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 0x558f9a9409c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f042f7fe700 1 -- 172.21.15.116:0/704364802 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f9a82b030 con 0x558f9a907b60 2023-05-12T09:07:17.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f042ffff700 1 --2- 172.21.15.116:0/704364802 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 0x558f9a9409c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:17.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f042f7fe700 1 --2- 172.21.15.116:0/704364802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a907b60 0x558f9a93ca70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f042000e190 tx=0x7f0420019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa704851b9795813 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:17.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f04167fc700 1 -- 172.21.15.116:0/704364802 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420029b90 con 0x558f9a907b60 2023-05-12T09:07:17.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f04167fc700 1 -- 172.21.15.116:0/704364802 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420029350 con 0x558f9a907b60 2023-05-12T09:07:17.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.884+0000 7f04167fc700 1 -- 172.21.15.116:0/704364802 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04200294c0 con 0x558f9a907b60 2023-05-12T09:07:17.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.885+0000 7f0449958b80 1 -- 172.21.15.116:0/704364802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a907b60 msgr2=0x558f9a93ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.885+0000 7f0449958b80 1 --2- 172.21.15.116:0/704364802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a907b60 0x558f9a93ca70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f042000e190 tx=0x7f0420019000 comp rx=0 tx=0).stop 2023-05-12T09:07:17.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.885+0000 7f0449958b80 1 -- 172.21.15.116:0/704364802 shutdown_connections 2023-05-12T09:07:17.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.885+0000 7f0449958b80 1 --2- 172.21.15.116:0/704364802 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a958230 0x558f9a9409c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.885+0000 7f0449958b80 1 --2- 172.21.15.116:0/704364802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a907b60 0x558f9a93ca70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.885+0000 7f0449958b80 1 --2- 172.21.15.116:0/704364802 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a910740 0x558f9a97a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.885+0000 7f0449958b80 1 -- 172.21.15.116:0/704364802 >> 172.21.15.116:0/704364802 conn(0x558f9a90e8a0 msgr2=0x558f9a95b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:17.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.885+0000 7f0449958b80 1 -- 172.21.15.116:0/704364802 shutdown_connections 2023-05-12T09:07:17.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.885+0000 7f0449958b80 1 -- 172.21.15.116:0/704364802 wait complete. 2023-05-12T09:07:17.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.886+0000 7f0449958b80 1 -- start start 2023-05-12T09:07:17.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.886+0000 7f0449958b80 1 Processor -- start 2023-05-12T09:07:17.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f0449958b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a907b60 0x558f9a9bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f0449958b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a910740 0x558f9a957480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f0449958b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a958230 0x558f9a90d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f0449958b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a9bfb00 con 0x558f9a958230 2023-05-12T09:07:17.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f0449958b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a9579c0 con 0x558f9a907b60 2023-05-12T09:07:17.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f0449958b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f9a9c0bd0 con 0x558f9a910740 2023-05-12T09:07:17.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f0449958b80 10 client.0 _ll_register_callbacks cb 0x558f9a802400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-12T09:07:17.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f042ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a958230 0x558f9a90d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f042ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a958230 0x558f9a90d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42392/0 (socket says 172.21.15.116:42392) 2023-05-12T09:07:17.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f042ffff700 1 -- 172.21.15.116:0/2207770782 learned_addr learned my addr 172.21.15.116:0/2207770782 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:17.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f042f7fe700 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a907b60 0x558f9a9bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f042effd700 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a910740 0x558f9a957480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f042ffff700 1 -- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a910740 msgr2=0x558f9a957480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:17.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f042ffff700 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a910740 0x558f9a957480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f042ffff700 1 -- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a907b60 msgr2=0x558f9a9bf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:17.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f042ffff700 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a907b60 0x558f9a9bf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.887+0000 7f042ffff700 1 -- 172.21.15.116:0/2207770782 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f9a82b2e0 con 0x558f9a958230 2023-05-12T09:07:17.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f042ffff700 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a958230 0x558f9a90d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0428002230 tx=0x7f0428001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42688447ade81de2 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:17.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f040e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-05-12T09:07:17.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f040e7fc700 1 -- 172.21.15.116:0/2207770782 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428024070 con 0x558f9a958230 2023-05-12T09:07:17.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f0449958b80 1 -- 172.21.15.116:0/2207770782 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04280133f0 con 0x558f9a958230 2023-05-12T09:07:17.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f040e7fc700 1 -- 172.21.15.116:0/2207770782 <== mon.0 v2:172.21.15.116:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f04280060e0 con 0x558f9a958230 2023-05-12T09:07:17.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f040e7fc700 1 -- 172.21.15.116:0/2207770782 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0428007ba0 con 0x558f9a958230 2023-05-12T09:07:17.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f0449958b80 10 client.4431 fetch_fsmap learned FSMap version 7 2023-05-12T09:07:17.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f0449958b80 1 -- 172.21.15.116:0/2207770782 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558f9a811b10 con 0x558f9a958230 2023-05-12T09:07:17.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f040e7fc700 1 -- 172.21.15.116:0/2207770782 <== mon.0 v2:172.21.15.116:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04280133f0 con 0x558f9a958230 2023-05-12T09:07:17.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f040e7fc700 1 -- 172.21.15.116:0/2207770782 <== mon.0 v2:172.21.15.116:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0428012070 con 0x558f9a958230 2023-05-12T09:07:17.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f0449958b80 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-05-12T09:07:17.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f0449958b80 10 client.4431 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-12T09:07:17.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f0449958b80 20 client.4431 populate_metadata read hostname 'smithi116' 2023-05-12T09:07:17.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f0449958b80 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x558f9a9592d0 0x558f9a92fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:17.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.888+0000 7f0449958b80 4 client.4431 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-05-12T09:07:17.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.889+0000 7f0449958b80 1 -- 172.21.15.116:0/2207770782 --> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558f9a85dba0 con 0x558f9a9592d0 2023-05-12T09:07:17.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.889+0000 7f042f7fe700 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x558f9a9592d0 0x558f9a92fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:17.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.889+0000 7f040e7fc700 10 client.4431 ms_handle_connect on v2:172.21.15.182:6832/765908362 2023-05-12T09:07:17.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.889+0000 7f042f7fe700 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x558f9a9592d0 0x558f9a92fa70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f22b11d60a9fead server_cookie=74039ee4635c9acc in_seq=0 out_seq=0 2023-05-12T09:07:17.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f040e7fc700 1 -- 172.21.15.116:0/2207770782 <== mds.0 v2:172.21.15.182:6832/765908362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x558f9a85dba0 con 0x558f9a9592d0 2023-05-12T09:07:17.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f040e7fc700 10 client.4431 handle_command_reply: tid=0 2023-05-12T09:07:17.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 client.4431 shutdown 2023-05-12T09:07:17.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 -- 172.21.15.116:0/2207770782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a958230 msgr2=0x558f9a90d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a958230 0x558f9a90d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0428002230 tx=0x7f0428001250 comp rx=0 tx=0).stop 2023-05-12T09:07:17.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 -- 172.21.15.116:0/2207770782 shutdown_connections 2023-05-12T09:07:17.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x558f9a9592d0 0x558f9a92fa70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558f9a958230 0x558f9a90d350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x558f9a907b60 0x558f9a9bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f040e7fc700 0 client.4431 ms_handle_reset on v2:172.21.15.182:6832/765908362 2023-05-12T09:07:17.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 --2- 172.21.15.116:0/2207770782 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558f9a910740 0x558f9a957480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 -- 172.21.15.116:0/2207770782 >> 172.21.15.116:0/2207770782 conn(0x558f9a90e8a0 msgr2=0x558f9a90bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:17.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 -- 172.21.15.116:0/2207770782 shutdown_connections 2023-05-12T09:07:17.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 1 -- 172.21.15.116:0/2207770782 wait complete. 2023-05-12T09:07:17.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.890+0000 7f0449958b80 20 client.4431 trim_cache size 0 max 16384 2023-05-12T09:07:17.906 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-05-12T09:07:17.906 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_fsid": "09fd430d-d641-4faf-8b07-e4040d2273e8", 2023-05-12T09:07:17.907 INFO:teuthology.orchestra.run.smithi116.stdout: "whoami": 0, 2023-05-12T09:07:17.907 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 4290, 2023-05-12T09:07:17.907 INFO:teuthology.orchestra.run.smithi116.stdout: "want_state": "up:active", 2023-05-12T09:07:17.907 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "up:active", 2023-05-12T09:07:17.907 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs", 2023-05-12T09:07:17.907 INFO:teuthology.orchestra.run.smithi116.stdout: "rank_uptime": 7.3582449370000003, 2023-05-12T09:07:17.907 INFO:teuthology.orchestra.run.smithi116.stdout: "mdsmap_epoch": 7, 2023-05-12T09:07:17.907 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_epoch": 24, 2023-05-12T09:07:17.908 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_epoch_barrier": 23, 2023-05-12T09:07:17.908 INFO:teuthology.orchestra.run.smithi116.stdout: "uptime": 12.872820957 2023-05-12T09:07:17.908 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-05-12T09:07:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 -- 172.21.15.116:0/773805380 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f041c06ace0 msgr2=0x7f041c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f041c06ace0 0x7f041c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0420000f60 tx=0x7f0420009040 comp rx=0 tx=0).stop 2023-05-12T09:07:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 -- 172.21.15.116:0/773805380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04300cfbf0 msgr2=0x7f04300d2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04300cfbf0 0x7f04300d2670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04240090b0 tx=0x7f0424004750 comp rx=0 tx=0).stop 2023-05-12T09:07:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 -- 172.21.15.116:0/773805380 shutdown_connections 2023-05-12T09:07:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f041c06ace0 0x7f041c06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04300d1100 0x7f04300d2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04300b87a0 0x7f043015a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 --2- 172.21.15.116:0/773805380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04300cfbf0 0x7f04300d2670 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 -- 172.21.15.116:0/773805380 >> 172.21.15.116:0/773805380 conn(0x7f0430071b10 msgr2=0x7f04300b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 -- 172.21.15.116:0/773805380 shutdown_connections 2023-05-12T09:07:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:17.891+0000 7f0435fff700 1 -- 172.21.15.116:0/773805380 wait complete. 2023-05-12T09:07:17.911 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-12T09:07:17.912 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-12T09:07:17.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-12T09:07:18.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.095+0000 7f4c595ff700 1 Processor -- start 2023-05-12T09:07:18.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.095+0000 7f4c595ff700 1 -- start start 2023-05-12T09:07:18.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.096+0000 7f4c595ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cd520 0x7f4c540cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:18.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.096+0000 7f4c595ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f4c540cfe20 0x7f4c540b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:18.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.096+0000 7f4c595ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5415d660 con 0x7f4c5415a140 2023-05-12T09:07:18.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.096+0000 7f4c595ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c540d02a0 con 0x7f4c540cfe20 2023-05-12T09:07:18.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.096+0000 7f4c595ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5415cd70 con 0x7f4c540cd520 2023-05-12T09:07:18.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c537fe700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f4c540cfe20 0x7f4c540b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:18.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c527fc700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cd520 0x7f4c540cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:18.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c52ffd700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f4c5415a140 0x7f4c54160ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:43954/0 (socket says 172.21.15.116:43954) 2023-05-12T09:07:18.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c52ffd700 1 -- 172.21.15.116:0/3708783279 learned_addr learned my addr 172.21.15.116:0/3708783279 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:18.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c527fc700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cd520 0x7f4c540cf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:50276/0 (socket says 172.21.15.116:50276) 2023-05-12T09:07:18.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c537fe700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f4c540cfe20 0x7f4c540b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:49374/0 (socket says 172.21.15.116:49374) 2023-05-12T09:07:18.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c51ffb700 1 -- 172.21.15.116:0/3708783279 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092561738 0 0) 0x7f4c5415d660 con 0x7f4c5415a140 2023-05-12T09:07:18.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c537fe700 1 -- 172.21.15.116:0/3708783279 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cd520 msgr2=0x7f4c540cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:18.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c537fe700 1 --2- 172.21.15.116:0/3708783279 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cd520 0x7f4c540cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:18.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c537fe700 1 -- 172.21.15.116:0/3708783279 >> v1:172.21.15.182:6789/0 conn(0x7f4c5415a140 legacy=0x7f4c54160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:18.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c537fe700 1 -- 172.21.15.116:0/3708783279 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5415d010 con 0x7f4c540cfe20 2023-05-12T09:07:18.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c527fc700 1 --2- 172.21.15.116:0/3708783279 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cd520 0x7f4c540cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:18.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.097+0000 7f4c537fe700 1 --2- 172.21.15.116:0/3708783279 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4c540cfe20 0x7f4c540b1b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009dc0 tx=0x7f4c4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f046c2ebaa5c13e server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:18.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.098+0000 7f4c51ffb700 1 -- 172.21.15.116:0/3708783279 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00e070 con 0x7f4c540cfe20 2023-05-12T09:07:18.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.098+0000 7f4c51ffb700 1 -- 172.21.15.116:0/3708783279 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c00bae0 con 0x7f4c540cfe20 2023-05-12T09:07:18.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.098+0000 7f4c51ffb700 1 -- 172.21.15.116:0/3708783279 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00be90 con 0x7f4c540cfe20 2023-05-12T09:07:18.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.098+0000 7f4c595ff700 1 -- 172.21.15.116:0/3708783279 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4c540cfe20 msgr2=0x7f4c540b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:18.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.098+0000 7f4c595ff700 1 --2- 172.21.15.116:0/3708783279 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4c540cfe20 0x7f4c540b1b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009dc0 tx=0x7f4c4c00b330 comp rx=0 tx=0).stop 2023-05-12T09:07:18.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.098+0000 7f4c595ff700 1 -- 172.21.15.116:0/3708783279 shutdown_connections 2023-05-12T09:07:18.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.098+0000 7f4c595ff700 1 --2- 172.21.15.116:0/3708783279 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4c540cfe20 0x7f4c540b1b70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:18.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.098+0000 7f4c595ff700 1 --2- 172.21.15.116:0/3708783279 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cd520 0x7f4c540cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:18.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.098+0000 7f4c595ff700 1 -- 172.21.15.116:0/3708783279 >> 172.21.15.116:0/3708783279 conn(0x7f4c54071b10 msgr2=0x7f4c54071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:18.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.099+0000 7f4c595ff700 1 -- 172.21.15.116:0/3708783279 shutdown_connections 2023-05-12T09:07:18.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.099+0000 7f4c595ff700 1 -- 172.21.15.116:0/3708783279 wait complete. 2023-05-12T09:07:18.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.100+0000 7f4c595ff700 1 Processor -- start 2023-05-12T09:07:18.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.100+0000 7f4c595ff700 1 -- start start 2023-05-12T09:07:18.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.101+0000 7f4c595ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c540cd520 0x7f4c540d3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:18.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.101+0000 7f4c595ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cfe20 0x7f4c540d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:18.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.101+0000 7f4c595ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4c5415a140 0x7f4c541f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:18.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.101+0000 7f4c595ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540d3d20 con 0x7f4c540cd520 2023-05-12T09:07:18.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.101+0000 7f4c595ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540d10f0 con 0x7f4c5415a140 2023-05-12T09:07:18.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.101+0000 7f4c595ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540d3760 con 0x7f4c540cfe20 2023-05-12T09:07:18.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c52ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c540cd520 0x7f4c540d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:18.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c52ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c540cd520 0x7f4c540d3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42396/0 (socket says 172.21.15.116:42396) 2023-05-12T09:07:18.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c52ffd700 1 -- 172.21.15.116:0/2606037655 learned_addr learned my addr 172.21.15.116:0/2606037655 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:18.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c527fc700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cfe20 0x7f4c540d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:18.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c537fe700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4c5415a140 0x7f4c541f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:18.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c52ffd700 1 -- 172.21.15.116:0/2606037655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cfe20 msgr2=0x7f4c540d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:18.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c52ffd700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cfe20 0x7f4c540d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:18.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c52ffd700 1 -- 172.21.15.116:0/2606037655 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4c5415a140 msgr2=0x7f4c541f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:18.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c52ffd700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4c5415a140 0x7f4c541f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:18.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c52ffd700 1 -- 172.21.15.116:0/2606037655 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480094a0 con 0x7f4c540cd520 2023-05-12T09:07:18.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c52ffd700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c540cd520 0x7f4c540d3060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400c550 tx=0x7f4c4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:18.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c3b7fe700 1 -- 172.21.15.116:0/2606037655 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c44004c80 con 0x7f4c540cd520 2023-05-12T09:07:18.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c3b7fe700 1 -- 172.21.15.116:0/2606037655 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c44004e00 con 0x7f4c540cd520 2023-05-12T09:07:18.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c3b7fe700 1 -- 172.21.15.116:0/2606037655 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c44007310 con 0x7f4c540cd520 2023-05-12T09:07:18.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.102+0000 7f4c595ff700 1 -- 172.21.15.116:0/2606037655 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c009a70 con 0x7f4c540cd520 2023-05-12T09:07:18.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.103+0000 7f4c595ff700 1 -- 172.21.15.116:0/2606037655 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5415daf0 con 0x7f4c540cd520 2023-05-12T09:07:18.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.103+0000 7f4c595ff700 1 -- 172.21.15.116:0/2606037655 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5415d2f0 con 0x7f4c540cd520 2023-05-12T09:07:18.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.104+0000 7f4c3b7fe700 1 -- 172.21.15.116:0/2606037655 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c44007470 con 0x7f4c540cd520 2023-05-12T09:07:18.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.105+0000 7f4c3b7fe700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c4006ace0 0x7f4c4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:18.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.105+0000 7f4c3b7fe700 1 -- 172.21.15.116:0/2606037655 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4c440894c0 con 0x7f4c540cd520 2023-05-12T09:07:18.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.105+0000 7f4c527fc700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c4006ace0 0x7f4c4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:18.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.106+0000 7f4c527fc700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c4006ace0 0x7f4c4006d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c5415ff50 tx=0x7f4c48008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:18.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.110+0000 7f4c3b7fe700 1 -- 172.21.15.116:0/2606037655 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4c44054270 con 0x7f4c540cd520 2023-05-12T09:07:18.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.345+0000 7f4c595ff700 1 -- 172.21.15.116:0/2606037655 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c540cdb00 con 0x7f4c540cd520 2023-05-12T09:07:18.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.346+0000 7f4c3b7fe700 1 -- 172.21.15.116:0/2606037655 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4c44057890 con 0x7f4c540cd520 2023-05-12T09:07:18.349 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-12T09:07:18.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 -- 172.21.15.116:0/2606037655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c4006ace0 msgr2=0x7f4c4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:18.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c4006ace0 0x7f4c4006d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c5415ff50 tx=0x7f4c48008040 comp rx=0 tx=0).stop 2023-05-12T09:07:18.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 -- 172.21.15.116:0/2606037655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c540cd520 msgr2=0x7f4c540d3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:18.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c540cd520 0x7f4c540d3060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400c550 tx=0x7f4c4400c910 comp rx=0 tx=0).stop 2023-05-12T09:07:18.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 -- 172.21.15.116:0/2606037655 shutdown_connections 2023-05-12T09:07:18.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4c5415a140 0x7f4c541f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:18.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c540cd520 0x7f4c540d3060 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:18.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c4006ace0 0x7f4c4006d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:18.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 --2- 172.21.15.116:0/2606037655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4c540cfe20 0x7f4c540d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:18.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 -- 172.21.15.116:0/2606037655 >> 172.21.15.116:0/2606037655 conn(0x7f4c54071b10 msgr2=0x7f4c541556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:18.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 -- 172.21.15.116:0/2606037655 shutdown_connections 2023-05-12T09:07:18.353 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:18.348+0000 7f4c595ff700 1 -- 172.21.15.116:0/2606037655 wait complete. 2023-05-12T09:07:18.368 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-05-12T09:07:18.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-12T09:07:18.369 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2023-05-12T09:07:18.369 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-05-12T09:07:18.369 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-12T09:07:18.369 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-05-12T09:07:18.370 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-12T09:07:18.370 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-12T09:07:18.370 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-05-12T09:07:18.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:18.371 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2023-05-12T09:07:18.412 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-12T09:07:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-12T09:07:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2023-05-12T09:07:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2023-05-12T09:07:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:18.414 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:07:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2023-05-12T09:07:18.414 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:07:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2023-05-12T09:07:18.414 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:07:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:18.415 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-12T09:07:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-12T09:07:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42092sec preferred_lft 42092sec 2023-05-12T09:07:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2023-05-12T09:07:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:18.417 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-12T09:07:18.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:18.417 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:18.418 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:18.419 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add name ceph-brx type bridge 2023-05-12T09:07:18.419 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr flush dev ceph-brx 2023-05-12T09:07:18.419 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set ceph-brx up 2023-05-12T09:07:18.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-12T09:07:18.420 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:18.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:18.874 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-12T09:07:18.976 INFO:teuthology.orchestra.run.smithi116.stdout:1 2023-05-12T09:07:18.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:18.980 DEBUG:teuthology.orchestra.run.smithi116:> route 2023-05-12T09:07:19.047 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2023-05-12T09:07:19.047 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-12T09:07:19.048 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-12T09:07:19.048 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-12T09:07:19.048 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-12T09:07:19.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:19.050 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:19.050 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:19.051 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-12T09:07:19.051 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-12T09:07:19.052 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-12T09:07:19.053 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:19.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:19.715 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2023-05-12T09:07:19.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:19.758 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2023-05-12T09:07:19.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:19.839 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:19.840 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:19.840 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-12T09:07:19.840 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-05-12T09:07:19.840 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:20.007 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-05-12T09:07:20.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:20.008 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:20.008 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:20.008 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-05-12T09:07:20.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-12T09:07:20.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-05-12T09:07:20.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-05-12T09:07:20.010 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-05-12T09:07:20.010 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:20.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:20.256 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:20.257 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:20.257 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2023-05-12T09:07:20.258 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.0 master ceph-brx 2023-05-12T09:07:20.258 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:20.424 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-05-12T09:07:20.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:07:20.426 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-05-12T09:07:20.467 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-05-12T09:07:20.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:07:20.468 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-05-12T09:07:20.548 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-05-12T09:07:20.651 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:07:20.651 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:07:20.712 INFO:teuthology.orchestra.run.smithi116.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:07:20.714 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:07:20.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:20.716 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-05-12T09:07:20.757 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-12T09:07:20.758 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-05-12T09:07:20.802 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-05-12T09:07:20.866 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:07:20.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:07:20.929 INFO:teuthology.orchestra.run.smithi116.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:07:20.931 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:07:20.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:20.932 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-05-12T09:07:20.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi116.stderr:2023-05-12T09:07:20.964+0000 7f12f47a75c0 -1 init, newargv = 0x562074bb27f0 newargc=15 2023-05-12T09:07:20.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi116.stderr:ceph-fuse[112123]: starting ceph client 2023-05-12T09:07:20.978 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi116.stderr:ceph-fuse[112123]: starting fuse 2023-05-12T09:07:22.076 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-05-12T09:07:22.148 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:07:22.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:07:22.211 INFO:teuthology.orchestra.run.smithi116.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:07:22.213 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:07:22.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:22.214 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-05-12T09:07:22.256 INFO:teuthology.orchestra.run.smithi116.stdout:42 2023-05-12T09:07:22.256 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-12T09:07:22.257 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-12T09:07:22.257 DEBUG:teuthology.orchestra.run.smithi116:> import glob 2023-05-12T09:07:22.258 DEBUG:teuthology.orchestra.run.smithi116:> import re 2023-05-12T09:07:22.258 DEBUG:teuthology.orchestra.run.smithi116:> import os 2023-05-12T09:07:22.258 DEBUG:teuthology.orchestra.run.smithi116:> import subprocess 2023-05-12T09:07:22.259 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:22.259 DEBUG:teuthology.orchestra.run.smithi116:> def _find_admin_socket(client_name): 2023-05-12T09:07:22.259 DEBUG:teuthology.orchestra.run.smithi116:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-05-12T09:07:22.259 DEBUG:teuthology.orchestra.run.smithi116:> files = glob.glob(asok_path) 2023-05-12T09:07:22.260 DEBUG:teuthology.orchestra.run.smithi116:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-05-12T09:07:22.260 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:22.260 DEBUG:teuthology.orchestra.run.smithi116:> # Given a non-glob path, it better be there 2023-05-12T09:07:22.260 DEBUG:teuthology.orchestra.run.smithi116:> if "*" not in asok_path: 2023-05-12T09:07:22.261 DEBUG:teuthology.orchestra.run.smithi116:> assert(len(files) == 1) 2023-05-12T09:07:22.261 DEBUG:teuthology.orchestra.run.smithi116:> return files[0] 2023-05-12T09:07:22.261 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:22.262 DEBUG:teuthology.orchestra.run.smithi116:> for f in files: 2023-05-12T09:07:22.262 DEBUG:teuthology.orchestra.run.smithi116:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-12T09:07:22.262 DEBUG:teuthology.orchestra.run.smithi116:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-12T09:07:22.262 DEBUG:teuthology.orchestra.run.smithi116:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-12T09:07:22.263 DEBUG:teuthology.orchestra.run.smithi116:> contents = proc_f.read() 2023-05-12T09:07:22.263 DEBUG:teuthology.orchestra.run.smithi116:> if mountpoint in contents: 2023-05-12T09:07:22.263 DEBUG:teuthology.orchestra.run.smithi116:> return f 2023-05-12T09:07:22.263 DEBUG:teuthology.orchestra.run.smithi116:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-12T09:07:22.264 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:22.264 DEBUG:teuthology.orchestra.run.smithi116:> print(_find_admin_socket("client.admin")) 2023-05-12T09:07:22.264 DEBUG:teuthology.orchestra.run.smithi116:> ' 2023-05-12T09:07:22.428 INFO:teuthology.orchestra.run.smithi116.stdout:/var/run/ceph/ceph-client.admin.112123.asok 2023-05-12T09:07:22.607 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.112123.asok 2023-05-12T09:07:22.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:22.608 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.112123.asok status 2023-05-12T09:07:22.820 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-05-12T09:07:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "metadata": { 2023-05-12T09:07:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_sha1": "5a6b166b7c43e2b5890833e75dd257ab21264ded", 2023-05-12T09:07:22.820 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev)", 2023-05-12T09:07:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "entity_id": "admin", 2023-05-12T09:07:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "hostname": "smithi116", 2023-05-12T09:07:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-05-12T09:07:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "pid": "112123", 2023-05-12T09:07:22.821 INFO:teuthology.orchestra.run.smithi116.stdout: "root": "/" 2023-05-12T09:07:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_count": 0, 2023-05-12T09:07:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_pinned_count": 0, 2023-05-12T09:07:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 4440, 2023-05-12T09:07:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "inst": { 2023-05-12T09:07:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "name": { 2023-05-12T09:07:22.822 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "client", 2023-05-12T09:07:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "num": 4440 2023-05-12T09:07:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-05-12T09:07:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-05-12T09:07:22.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "192.168.0.1:0", 2023-05-12T09:07:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 333184919 2023-05-12T09:07:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:07:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-05-12T09:07:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-05-12T09:07:22.824 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "192.168.0.1:0", 2023-05-12T09:07:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 333184919 2023-05-12T09:07:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "inst_str": "client.4440 192.168.0.1:0/333184919", 2023-05-12T09:07:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "addr_str": "192.168.0.1:0/333184919", 2023-05-12T09:07:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "inode_count": 1, 2023-05-12T09:07:22.825 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_epoch": 7, 2023-05-12T09:07:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch": 24, 2023-05-12T09:07:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch_barrier": 0, 2023-05-12T09:07:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklisted": false, 2023-05-12T09:07:22.826 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs" 2023-05-12T09:07:22.826 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-05-12T09:07:22.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:22.834 DEBUG:teuthology.orchestra.run.smithi116:> stat --file-system '--printf=%T 2023-05-12T09:07:22.834 DEBUG:teuthology.orchestra.run.smithi116:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-05-12T09:07:22.877 INFO:teuthology.orchestra.run.smithi116.stdout:fuseblk 2023-05-12T09:07:22.877 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-05-12T09:07:22.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:22.878 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-05-12T09:07:22.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:22.981 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-05-12T09:07:23.112 INFO:teuthology.orchestra.run.smithi116.stdout:# file: . 2023-05-12T09:07:23.112 INFO:teuthology.orchestra.run.smithi116.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-05-12T09:07:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:23.113 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:07:23.114 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:07:23.155 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:23.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.375+0000 7f01ff3ff700 1 Processor -- start 2023-05-12T09:07:23.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.375+0000 7f01ff3ff700 1 -- start start 2023-05-12T09:07:23.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.376+0000 7f01ff3ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f01f815a280 0x7f01f815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.376+0000 7f01ff3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 0x7f01f80d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.376+0000 7f01ff3ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f815d6e0 con 0x7f01f80cd640 2023-05-12T09:07:23.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.376+0000 7f01ff3ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f815d9c0 con 0x7f01f815a280 2023-05-12T09:07:23.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.376+0000 7f01ff3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f815dca0 con 0x7f01f80d0b50 2023-05-12T09:07:23.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fd19b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f01f815a280 0x7f01f815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fd19b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f01f815a280 0x7f01f815cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:45164/0 (socket says 172.21.15.116:45164) 2023-05-12T09:07:23.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fc99a700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f01f80cd640 0x7f01f80cfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:46292/0 (socket says 172.21.15.116:46292) 2023-05-12T09:07:23.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fd99c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 0x7f01f80d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fd19b700 1 -- 172.21.15.116:0/2570774478 learned_addr learned my addr 172.21.15.116:0/2570774478 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:23.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fd99c700 1 -- 172.21.15.116:0/2570774478 >> v2:172.21.15.182:3300/0 conn(0x7f01f815a280 msgr2=0x7f01f815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:23.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fd99c700 1 --2- 172.21.15.116:0/2570774478 >> v2:172.21.15.182:3300/0 conn(0x7f01f815a280 0x7f01f815cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fd99c700 1 -- 172.21.15.116:0/2570774478 >> v1:172.21.15.182:6789/0 conn(0x7f01f80cd640 legacy=0x7f01f80cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fd99c700 1 -- 172.21.15.116:0/2570774478 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f80cf370 con 0x7f01f80d0b50 2023-05-12T09:07:23.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fd19b700 1 --2- 172.21.15.116:0/2570774478 >> v2:172.21.15.182:3300/0 conn(0x7f01f815a280 0x7f01f815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:23.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01effff700 1 -- 172.21.15.116:0/2570774478 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721409025 0 0) 0x7f01f815d6e0 con 0x7f01f80cd640 2023-05-12T09:07:23.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.377+0000 7f01fd99c700 1 --2- 172.21.15.116:0/2570774478 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 0x7f01f80d0fd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009d90 tx=0x7f01f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55123475681ca853 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:23.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01effff700 1 -- 172.21.15.116:0/2570774478 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000e070 con 0x7f01f80d0b50 2023-05-12T09:07:23.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01effff700 1 -- 172.21.15.116:0/2570774478 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f000bb20 con 0x7f01f80d0b50 2023-05-12T09:07:23.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01effff700 1 -- 172.21.15.116:0/2570774478 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0012430 con 0x7f01f80d0b50 2023-05-12T09:07:23.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01ff3ff700 1 -- 172.21.15.116:0/2570774478 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 msgr2=0x7f01f80d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01ff3ff700 1 --2- 172.21.15.116:0/2570774478 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 0x7f01f80d0fd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009d90 tx=0x7f01f000b330 comp rx=0 tx=0).stop 2023-05-12T09:07:23.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01ff3ff700 1 -- 172.21.15.116:0/2570774478 shutdown_connections 2023-05-12T09:07:23.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01ff3ff700 1 --2- 172.21.15.116:0/2570774478 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 0x7f01f80d0fd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01ff3ff700 1 --2- 172.21.15.116:0/2570774478 >> v2:172.21.15.182:3300/0 conn(0x7f01f815a280 0x7f01f815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01ff3ff700 1 -- 172.21.15.116:0/2570774478 >> 172.21.15.116:0/2570774478 conn(0x7f01f8066260 msgr2=0x7f01f8071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:23.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01ff3ff700 1 -- 172.21.15.116:0/2570774478 shutdown_connections 2023-05-12T09:07:23.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.378+0000 7f01ff3ff700 1 -- 172.21.15.116:0/2570774478 wait complete. 2023-05-12T09:07:23.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.380+0000 7f01ff3ff700 1 Processor -- start 2023-05-12T09:07:23.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.380+0000 7f01ff3ff700 1 -- start start 2023-05-12T09:07:23.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.381+0000 7f01ff3ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f01f80cd640 0x7f01f80b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.381+0000 7f01ff3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 0x7f01f81581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.381+0000 7f01ff3ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f815a280 0x7f01f80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.381+0000 7f01ff3ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80b4220 con 0x7f01f815a280 2023-05-12T09:07:23.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.381+0000 7f01ff3ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80b4b80 con 0x7f01f80cd640 2023-05-12T09:07:23.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.381+0000 7f01ff3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80b3bf0 con 0x7f01f80d0b50 2023-05-12T09:07:23.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.381+0000 7f01fd99c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f815a280 0x7f01f80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01fd99c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f815a280 0x7f01f80b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39168/0 (socket says 172.21.15.116:39168) 2023-05-12T09:07:23.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01fd99c700 1 -- 172.21.15.116:0/1016065557 learned_addr learned my addr 172.21.15.116:0/1016065557 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:23.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01fc99a700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 0x7f01f81581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01fd19b700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f01f80cd640 0x7f01f80b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01fd99c700 1 -- 172.21.15.116:0/1016065557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 msgr2=0x7f01f81581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01fd99c700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 0x7f01f81581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01fd99c700 1 -- 172.21.15.116:0/1016065557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f01f80cd640 msgr2=0x7f01f80b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01fd99c700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f01f80cd640 0x7f01f80b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01fd99c700 1 -- 172.21.15.116:0/1016065557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f4009550 con 0x7f01f815a280 2023-05-12T09:07:23.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01fd99c700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f815a280 0x7f01f80b2a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b680 tx=0x7f01f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:23.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01edffb700 1 -- 172.21.15.116:0/1016065557 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0012430 con 0x7f01f815a280 2023-05-12T09:07:23.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01edffb700 1 -- 172.21.15.116:0/1016065557 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f0020070 con 0x7f01f815a280 2023-05-12T09:07:23.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.382+0000 7f01ff3ff700 1 -- 172.21.15.116:0/1016065557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f0009a70 con 0x7f01f815a280 2023-05-12T09:07:23.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.383+0000 7f01edffb700 1 -- 172.21.15.116:0/1016065557 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0004280 con 0x7f01f815a280 2023-05-12T09:07:23.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.383+0000 7f01ff3ff700 1 -- 172.21.15.116:0/1016065557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f815a650 con 0x7f01f815a280 2023-05-12T09:07:23.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.384+0000 7f01ff3ff700 1 -- 172.21.15.116:0/1016065557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f80cf650 con 0x7f01f815a280 2023-05-12T09:07:23.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.385+0000 7f01edffb700 1 -- 172.21.15.116:0/1016065557 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f01f00043e0 con 0x7f01f815a280 2023-05-12T09:07:23.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.385+0000 7f01edffb700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f01dc06ace0 0x7f01dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.386+0000 7f01edffb700 1 -- 172.21.15.116:0/1016065557 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f01f0022070 con 0x7f01f815a280 2023-05-12T09:07:23.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.386+0000 7f01fd19b700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f01dc06ace0 0x7f01dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.386+0000 7f01fd19b700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f01dc06ace0 0x7f01dc06d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01f80c9400 tx=0x7f01f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:23.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.390+0000 7f01edffb700 1 -- 172.21.15.116:0/1016065557 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f01f00564c0 con 0x7f01f815a280 2023-05-12T09:07:23.590 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.587+0000 7f01ff3ff700 1 -- 172.21.15.116:0/1016065557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01f815b960 con 0x7f01f815a280 2023-05-12T09:07:23.591 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.588+0000 7f01edffb700 1 -- 172.21.15.116:0/1016065557 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7f01f0059ae0 con 0x7f01f815a280 2023-05-12T09:07:23.592 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:23.592 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:23.593 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.590+0000 7f01ff3ff700 1 -- 172.21.15.116:0/1016065557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f01dc06ace0 msgr2=0x7f01dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.590+0000 7f01ff3ff700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f01dc06ace0 0x7f01dc06d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01f80c9400 tx=0x7f01f4008040 comp rx=0 tx=0).stop 2023-05-12T09:07:23.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.590+0000 7f01ff3ff700 1 -- 172.21.15.116:0/1016065557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f815a280 msgr2=0x7f01f80b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.591+0000 7f01ff3ff700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f815a280 0x7f01f80b2a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b680 tx=0x7f01f0004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.591+0000 7f01ff3ff700 1 -- 172.21.15.116:0/1016065557 shutdown_connections 2023-05-12T09:07:23.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.591+0000 7f01ff3ff700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f815a280 0x7f01f80b2a50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.591+0000 7f01ff3ff700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f01f80cd640 0x7f01f80b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.595 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.591+0000 7f01ff3ff700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f01dc06ace0 0x7f01dc06d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.595 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.591+0000 7f01ff3ff700 1 --2- 172.21.15.116:0/1016065557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f01f80d0b50 0x7f01f81581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.595 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.591+0000 7f01ff3ff700 1 -- 172.21.15.116:0/1016065557 >> 172.21.15.116:0/1016065557 conn(0x7f01f8066260 msgr2=0x7f01f815c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:23.595 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.591+0000 7f01ff3ff700 1 -- 172.21.15.116:0/1016065557 shutdown_connections 2023-05-12T09:07:23.595 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.591+0000 7f01ff3ff700 1 -- 172.21.15.116:0/1016065557 wait complete. 2023-05-12T09:07:23.611 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:07:23.612 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:07:23.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.796+0000 7fe8225ff700 1 Processor -- start 2023-05-12T09:07:23.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.796+0000 7fe8225ff700 1 -- start start 2023-05-12T09:07:23.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.797+0000 7fe8225ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe81c0cfbf0 0x7fe81c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.798+0000 7fe8225ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0d0020 con 0x7fe81c0d1100 2023-05-12T09:07:23.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.798+0000 7fe8225ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0cdc60 con 0x7fe81c0b87a0 2023-05-12T09:07:23.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.798+0000 7fe8225ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c0d02d0 con 0x7fe81c0cfbf0 2023-05-12T09:07:23.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.798+0000 7fe81b7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe81c0cfbf0 0x7fe81c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.798+0000 7fe81b7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe81c0cfbf0 0x7fe81c1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39184/0 (socket says 172.21.15.116:39184) 2023-05-12T09:07:23.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.798+0000 7fe81b7fe700 1 -- 172.21.15.116:0/171313706 learned_addr learned my addr 172.21.15.116:0/171313706 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:23.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.798+0000 7fe820b9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe81c0d1100 0x7fe81c0d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:32948/0 (socket says 172.21.15.116:32948) 2023-05-12T09:07:23.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.798+0000 7fe81b7fe700 1 -- 172.21.15.116:0/171313706 >> v1:172.21.15.182:6789/0 conn(0x7fe81c0b87a0 legacy=0x7fe81c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.798+0000 7fe81b7fe700 1 -- 172.21.15.116:0/171313706 >> v1:172.21.15.116:6789/0 conn(0x7fe81c0d1100 legacy=0x7fe81c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.798+0000 7fe81b7fe700 1 -- 172.21.15.116:0/171313706 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0cd6a0 con 0x7fe81c0cfbf0 2023-05-12T09:07:23.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.799+0000 7fe81b7fe700 1 --2- 172.21.15.116:0/171313706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0cfbf0 0x7fe81c1608f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8100098f0 tx=0x7fe810009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db56aa6c40463a57 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:23.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.799+0000 7fe81affd700 1 -- 172.21.15.116:0/171313706 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81000b8a0 con 0x7fe81c0cfbf0 2023-05-12T09:07:23.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.799+0000 7fe81affd700 1 -- 172.21.15.116:0/171313706 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81000ba00 con 0x7fe81c0cfbf0 2023-05-12T09:07:23.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.799+0000 7fe81affd700 1 -- 172.21.15.116:0/171313706 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81000bd90 con 0x7fe81c0cfbf0 2023-05-12T09:07:23.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.799+0000 7fe8225ff700 1 -- 172.21.15.116:0/171313706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0cfbf0 msgr2=0x7fe81c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.799+0000 7fe8225ff700 1 --2- 172.21.15.116:0/171313706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0cfbf0 0x7fe81c1608f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8100098f0 tx=0x7fe810009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:23.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.799+0000 7fe8225ff700 1 -- 172.21.15.116:0/171313706 shutdown_connections 2023-05-12T09:07:23.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.799+0000 7fe8225ff700 1 --2- 172.21.15.116:0/171313706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0cfbf0 0x7fe81c1608f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.799+0000 7fe8225ff700 1 -- 172.21.15.116:0/171313706 >> 172.21.15.116:0/171313706 conn(0x7fe81c071b10 msgr2=0x7fe81c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:23.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.799+0000 7fe8225ff700 1 -- 172.21.15.116:0/171313706 shutdown_connections 2023-05-12T09:07:23.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.800+0000 7fe8225ff700 1 -- 172.21.15.116:0/171313706 wait complete. 2023-05-12T09:07:23.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.801+0000 7fe8225ff700 1 Processor -- start 2023-05-12T09:07:23.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.801+0000 7fe8225ff700 1 -- start start 2023-05-12T09:07:23.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.802+0000 7fe8225ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0b87a0 0x7fe81c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.802+0000 7fe8225ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe81c0cfbf0 0x7fe81c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.802+0000 7fe8225ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe81c0d1100 0x7fe81c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.802+0000 7fe8225ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c15b500 con 0x7fe81c0b87a0 2023-05-12T09:07:23.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.802+0000 7fe8225ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1e6e40 con 0x7fe81c0d1100 2023-05-12T09:07:23.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.802+0000 7fe8225ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1e7120 con 0x7fe81c0cfbf0 2023-05-12T09:07:23.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.802+0000 7fe81bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0b87a0 0x7fe81c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.802+0000 7fe81bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0b87a0 0x7fe81c14e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39192/0 (socket says 172.21.15.116:39192) 2023-05-12T09:07:23.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.802+0000 7fe81bfff700 1 -- 172.21.15.116:0/2885559450 learned_addr learned my addr 172.21.15.116:0/2885559450 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:23.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe820b9c700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe81c0d1100 0x7fe81c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe81b7fe700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe81c0cfbf0 0x7fe81c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe81bfff700 1 -- 172.21.15.116:0/2885559450 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe81c0cfbf0 msgr2=0x7fe81c0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe81bfff700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe81c0cfbf0 0x7fe81c0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe81bfff700 1 -- 172.21.15.116:0/2885559450 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe81c0d1100 msgr2=0x7fe81c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:23.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe81bfff700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe81c0d1100 0x7fe81c0cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:23.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe81bfff700 1 -- 172.21.15.116:0/2885559450 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe810009550 con 0x7fe81c0b87a0 2023-05-12T09:07:23.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe81bfff700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0b87a0 0x7fe81c14e0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00c4e0 tx=0x7fe80c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:23.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe818ff9700 1 -- 172.21.15.116:0/2885559450 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0052d0 con 0x7fe81c0b87a0 2023-05-12T09:07:23.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe818ff9700 1 -- 172.21.15.116:0/2885559450 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c005430 con 0x7fe81c0b87a0 2023-05-12T09:07:23.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe818ff9700 1 -- 172.21.15.116:0/2885559450 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0038c0 con 0x7fe81c0b87a0 2023-05-12T09:07:23.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.803+0000 7fe8225ff700 1 -- 172.21.15.116:0/2885559450 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c160e30 con 0x7fe81c0b87a0 2023-05-12T09:07:23.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.804+0000 7fe8225ff700 1 -- 172.21.15.116:0/2885559450 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c0cd980 con 0x7fe81c0b87a0 2023-05-12T09:07:23.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.805+0000 7fe8225ff700 1 -- 172.21.15.116:0/2885559450 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c160fc0 con 0x7fe81c0b87a0 2023-05-12T09:07:23.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.806+0000 7fe818ff9700 1 -- 172.21.15.116:0/2885559450 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe80c003a20 con 0x7fe81c0b87a0 2023-05-12T09:07:23.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.806+0000 7fe818ff9700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe80806ace0 0x7fe80806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:23.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.807+0000 7fe818ff9700 1 -- 172.21.15.116:0/2885559450 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe80c088bb0 con 0x7fe81c0b87a0 2023-05-12T09:07:23.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.807+0000 7fe81b7fe700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe80806ace0 0x7fe80806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:23.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.807+0000 7fe81b7fe700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe80806ace0 0x7fe80806d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe810009c40 tx=0x7fe810008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:23.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:23.811+0000 7fe818ff9700 1 -- 172.21.15.116:0/2885559450 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe80c0538d0 con 0x7fe81c0b87a0 2023-05-12T09:07:24.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.001+0000 7fe8225ff700 1 -- 172.21.15.116:0/2885559450 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe81c0b52f0 con 0x7fe81c0b87a0 2023-05-12T09:07:24.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.002+0000 7fe818ff9700 1 -- 172.21.15.116:0/2885559450 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe80c017020 con 0x7fe81c0b87a0 2023-05-12T09:07:24.005 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 -- 172.21.15.116:0/2885559450 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe80806ace0 msgr2=0x7fe80806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe80806ace0 0x7fe80806d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe810009c40 tx=0x7fe810008030 comp rx=0 tx=0).stop 2023-05-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 -- 172.21.15.116:0/2885559450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0b87a0 msgr2=0x7fe81c14e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0b87a0 0x7fe81c14e0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00c4e0 tx=0x7fe80c00c7f0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 -- 172.21.15.116:0/2885559450 shutdown_connections 2023-05-12T09:07:24.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe81c0d1100 0x7fe81c0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0b87a0 0x7fe81c14e0d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe80806ace0 0x7fe80806d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 --2- 172.21.15.116:0/2885559450 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe81c0cfbf0 0x7fe81c0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 -- 172.21.15.116:0/2885559450 >> 172.21.15.116:0/2885559450 conn(0x7fe81c071b10 msgr2=0x7fe81c0b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:24.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 -- 172.21.15.116:0/2885559450 shutdown_connections 2023-05-12T09:07:24.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.004+0000 7fe8225ff700 1 -- 172.21.15.116:0/2885559450 wait complete. 2023-05-12T09:07:24.024 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:07:24.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.208+0000 7f35817ff700 1 Processor -- start 2023-05-12T09:07:24.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.208+0000 7f35817ff700 1 -- start start 2023-05-12T09:07:24.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.209+0000 7f35817ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c0b87a0 0x7f357c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.209+0000 7f35817ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f357c1601e0 0x7f357c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.209+0000 7f35817ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c160ff0 con 0x7f357c160b70 2023-05-12T09:07:24.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.209+0000 7f35817ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c0d02d0 con 0x7f357c1601e0 2023-05-12T09:07:24.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.209+0000 7f35817ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0d0cb0 con 0x7f357c0b87a0 2023-05-12T09:07:24.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.210+0000 7f3573fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f357c1601e0 0x7f357c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.210+0000 7f3573fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f357c1601e0 0x7f357c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39206/0 (socket says 172.21.15.116:39206) 2023-05-12T09:07:24.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.210+0000 7f3573fff700 1 -- 172.21.15.116:0/348848850 learned_addr learned my addr 172.21.15.116:0/348848850 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:24.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.210+0000 7f357affd700 1 --2- 172.21.15.116:0/348848850 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c0b87a0 0x7f357c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.210+0000 7f3573fff700 1 -- 172.21.15.116:0/348848850 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c0b87a0 msgr2=0x7f357c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:24.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.210+0000 7f3573fff700 1 --2- 172.21.15.116:0/348848850 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c0b87a0 0x7f357c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.210+0000 7f3573fff700 1 -- 172.21.15.116:0/348848850 >> v1:172.21.15.182:6789/0 conn(0x7f357c160b70 legacy=0x7f357c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.210+0000 7f3573fff700 1 -- 172.21.15.116:0/348848850 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0cdc60 con 0x7f357c1601e0 2023-05-12T09:07:24.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.210+0000 7f357affd700 1 --2- 172.21.15.116:0/348848850 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c0b87a0 0x7f357c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:24.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.210+0000 7f3573fff700 1 --2- 172.21.15.116:0/348848850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c1601e0 0x7f357c160630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f35640098f0 tx=0x7f3564009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7bb037d0edf815 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:24.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f357a7fc700 1 -- 172.21.15.116:0/348848850 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356400b8a0 con 0x7f357c1601e0 2023-05-12T09:07:24.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f357a7fc700 1 -- 172.21.15.116:0/348848850 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356400ba00 con 0x7f357c1601e0 2023-05-12T09:07:24.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f357a7fc700 1 -- 172.21.15.116:0/348848850 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356400bd90 con 0x7f357c1601e0 2023-05-12T09:07:24.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f35817ff700 1 -- 172.21.15.116:0/348848850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c1601e0 msgr2=0x7f357c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f35817ff700 1 --2- 172.21.15.116:0/348848850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c1601e0 0x7f357c160630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f35640098f0 tx=0x7f3564009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:24.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f35817ff700 1 -- 172.21.15.116:0/348848850 shutdown_connections 2023-05-12T09:07:24.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f35817ff700 1 --2- 172.21.15.116:0/348848850 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c0b87a0 0x7f357c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f35817ff700 1 --2- 172.21.15.116:0/348848850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c1601e0 0x7f357c160630 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f35817ff700 1 -- 172.21.15.116:0/348848850 >> 172.21.15.116:0/348848850 conn(0x7f357c071b10 msgr2=0x7f357c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:24.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f35817ff700 1 -- 172.21.15.116:0/348848850 shutdown_connections 2023-05-12T09:07:24.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.211+0000 7f35817ff700 1 -- 172.21.15.116:0/348848850 wait complete. 2023-05-12T09:07:24.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.213+0000 7f35817ff700 1 Processor -- start 2023-05-12T09:07:24.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.213+0000 7f35817ff700 1 -- start start 2023-05-12T09:07:24.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.214+0000 7f35817ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c0b87a0 0x7f357c0c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.214+0000 7f35817ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f357c1601e0 0x7f357c159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.214+0000 7f35817ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c160b70 0x7f357c0cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.214+0000 7f35817ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c1e6a60 con 0x7f357c0b87a0 2023-05-12T09:07:24.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.214+0000 7f35817ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c1e6180 con 0x7f357c1601e0 2023-05-12T09:07:24.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.214+0000 7f35817ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c1e6cd0 con 0x7f357c160b70 2023-05-12T09:07:24.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357affd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c0b87a0 0x7f357c0c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357affd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c0b87a0 0x7f357c0c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39208/0 (socket says 172.21.15.116:39208) 2023-05-12T09:07:24.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357affd700 1 -- 172.21.15.116:0/3033062020 learned_addr learned my addr 172.21.15.116:0/3033062020 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:24.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f3573fff700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f357c1601e0 0x7f357c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357b7fe700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c160b70 0x7f357c0cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357affd700 1 -- 172.21.15.116:0/3033062020 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c160b70 msgr2=0x7f357c0cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357affd700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c160b70 0x7f357c0cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357affd700 1 -- 172.21.15.116:0/3033062020 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f357c1601e0 msgr2=0x7f357c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357affd700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f357c1601e0 0x7f357c159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357affd700 1 -- 172.21.15.116:0/3033062020 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564009550 con 0x7f357c0b87a0 2023-05-12T09:07:24.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357b7fe700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c160b70 0x7f357c0cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:24.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.215+0000 7f357affd700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c0b87a0 0x7f357c0c69c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f356c00e810 tx=0x7f356c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:24.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.216+0000 7f35737fe700 1 -- 172.21.15.116:0/3033062020 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c004230 con 0x7f357c0b87a0 2023-05-12T09:07:24.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.216+0000 7f35737fe700 1 -- 172.21.15.116:0/3033062020 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0043b0 con 0x7f357c0b87a0 2023-05-12T09:07:24.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.216+0000 7f35817ff700 1 -- 172.21.15.116:0/3033062020 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c0cd980 con 0x7f357c0b87a0 2023-05-12T09:07:24.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.216+0000 7f35737fe700 1 -- 172.21.15.116:0/3033062020 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0038e0 con 0x7f357c0b87a0 2023-05-12T09:07:24.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.216+0000 7f35817ff700 1 -- 172.21.15.116:0/3033062020 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c0cd6a0 con 0x7f357c0b87a0 2023-05-12T09:07:24.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.217+0000 7f35817ff700 1 -- 172.21.15.116:0/3033062020 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c0d2110 con 0x7f357c0b87a0 2023-05-12T09:07:24.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.217+0000 7f35737fe700 1 -- 172.21.15.116:0/3033062020 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f356c003a40 con 0x7f357c0b87a0 2023-05-12T09:07:24.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.218+0000 7f35737fe700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f355c06ace0 0x7f355c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.218+0000 7f35737fe700 1 -- 172.21.15.116:0/3033062020 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f356c089240 con 0x7f357c0b87a0 2023-05-12T09:07:24.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.219+0000 7f3573fff700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f355c06ace0 0x7f355c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.219+0000 7f3573fff700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f355c06ace0 0x7f355c06d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3564009c40 tx=0x7f3564008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:24.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.222+0000 7f35737fe700 1 -- 172.21.15.116:0/3033062020 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f356c0579f0 con 0x7f357c0b87a0 2023-05-12T09:07:24.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.417+0000 7f35817ff700 1 -- 172.21.15.116:0/3033062020 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f357c1e6e90 con 0x7f357c0b87a0 2023-05-12T09:07:24.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.417+0000 7f35737fe700 1 -- 172.21.15.116:0/3033062020 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f356c0094c0 con 0x7f357c0b87a0 2023-05-12T09:07:24.421 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:07:24.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 -- 172.21.15.116:0/3033062020 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f355c06ace0 msgr2=0x7f355c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f355c06ace0 0x7f355c06d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3564009c40 tx=0x7f3564008030 comp rx=0 tx=0).stop 2023-05-12T09:07:24.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 -- 172.21.15.116:0/3033062020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c0b87a0 msgr2=0x7f357c0c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c0b87a0 0x7f357c0c69c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f356c00e810 tx=0x7f356c00eb20 comp rx=0 tx=0).stop 2023-05-12T09:07:24.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 -- 172.21.15.116:0/3033062020 shutdown_connections 2023-05-12T09:07:24.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f355c06ace0 0x7f355c06d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f357c160b70 0x7f357c0cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f357c0b87a0 0x7f357c0c69c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 --2- 172.21.15.116:0/3033062020 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f357c1601e0 0x7f357c159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 -- 172.21.15.116:0/3033062020 >> 172.21.15.116:0/3033062020 conn(0x7f357c071b10 msgr2=0x7f357c06bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:24.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 -- 172.21.15.116:0/3033062020 shutdown_connections 2023-05-12T09:07:24.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.420+0000 7f35817ff700 1 -- 172.21.15.116:0/3033062020 wait complete. 2023-05-12T09:07:24.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:07:24.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.624+0000 7ff5927ff700 1 Processor -- start 2023-05-12T09:07:24.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.624+0000 7ff5927ff700 1 -- start start 2023-05-12T09:07:24.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.625+0000 7ff5927ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7ff58c0cfbf0 0x7ff58c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.625+0000 7ff5927ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0d0020 con 0x7ff58c0d1100 2023-05-12T09:07:24.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.625+0000 7ff5927ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0cdc60 con 0x7ff58c0b87a0 2023-05-12T09:07:24.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.625+0000 7ff5927ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58c0d02d0 con 0x7ff58c0cfbf0 2023-05-12T09:07:24.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.626+0000 7ff590d9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff58c0d1100 0x7ff58c0d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:32952/0 (socket says 172.21.15.116:32952) 2023-05-12T09:07:24.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.626+0000 7ff590d9c700 1 -- 172.21.15.116:0/2471781014 learned_addr learned my addr 172.21.15.116:0/2471781014 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:24.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.626+0000 7ff58b7fe700 1 --2- 172.21.15.116:0/2471781014 >> v2:172.21.15.182:3300/0 conn(0x7ff58c0cfbf0 0x7ff58c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.626+0000 7ff58affd700 1 -- 172.21.15.116:0/2471781014 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727435062 0 0) 0x7ff58c0d0020 con 0x7ff58c0d1100 2023-05-12T09:07:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.626+0000 7ff58affd700 1 -- 172.21.15.116:0/2471781014 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5740035b0 con 0x7ff58c0d1100 2023-05-12T09:07:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.626+0000 7ff58b7fe700 1 -- 172.21.15.116:0/2471781014 >> v1:172.21.15.182:6789/0 conn(0x7ff58c0b87a0 legacy=0x7ff58c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.626+0000 7ff58b7fe700 1 -- 172.21.15.116:0/2471781014 >> v1:172.21.15.116:6789/0 conn(0x7ff58c0d1100 legacy=0x7ff58c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.626+0000 7ff58b7fe700 1 -- 172.21.15.116:0/2471781014 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0cd6a0 con 0x7ff58c0cfbf0 2023-05-12T09:07:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.627+0000 7ff58b7fe700 1 --2- 172.21.15.116:0/2471781014 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff58c0cfbf0 0x7ff58c1608f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff580009840 tx=0x7ff580009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4059bdb786070626 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.627+0000 7ff58affd700 1 -- 172.21.15.116:0/2471781014 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580011830 con 0x7ff58c0cfbf0 2023-05-12T09:07:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.627+0000 7ff58affd700 1 -- 172.21.15.116:0/2471781014 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580011990 con 0x7ff58c0cfbf0 2023-05-12T09:07:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.627+0000 7ff58affd700 1 -- 172.21.15.116:0/2471781014 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580011d20 con 0x7ff58c0cfbf0 2023-05-12T09:07:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.627+0000 7ff5927ff700 1 -- 172.21.15.116:0/2471781014 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff58c0cfbf0 msgr2=0x7ff58c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.627+0000 7ff5927ff700 1 --2- 172.21.15.116:0/2471781014 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff58c0cfbf0 0x7ff58c1608f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff580009840 tx=0x7ff580009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.627+0000 7ff5927ff700 1 -- 172.21.15.116:0/2471781014 shutdown_connections 2023-05-12T09:07:24.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.627+0000 7ff5927ff700 1 --2- 172.21.15.116:0/2471781014 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff58c0cfbf0 0x7ff58c1608f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.627+0000 7ff5927ff700 1 -- 172.21.15.116:0/2471781014 >> 172.21.15.116:0/2471781014 conn(0x7ff58c071b10 msgr2=0x7ff58c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:24.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.628+0000 7ff5927ff700 1 -- 172.21.15.116:0/2471781014 shutdown_connections 2023-05-12T09:07:24.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.628+0000 7ff5927ff700 1 -- 172.21.15.116:0/2471781014 wait complete. 2023-05-12T09:07:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.629+0000 7ff5927ff700 1 Processor -- start 2023-05-12T09:07:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.629+0000 7ff5927ff700 1 -- start start 2023-05-12T09:07:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.630+0000 7ff5927ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff58c0b87a0 0x7ff58c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.630+0000 7ff5927ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff58c0cfbf0 0x7ff58c159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.630+0000 7ff5927ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff58c0d1100 0x7ff58c0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.630+0000 7ff5927ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0cd060 con 0x7ff58c0d1100 2023-05-12T09:07:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.630+0000 7ff5927ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0cce10 con 0x7ff58c0cfbf0 2023-05-12T09:07:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.630+0000 7ff5927ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c15a1d0 con 0x7ff58c0b87a0 2023-05-12T09:07:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.630+0000 7ff590d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff58c0d1100 0x7ff58c0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff590d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff58c0d1100 0x7ff58c0ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39220/0 (socket says 172.21.15.116:39220) 2023-05-12T09:07:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff590d9c700 1 -- 172.21.15.116:0/1261130635 learned_addr learned my addr 172.21.15.116:0/1261130635 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff58b7fe700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff58c0cfbf0 0x7ff58c159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff58bfff700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff58c0b87a0 0x7ff58c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff590d9c700 1 -- 172.21.15.116:0/1261130635 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff58c0b87a0 msgr2=0x7ff58c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff590d9c700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff58c0b87a0 0x7ff58c0cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff590d9c700 1 -- 172.21.15.116:0/1261130635 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff58c0cfbf0 msgr2=0x7ff58c159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff590d9c700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff58c0cfbf0 0x7ff58c159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff590d9c700 1 -- 172.21.15.116:0/1261130635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5800094a0 con 0x7ff58c0d1100 2023-05-12T09:07:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff590d9c700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff58c0d1100 0x7ff58c0ca0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff58400cad0 tx=0x7ff58400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.631+0000 7ff588ff9700 1 -- 172.21.15.116:0/1261130635 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400a9a0 con 0x7ff58c0d1100 2023-05-12T09:07:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.632+0000 7ff588ff9700 1 -- 172.21.15.116:0/1261130635 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58400ab00 con 0x7ff58c0d1100 2023-05-12T09:07:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.632+0000 7ff5927ff700 1 -- 172.21.15.116:0/1261130635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c160e30 con 0x7ff58c0d1100 2023-05-12T09:07:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.632+0000 7ff588ff9700 1 -- 172.21.15.116:0/1261130635 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400ae90 con 0x7ff58c0d1100 2023-05-12T09:07:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.632+0000 7ff5927ff700 1 -- 172.21.15.116:0/1261130635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c0cd980 con 0x7ff58c0d1100 2023-05-12T09:07:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.633+0000 7ff5927ff700 1 -- 172.21.15.116:0/1261130635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58c160fc0 con 0x7ff58c0d1100 2023-05-12T09:07:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.633+0000 7ff588ff9700 1 -- 172.21.15.116:0/1261130635 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff58401b3b0 con 0x7ff58c0d1100 2023-05-12T09:07:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.634+0000 7ff588ff9700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff57806acb0 0x7ff57806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.634+0000 7ff588ff9700 1 -- 172.21.15.116:0/1261130635 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff584089470 con 0x7ff58c0d1100 2023-05-12T09:07:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.635+0000 7ff58bfff700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff57806acb0 0x7ff57806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.635+0000 7ff58bfff700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff57806acb0 0x7ff57806d160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff58c1e6940 tx=0x7ff57c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.638+0000 7ff588ff9700 1 -- 172.21.15.116:0/1261130635 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff584054190 con 0x7ff58c0d1100 2023-05-12T09:07:24.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.833+0000 7ff5927ff700 1 -- 172.21.15.116:0/1261130635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff58c0ca5e0 con 0x7ff58c0d1100 2023-05-12T09:07:24.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.834+0000 7ff588ff9700 1 -- 172.21.15.116:0/1261130635 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5840577b0 con 0x7ff58c0d1100 2023-05-12T09:07:24.837 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:07:24.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 -- 172.21.15.116:0/1261130635 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff57806acb0 msgr2=0x7ff57806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff57806acb0 0x7ff57806d160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff58c1e6940 tx=0x7ff57c009040 comp rx=0 tx=0).stop 2023-05-12T09:07:24.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 -- 172.21.15.116:0/1261130635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff58c0d1100 msgr2=0x7ff58c0ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:24.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff58c0d1100 0x7ff58c0ca0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff58400cad0 tx=0x7ff58400cde0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 -- 172.21.15.116:0/1261130635 shutdown_connections 2023-05-12T09:07:24.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff58c0d1100 0x7ff58c0ca0a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff57806acb0 0x7ff57806d160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff58c0b87a0 0x7ff58c0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 --2- 172.21.15.116:0/1261130635 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff58c0cfbf0 0x7ff58c159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:24.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 -- 172.21.15.116:0/1261130635 >> 172.21.15.116:0/1261130635 conn(0x7ff58c071b10 msgr2=0x7ff58c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:24.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 -- 172.21.15.116:0/1261130635 shutdown_connections 2023-05-12T09:07:24.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:24.836+0000 7ff5927ff700 1 -- 172.21.15.116:0/1261130635 wait complete. 2023-05-12T09:07:24.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:07:25.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.041+0000 7f6e6c5ff700 1 Processor -- start 2023-05-12T09:07:25.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.041+0000 7f6e6c5ff700 1 -- start start 2023-05-12T09:07:25.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.042+0000 7f6e6c5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6e640b87a0 0x7f6e640cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.042+0000 7f6e6c5ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6e641601e0 0x7f6e64160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.042+0000 7f6e6c5ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e64160ff0 con 0x7f6e64160b70 2023-05-12T09:07:25.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.042+0000 7f6e6c5ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e640d02d0 con 0x7f6e641601e0 2023-05-12T09:07:25.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.042+0000 7f6e6c5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e640d0cb0 con 0x7f6e640b87a0 2023-05-12T09:07:25.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.043+0000 7f6e69b9a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6e641601e0 0x7f6e64160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.043+0000 7f6e69b9a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6e641601e0 0x7f6e64160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39224/0 (socket says 172.21.15.116:39224) 2023-05-12T09:07:25.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.043+0000 7f6e69b9a700 1 -- 172.21.15.116:0/1601794745 learned_addr learned my addr 172.21.15.116:0/1601794745 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:25.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.043+0000 7f6e6a39b700 1 --2- 172.21.15.116:0/1601794745 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6e640b87a0 0x7f6e640cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.043+0000 7f6e69b9a700 1 -- 172.21.15.116:0/1601794745 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6e640b87a0 msgr2=0x7f6e640cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:25.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.043+0000 7f6e69b9a700 1 --2- 172.21.15.116:0/1601794745 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6e640b87a0 0x7f6e640cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.043+0000 7f6e69b9a700 1 -- 172.21.15.116:0/1601794745 >> v1:172.21.15.182:6789/0 conn(0x7f6e64160b70 legacy=0x7f6e640d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.043+0000 7f6e69b9a700 1 -- 172.21.15.116:0/1601794745 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e640cdc60 con 0x7f6e641601e0 2023-05-12T09:07:25.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.043+0000 7f6e69b9a700 1 --2- 172.21.15.116:0/1601794745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e641601e0 0x7f6e64160630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e540098f0 tx=0x7f6e54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c67daee9b0e5759 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:25.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e69399700 1 -- 172.21.15.116:0/1601794745 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400b8a0 con 0x7f6e641601e0 2023-05-12T09:07:25.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e69399700 1 -- 172.21.15.116:0/1601794745 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5400ba00 con 0x7f6e641601e0 2023-05-12T09:07:25.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e69399700 1 -- 172.21.15.116:0/1601794745 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400bd90 con 0x7f6e641601e0 2023-05-12T09:07:25.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/1601794745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e641601e0 msgr2=0x7f6e64160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e6c5ff700 1 --2- 172.21.15.116:0/1601794745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e641601e0 0x7f6e64160630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e540098f0 tx=0x7f6e54009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:25.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/1601794745 shutdown_connections 2023-05-12T09:07:25.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e6c5ff700 1 --2- 172.21.15.116:0/1601794745 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6e640b87a0 0x7f6e640cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e6c5ff700 1 --2- 172.21.15.116:0/1601794745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e641601e0 0x7f6e64160630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/1601794745 >> 172.21.15.116:0/1601794745 conn(0x7f6e64071b10 msgr2=0x7f6e64071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:25.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/1601794745 shutdown_connections 2023-05-12T09:07:25.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.044+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/1601794745 wait complete. 2023-05-12T09:07:25.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.046+0000 7f6e6c5ff700 1 Processor -- start 2023-05-12T09:07:25.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.046+0000 7f6e6c5ff700 1 -- start start 2023-05-12T09:07:25.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.047+0000 7f6e6c5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6e640b87a0 0x7f6e640b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.047+0000 7f6e6c5ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6e641601e0 0x7f6e640c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.047+0000 7f6e6c5ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e64160b70 0x7f6e640c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.047+0000 7f6e6c5ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e641e8460 con 0x7f6e64160b70 2023-05-12T09:07:25.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.047+0000 7f6e6c5ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e640c8aa0 con 0x7f6e641601e0 2023-05-12T09:07:25.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.047+0000 7f6e6c5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e640c8d80 con 0x7f6e640b87a0 2023-05-12T09:07:25.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.047+0000 7f6e6ab9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e64160b70 0x7f6e640c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.047+0000 7f6e6ab9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e64160b70 0x7f6e640c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39228/0 (socket says 172.21.15.116:39228) 2023-05-12T09:07:25.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.047+0000 7f6e6ab9c700 1 -- 172.21.15.116:0/2425465932 learned_addr learned my addr 172.21.15.116:0/2425465932 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:25.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e6a39b700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6e640b87a0 0x7f6e640b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e69b9a700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6e641601e0 0x7f6e640c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e6ab9c700 1 -- 172.21.15.116:0/2425465932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6e640b87a0 msgr2=0x7f6e640b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e6ab9c700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6e640b87a0 0x7f6e640b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e6ab9c700 1 -- 172.21.15.116:0/2425465932 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6e641601e0 msgr2=0x7f6e640c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e6ab9c700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6e641601e0 0x7f6e640c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e6ab9c700 1 -- 172.21.15.116:0/2425465932 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54009550 con 0x7f6e64160b70 2023-05-12T09:07:25.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e6ab9c700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e64160b70 0x7f6e640c8490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00cb50 tx=0x7f6e5c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:25.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e5affd700 1 -- 172.21.15.116:0/2425465932 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c003c00 con 0x7f6e64160b70 2023-05-12T09:07:25.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e5affd700 1 -- 172.21.15.116:0/2425465932 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c003d60 con 0x7f6e64160b70 2023-05-12T09:07:25.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/2425465932 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e640cd980 con 0x7f6e64160b70 2023-05-12T09:07:25.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e5affd700 1 -- 172.21.15.116:0/2425465932 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c00ab70 con 0x7f6e64160b70 2023-05-12T09:07:25.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.048+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/2425465932 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e640cd6a0 con 0x7f6e64160b70 2023-05-12T09:07:25.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.049+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/2425465932 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e640d2110 con 0x7f6e64160b70 2023-05-12T09:07:25.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.050+0000 7f6e5affd700 1 -- 172.21.15.116:0/2425465932 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6e5c00acd0 con 0x7f6e64160b70 2023-05-12T09:07:25.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.051+0000 7f6e5affd700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6e4806ace0 0x7f6e4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.051+0000 7f6e5affd700 1 -- 172.21.15.116:0/2425465932 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6e5c089810 con 0x7f6e64160b70 2023-05-12T09:07:25.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.051+0000 7f6e6a39b700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6e4806ace0 0x7f6e4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.052+0000 7f6e6a39b700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6e4806ace0 0x7f6e4806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009930 tx=0x7f6e60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:25.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.056+0000 7f6e5affd700 1 -- 172.21.15.116:0/2425465932 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6e5c0545d0 con 0x7f6e64160b70 2023-05-12T09:07:25.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.254+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/2425465932 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6e64074430 con 0x7f6e64160b70 2023-05-12T09:07:25.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.255+0000 7f6e5affd700 1 -- 172.21.15.116:0/2425465932 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6e5c057bf0 con 0x7f6e64160b70 2023-05-12T09:07:25.258 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:07:25.260 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/2425465932 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6e4806ace0 msgr2=0x7f6e4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6e4806ace0 0x7f6e4806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009930 tx=0x7f6e60008040 comp rx=0 tx=0).stop 2023-05-12T09:07:25.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/2425465932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e64160b70 msgr2=0x7f6e640c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e64160b70 0x7f6e640c8490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00cb50 tx=0x7f6e5c00cf10 comp rx=0 tx=0).stop 2023-05-12T09:07:25.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/2425465932 shutdown_connections 2023-05-12T09:07:25.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e64160b70 0x7f6e640c8490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6e4806ace0 0x7f6e4806d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6e640b87a0 0x7f6e640b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 --2- 172.21.15.116:0/2425465932 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6e641601e0 0x7f6e640c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/2425465932 >> 172.21.15.116:0/2425465932 conn(0x7f6e64071b10 msgr2=0x7f6e6415adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:25.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.257+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/2425465932 shutdown_connections 2023-05-12T09:07:25.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.258+0000 7f6e6c5ff700 1 -- 172.21.15.116:0/2425465932 wait complete. 2023-05-12T09:07:25.277 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:07:25.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.462+0000 7f558abff700 1 Processor -- start 2023-05-12T09:07:25.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.462+0000 7f558abff700 1 -- start start 2023-05-12T09:07:25.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.463+0000 7f558abff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f558415a140 0x7f55840cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.463+0000 7f558abff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5584160ba0 0x7f55840cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.463+0000 7f558abff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f55840cfe20 0x7f55840b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.463+0000 7f558abff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840d02a0 con 0x7f5584160ba0 2023-05-12T09:07:25.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.463+0000 7f558abff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558415d660 con 0x7f55840cfe20 2023-05-12T09:07:25.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.463+0000 7f558abff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558415cd70 con 0x7f558415a140 2023-05-12T09:07:25.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.463+0000 7f5583fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5584160ba0 0x7f55840cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.463+0000 7f5583fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5584160ba0 0x7f55840cf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39232/0 (socket says 172.21.15.116:39232) 2023-05-12T09:07:25.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f5583fff700 1 -- 172.21.15.116:0/2734737618 learned_addr learned my addr 172.21.15.116:0/2734737618 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:25.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f558919c700 1 --2- 172.21.15.116:0/2734737618 >> v2:172.21.15.182:3300/0 conn(0x7f55840cfe20 0x7f55840b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f558899b700 1 --2- 172.21.15.116:0/2734737618 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f558415a140 0x7f55840cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f5583fff700 1 -- 172.21.15.116:0/2734737618 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f558415a140 msgr2=0x7f55840cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:25.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f5583fff700 1 --2- 172.21.15.116:0/2734737618 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f558415a140 0x7f55840cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f5583fff700 1 -- 172.21.15.116:0/2734737618 >> v2:172.21.15.182:3300/0 conn(0x7f55840cfe20 msgr2=0x7f55840b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:25.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f5583fff700 1 --2- 172.21.15.116:0/2734737618 >> v2:172.21.15.182:3300/0 conn(0x7f55840cfe20 0x7f55840b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f5583fff700 1 -- 172.21.15.116:0/2734737618 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558415d010 con 0x7f5584160ba0 2023-05-12T09:07:25.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f5583fff700 1 --2- 172.21.15.116:0/2734737618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 0x7f55840cf8e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f55840b4ee0 tx=0x7f5570009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa769e85f9a077b server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:25.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f55837fe700 1 -- 172.21.15.116:0/2734737618 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557000b870 con 0x7f5584160ba0 2023-05-12T09:07:25.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f55837fe700 1 -- 172.21.15.116:0/2734737618 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557000b9d0 con 0x7f5584160ba0 2023-05-12T09:07:25.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.464+0000 7f55837fe700 1 -- 172.21.15.116:0/2734737618 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557000bd60 con 0x7f5584160ba0 2023-05-12T09:07:25.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.465+0000 7f558abff700 1 -- 172.21.15.116:0/2734737618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 msgr2=0x7f55840cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.465+0000 7f558abff700 1 --2- 172.21.15.116:0/2734737618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 0x7f55840cf8e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f55840b4ee0 tx=0x7f5570009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.465+0000 7f558abff700 1 -- 172.21.15.116:0/2734737618 shutdown_connections 2023-05-12T09:07:25.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.465+0000 7f558abff700 1 --2- 172.21.15.116:0/2734737618 >> v2:172.21.15.182:3300/0 conn(0x7f55840cfe20 0x7f55840b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.465+0000 7f558abff700 1 --2- 172.21.15.116:0/2734737618 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f558415a140 0x7f55840cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.465+0000 7f558abff700 1 --2- 172.21.15.116:0/2734737618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 0x7f55840cf8e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.465+0000 7f558abff700 1 -- 172.21.15.116:0/2734737618 >> 172.21.15.116:0/2734737618 conn(0x7f5584071b10 msgr2=0x7f5584071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:25.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.465+0000 7f558abff700 1 -- 172.21.15.116:0/2734737618 shutdown_connections 2023-05-12T09:07:25.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.465+0000 7f558abff700 1 -- 172.21.15.116:0/2734737618 wait complete. 2023-05-12T09:07:25.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.467+0000 7f558abff700 1 Processor -- start 2023-05-12T09:07:25.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.467+0000 7f558abff700 1 -- start start 2023-05-12T09:07:25.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558abff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f55840cfe20 0x7f558414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558abff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f558415a140 0x7f55840cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558abff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 0x7f55840b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558abff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840ccab0 con 0x7f5584160ba0 2023-05-12T09:07:25.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558abff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840cbe30 con 0x7f558415a140 2023-05-12T09:07:25.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558abff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840cc110 con 0x7f55840cfe20 2023-05-12T09:07:25.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558919c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 0x7f55840b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558919c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 0x7f55840b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39244/0 (socket says 172.21.15.116:39244) 2023-05-12T09:07:25.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558919c700 1 -- 172.21.15.116:0/3508317988 learned_addr learned my addr 172.21.15.116:0/3508317988 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:25.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558899b700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f55840cfe20 0x7f558414deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f5583fff700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f558415a140 0x7f55840cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558919c700 1 -- 172.21.15.116:0/3508317988 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f55840cfe20 msgr2=0x7f558414deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558919c700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f55840cfe20 0x7f558414deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558919c700 1 -- 172.21.15.116:0/3508317988 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f558415a140 msgr2=0x7f55840cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558919c700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f558415a140 0x7f55840cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.468+0000 7f558919c700 1 -- 172.21.15.116:0/3508317988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5570009550 con 0x7f5584160ba0 2023-05-12T09:07:25.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.469+0000 7f558919c700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 0x7f55840b7720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f557c007e60 tx=0x7f557c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:25.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.469+0000 7f55817fa700 1 -- 172.21.15.116:0/3508317988 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c00ed30 con 0x7f5584160ba0 2023-05-12T09:07:25.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.469+0000 7f55817fa700 1 -- 172.21.15.116:0/3508317988 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c014420 con 0x7f5584160ba0 2023-05-12T09:07:25.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.469+0000 7f558abff700 1 -- 172.21.15.116:0/3508317988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558415daf0 con 0x7f5584160ba0 2023-05-12T09:07:25.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.469+0000 7f55817fa700 1 -- 172.21.15.116:0/3508317988 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c0147d0 con 0x7f5584160ba0 2023-05-12T09:07:25.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.469+0000 7f558abff700 1 -- 172.21.15.116:0/3508317988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558415d2f0 con 0x7f5584160ba0 2023-05-12T09:07:25.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.470+0000 7f558abff700 1 -- 172.21.15.116:0/3508317988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55840cdb00 con 0x7f5584160ba0 2023-05-12T09:07:25.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.471+0000 7f55817fa700 1 -- 172.21.15.116:0/3508317988 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f557c014930 con 0x7f5584160ba0 2023-05-12T09:07:25.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.472+0000 7f55817fa700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f556806ace0 0x7f556806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.472+0000 7f55817fa700 1 -- 172.21.15.116:0/3508317988 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f557c089d20 con 0x7f5584160ba0 2023-05-12T09:07:25.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.472+0000 7f558899b700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f556806ace0 0x7f556806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.473+0000 7f558899b700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f556806ace0 0x7f556806d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5578006b20 tx=0x7f5578008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:25.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.477+0000 7f55817fa700 1 -- 172.21.15.116:0/3508317988 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f557c054b70 con 0x7f5584160ba0 2023-05-12T09:07:25.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.673+0000 7f558abff700 1 -- 172.21.15.116:0/3508317988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f55840ccbf0 con 0x7f5584160ba0 2023-05-12T09:07:25.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.673+0000 7f55817fa700 1 -- 172.21.15.116:0/3508317988 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f55840ccbf0 con 0x7f5584160ba0 2023-05-12T09:07:25.677 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:07:25.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.675+0000 7f558abff700 1 -- 172.21.15.116:0/3508317988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f556806ace0 msgr2=0x7f556806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.675+0000 7f558abff700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f556806ace0 0x7f556806d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5578006b20 tx=0x7f5578008040 comp rx=0 tx=0).stop 2023-05-12T09:07:25.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.675+0000 7f558abff700 1 -- 172.21.15.116:0/3508317988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 msgr2=0x7f55840b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.675+0000 7f558abff700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 0x7f55840b7720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f557c007e60 tx=0x7f557c00e3c0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.676+0000 7f558abff700 1 -- 172.21.15.116:0/3508317988 shutdown_connections 2023-05-12T09:07:25.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.676+0000 7f558abff700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5584160ba0 0x7f55840b7720 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.676+0000 7f558abff700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f556806ace0 0x7f556806d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.676+0000 7f558abff700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f55840cfe20 0x7f558414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.676+0000 7f558abff700 1 --2- 172.21.15.116:0/3508317988 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f558415a140 0x7f55840cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.676+0000 7f558abff700 1 -- 172.21.15.116:0/3508317988 >> 172.21.15.116:0/3508317988 conn(0x7f5584071b10 msgr2=0x7f5584072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:25.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.676+0000 7f558abff700 1 -- 172.21.15.116:0/3508317988 shutdown_connections 2023-05-12T09:07:25.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.676+0000 7f558abff700 1 -- 172.21.15.116:0/3508317988 wait complete. 2023-05-12T09:07:25.696 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-12T09:07:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.878+0000 7f6ad89ff700 1 Processor -- start 2023-05-12T09:07:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.878+0000 7f6ad89ff700 1 -- start start 2023-05-12T09:07:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.879+0000 7f6ad89ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f6ad40d2110 0x7f6ad4167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.879+0000 7f6ad89ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad4161000 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.879+0000 7f6ad89ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad40d0020 con 0x7f6ad40b87a0 2023-05-12T09:07:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.879+0000 7f6ad89ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad40d02d0 con 0x7f6ad40d2110 2023-05-12T09:07:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.879+0000 7f6ad1d9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f6ad40cfbf0 0x7f6ad41608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:32958/0 (socket says 172.21.15.116:32958) 2023-05-12T09:07:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.879+0000 7f6ad1d9b700 1 -- 172.21.15.116:0/837875894 learned_addr learned my addr 172.21.15.116:0/837875894 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.880+0000 7f6ad2d9d700 1 --2- 172.21.15.116:0/837875894 >> v2:172.21.15.182:3300/0 conn(0x7f6ad40d2110 0x7f6ad4167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.880+0000 7f6ad159a700 1 -- 172.21.15.116:0/837875894 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243853333 0 0) 0x7f6ad4161000 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.880+0000 7f6ad159a700 1 -- 172.21.15.116:0/837875894 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6abc0035b0 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.880+0000 7f6ad159a700 1 -- 172.21.15.116:0/837875894 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920285680 0 0) 0x7f6ad40d0020 con 0x7f6ad40b87a0 2023-05-12T09:07:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.880+0000 7f6ad159a700 1 -- 172.21.15.116:0/837875894 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad4161000 con 0x7f6ad40b87a0 2023-05-12T09:07:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.880+0000 7f6ad2d9d700 1 -- 172.21.15.116:0/837875894 >> v1:172.21.15.182:6789/0 conn(0x7f6ad40b87a0 legacy=0x7f6ad41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.880+0000 7f6ad2d9d700 1 -- 172.21.15.116:0/837875894 >> v1:172.21.15.116:6789/0 conn(0x7f6ad40cfbf0 legacy=0x7f6ad41608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.880+0000 7f6ad2d9d700 1 -- 172.21.15.116:0/837875894 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad40cdc60 con 0x7f6ad40d2110 2023-05-12T09:07:25.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.880+0000 7f6ad2d9d700 1 --2- 172.21.15.116:0/837875894 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ad40d2110 0x7f6ad4167550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009d90 tx=0x7f6acc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0de4612de1ebd1b server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:25.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.881+0000 7f6ad159a700 1 -- 172.21.15.116:0/837875894 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00e070 con 0x7f6ad40d2110 2023-05-12T09:07:25.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.881+0000 7f6ad159a700 1 -- 172.21.15.116:0/837875894 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc00bb20 con 0x7f6ad40d2110 2023-05-12T09:07:25.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.881+0000 7f6ad159a700 1 -- 172.21.15.116:0/837875894 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc012430 con 0x7f6ad40d2110 2023-05-12T09:07:25.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.881+0000 7f6ad89ff700 1 -- 172.21.15.116:0/837875894 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ad40d2110 msgr2=0x7f6ad4167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.881+0000 7f6ad89ff700 1 --2- 172.21.15.116:0/837875894 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ad40d2110 0x7f6ad4167550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009d90 tx=0x7f6acc00b330 comp rx=0 tx=0).stop 2023-05-12T09:07:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.881+0000 7f6ad89ff700 1 -- 172.21.15.116:0/837875894 shutdown_connections 2023-05-12T09:07:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.881+0000 7f6ad89ff700 1 --2- 172.21.15.116:0/837875894 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ad40d2110 0x7f6ad4167550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.881+0000 7f6ad89ff700 1 -- 172.21.15.116:0/837875894 >> 172.21.15.116:0/837875894 conn(0x7f6ad4071b10 msgr2=0x7f6ad4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.881+0000 7f6ad89ff700 1 -- 172.21.15.116:0/837875894 shutdown_connections 2023-05-12T09:07:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.881+0000 7f6ad89ff700 1 -- 172.21.15.116:0/837875894 wait complete. 2023-05-12T09:07:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.883+0000 7f6ad89ff700 1 Processor -- start 2023-05-12T09:07:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.883+0000 7f6ad89ff700 1 -- start start 2023-05-12T09:07:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad89ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6ad40b87a0 0x7f6ad414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad89ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ad40cfbf0 0x7f6ad41562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad89ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ad40d2110 0x7f6ad414ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad89ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4157300 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad89ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad41575e0 con 0x7f6ad40d2110 2023-05-12T09:07:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad89ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4155530 con 0x7f6ad40b87a0 2023-05-12T09:07:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad1d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ad40cfbf0 0x7f6ad41562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad1d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ad40cfbf0 0x7f6ad41562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39260/0 (socket says 172.21.15.116:39260) 2023-05-12T09:07:25.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad1d9b700 1 -- 172.21.15.116:0/3406621530 learned_addr learned my addr 172.21.15.116:0/3406621530 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:25.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad2d9d700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ad40d2110 0x7f6ad414ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.884+0000 7f6ad259c700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6ad40b87a0 0x7f6ad414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ad1d9b700 1 -- 172.21.15.116:0/3406621530 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6ad40b87a0 msgr2=0x7f6ad414e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ad1d9b700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6ad40b87a0 0x7f6ad414e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ad1d9b700 1 -- 172.21.15.116:0/3406621530 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ad40d2110 msgr2=0x7f6ad414ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ad1d9b700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ad40d2110 0x7f6ad414ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ad1d9b700 1 -- 172.21.15.116:0/3406621530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc009a70 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ad1d9b700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ad40cfbf0 0x7f6ad41562f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c700 tx=0x7f6ac800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ac2ffd700 1 -- 172.21.15.116:0/3406621530 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8005d70 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ac2ffd700 1 -- 172.21.15.116:0/3406621530 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac80070d0 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ad89ff700 1 -- 172.21.15.116:0/3406621530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad40cd980 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ac2ffd700 1 -- 172.21.15.116:0/3406621530 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8007460 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.885+0000 7f6ad89ff700 1 -- 172.21.15.116:0/3406621530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad40cd6a0 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.886+0000 7f6ad89ff700 1 -- 172.21.15.116:0/3406621530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad4167a90 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.887+0000 7f6ac2ffd700 1 -- 172.21.15.116:0/3406621530 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ac80075c0 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.888+0000 7f6ac2ffd700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6ab406ace0 0x7f6ab406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.888+0000 7f6ac2ffd700 1 -- 172.21.15.116:0/3406621530 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ac8088be0 con 0x7f6ad40cfbf0 2023-05-12T09:07:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.888+0000 7f6ad259c700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6ab406ace0 0x7f6ab406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.889+0000 7f6ad259c700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6ab406ace0 0x7f6ab406d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40011e0 tx=0x7f6ac4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:25.893+0000 7f6ac2ffd700 1 -- 172.21.15.116:0/3406621530 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6ac8053990 con 0x7f6ad40cfbf0 2023-05-12T09:07:26.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.104+0000 7f6ad89ff700 1 -- 172.21.15.116:0/3406621530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6ad40b52f0 con 0x7f6ad40cfbf0 2023-05-12T09:07:26.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.104+0000 7f6ac2ffd700 1 -- 172.21.15.116:0/3406621530 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6ac8017080 con 0x7f6ad40cfbf0 2023-05-12T09:07:26.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.106+0000 7f6ad89ff700 1 -- 172.21.15.116:0/3406621530 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6ab406ace0 msgr2=0x7f6ab406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.106+0000 7f6ad89ff700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6ab406ace0 0x7f6ab406d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40011e0 tx=0x7f6ac4009040 comp rx=0 tx=0).stop 2023-05-12T09:07:26.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.106+0000 7f6ad89ff700 1 -- 172.21.15.116:0/3406621530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ad40cfbf0 msgr2=0x7f6ad41562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.106+0000 7f6ad89ff700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ad40cfbf0 0x7f6ad41562f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c700 tx=0x7f6ac800ca10 comp rx=0 tx=0).stop 2023-05-12T09:07:26.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.107+0000 7f6ad89ff700 1 -- 172.21.15.116:0/3406621530 shutdown_connections 2023-05-12T09:07:26.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.107+0000 7f6ad89ff700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6ad40d2110 0x7f6ad414ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.107+0000 7f6ad89ff700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6ab406ace0 0x7f6ab406d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.107+0000 7f6ad89ff700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6ad40b87a0 0x7f6ad414e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.107+0000 7f6ad89ff700 1 --2- 172.21.15.116:0/3406621530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ad40cfbf0 0x7f6ad41562f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.107+0000 7f6ad89ff700 1 -- 172.21.15.116:0/3406621530 >> 172.21.15.116:0/3406621530 conn(0x7f6ad4071b10 msgr2=0x7f6ad4154920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:26.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.107+0000 7f6ad89ff700 1 -- 172.21.15.116:0/3406621530 shutdown_connections 2023-05-12T09:07:26.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.107+0000 7f6ad89ff700 1 -- 172.21.15.116:0/3406621530 wait complete. 2023-05-12T09:07:26.112 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2023-05-12T09:07:26.126 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:07:26.127 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:07:26.169 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:26.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.392+0000 7f26cb7ff700 1 Processor -- start 2023-05-12T09:07:26.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.392+0000 7f26cb7ff700 1 -- start start 2023-05-12T09:07:26.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.393+0000 7f26cb7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 0x7f26c41608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.393+0000 7f26cb7ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f26c40d1100 0x7f26c40d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.393+0000 7f26cb7ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c40d0020 con 0x7f26c40b87a0 2023-05-12T09:07:26.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.393+0000 7f26cb7ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c40d02d0 con 0x7f26c40d1100 2023-05-12T09:07:26.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.393+0000 7f26cb7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40d0cb0 con 0x7f26c40cfbf0 2023-05-12T09:07:26.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.393+0000 7f26c959b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f26c40b87a0 0x7f26c41601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:32964/0 (socket says 172.21.15.116:32964) 2023-05-12T09:07:26.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.393+0000 7f26c959b700 1 -- 172.21.15.116:0/1589698044 learned_addr learned my addr 172.21.15.116:0/1589698044 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:26.399 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.394+0000 7f26c8d9a700 1 --2- 172.21.15.116:0/1589698044 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 0x7f26c41608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.394+0000 7f26c9d9c700 1 --2- 172.21.15.116:0/1589698044 >> v2:172.21.15.182:3300/0 conn(0x7f26c40d1100 0x7f26c40d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.394+0000 7f26bbfff700 1 -- 172.21.15.116:0/1589698044 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152647247 0 0) 0x7f26c40d0020 con 0x7f26c40b87a0 2023-05-12T09:07:26.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.394+0000 7f26bbfff700 1 -- 172.21.15.116:0/1589698044 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b00035b0 con 0x7f26c40b87a0 2023-05-12T09:07:26.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.394+0000 7f26c8d9a700 1 -- 172.21.15.116:0/1589698044 >> v2:172.21.15.182:3300/0 conn(0x7f26c40d1100 msgr2=0x7f26c40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:26.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.394+0000 7f26c8d9a700 1 --2- 172.21.15.116:0/1589698044 >> v2:172.21.15.182:3300/0 conn(0x7f26c40d1100 0x7f26c40d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.394+0000 7f26c8d9a700 1 -- 172.21.15.116:0/1589698044 >> v1:172.21.15.116:6789/0 conn(0x7f26c40b87a0 legacy=0x7f26c41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.394+0000 7f26c8d9a700 1 -- 172.21.15.116:0/1589698044 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40cdc60 con 0x7f26c40cfbf0 2023-05-12T09:07:26.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.394+0000 7f26c9d9c700 1 --2- 172.21.15.116:0/1589698044 >> v2:172.21.15.182:3300/0 conn(0x7f26c40d1100 0x7f26c40d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:26.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.394+0000 7f26c8d9a700 1 --2- 172.21.15.116:0/1589698044 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 0x7f26c41608f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009840 tx=0x7f26b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f845dd280461365d server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:26.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26bbfff700 1 -- 172.21.15.116:0/1589698044 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4011830 con 0x7f26c40cfbf0 2023-05-12T09:07:26.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26bbfff700 1 -- 172.21.15.116:0/1589698044 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b4011990 con 0x7f26c40cfbf0 2023-05-12T09:07:26.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26bbfff700 1 -- 172.21.15.116:0/1589698044 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4011d20 con 0x7f26c40cfbf0 2023-05-12T09:07:26.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26cb7ff700 1 -- 172.21.15.116:0/1589698044 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 msgr2=0x7f26c41608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26cb7ff700 1 --2- 172.21.15.116:0/1589698044 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 0x7f26c41608f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009840 tx=0x7f26b4009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:26.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26cb7ff700 1 -- 172.21.15.116:0/1589698044 shutdown_connections 2023-05-12T09:07:26.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26cb7ff700 1 --2- 172.21.15.116:0/1589698044 >> v2:172.21.15.182:3300/0 conn(0x7f26c40d1100 0x7f26c40d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26cb7ff700 1 --2- 172.21.15.116:0/1589698044 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 0x7f26c41608f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26cb7ff700 1 -- 172.21.15.116:0/1589698044 >> 172.21.15.116:0/1589698044 conn(0x7f26c4071b10 msgr2=0x7f26c4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:26.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26cb7ff700 1 -- 172.21.15.116:0/1589698044 shutdown_connections 2023-05-12T09:07:26.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.395+0000 7f26cb7ff700 1 -- 172.21.15.116:0/1589698044 wait complete. 2023-05-12T09:07:26.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.397+0000 7f26cb7ff700 1 Processor -- start 2023-05-12T09:07:26.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.397+0000 7f26cb7ff700 1 -- start start 2023-05-12T09:07:26.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26cb7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f26c40b87a0 0x7f26c41516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26cb7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 0x7f26c4159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26cb7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c40d1100 0x7f26c415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26cb7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c415f150 con 0x7f26c40d1100 2023-05-12T09:07:26.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26cb7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c415cca0 con 0x7f26c40b87a0 2023-05-12T09:07:26.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26cb7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c415dc70 con 0x7f26c40cfbf0 2023-05-12T09:07:26.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26c9d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c40d1100 0x7f26c415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26c9d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c40d1100 0x7f26c415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39270/0 (socket says 172.21.15.116:39270) 2023-05-12T09:07:26.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26c9d9c700 1 -- 172.21.15.116:0/468631325 learned_addr learned my addr 172.21.15.116:0/468631325 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:26.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26c959b700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f26c40b87a0 0x7f26c41516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.398+0000 7f26c8d9a700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 0x7f26c4159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.399+0000 7f26c9d9c700 1 -- 172.21.15.116:0/468631325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 msgr2=0x7f26c4159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.399+0000 7f26c9d9c700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 0x7f26c4159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.399+0000 7f26c9d9c700 1 -- 172.21.15.116:0/468631325 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f26c40b87a0 msgr2=0x7f26c41516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.399+0000 7f26c9d9c700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f26c40b87a0 0x7f26c41516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.399+0000 7f26c9d9c700 1 -- 172.21.15.116:0/468631325 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc009a70 con 0x7f26c40d1100 2023-05-12T09:07:26.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.399+0000 7f26c9d9c700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c40d1100 0x7f26c415a360 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009f00 tx=0x7f26bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:26.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.399+0000 7f26b9ffb700 1 -- 172.21.15.116:0/468631325 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc009d70 con 0x7f26c40d1100 2023-05-12T09:07:26.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.399+0000 7f26b9ffb700 1 -- 172.21.15.116:0/468631325 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc00f040 con 0x7f26c40d1100 2023-05-12T09:07:26.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.399+0000 7f26b9ffb700 1 -- 172.21.15.116:0/468631325 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00cd70 con 0x7f26c40d1100 2023-05-12T09:07:26.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.399+0000 7f26cb7ff700 1 -- 172.21.15.116:0/468631325 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b40094a0 con 0x7f26c40d1100 2023-05-12T09:07:26.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.400+0000 7f26cb7ff700 1 -- 172.21.15.116:0/468631325 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c40cd980 con 0x7f26c40d1100 2023-05-12T09:07:26.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.400+0000 7f26cb7ff700 1 -- 172.21.15.116:0/468631325 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c40cd6a0 con 0x7f26c40d1100 2023-05-12T09:07:26.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.401+0000 7f26b9ffb700 1 -- 172.21.15.116:0/468631325 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26bc014480 con 0x7f26c40d1100 2023-05-12T09:07:26.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.402+0000 7f26b9ffb700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f26a806ace0 0x7f26a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.402+0000 7f26b9ffb700 1 -- 172.21.15.116:0/468631325 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f26bc089da0 con 0x7f26c40d1100 2023-05-12T09:07:26.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.402+0000 7f26c959b700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f26a806ace0 0x7f26a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.403+0000 7f26c959b700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f26a806ace0 0x7f26a806d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f26c0007fd0 tx=0x7f26c0007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:26.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.407+0000 7f26b9ffb700 1 -- 172.21.15.116:0/468631325 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f26bc054b50 con 0x7f26c40d1100 2023-05-12T09:07:26.610 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.607+0000 7f26cb7ff700 1 -- 172.21.15.116:0/468631325 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26c4160e30 con 0x7f26c40d1100 2023-05-12T09:07:26.611 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.608+0000 7f26b9ffb700 1 -- 172.21.15.116:0/468631325 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7f26bc058170 con 0x7f26c40d1100 2023-05-12T09:07:26.612 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:26.612 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:26.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 -- 172.21.15.116:0/468631325 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f26a806ace0 msgr2=0x7f26a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f26a806ace0 0x7f26a806d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f26c0007fd0 tx=0x7f26c0007dc0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 -- 172.21.15.116:0/468631325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c40d1100 msgr2=0x7f26c415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c40d1100 0x7f26c415a360 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009f00 tx=0x7f26bc00c3a0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 -- 172.21.15.116:0/468631325 shutdown_connections 2023-05-12T09:07:26.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c40d1100 0x7f26c415a360 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f26c40b87a0 0x7f26c41516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f26a806ace0 0x7f26a806d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 --2- 172.21.15.116:0/468631325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f26c40cfbf0 0x7f26c4159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 -- 172.21.15.116:0/468631325 >> 172.21.15.116:0/468631325 conn(0x7f26c4071b10 msgr2=0x7f26c40cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:26.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 -- 172.21.15.116:0/468631325 shutdown_connections 2023-05-12T09:07:26.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.611+0000 7f26cb7ff700 1 -- 172.21.15.116:0/468631325 wait complete. 2023-05-12T09:07:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:07:26.634 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:07:26.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.819+0000 7fb15abff700 1 Processor -- start 2023-05-12T09:07:26.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.819+0000 7fb15abff700 1 -- start start 2023-05-12T09:07:26.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.820+0000 7fb15abff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb1540b87a0 0x7fb1540cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.820+0000 7fb15abff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fb1541601e0 0x7fb154160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.820+0000 7fb15abff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1540cdc60 con 0x7fb154160b70 2023-05-12T09:07:26.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.820+0000 7fb15abff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1540d02d0 con 0x7fb1540b87a0 2023-05-12T09:07:26.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.820+0000 7fb15abff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1540d0cb0 con 0x7fb1541601e0 2023-05-12T09:07:26.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.820+0000 7fb15899b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb1540b87a0 0x7fb1540cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb15899b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb1540b87a0 0x7fb1540cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39272/0 (socket says 172.21.15.116:39272) 2023-05-12T09:07:26.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb15899b700 1 -- 172.21.15.116:0/4122254723 learned_addr learned my addr 172.21.15.116:0/4122254723 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:26.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb153fff700 1 --2- 172.21.15.116:0/4122254723 >> v2:172.21.15.182:3300/0 conn(0x7fb1541601e0 0x7fb154160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb15899b700 1 -- 172.21.15.116:0/4122254723 >> v2:172.21.15.182:3300/0 conn(0x7fb1541601e0 msgr2=0x7fb154160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:26.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb15899b700 1 --2- 172.21.15.116:0/4122254723 >> v2:172.21.15.182:3300/0 conn(0x7fb1541601e0 0x7fb154160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb15899b700 1 -- 172.21.15.116:0/4122254723 >> v1:172.21.15.182:6789/0 conn(0x7fb154160b70 legacy=0x7fb1540d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:26.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb15899b700 1 -- 172.21.15.116:0/4122254723 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1540cd6a0 con 0x7fb1540b87a0 2023-05-12T09:07:26.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb153fff700 1 --2- 172.21.15.116:0/4122254723 >> v2:172.21.15.182:3300/0 conn(0x7fb1541601e0 0x7fb154160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:26.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb15899b700 1 --2- 172.21.15.116:0/4122254723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1540b87a0 0x7fb1540cfbf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1540b8f60 tx=0x7fb148009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cc7292b7bb61fd server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:26.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb1537fe700 1 -- 172.21.15.116:0/4122254723 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148004230 con 0x7fb1540b87a0 2023-05-12T09:07:26.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.821+0000 7fb1537fe700 1 -- 172.21.15.116:0/4122254723 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148004390 con 0x7fb1540b87a0 2023-05-12T09:07:26.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.822+0000 7fb1537fe700 1 -- 172.21.15.116:0/4122254723 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480036a0 con 0x7fb1540b87a0 2023-05-12T09:07:26.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.822+0000 7fb15abff700 1 -- 172.21.15.116:0/4122254723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1540b87a0 msgr2=0x7fb1540cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.822+0000 7fb15abff700 1 --2- 172.21.15.116:0/4122254723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1540b87a0 0x7fb1540cfbf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1540b8f60 tx=0x7fb148009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:26.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.822+0000 7fb15abff700 1 -- 172.21.15.116:0/4122254723 shutdown_connections 2023-05-12T09:07:26.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.822+0000 7fb15abff700 1 --2- 172.21.15.116:0/4122254723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1540b87a0 0x7fb1540cfbf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.822+0000 7fb15abff700 1 --2- 172.21.15.116:0/4122254723 >> v2:172.21.15.182:3300/0 conn(0x7fb1541601e0 0x7fb154160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.822+0000 7fb15abff700 1 -- 172.21.15.116:0/4122254723 >> 172.21.15.116:0/4122254723 conn(0x7fb154071b10 msgr2=0x7fb154071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:26.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.822+0000 7fb15abff700 1 -- 172.21.15.116:0/4122254723 shutdown_connections 2023-05-12T09:07:26.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.822+0000 7fb15abff700 1 -- 172.21.15.116:0/4122254723 wait complete. 2023-05-12T09:07:26.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.824+0000 7fb15abff700 1 Processor -- start 2023-05-12T09:07:26.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.824+0000 7fb15abff700 1 -- start start 2023-05-12T09:07:26.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15abff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb1540b87a0 0x7fb15415cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15abff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb1541601e0 0x7fb1540b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15abff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb154160b70 0x7fb154150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15abff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540cc340 con 0x7fb154160b70 2023-05-12T09:07:26.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15abff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540cc620 con 0x7fb1541601e0 2023-05-12T09:07:26.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15abff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15415c3e0 con 0x7fb1540b87a0 2023-05-12T09:07:26.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15919c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb154160b70 0x7fb154150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15919c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb154160b70 0x7fb154150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39278/0 (socket says 172.21.15.116:39278) 2023-05-12T09:07:26.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15919c700 1 -- 172.21.15.116:0/3931514080 learned_addr learned my addr 172.21.15.116:0/3931514080 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:26.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb153fff700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb1541601e0 0x7fb1540b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15899b700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb1540b87a0 0x7fb15415cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15919c700 1 -- 172.21.15.116:0/3931514080 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb1540b87a0 msgr2=0x7fb15415cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15919c700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb1540b87a0 0x7fb15415cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15919c700 1 -- 172.21.15.116:0/3931514080 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb1541601e0 msgr2=0x7fb1540b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:26.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.825+0000 7fb15919c700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb1541601e0 0x7fb1540b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:26.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.826+0000 7fb15919c700 1 -- 172.21.15.116:0/3931514080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb148009550 con 0x7fb154160b70 2023-05-12T09:07:26.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.826+0000 7fb153fff700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb1541601e0 0x7fb1540b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:26.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.826+0000 7fb15899b700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb1540b87a0 0x7fb15415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:26.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.826+0000 7fb15919c700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb154160b70 0x7fb154150120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00b970 tx=0x7fb14c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:26.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.826+0000 7fb1517fa700 1 -- 172.21.15.116:0/3931514080 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c00c9b0 con 0x7fb154160b70 2023-05-12T09:07:26.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.826+0000 7fb1517fa700 1 -- 172.21.15.116:0/3931514080 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c00cb10 con 0x7fb154160b70 2023-05-12T09:07:26.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.826+0000 7fb15abff700 1 -- 172.21.15.116:0/3931514080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb154160f90 con 0x7fb154160b70 2023-05-12T09:07:26.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.826+0000 7fb1517fa700 1 -- 172.21.15.116:0/3931514080 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c014440 con 0x7fb154160b70 2023-05-12T09:07:26.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.826+0000 7fb15abff700 1 -- 172.21.15.116:0/3931514080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1540cd980 con 0x7fb154160b70 2023-05-12T09:07:26.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.827+0000 7fb15abff700 1 -- 172.21.15.116:0/3931514080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1540d2110 con 0x7fb154160b70 2023-05-12T09:07:26.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.828+0000 7fb1517fa700 1 -- 172.21.15.116:0/3931514080 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb14c01d3b0 con 0x7fb154160b70 2023-05-12T09:07:26.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.829+0000 7fb1517fa700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb13806ace0 0x7fb13806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:26.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.829+0000 7fb1517fa700 1 -- 172.21.15.116:0/3931514080 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb14c0894e0 con 0x7fb154160b70 2023-05-12T09:07:26.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.829+0000 7fb15899b700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb13806ace0 0x7fb13806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:26.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.830+0000 7fb15899b700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb13806ace0 0x7fb13806d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb148009c40 tx=0x7fb148008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:26.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:26.833+0000 7fb1517fa700 1 -- 172.21.15.116:0/3931514080 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb14c0541f0 con 0x7fb154160b70 2023-05-12T09:07:27.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.028+0000 7fb15abff700 1 -- 172.21.15.116:0/3931514080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb154074430 con 0x7fb154160b70 2023-05-12T09:07:27.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.029+0000 7fb1517fa700 1 -- 172.21.15.116:0/3931514080 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb14c057810 con 0x7fb154160b70 2023-05-12T09:07:27.032 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:07:27.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.031+0000 7fb15abff700 1 -- 172.21.15.116:0/3931514080 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb13806ace0 msgr2=0x7fb13806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.031+0000 7fb15abff700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb13806ace0 0x7fb13806d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb148009c40 tx=0x7fb148008030 comp rx=0 tx=0).stop 2023-05-12T09:07:27.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.031+0000 7fb15abff700 1 -- 172.21.15.116:0/3931514080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb154160b70 msgr2=0x7fb154150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.031+0000 7fb15abff700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb154160b70 0x7fb154150120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00b970 tx=0x7fb14c00bd30 comp rx=0 tx=0).stop 2023-05-12T09:07:27.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.032+0000 7fb15abff700 1 -- 172.21.15.116:0/3931514080 shutdown_connections 2023-05-12T09:07:27.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.032+0000 7fb15abff700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb154160b70 0x7fb154150120 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.032+0000 7fb15abff700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb13806ace0 0x7fb13806d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.032+0000 7fb15abff700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb1540b87a0 0x7fb15415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.032+0000 7fb15abff700 1 --2- 172.21.15.116:0/3931514080 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb1541601e0 0x7fb1540b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.032+0000 7fb15abff700 1 -- 172.21.15.116:0/3931514080 >> 172.21.15.116:0/3931514080 conn(0x7fb154071b10 msgr2=0x7fb1540b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:27.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.032+0000 7fb15abff700 1 -- 172.21.15.116:0/3931514080 shutdown_connections 2023-05-12T09:07:27.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.032+0000 7fb15abff700 1 -- 172.21.15.116:0/3931514080 wait complete. 2023-05-12T09:07:27.051 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:07:27.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.235+0000 7fb3cd5ff700 1 Processor -- start 2023-05-12T09:07:27.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.235+0000 7fb3cd5ff700 1 -- start start 2023-05-12T09:07:27.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.236+0000 7fb3cd5ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb3c80b87a0 0x7fb3c80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.236+0000 7fb3cd5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb3c81601e0 0x7fb3c8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.236+0000 7fb3cd5ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c8160ff0 con 0x7fb3c8160b70 2023-05-12T09:07:27.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.236+0000 7fb3cd5ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c80d02d0 con 0x7fb3c80b87a0 2023-05-12T09:07:27.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.236+0000 7fb3cd5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80d0cb0 con 0x7fb3c81601e0 2023-05-12T09:07:27.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.237+0000 7fb3c6ffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb3c80b87a0 0x7fb3c80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.237+0000 7fb3c6ffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb3c80b87a0 0x7fb3c80cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39284/0 (socket says 172.21.15.116:39284) 2023-05-12T09:07:27.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.237+0000 7fb3c6ffd700 1 -- 172.21.15.116:0/1184029791 learned_addr learned my addr 172.21.15.116:0/1184029791 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:27.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.237+0000 7fb3c67fc700 1 --2- 172.21.15.116:0/1184029791 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb3c81601e0 0x7fb3c8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.237+0000 7fb3c6ffd700 1 -- 172.21.15.116:0/1184029791 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb3c81601e0 msgr2=0x7fb3c8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:27.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.237+0000 7fb3c6ffd700 1 --2- 172.21.15.116:0/1184029791 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb3c81601e0 0x7fb3c8160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.237+0000 7fb3c6ffd700 1 -- 172.21.15.116:0/1184029791 >> v1:172.21.15.182:6789/0 conn(0x7fb3c8160b70 legacy=0x7fb3c80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.237+0000 7fb3c6ffd700 1 -- 172.21.15.116:0/1184029791 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c80cdc60 con 0x7fb3c80b87a0 2023-05-12T09:07:27.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.237+0000 7fb3c6ffd700 1 --2- 172.21.15.116:0/1184029791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c80b87a0 0x7fb3c80cfbf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80098f0 tx=0x7fb3b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3219da55b63393e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:27.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.237+0000 7fb3c5ffb700 1 -- 172.21.15.116:0/1184029791 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8011830 con 0x7fb3c80b87a0 2023-05-12T09:07:27.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.238+0000 7fb3c5ffb700 1 -- 172.21.15.116:0/1184029791 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b8011990 con 0x7fb3c80b87a0 2023-05-12T09:07:27.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.238+0000 7fb3c5ffb700 1 -- 172.21.15.116:0/1184029791 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8011d20 con 0x7fb3c80b87a0 2023-05-12T09:07:27.243 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.238+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/1184029791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c80b87a0 msgr2=0x7fb3c80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.243 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.238+0000 7fb3cd5ff700 1 --2- 172.21.15.116:0/1184029791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c80b87a0 0x7fb3c80cfbf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80098f0 tx=0x7fb3b8009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:27.243 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.238+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/1184029791 shutdown_connections 2023-05-12T09:07:27.243 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.238+0000 7fb3cd5ff700 1 --2- 172.21.15.116:0/1184029791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c80b87a0 0x7fb3c80cfbf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.243 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.238+0000 7fb3cd5ff700 1 --2- 172.21.15.116:0/1184029791 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb3c81601e0 0x7fb3c8160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.238+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/1184029791 >> 172.21.15.116:0/1184029791 conn(0x7fb3c8071b10 msgr2=0x7fb3c8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:27.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.238+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/1184029791 shutdown_connections 2023-05-12T09:07:27.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.238+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/1184029791 wait complete. 2023-05-12T09:07:27.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.240+0000 7fb3cd5ff700 1 Processor -- start 2023-05-12T09:07:27.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.240+0000 7fb3cd5ff700 1 -- start start 2023-05-12T09:07:27.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3cd5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb3c80b87a0 0x7fb3c80c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3cd5ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c81601e0 0x7fb3c8154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3cd5ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb3c8160b70 0x7fb3c8159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3cd5ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80c8170 con 0x7fb3c81601e0 2023-05-12T09:07:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3cd5ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80c8450 con 0x7fb3c8160b70 2023-05-12T09:07:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3cd5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80c8730 con 0x7fb3c80b87a0 2023-05-12T09:07:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3c67fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c81601e0 0x7fb3c8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3c67fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c81601e0 0x7fb3c8154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39290/0 (socket says 172.21.15.116:39290) 2023-05-12T09:07:27.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3c67fc700 1 -- 172.21.15.116:0/2493270678 learned_addr learned my addr 172.21.15.116:0/2493270678 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:27.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3c6ffd700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb3c80b87a0 0x7fb3c80c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.241+0000 7fb3c77fe700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb3c8160b70 0x7fb3c8159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3c67fc700 1 -- 172.21.15.116:0/2493270678 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb3c80b87a0 msgr2=0x7fb3c80c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3c67fc700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb3c80b87a0 0x7fb3c80c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3c67fc700 1 -- 172.21.15.116:0/2493270678 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb3c8160b70 msgr2=0x7fb3c8159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3c67fc700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb3c8160b70 0x7fb3c8159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3c67fc700 1 -- 172.21.15.116:0/2493270678 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8009550 con 0x7fb3c81601e0 2023-05-12T09:07:27.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3c67fc700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c81601e0 0x7fb3c8154130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00e9b0 tx=0x7fb3bc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:27.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3af7fe700 1 -- 172.21.15.116:0/2493270678 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc009710 con 0x7fb3c81601e0 2023-05-12T09:07:27.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3af7fe700 1 -- 172.21.15.116:0/2493270678 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc00ee50 con 0x7fb3c81601e0 2023-05-12T09:07:27.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3af7fe700 1 -- 172.21.15.116:0/2493270678 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc00ca50 con 0x7fb3c81601e0 2023-05-12T09:07:27.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/2493270678 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c80cd980 con 0x7fb3c81601e0 2023-05-12T09:07:27.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.242+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/2493270678 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c80cd6a0 con 0x7fb3c81601e0 2023-05-12T09:07:27.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.243+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/2493270678 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c80d2110 con 0x7fb3c81601e0 2023-05-12T09:07:27.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.244+0000 7fb3af7fe700 1 -- 172.21.15.116:0/2493270678 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb3bc00cbb0 con 0x7fb3c81601e0 2023-05-12T09:07:27.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.245+0000 7fb3af7fe700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb3b406ace0 0x7fb3b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.245+0000 7fb3af7fe700 1 -- 172.21.15.116:0/2493270678 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb3bc089830 con 0x7fb3c81601e0 2023-05-12T09:07:27.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.245+0000 7fb3c6ffd700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb3b406ace0 0x7fb3b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.246+0000 7fb3c6ffd700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb3b406ace0 0x7fb3b406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009c40 tx=0x7fb3b8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:27.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.249+0000 7fb3af7fe700 1 -- 172.21.15.116:0/2493270678 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb3bc057fe0 con 0x7fb3c81601e0 2023-05-12T09:07:27.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.444+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/2493270678 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3c8074430 con 0x7fb3c81601e0 2023-05-12T09:07:27.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.445+0000 7fb3af7fe700 1 -- 172.21.15.116:0/2493270678 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3bc00ce60 con 0x7fb3c81601e0 2023-05-12T09:07:27.448 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:07:27.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/2493270678 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb3b406ace0 msgr2=0x7fb3b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb3b406ace0 0x7fb3b406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009c40 tx=0x7fb3b8008030 comp rx=0 tx=0).stop 2023-05-12T09:07:27.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/2493270678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c81601e0 msgr2=0x7fb3c8154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c81601e0 0x7fb3c8154130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00e9b0 tx=0x7fb3bc00ecc0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/2493270678 shutdown_connections 2023-05-12T09:07:27.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb3c8160b70 0x7fb3c8159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb3b406ace0 0x7fb3b406d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb3c80b87a0 0x7fb3c80c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 --2- 172.21.15.116:0/2493270678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3c81601e0 0x7fb3c8154130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/2493270678 >> 172.21.15.116:0/2493270678 conn(0x7fb3c8071b10 msgr2=0x7fb3c815acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:27.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/2493270678 shutdown_connections 2023-05-12T09:07:27.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.447+0000 7fb3cd5ff700 1 -- 172.21.15.116:0/2493270678 wait complete. 2023-05-12T09:07:27.467 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:07:27.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.655+0000 7f8cc6dff700 1 Processor -- start 2023-05-12T09:07:27.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.655+0000 7f8cc6dff700 1 -- start start 2023-05-12T09:07:27.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.656+0000 7f8cc6dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cc00b87a0 0x7f8cc00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.656+0000 7f8cc6dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8cc01601e0 0x7f8cc0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.656+0000 7f8cc6dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f8cc0160b70 0x7f8cc00d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.656+0000 7f8cc6dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc00d02d0 con 0x7f8cc01601e0 2023-05-12T09:07:27.660 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.656+0000 7f8cc6dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc00d0cb0 con 0x7f8cc0160b70 2023-05-12T09:07:27.660 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.656+0000 7f8cc6dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00b2730 con 0x7f8cc00b87a0 2023-05-12T09:07:27.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.656+0000 7f8cbffff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8cc01601e0 0x7f8cc0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbffff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8cc01601e0 0x7f8cc0160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39296/0 (socket says 172.21.15.116:39296) 2023-05-12T09:07:27.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbffff700 1 -- 172.21.15.116:0/531420175 learned_addr learned my addr 172.21.15.116:0/531420175 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:27.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cc4b9b700 1 --2- 172.21.15.116:0/531420175 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cc00b87a0 0x7f8cc00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cc539c700 1 --2- 172.21.15.116:0/531420175 >> v2:172.21.15.182:3300/0 conn(0x7f8cc0160b70 0x7f8cc00d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbffff700 1 -- 172.21.15.116:0/531420175 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cc00b87a0 msgr2=0x7f8cc00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:27.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbffff700 1 --2- 172.21.15.116:0/531420175 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cc00b87a0 0x7f8cc00cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbffff700 1 -- 172.21.15.116:0/531420175 >> v2:172.21.15.182:3300/0 conn(0x7f8cc0160b70 msgr2=0x7f8cc00d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:27.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbffff700 1 --2- 172.21.15.116:0/531420175 >> v2:172.21.15.182:3300/0 conn(0x7f8cc0160b70 0x7f8cc00d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbffff700 1 -- 172.21.15.116:0/531420175 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc0160ff0 con 0x7f8cc01601e0 2023-05-12T09:07:27.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbffff700 1 --2- 172.21.15.116:0/531420175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc01601e0 0x7f8cc0160630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8cc008be30 tx=0x7f8cac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8437671f91cb40c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:27.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbf7fe700 1 -- 172.21.15.116:0/531420175 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac011830 con 0x7f8cc01601e0 2023-05-12T09:07:27.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbf7fe700 1 -- 172.21.15.116:0/531420175 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac011990 con 0x7f8cc01601e0 2023-05-12T09:07:27.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.657+0000 7f8cbf7fe700 1 -- 172.21.15.116:0/531420175 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac011d20 con 0x7f8cc01601e0 2023-05-12T09:07:27.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.658+0000 7f8cc6dff700 1 -- 172.21.15.116:0/531420175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc01601e0 msgr2=0x7f8cc0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.658+0000 7f8cc6dff700 1 --2- 172.21.15.116:0/531420175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc01601e0 0x7f8cc0160630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8cc008be30 tx=0x7f8cac009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.658+0000 7f8cc6dff700 1 -- 172.21.15.116:0/531420175 shutdown_connections 2023-05-12T09:07:27.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.658+0000 7f8cc6dff700 1 --2- 172.21.15.116:0/531420175 >> v2:172.21.15.182:3300/0 conn(0x7f8cc0160b70 0x7f8cc00d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.658+0000 7f8cc6dff700 1 --2- 172.21.15.116:0/531420175 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cc00b87a0 0x7f8cc00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.658+0000 7f8cc6dff700 1 --2- 172.21.15.116:0/531420175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc01601e0 0x7f8cc0160630 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.658+0000 7f8cc6dff700 1 -- 172.21.15.116:0/531420175 >> 172.21.15.116:0/531420175 conn(0x7f8cc0071b10 msgr2=0x7f8cc0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:27.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.658+0000 7f8cc6dff700 1 -- 172.21.15.116:0/531420175 shutdown_connections 2023-05-12T09:07:27.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.658+0000 7f8cc6dff700 1 -- 172.21.15.116:0/531420175 wait complete. 2023-05-12T09:07:27.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.660+0000 7f8cc6dff700 1 Processor -- start 2023-05-12T09:07:27.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.661+0000 7f8cc6dff700 1 -- start start 2023-05-12T09:07:27.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cc6dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc00b87a0 0x7f8cc0151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cc6dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8cc01601e0 0x7f8cc015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cc6dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cc0160b70 0x7f8cc015e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cc6dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0151970 con 0x7f8cc00b87a0 2023-05-12T09:07:27.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cc6dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00c9f80 con 0x7f8cc01601e0 2023-05-12T09:07:27.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cc6dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc015d4f0 con 0x7f8cc0160b70 2023-05-12T09:07:27.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cc4b9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc00b87a0 0x7f8cc0151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cc4b9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc00b87a0 0x7f8cc0151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39304/0 (socket says 172.21.15.116:39304) 2023-05-12T09:07:27.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cc4b9b700 1 -- 172.21.15.116:0/2321644991 learned_addr learned my addr 172.21.15.116:0/2321644991 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:27.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cbffff700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8cc01601e0 0x7f8cc015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.662+0000 7f8cc539c700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cc0160b70 0x7f8cc015e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cc4b9b700 1 -- 172.21.15.116:0/2321644991 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cc0160b70 msgr2=0x7f8cc015e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cc4b9b700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cc0160b70 0x7f8cc015e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cc4b9b700 1 -- 172.21.15.116:0/2321644991 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8cc01601e0 msgr2=0x7f8cc015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cc4b9b700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8cc01601e0 0x7f8cc015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cc4b9b700 1 -- 172.21.15.116:0/2321644991 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac009550 con 0x7f8cc00b87a0 2023-05-12T09:07:27.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cc4b9b700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc00b87a0 0x7f8cc0151430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400e870 tx=0x7f8cb400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:27.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cbd7fa700 1 -- 172.21.15.116:0/2321644991 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4013680 con 0x7f8cc00b87a0 2023-05-12T09:07:27.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cbd7fa700 1 -- 172.21.15.116:0/2321644991 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb40137e0 con 0x7f8cc00b87a0 2023-05-12T09:07:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cc6dff700 1 -- 172.21.15.116:0/2321644991 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc00cd6a0 con 0x7f8cc00b87a0 2023-05-12T09:07:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cbd7fa700 1 -- 172.21.15.116:0/2321644991 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4013b90 con 0x7f8cc00b87a0 2023-05-12T09:07:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.663+0000 7f8cc6dff700 1 -- 172.21.15.116:0/2321644991 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc00cdc60 con 0x7f8cc00b87a0 2023-05-12T09:07:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.664+0000 7f8cc6dff700 1 -- 172.21.15.116:0/2321644991 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc00cd980 con 0x7f8cc00b87a0 2023-05-12T09:07:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.665+0000 7f8cbd7fa700 1 -- 172.21.15.116:0/2321644991 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cb4013cf0 con 0x7f8cc00b87a0 2023-05-12T09:07:27.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.666+0000 7f8cbd7fa700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8ca406ace0 0x7f8ca406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:27.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.666+0000 7f8cbd7fa700 1 -- 172.21.15.116:0/2321644991 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8cb4089940 con 0x7f8cc00b87a0 2023-05-12T09:07:27.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.666+0000 7f8cbffff700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8ca406ace0 0x7f8ca406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:27.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.667+0000 7f8cbffff700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8ca406ace0 0x7f8ca406d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009c10 tx=0x7f8cac008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:27.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.670+0000 7f8cbd7fa700 1 -- 172.21.15.116:0/2321644991 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8cb40546f0 con 0x7f8cc00b87a0 2023-05-12T09:07:27.864 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.861+0000 7f8cc6dff700 1 -- 172.21.15.116:0/2321644991 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8cc0074430 con 0x7f8cc00b87a0 2023-05-12T09:07:27.865 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.862+0000 7f8cbd7fa700 1 -- 172.21.15.116:0/2321644991 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8cb4057d10 con 0x7f8cc00b87a0 2023-05-12T09:07:27.865 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:07:27.867 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 -- 172.21.15.116:0/2321644991 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8ca406ace0 msgr2=0x7f8ca406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.867 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8ca406ace0 0x7f8ca406d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009c10 tx=0x7f8cac008030 comp rx=0 tx=0).stop 2023-05-12T09:07:27.867 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 -- 172.21.15.116:0/2321644991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc00b87a0 msgr2=0x7f8cc0151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:27.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc00b87a0 0x7f8cc0151430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400e870 tx=0x7f8cb400eb80 comp rx=0 tx=0).stop 2023-05-12T09:07:27.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 -- 172.21.15.116:0/2321644991 shutdown_connections 2023-05-12T09:07:27.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8ca406ace0 0x7f8ca406d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cc0160b70 0x7f8cc015e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cc00b87a0 0x7f8cc0151430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 --2- 172.21.15.116:0/2321644991 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8cc01601e0 0x7f8cc015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:27.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 -- 172.21.15.116:0/2321644991 >> 172.21.15.116:0/2321644991 conn(0x7f8cc0071b10 msgr2=0x7f8cc00cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:27.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 -- 172.21.15.116:0/2321644991 shutdown_connections 2023-05-12T09:07:27.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:27.864+0000 7f8cc6dff700 1 -- 172.21.15.116:0/2321644991 wait complete. 2023-05-12T09:07:27.884 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:07:28.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.068+0000 7f83c55ff700 1 Processor -- start 2023-05-12T09:07:28.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.068+0000 7f83c55ff700 1 -- start start 2023-05-12T09:07:28.072 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.069+0000 7f83c55ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83c015c590 0x7f83c0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.072 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.069+0000 7f83c55ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c00cd520 con 0x7f83c00cff50 2023-05-12T09:07:28.072 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.069+0000 7f83c55ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c00d2640 con 0x7f83c00cf010 2023-05-12T09:07:28.072 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.069+0000 7f83c55ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01610d0 con 0x7f83c015c590 2023-05-12T09:07:28.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.069+0000 7f83bf7fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f83c00cff50 0x7f83c00d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:32980/0 (socket says 172.21.15.116:32980) 2023-05-12T09:07:28.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.069+0000 7f83bf7fe700 1 -- 172.21.15.116:0/1567745613 learned_addr learned my addr 172.21.15.116:0/1567745613 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:28.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83beffd700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83c015c590 0x7f83c0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041868963 0 0) 0x7f83c00cd520 con 0x7f83c00cff50 2023-05-12T09:07:28.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a80035b0 con 0x7f83c00cff50 2023-05-12T09:07:28.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1945902304 0 0) 0x7f83a80035b0 con 0x7f83c00cff50 2023-05-12T09:07:28.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83c015c590 msgr2=0x7f83c0160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:28.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83c015c590 0x7f83c0160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 >> v1:172.21.15.182:6789/0 conn(0x7f83c00cf010 legacy=0x7f83c00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00b23c0 con 0x7f83c00cff50 2023-05-12T09:07:28.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f83b80019f0 con 0x7f83c00cff50 2023-05-12T09:07:28.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 >> v1:172.21.15.116:6789/0 conn(0x7f83c00cff50 legacy=0x7f83c00d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83a8003a30 0x7f83a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83c015c590 0x7f83a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83a8004d90 0x7f83a8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01610d0 con 0x7f83a8003a30 2023-05-12T09:07:28.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a800ba10 con 0x7f83a8004d90 2023-05-12T09:07:28.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a800bba0 con 0x7f83c015c590 2023-05-12T09:07:28.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83beffd700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83a8003a30 0x7f83a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.070+0000 7f83be7fc700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83c015c590 0x7f83a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83bf7fe700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83a8004d90 0x7f83a8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83beffd700 1 -- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83c015c590 msgr2=0x7f83a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:28.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83beffd700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83c015c590 0x7f83a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83beffd700 1 -- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83a8004d90 msgr2=0x7f83a8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:28.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83beffd700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83a8004d90 0x7f83a8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83beffd700 1 -- 172.21.15.116:0/1567745613 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a80035b0 con 0x7f83a8003a30 2023-05-12T09:07:28.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83bf7fe700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83a8004d90 0x7f83a8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:28.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83beffd700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83a8003a30 0x7f83a8003e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009b60 tx=0x7f83a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f3db2335a2ea2c server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:28.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000e6c0 con 0x7f83a8003a30 2023-05-12T09:07:28.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b000e820 con 0x7f83a8003a30 2023-05-12T09:07:28.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.071+0000 7f83bdffb700 1 -- 172.21.15.116:0/1567745613 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000eb90 con 0x7f83a8003a30 2023-05-12T09:07:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.072+0000 7f83c55ff700 1 -- 172.21.15.116:0/1567745613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83a8003a30 msgr2=0x7f83a8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.072+0000 7f83c55ff700 1 --2- 172.21.15.116:0/1567745613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83a8003a30 0x7f83a8003e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009b60 tx=0x7f83a8005880 comp rx=0 tx=0).stop 2023-05-12T09:07:28.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.072+0000 7f83bf7fe700 1 -- 172.21.15.116:0/1567745613 reap_dead start 2023-05-12T09:07:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.072+0000 7f83c55ff700 1 -- 172.21.15.116:0/1567745613 shutdown_connections 2023-05-12T09:07:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.072+0000 7f83c55ff700 1 -- 172.21.15.116:0/1567745613 >> 172.21.15.116:0/1567745613 conn(0x7f83c0071b10 msgr2=0x7f83c0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.072+0000 7f83c55ff700 1 -- 172.21.15.116:0/1567745613 shutdown_connections 2023-05-12T09:07:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.072+0000 7f83c55ff700 1 -- 172.21.15.116:0/1567745613 wait complete. 2023-05-12T09:07:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.073+0000 7f83c55ff700 1 Processor -- start 2023-05-12T09:07:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.074+0000 7f83c55ff700 1 -- start start 2023-05-12T09:07:28.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.074+0000 7f83c55ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83a8003a30 0x7f83c0155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83c55ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83c00c6a00 0x7f83c00c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83c55ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83c00b7750 0x7f83c00b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83c55ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00b8100 con 0x7f83c00b7750 2023-05-12T09:07:28.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83c55ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0155a60 con 0x7f83c00c6a00 2023-05-12T09:07:28.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83c55ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00c74a0 con 0x7f83a8003a30 2023-05-12T09:07:28.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83bf7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83c00b7750 0x7f83c00b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83bf7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83c00b7750 0x7f83c00b7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39316/0 (socket says 172.21.15.116:39316) 2023-05-12T09:07:28.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83bf7fe700 1 -- 172.21.15.116:0/3643496010 learned_addr learned my addr 172.21.15.116:0/3643496010 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:28.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83beffd700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83a8003a30 0x7f83c0155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83be7fc700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83c00c6a00 0x7f83c00c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83bf7fe700 1 -- 172.21.15.116:0/3643496010 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83a8003a30 msgr2=0x7f83c0155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83bf7fe700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83a8003a30 0x7f83c0155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83bf7fe700 1 -- 172.21.15.116:0/3643496010 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83c00c6a00 msgr2=0x7f83c00c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83bf7fe700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83c00c6a00 0x7f83c00c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83bf7fe700 1 -- 172.21.15.116:0/3643496010 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00cd770 con 0x7f83c00b7750 2023-05-12T09:07:28.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83be7fc700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83c00c6a00 0x7f83c00c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:28.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.075+0000 7f83bf7fe700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83c00b7750 0x7f83c00b7bc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f83c00b20b0 tx=0x7f83b800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:28.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.076+0000 7f83a77fe700 1 -- 172.21.15.116:0/3643496010 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8017070 con 0x7f83c00b7750 2023-05-12T09:07:28.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.076+0000 7f83a77fe700 1 -- 172.21.15.116:0/3643496010 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b800ec70 con 0x7f83c00b7750 2023-05-12T09:07:28.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.076+0000 7f83c55ff700 1 -- 172.21.15.116:0/3643496010 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c00cf560 con 0x7f83c00b7750 2023-05-12T09:07:28.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.076+0000 7f83a77fe700 1 -- 172.21.15.116:0/3643496010 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800ee00 con 0x7f83c00b7750 2023-05-12T09:07:28.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.076+0000 7f83c55ff700 1 -- 172.21.15.116:0/3643496010 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c015c960 con 0x7f83c00b7750 2023-05-12T09:07:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.077+0000 7f83c55ff700 1 -- 172.21.15.116:0/3643496010 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c00b51f0 con 0x7f83c00b7750 2023-05-12T09:07:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.078+0000 7f83a77fe700 1 -- 172.21.15.116:0/3643496010 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83b8013420 con 0x7f83c00b7750 2023-05-12T09:07:28.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.079+0000 7f83a77fe700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f83ac06ace0 0x7f83ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.079+0000 7f83a77fe700 1 -- 172.21.15.116:0/3643496010 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f83b8089520 con 0x7f83c00b7750 2023-05-12T09:07:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.079+0000 7f83beffd700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f83ac06ace0 0x7f83ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.079+0000 7f83beffd700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f83ac06ace0 0x7f83ac06d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f83b00090b0 tx=0x7f83b0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:28.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.083+0000 7f83a77fe700 1 -- 172.21.15.116:0/3643496010 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f83b8054240 con 0x7f83c00b7750 2023-05-12T09:07:28.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.278+0000 7f83c55ff700 1 -- 172.21.15.116:0/3643496010 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83c00cfb80 con 0x7f83c00b7750 2023-05-12T09:07:28.282 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.279+0000 7f83a77fe700 1 -- 172.21.15.116:0/3643496010 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83b8057860 con 0x7f83c00b7750 2023-05-12T09:07:28.282 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:07:28.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 -- 172.21.15.116:0/3643496010 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f83ac06ace0 msgr2=0x7f83ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f83ac06ace0 0x7f83ac06d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f83b00090b0 tx=0x7f83b0008030 comp rx=0 tx=0).stop 2023-05-12T09:07:28.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 -- 172.21.15.116:0/3643496010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83c00b7750 msgr2=0x7f83c00b7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83c00b7750 0x7f83c00b7bc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f83c00b20b0 tx=0x7f83b800e440 comp rx=0 tx=0).stop 2023-05-12T09:07:28.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 -- 172.21.15.116:0/3643496010 shutdown_connections 2023-05-12T09:07:28.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83c00b7750 0x7f83c00b7bc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f83ac06ace0 0x7f83ac06d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f83a8003a30 0x7f83c0155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 --2- 172.21.15.116:0/3643496010 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f83c00c6a00 0x7f83c00c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 -- 172.21.15.116:0/3643496010 >> 172.21.15.116:0/3643496010 conn(0x7f83c0071b10 msgr2=0x7f83c00d2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:28.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 -- 172.21.15.116:0/3643496010 shutdown_connections 2023-05-12T09:07:28.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.281+0000 7f83c55ff700 1 -- 172.21.15.116:0/3643496010 wait complete. 2023-05-12T09:07:28.301 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:07:28.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.484+0000 7f3722dff700 1 Processor -- start 2023-05-12T09:07:28.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.485+0000 7f3722dff700 1 -- start start 2023-05-12T09:07:28.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.486+0000 7f3722dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 0x7f371c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.486+0000 7f3722dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c0cdc60 con 0x7f371c160d40 2023-05-12T09:07:28.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.486+0000 7f3722dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c0cd6a0 con 0x7f371c1601e0 2023-05-12T09:07:28.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.486+0000 7f3722dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c0d02d0 con 0x7f371c0b87a0 2023-05-12T09:07:28.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.486+0000 7f372139c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f371c160d40 0x7f371c0d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:32988/0 (socket says 172.21.15.116:32988) 2023-05-12T09:07:28.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.486+0000 7f372139c700 1 -- 172.21.15.116:0/2032590577 learned_addr learned my addr 172.21.15.116:0/2032590577 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:28.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.486+0000 7f3720b9b700 1 --2- 172.21.15.116:0/2032590577 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 0x7f371c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.486+0000 7f371b7fe700 1 -- 172.21.15.116:0/2032590577 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456699689 0 0) 0x7f371c0cdc60 con 0x7f371c160d40 2023-05-12T09:07:28.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.487+0000 7f371b7fe700 1 -- 172.21.15.116:0/2032590577 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f370c0035b0 con 0x7f371c160d40 2023-05-12T09:07:28.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.487+0000 7f371b7fe700 1 -- 172.21.15.116:0/2032590577 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494257272 0 0) 0x7f371c0cd6a0 con 0x7f371c1601e0 2023-05-12T09:07:28.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.487+0000 7f371b7fe700 1 -- 172.21.15.116:0/2032590577 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f371c0cdc60 con 0x7f371c1601e0 2023-05-12T09:07:28.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.487+0000 7f3720b9b700 1 -- 172.21.15.116:0/2032590577 >> v1:172.21.15.182:6789/0 conn(0x7f371c1601e0 legacy=0x7f371c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.487+0000 7f3720b9b700 1 -- 172.21.15.116:0/2032590577 >> v1:172.21.15.116:6789/0 conn(0x7f371c160d40 legacy=0x7f371c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.487+0000 7f3720b9b700 1 -- 172.21.15.116:0/2032590577 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c0cd980 con 0x7f371c0b87a0 2023-05-12T09:07:28.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.487+0000 7f3720b9b700 1 --2- 172.21.15.116:0/2032590577 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 0x7f371c0cfbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3710009870 tx=0x7f3710009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0c510ffd0ac5a74 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:28.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.487+0000 7f371b7fe700 1 -- 172.21.15.116:0/2032590577 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710011830 con 0x7f371c0b87a0 2023-05-12T09:07:28.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.487+0000 7f371b7fe700 1 -- 172.21.15.116:0/2032590577 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3710011990 con 0x7f371c0b87a0 2023-05-12T09:07:28.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.487+0000 7f371b7fe700 1 -- 172.21.15.116:0/2032590577 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710011d20 con 0x7f371c0b87a0 2023-05-12T09:07:28.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.488+0000 7f3722dff700 1 -- 172.21.15.116:0/2032590577 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 msgr2=0x7f371c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.488+0000 7f3722dff700 1 --2- 172.21.15.116:0/2032590577 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 0x7f371c0cfbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3710009870 tx=0x7f3710009b80 comp rx=0 tx=0).stop 2023-05-12T09:07:28.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.488+0000 7f3722dff700 1 -- 172.21.15.116:0/2032590577 shutdown_connections 2023-05-12T09:07:28.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.488+0000 7f3722dff700 1 --2- 172.21.15.116:0/2032590577 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 0x7f371c0cfbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.488+0000 7f3722dff700 1 -- 172.21.15.116:0/2032590577 >> 172.21.15.116:0/2032590577 conn(0x7f371c071b10 msgr2=0x7f371c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:28.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.488+0000 7f3722dff700 1 -- 172.21.15.116:0/2032590577 shutdown_connections 2023-05-12T09:07:28.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.488+0000 7f3722dff700 1 -- 172.21.15.116:0/2032590577 wait complete. 2023-05-12T09:07:28.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.490+0000 7f3722dff700 1 Processor -- start 2023-05-12T09:07:28.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.490+0000 7f3722dff700 1 -- start start 2023-05-12T09:07:28.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.490+0000 7f3722dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 0x7f371c0c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f3722dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f371c1601e0 0x7f371c15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f3722dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f371c160d40 0x7f371c0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f3722dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c15cce0 con 0x7f371c1601e0 2023-05-12T09:07:28.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f3722dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c15cf30 con 0x7f371c160d40 2023-05-12T09:07:28.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f3722dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c15d210 con 0x7f371c0b87a0 2023-05-12T09:07:28.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f371bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f371c1601e0 0x7f371c15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f371bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f371c1601e0 0x7f371c15dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39332/0 (socket says 172.21.15.116:39332) 2023-05-12T09:07:28.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f371bfff700 1 -- 172.21.15.116:0/528708296 learned_addr learned my addr 172.21.15.116:0/528708296 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:28.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f372139c700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f371c160d40 0x7f371c0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f3720b9b700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 0x7f371c0c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f371bfff700 1 -- 172.21.15.116:0/528708296 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 msgr2=0x7f371c0c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f371bfff700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 0x7f371c0c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f371bfff700 1 -- 172.21.15.116:0/528708296 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f371c160d40 msgr2=0x7f371c0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f371bfff700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f371c160d40 0x7f371c0c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f371bfff700 1 -- 172.21.15.116:0/528708296 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37100094a0 con 0x7f371c1601e0 2023-05-12T09:07:28.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f372139c700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f371c160d40 0x7f371c0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:28.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.491+0000 7f3720b9b700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 0x7f371c0c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:28.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.492+0000 7f371bfff700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f371c1601e0 0x7f371c15dfd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f370800c520 tx=0x7f370800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:28.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.492+0000 7f37197fa700 1 -- 172.21.15.116:0/528708296 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080052d0 con 0x7f371c1601e0 2023-05-12T09:07:28.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.492+0000 7f37197fa700 1 -- 172.21.15.116:0/528708296 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708005430 con 0x7f371c1601e0 2023-05-12T09:07:28.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.492+0000 7f3722dff700 1 -- 172.21.15.116:0/528708296 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c0d19a0 con 0x7f371c1601e0 2023-05-12T09:07:28.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.492+0000 7f37197fa700 1 -- 172.21.15.116:0/528708296 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080038c0 con 0x7f371c1601e0 2023-05-12T09:07:28.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.492+0000 7f3722dff700 1 -- 172.21.15.116:0/528708296 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c0d1810 con 0x7f371c1601e0 2023-05-12T09:07:28.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.493+0000 7f3722dff700 1 -- 172.21.15.116:0/528708296 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371c0d1b30 con 0x7f371c1601e0 2023-05-12T09:07:28.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.494+0000 7f37197fa700 1 -- 172.21.15.116:0/528708296 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3708003a20 con 0x7f371c1601e0 2023-05-12T09:07:28.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.495+0000 7f37197fa700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f370006ace0 0x7f370006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.495+0000 7f37197fa700 1 -- 172.21.15.116:0/528708296 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3708088d50 con 0x7f371c1601e0 2023-05-12T09:07:28.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.495+0000 7f3720b9b700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f370006ace0 0x7f370006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.496+0000 7f3720b9b700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f370006ace0 0x7f370006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f37100097c0 tx=0x7f371001c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:28.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.499+0000 7f37197fa700 1 -- 172.21.15.116:0/528708296 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3708053b00 con 0x7f371c1601e0 2023-05-12T09:07:28.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.694+0000 7f3722dff700 1 -- 172.21.15.116:0/528708296 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f371c0b52f0 con 0x7f371c1601e0 2023-05-12T09:07:28.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.695+0000 7f37197fa700 1 -- 172.21.15.116:0/528708296 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3708017020 con 0x7f371c1601e0 2023-05-12T09:07:28.698 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:07:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 -- 172.21.15.116:0/528708296 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f370006ace0 msgr2=0x7f370006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f370006ace0 0x7f370006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f37100097c0 tx=0x7f371001c040 comp rx=0 tx=0).stop 2023-05-12T09:07:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 -- 172.21.15.116:0/528708296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f371c1601e0 msgr2=0x7f371c15dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f371c1601e0 0x7f371c15dfd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f370800c520 tx=0x7f370800c8e0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 -- 172.21.15.116:0/528708296 shutdown_connections 2023-05-12T09:07:28.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f371c160d40 0x7f371c0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f370006ace0 0x7f370006d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f371c0b87a0 0x7f371c0c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 --2- 172.21.15.116:0/528708296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f371c1601e0 0x7f371c15dfd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 -- 172.21.15.116:0/528708296 >> 172.21.15.116:0/528708296 conn(0x7f371c071b10 msgr2=0x7f371c15c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:28.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 -- 172.21.15.116:0/528708296 shutdown_connections 2023-05-12T09:07:28.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.697+0000 7f3722dff700 1 -- 172.21.15.116:0/528708296 wait complete. 2023-05-12T09:07:28.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-12T09:07:28.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.901+0000 7f95acfff700 1 Processor -- start 2023-05-12T09:07:28.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.901+0000 7f95acfff700 1 -- start start 2023-05-12T09:07:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.902+0000 7f95acfff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f95a80b87a0 0x7f95a80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.902+0000 7f95acfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f95a8160d40 0x7f95a80d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.902+0000 7f95acfff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a80cdc60 con 0x7f95a81601e0 2023-05-12T09:07:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.902+0000 7f95acfff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a80d02d0 con 0x7f95a8160d40 2023-05-12T09:07:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.902+0000 7f95acfff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a80d0cb0 con 0x7f95a80b87a0 2023-05-12T09:07:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.902+0000 7f95a6d9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f95a8160d40 0x7f95a80d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.902+0000 7f95a6d9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f95a8160d40 0x7f95a80d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39338/0 (socket says 172.21.15.116:39338) 2023-05-12T09:07:28.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.902+0000 7f95a6d9d700 1 -- 172.21.15.116:0/660729553 learned_addr learned my addr 172.21.15.116:0/660729553 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:28.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.902+0000 7f95a659c700 1 --2- 172.21.15.116:0/660729553 >> v2:172.21.15.182:3300/0 conn(0x7f95a80b87a0 0x7f95a80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.903+0000 7f95a6d9d700 1 -- 172.21.15.116:0/660729553 >> v2:172.21.15.182:3300/0 conn(0x7f95a80b87a0 msgr2=0x7f95a80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:28.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.903+0000 7f95a6d9d700 1 --2- 172.21.15.116:0/660729553 >> v2:172.21.15.182:3300/0 conn(0x7f95a80b87a0 0x7f95a80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.903+0000 7f95a559a700 1 -- 172.21.15.116:0/660729553 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44703140 0 0) 0x7f95a80cdc60 con 0x7f95a81601e0 2023-05-12T09:07:28.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.903+0000 7f95a6d9d700 1 -- 172.21.15.116:0/660729553 >> v1:172.21.15.182:6789/0 conn(0x7f95a81601e0 legacy=0x7f95a8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.903+0000 7f95a6d9d700 1 -- 172.21.15.116:0/660729553 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a80cd6a0 con 0x7f95a8160d40 2023-05-12T09:07:28.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.903+0000 7f95a6d9d700 1 --2- 172.21.15.116:0/660729553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a8160d40 0x7f95a80d1100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f95a80b4ac0 tx=0x7f95a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a231e83eec47d120 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:28.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.903+0000 7f95a559a700 1 -- 172.21.15.116:0/660729553 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a000e070 con 0x7f95a8160d40 2023-05-12T09:07:28.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.903+0000 7f95a559a700 1 -- 172.21.15.116:0/660729553 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a000b8d0 con 0x7f95a8160d40 2023-05-12T09:07:28.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.903+0000 7f95a559a700 1 -- 172.21.15.116:0/660729553 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a000bc80 con 0x7f95a8160d40 2023-05-12T09:07:28.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.904+0000 7f95acfff700 1 -- 172.21.15.116:0/660729553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a8160d40 msgr2=0x7f95a80d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.904+0000 7f95acfff700 1 --2- 172.21.15.116:0/660729553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a8160d40 0x7f95a80d1100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f95a80b4ac0 tx=0x7f95a000b330 comp rx=0 tx=0).stop 2023-05-12T09:07:28.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.904+0000 7f95acfff700 1 -- 172.21.15.116:0/660729553 shutdown_connections 2023-05-12T09:07:28.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.904+0000 7f95acfff700 1 --2- 172.21.15.116:0/660729553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a8160d40 0x7f95a80d1100 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.904+0000 7f95acfff700 1 --2- 172.21.15.116:0/660729553 >> v2:172.21.15.182:3300/0 conn(0x7f95a80b87a0 0x7f95a80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.904+0000 7f95acfff700 1 -- 172.21.15.116:0/660729553 >> 172.21.15.116:0/660729553 conn(0x7f95a8071b10 msgr2=0x7f95a8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:28.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.904+0000 7f95acfff700 1 -- 172.21.15.116:0/660729553 shutdown_connections 2023-05-12T09:07:28.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.904+0000 7f95acfff700 1 -- 172.21.15.116:0/660729553 wait complete. 2023-05-12T09:07:28.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.906+0000 7f95acfff700 1 Processor -- start 2023-05-12T09:07:28.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.906+0000 7f95acfff700 1 -- start start 2023-05-12T09:07:28.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95acfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a80b87a0 0x7f95a81f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95acfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f95a81601e0 0x7f95a81e7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95acfff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f95a8160d40 0x7f95a80c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95acfff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80cacc0 con 0x7f95a80b87a0 2023-05-12T09:07:28.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95acfff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80ca0b0 con 0x7f95a8160d40 2023-05-12T09:07:28.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95acfff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80ca390 con 0x7f95a81601e0 2023-05-12T09:07:28.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a659c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a80b87a0 0x7f95a81f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a659c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a80b87a0 0x7f95a81f17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39344/0 (socket says 172.21.15.116:39344) 2023-05-12T09:07:28.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a659c700 1 -- 172.21.15.116:0/2624852216 learned_addr learned my addr 172.21.15.116:0/2624852216 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:28.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a6d9d700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f95a8160d40 0x7f95a80c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a5d9b700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f95a81601e0 0x7f95a81e7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a659c700 1 -- 172.21.15.116:0/2624852216 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f95a81601e0 msgr2=0x7f95a81e7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a659c700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f95a81601e0 0x7f95a81e7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a659c700 1 -- 172.21.15.116:0/2624852216 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f95a8160d40 msgr2=0x7f95a80c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:28.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a659c700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f95a8160d40 0x7f95a80c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:28.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a659c700 1 -- 172.21.15.116:0/2624852216 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0009b30 con 0x7f95a80b87a0 2023-05-12T09:07:28.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.907+0000 7f95a5d9b700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f95a81601e0 0x7f95a81e7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:28.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.908+0000 7f95a659c700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a80b87a0 0x7f95a81f17c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f959800e9b0 tx=0x7f959800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:28.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.908+0000 7f9596ffd700 1 -- 172.21.15.116:0/2624852216 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598009710 con 0x7f95a80b87a0 2023-05-12T09:07:28.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.908+0000 7f9596ffd700 1 -- 172.21.15.116:0/2624852216 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959800c850 con 0x7f95a80b87a0 2023-05-12T09:07:28.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.908+0000 7f9596ffd700 1 -- 172.21.15.116:0/2624852216 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800cbc0 con 0x7f95a80b87a0 2023-05-12T09:07:28.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.908+0000 7f95acfff700 1 -- 172.21.15.116:0/2624852216 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a80d1640 con 0x7f95a80b87a0 2023-05-12T09:07:28.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.908+0000 7f95acfff700 1 -- 172.21.15.116:0/2624852216 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a80cd980 con 0x7f95a80b87a0 2023-05-12T09:07:28.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.909+0000 7f95acfff700 1 -- 172.21.15.116:0/2624852216 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a80d17d0 con 0x7f95a80b87a0 2023-05-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.910+0000 7f9596ffd700 1 -- 172.21.15.116:0/2624852216 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f959800cd20 con 0x7f95a80b87a0 2023-05-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.911+0000 7f9596ffd700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f958806ace0 0x7f958806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.911+0000 7f9596ffd700 1 -- 172.21.15.116:0/2624852216 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9598089770 con 0x7f95a80b87a0 2023-05-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.911+0000 7f95a5d9b700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f958806ace0 0x7f958806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.912+0000 7f95a5d9b700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f958806ace0 0x7f958806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95a81e8280 tx=0x7f959c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:28.918 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:28.915+0000 7f9596ffd700 1 -- 172.21.15.116:0/2624852216 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f95980545c0 con 0x7f95a80b87a0 2023-05-12T09:07:29.130 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.126+0000 7f95acfff700 1 -- 172.21.15.116:0/2624852216 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f95a8074430 con 0x7f95a80b87a0 2023-05-12T09:07:29.130 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.127+0000 7f9596ffd700 1 -- 172.21.15.116:0/2624852216 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9598057be0 con 0x7f95a80b87a0 2023-05-12T09:07:29.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 -- 172.21.15.116:0/2624852216 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f958806ace0 msgr2=0x7f958806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:29.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f958806ace0 0x7f958806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95a81e8280 tx=0x7f959c009040 comp rx=0 tx=0).stop 2023-05-12T09:07:29.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 -- 172.21.15.116:0/2624852216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a80b87a0 msgr2=0x7f95a81f17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:29.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a80b87a0 0x7f95a81f17c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f959800e9b0 tx=0x7f959800ecc0 comp rx=0 tx=0).stop 2023-05-12T09:07:29.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 -- 172.21.15.116:0/2624852216 shutdown_connections 2023-05-12T09:07:29.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f95a8160d40 0x7f95a80c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:29.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95a80b87a0 0x7f95a81f17c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:29.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f958806ace0 0x7f958806d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:29.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 --2- 172.21.15.116:0/2624852216 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f95a81601e0 0x7f95a81e7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:29.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 -- 172.21.15.116:0/2624852216 >> 172.21.15.116:0/2624852216 conn(0x7f95a8071b10 msgr2=0x7f95a80cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:29.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 -- 172.21.15.116:0/2624852216 shutdown_connections 2023-05-12T09:07:29.134 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:29.129+0000 7f95acfff700 1 -- 172.21.15.116:0/2624852216 wait complete. 2023-05-12T09:07:29.134 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2023-05-12T09:07:29.149 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi116.front.sepia.ceph.com... 2023-05-12T09:07:29.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:29.149 DEBUG:teuthology.orchestra.run.smithi116:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-05-12T09:07:29.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi116.stderr:ceph-fuse[112123]: fuse finished with error 0 and tester_r 0 2023-05-12T09:07:29.213 INFO:teuthology.orchestra.run:waiting for 300 2023-05-12T09:07:35.315 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T09:07:35.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:35.316 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-05-12T09:07:35.465 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:35.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.655+0000 7f3310bff700 1 Processor -- start 2023-05-12T09:07:35.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.656+0000 7f3310bff700 1 -- start start 2023-05-12T09:07:35.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.657+0000 7f3310bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f330c0d2110 0x7f330c167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:35.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.657+0000 7f3310bff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c161000 con 0x7f330c0b87a0 2023-05-12T09:07:35.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.657+0000 7f3310bff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c0d0020 con 0x7f330c0cfbf0 2023-05-12T09:07:35.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.657+0000 7f3310bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c0d02d0 con 0x7f330c0d2110 2023-05-12T09:07:35.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.657+0000 7f330a59c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f330c0b87a0 0x7f330c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47716/0 (socket says 172.21.15.116:47716) 2023-05-12T09:07:35.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.657+0000 7f330a59c700 1 -- 172.21.15.116:0/3491388370 learned_addr learned my addr 172.21.15.116:0/3491388370 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:35.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.657+0000 7f330ad9d700 1 --2- 172.21.15.116:0/3491388370 >> v2:172.21.15.182:3300/0 conn(0x7f330c0d2110 0x7f330c167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:35.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.657+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432364448 0 0) 0x7f330c161000 con 0x7f330c0b87a0 2023-05-12T09:07:35.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.657+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32f80035b0 con 0x7f330c0b87a0 2023-05-12T09:07:35.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372921777 0 0) 0x7f330c0d0020 con 0x7f330c0cfbf0 2023-05-12T09:07:35.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f330c161000 con 0x7f330c0cfbf0 2023-05-12T09:07:35.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4039237276 0 0) 0x7f32f80035b0 con 0x7f330c0b87a0 2023-05-12T09:07:35.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 >> v2:172.21.15.182:3300/0 conn(0x7f330c0d2110 msgr2=0x7f330c167550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:35.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 --2- 172.21.15.116:0/3491388370 >> v2:172.21.15.182:3300/0 conn(0x7f330c0d2110 0x7f330c167550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 >> v1:172.21.15.182:6789/0 conn(0x7f330c0cfbf0 legacy=0x7f330c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:35.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c0cdc60 con 0x7f330c0b87a0 2023-05-12T09:07:35.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f32fc001670 con 0x7f330c0b87a0 2023-05-12T09:07:35.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 >> v1:172.21.15.116:6789/0 conn(0x7f330c0b87a0 legacy=0x7f330c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:35.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32f8003b90 0x7f32f8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:35.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f32f8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:35.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32f8005200 0x7f32f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:35.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0d02d0 con 0x7f32f8004850 2023-05-12T09:07:35.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f800c060 con 0x7f32f8003b90 2023-05-12T09:07:35.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f800c220 con 0x7f32f8005200 2023-05-12T09:07:35.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f3303fff700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f32f8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:35.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f330a59c700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32f8003b90 0x7f32f8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:35.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.658+0000 7f330ad9d700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32f8005200 0x7f32f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:35.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f3303fff700 1 -- 172.21.15.116:0/3491388370 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32f8005200 msgr2=0x7f32f800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:35.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f3303fff700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32f8005200 0x7f32f800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f3303fff700 1 -- 172.21.15.116:0/3491388370 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32f8003b90 msgr2=0x7f32f8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:35.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f3303fff700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32f8003b90 0x7f32f8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f3303fff700 1 -- 172.21.15.116:0/3491388370 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80035b0 con 0x7f32f8004850 2023-05-12T09:07:35.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f330a59c700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32f8003b90 0x7f32f8003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:35.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f330ad9d700 1 -- 172.21.15.116:0/3491388370 reap_dead start 2023-05-12T09:07:35.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f3303fff700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f32f8004cc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f32f4001940 tx=0x7f32f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de42b3ce61516f2 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:35.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4001430 con 0x7f32f8004850 2023-05-12T09:07:35.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f40052f0 con 0x7f32f8004850 2023-05-12T09:07:35.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.659+0000 7f3309d9b700 1 -- 172.21.15.116:0/3491388370 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4001d10 con 0x7f32f8004850 2023-05-12T09:07:35.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.660+0000 7f3310bff700 1 -- 172.21.15.116:0/3491388370 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 msgr2=0x7f32f8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:35.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.660+0000 7f3310bff700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f32f8004cc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f32f4001940 tx=0x7f32f8005880 comp rx=0 tx=0).stop 2023-05-12T09:07:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.660+0000 7f3310bff700 1 -- 172.21.15.116:0/3491388370 shutdown_connections 2023-05-12T09:07:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.660+0000 7f3310bff700 1 --2- 172.21.15.116:0/3491388370 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f32f8004cc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.660+0000 7f3310bff700 1 -- 172.21.15.116:0/3491388370 >> 172.21.15.116:0/3491388370 conn(0x7f330c071b10 msgr2=0x7f330c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.660+0000 7f3310bff700 1 -- 172.21.15.116:0/3491388370 shutdown_connections 2023-05-12T09:07:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.660+0000 7f3310bff700 1 -- 172.21.15.116:0/3491388370 wait complete. 2023-05-12T09:07:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.661+0000 7f3310bff700 1 Processor -- start 2023-05-12T09:07:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.662+0000 7f3310bff700 1 -- start start 2023-05-12T09:07:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.662+0000 7f3310bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f330c15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.662+0000 7f3310bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f330c15db90 0x7f330c15e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.662+0000 7f3310bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f330c15c360 0x7f330c15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.662+0000 7f3310bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c15d8f0 con 0x7f32f8004850 2023-05-12T09:07:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.662+0000 7f3310bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c15e540 con 0x7f330c15db90 2023-05-12T09:07:35.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.662+0000 7f3310bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0ca1b0 con 0x7f330c15c360 2023-05-12T09:07:35.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f330a59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f330c15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:35.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f330a59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f330c15b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33888/0 (socket says 172.21.15.116:33888) 2023-05-12T09:07:35.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f330a59c700 1 -- 172.21.15.116:0/1477919620 learned_addr learned my addr 172.21.15.116:0/1477919620 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:35.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f3303fff700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f330c15db90 0x7f330c15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:35.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f330ad9d700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f330c15c360 0x7f330c15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f330a59c700 1 -- 172.21.15.116:0/1477919620 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f330c15c360 msgr2=0x7f330c15c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f330a59c700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f330c15c360 0x7f330c15c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f330a59c700 1 -- 172.21.15.116:0/1477919620 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f330c15db90 msgr2=0x7f330c15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f330a59c700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f330c15db90 0x7f330c15e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f330a59c700 1 -- 172.21.15.116:0/1477919620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c0cd980 con 0x7f32f8004850 2023-05-12T09:07:35.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f330a59c700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f330c15b4d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f32fc007320 tx=0x7f32fc0076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:35.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f3302ffd700 1 -- 172.21.15.116:0/1477919620 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc00f870 con 0x7f32f8004850 2023-05-12T09:07:35.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f3302ffd700 1 -- 172.21.15.116:0/1477919620 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc00f9d0 con 0x7f32f8004850 2023-05-12T09:07:35.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.663+0000 7f3310bff700 1 -- 172.21.15.116:0/1477919620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c0cd6a0 con 0x7f32f8004850 2023-05-12T09:07:35.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.664+0000 7f3302ffd700 1 -- 172.21.15.116:0/1477919620 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc00fd40 con 0x7f32f8004850 2023-05-12T09:07:35.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.664+0000 7f3310bff700 1 -- 172.21.15.116:0/1477919620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c1601e0 con 0x7f32f8004850 2023-05-12T09:07:35.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.664+0000 7f3310bff700 1 -- 172.21.15.116:0/1477919620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c0b52f0 con 0x7f32f8004850 2023-05-12T09:07:35.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.666+0000 7f3302ffd700 1 -- 172.21.15.116:0/1477919620 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32fc01e3b0 con 0x7f32f8004850 2023-05-12T09:07:35.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.666+0000 7f3302ffd700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32ec06ace0 0x7f32ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:35.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.667+0000 7f3302ffd700 1 -- 172.21.15.116:0/1477919620 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f32fc0893b0 con 0x7f32f8004850 2023-05-12T09:07:35.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.667+0000 7f3303fff700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32ec06ace0 0x7f32ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:35.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.667+0000 7f3303fff700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32ec06ace0 0x7f32ec06d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32f4005040 tx=0x7f32f400a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:35.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.671+0000 7f3302ffd700 1 -- 172.21.15.116:0/1477919620 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f32fc057c20 con 0x7f32f8004850 2023-05-12T09:07:35.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.865+0000 7f3310bff700 1 -- 172.21.15.116:0/1477919620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f330c0c9f60 con 0x7f32f8004850 2023-05-12T09:07:35.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.867+0000 7f3302ffd700 1 -- 172.21.15.116:0/1477919620 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7f32fc00fea0 con 0x7f32f8004850 2023-05-12T09:07:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:35.871 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:35.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 -- 172.21.15.116:0/1477919620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32ec06ace0 msgr2=0x7f32ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:35.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32ec06ace0 0x7f32ec06d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32f4005040 tx=0x7f32f400a000 comp rx=0 tx=0).stop 2023-05-12T09:07:35.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 -- 172.21.15.116:0/1477919620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 msgr2=0x7f330c15b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:35.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f330c15b4d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f32fc007320 tx=0x7f32fc0076e0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 -- 172.21.15.116:0/1477919620 shutdown_connections 2023-05-12T09:07:35.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32ec06ace0 0x7f32ec06d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f330c15c360 0x7f330c15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f8004850 0x7f330c15b4d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 --2- 172.21.15.116:0/1477919620 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f330c15db90 0x7f330c15e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:35.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 -- 172.21.15.116:0/1477919620 >> 172.21.15.116:0/1477919620 conn(0x7f330c071b10 msgr2=0x7f330c0d35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:35.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 -- 172.21.15.116:0/1477919620 shutdown_connections 2023-05-12T09:07:35.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:35.869+0000 7f3310bff700 1 -- 172.21.15.116:0/1477919620 wait complete. 2023-05-12T09:07:35.890 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:36.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.071+0000 7f84b15ff700 1 Processor -- start 2023-05-12T09:07:36.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.071+0000 7f84b15ff700 1 -- start start 2023-05-12T09:07:36.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.072+0000 7f84b15ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f84ac15a5a0 0x7f84ac06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84b15ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f84ac071200 0x7f84ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84b15ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac0cb280 con 0x7f84ac06a920 2023-05-12T09:07:36.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84b15ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ac15a970 con 0x7f84ac071200 2023-05-12T09:07:36.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84b15ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac06ad90 con 0x7f84ac15a5a0 2023-05-12T09:07:36.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84ab7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f84ac071200 0x7f84ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84ab7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f84ac071200 0x7f84ac06d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33900/0 (socket says 172.21.15.116:33900) 2023-05-12T09:07:36.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84ab7fe700 1 -- 172.21.15.116:0/2248168454 learned_addr learned my addr 172.21.15.116:0/2248168454 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:36.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84aaffd700 1 --2- 172.21.15.116:0/2248168454 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f84ac15a5a0 0x7f84ac06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84ab7fe700 1 -- 172.21.15.116:0/2248168454 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f84ac15a5a0 msgr2=0x7f84ac06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:36.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84ab7fe700 1 --2- 172.21.15.116:0/2248168454 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f84ac15a5a0 0x7f84ac06a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84ab7fe700 1 -- 172.21.15.116:0/2248168454 >> v1:172.21.15.182:6789/0 conn(0x7f84ac06a920 legacy=0x7f84ac070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:36.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.073+0000 7f84ab7fe700 1 -- 172.21.15.116:0/2248168454 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac071700 con 0x7f84ac071200 2023-05-12T09:07:36.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84ab7fe700 1 --2- 172.21.15.116:0/2248168454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac071200 0x7f84ac06d1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009e50 tx=0x7f84a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71d0a17aa91a9e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:36.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84aa7fc700 1 -- 172.21.15.116:0/2248168454 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400e070 con 0x7f84ac071200 2023-05-12T09:07:36.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84aa7fc700 1 -- 172.21.15.116:0/2248168454 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a400b910 con 0x7f84ac071200 2023-05-12T09:07:36.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84aa7fc700 1 -- 172.21.15.116:0/2248168454 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400bcc0 con 0x7f84ac071200 2023-05-12T09:07:36.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84b15ff700 1 -- 172.21.15.116:0/2248168454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac071200 msgr2=0x7f84ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:36.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84b15ff700 1 --2- 172.21.15.116:0/2248168454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac071200 0x7f84ac06d1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009e50 tx=0x7f84a400b330 comp rx=0 tx=0).stop 2023-05-12T09:07:36.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84b15ff700 1 -- 172.21.15.116:0/2248168454 shutdown_connections 2023-05-12T09:07:36.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84b15ff700 1 --2- 172.21.15.116:0/2248168454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac071200 0x7f84ac06d1a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84b15ff700 1 --2- 172.21.15.116:0/2248168454 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f84ac15a5a0 0x7f84ac06a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84b15ff700 1 -- 172.21.15.116:0/2248168454 >> 172.21.15.116:0/2248168454 conn(0x7f84ac0cf720 msgr2=0x7f84ac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:36.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84b15ff700 1 -- 172.21.15.116:0/2248168454 shutdown_connections 2023-05-12T09:07:36.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.074+0000 7f84b15ff700 1 -- 172.21.15.116:0/2248168454 wait complete. 2023-05-12T09:07:36.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.076+0000 7f84b15ff700 1 Processor -- start 2023-05-12T09:07:36.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.076+0000 7f84b15ff700 1 -- start start 2023-05-12T09:07:36.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.077+0000 7f84b15ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f84ac06a920 0x7f84ac155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.077+0000 7f84b15ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f84ac071200 0x7f84ac0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.077+0000 7f84b15ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac15a5a0 0x7f84ac0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.077+0000 7f84b15ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac159470 con 0x7f84ac15a5a0 2023-05-12T09:07:36.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.077+0000 7f84b15ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac0b22d0 con 0x7f84ac06a920 2023-05-12T09:07:36.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.077+0000 7f84b15ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac0b25b0 con 0x7f84ac071200 2023-05-12T09:07:36.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84ab7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac15a5a0 0x7f84ac0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84ab7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac15a5a0 0x7f84ac0b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33902/0 (socket says 172.21.15.116:33902) 2023-05-12T09:07:36.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84ab7fe700 1 -- 172.21.15.116:0/3649218762 learned_addr learned my addr 172.21.15.116:0/3649218762 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:36.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84aaffd700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f84ac06a920 0x7f84ac155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84a3fff700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f84ac071200 0x7f84ac0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84ab7fe700 1 -- 172.21.15.116:0/3649218762 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f84ac071200 msgr2=0x7f84ac0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:36.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84ab7fe700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f84ac071200 0x7f84ac0b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84ab7fe700 1 -- 172.21.15.116:0/3649218762 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f84ac06a920 msgr2=0x7f84ac155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:36.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84ab7fe700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f84ac06a920 0x7f84ac155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84ab7fe700 1 -- 172.21.15.116:0/3649218762 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a4009b30 con 0x7f84ac15a5a0 2023-05-12T09:07:36.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84ab7fe700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac15a5a0 0x7f84ac0b42a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f84a4012000 tx=0x7f84a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:36.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.078+0000 7f84a37fe700 1 -- 172.21.15.116:0/3649218762 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4004800 con 0x7f84ac15a5a0 2023-05-12T09:07:36.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.079+0000 7f84a37fe700 1 -- 172.21.15.116:0/3649218762 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4004960 con 0x7f84ac15a5a0 2023-05-12T09:07:36.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.079+0000 7f84a37fe700 1 -- 172.21.15.116:0/3649218762 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a401c680 con 0x7f84ac15a5a0 2023-05-12T09:07:36.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.079+0000 7f84b15ff700 1 -- 172.21.15.116:0/3649218762 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac06c6c0 con 0x7f84ac15a5a0 2023-05-12T09:07:36.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.079+0000 7f84b15ff700 1 -- 172.21.15.116:0/3649218762 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac0719e0 con 0x7f84ac15a5a0 2023-05-12T09:07:36.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.080+0000 7f84b15ff700 1 -- 172.21.15.116:0/3649218762 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ac06c9a0 con 0x7f84ac15a5a0 2023-05-12T09:07:36.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.080+0000 7f84a37fe700 1 -- 172.21.15.116:0/3649218762 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84a401c7e0 con 0x7f84ac15a5a0 2023-05-12T09:07:36.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.081+0000 7f84a37fe700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f848c06ace0 0x7f848c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.081+0000 7f84a37fe700 1 -- 172.21.15.116:0/3649218762 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f84a408b050 con 0x7f84ac15a5a0 2023-05-12T09:07:36.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.082+0000 7f84aaffd700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f848c06ace0 0x7f848c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.082+0000 7f84aaffd700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f848c06ace0 0x7f848c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f849c009b40 tx=0x7f849c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:36.088 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.086+0000 7f84a37fe700 1 -- 172.21.15.116:0/3649218762 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f84a40bd2d0 con 0x7f84ac15a5a0 2023-05-12T09:07:36.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.280+0000 7f84b15ff700 1 -- 172.21.15.116:0/3649218762 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84ac074430 con 0x7f84ac15a5a0 2023-05-12T09:07:36.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.282+0000 7f84a37fe700 1 -- 172.21.15.116:0/3649218762 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7f84a4055e00 con 0x7f84ac15a5a0 2023-05-12T09:07:36.285 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:36.285 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:36.287 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.284+0000 7f84b15ff700 1 -- 172.21.15.116:0/3649218762 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f848c06ace0 msgr2=0x7f848c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:36.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.284+0000 7f84b15ff700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f848c06ace0 0x7f848c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f849c009b40 tx=0x7f849c009210 comp rx=0 tx=0).stop 2023-05-12T09:07:36.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.284+0000 7f84b15ff700 1 -- 172.21.15.116:0/3649218762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac15a5a0 msgr2=0x7f84ac0b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:36.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.284+0000 7f84b15ff700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac15a5a0 0x7f84ac0b42a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f84a4012000 tx=0x7f84a4004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.284+0000 7f84b15ff700 1 -- 172.21.15.116:0/3649218762 shutdown_connections 2023-05-12T09:07:36.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.284+0000 7f84b15ff700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84ac15a5a0 0x7f84ac0b42a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.284+0000 7f84b15ff700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f84ac06a920 0x7f84ac155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.284+0000 7f84b15ff700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f848c06ace0 0x7f848c06d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.284+0000 7f84b15ff700 1 --2- 172.21.15.116:0/3649218762 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f84ac071200 0x7f84ac0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.285+0000 7f84b15ff700 1 -- 172.21.15.116:0/3649218762 >> 172.21.15.116:0/3649218762 conn(0x7f84ac0cf720 msgr2=0x7f84ac070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:36.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.285+0000 7f84b15ff700 1 -- 172.21.15.116:0/3649218762 shutdown_connections 2023-05-12T09:07:36.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.285+0000 7f84b15ff700 1 -- 172.21.15.116:0/3649218762 wait complete. 2023-05-12T09:07:36.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-12T09:07:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.489+0000 7f34ef9ff700 1 Processor -- start 2023-05-12T09:07:36.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.490+0000 7f34ef9ff700 1 -- start start 2023-05-12T09:07:36.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34ef9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e80b87a0 0x7f34e80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34ef9ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f34e81601e0 0x7f34e8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34ef9ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e8160ff0 con 0x7f34e8160b70 2023-05-12T09:07:36.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34ef9ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e80d02d0 con 0x7f34e81601e0 2023-05-12T09:07:36.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34ef9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80d0cb0 con 0x7f34e80b87a0 2023-05-12T09:07:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34edf9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f34e8160b70 0x7f34e80d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47718/0 (socket says 172.21.15.116:47718) 2023-05-12T09:07:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34edf9c700 1 -- 172.21.15.116:0/3041981861 learned_addr learned my addr 172.21.15.116:0/3041981861 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34ecf9a700 1 --2- 172.21.15.116:0/3041981861 >> v2:172.21.15.182:3300/0 conn(0x7f34e81601e0 0x7f34e8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34ed79b700 1 --2- 172.21.15.116:0/3041981861 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e80b87a0 0x7f34e80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34dffff700 1 -- 172.21.15.116:0/3041981861 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047949165 0 0) 0x7f34e8160ff0 con 0x7f34e8160b70 2023-05-12T09:07:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.491+0000 7f34dffff700 1 -- 172.21.15.116:0/3041981861 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d40035b0 con 0x7f34e8160b70 2023-05-12T09:07:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.492+0000 7f34ecf9a700 1 -- 172.21.15.116:0/3041981861 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e80b87a0 msgr2=0x7f34e80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.492+0000 7f34ecf9a700 1 --2- 172.21.15.116:0/3041981861 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e80b87a0 0x7f34e80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.492+0000 7f34ecf9a700 1 -- 172.21.15.116:0/3041981861 >> v1:172.21.15.116:6789/0 conn(0x7f34e8160b70 legacy=0x7f34e80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.492+0000 7f34ecf9a700 1 -- 172.21.15.116:0/3041981861 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80cdc60 con 0x7f34e81601e0 2023-05-12T09:07:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.492+0000 7f34ecf9a700 1 --2- 172.21.15.116:0/3041981861 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34e81601e0 0x7f34e8160630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009840 tx=0x7f34d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff913e1132c2bdd8 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.492+0000 7f34dffff700 1 -- 172.21.15.116:0/3041981861 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8011830 con 0x7f34e81601e0 2023-05-12T09:07:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.492+0000 7f34dffff700 1 -- 172.21.15.116:0/3041981861 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d8011990 con 0x7f34e81601e0 2023-05-12T09:07:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.492+0000 7f34dffff700 1 -- 172.21.15.116:0/3041981861 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8011d20 con 0x7f34e81601e0 2023-05-12T09:07:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.493+0000 7f34ef9ff700 1 -- 172.21.15.116:0/3041981861 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34e81601e0 msgr2=0x7f34e8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.493+0000 7f34ef9ff700 1 --2- 172.21.15.116:0/3041981861 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34e81601e0 0x7f34e8160630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009840 tx=0x7f34d8009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.493+0000 7f34ef9ff700 1 -- 172.21.15.116:0/3041981861 shutdown_connections 2023-05-12T09:07:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.493+0000 7f34ef9ff700 1 --2- 172.21.15.116:0/3041981861 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e80b87a0 0x7f34e80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.493+0000 7f34ef9ff700 1 --2- 172.21.15.116:0/3041981861 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34e81601e0 0x7f34e8160630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.493+0000 7f34ef9ff700 1 -- 172.21.15.116:0/3041981861 >> 172.21.15.116:0/3041981861 conn(0x7f34e8071b10 msgr2=0x7f34e8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.493+0000 7f34ef9ff700 1 -- 172.21.15.116:0/3041981861 shutdown_connections 2023-05-12T09:07:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.493+0000 7f34ef9ff700 1 -- 172.21.15.116:0/3041981861 wait complete. 2023-05-12T09:07:36.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.494+0000 7f34ef9ff700 1 Processor -- start 2023-05-12T09:07:36.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.495+0000 7f34ef9ff700 1 -- start start 2023-05-12T09:07:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.495+0000 7f34ef9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80b87a0 0x7f34e80b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.495+0000 7f34ef9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34e81601e0 0x7f34e80b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.495+0000 7f34ef9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e8160b70 0x7f34e81f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.495+0000 7f34ef9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e815f950 con 0x7f34e80b87a0 2023-05-12T09:07:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.495+0000 7f34ef9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e815ecd0 con 0x7f34e81601e0 2023-05-12T09:07:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.495+0000 7f34ef9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e815efb0 con 0x7f34e8160b70 2023-05-12T09:07:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ed79b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80b87a0 0x7f34e80b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ed79b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80b87a0 0x7f34e80b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33914/0 (socket says 172.21.15.116:33914) 2023-05-12T09:07:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ed79b700 1 -- 172.21.15.116:0/2512406616 learned_addr learned my addr 172.21.15.116:0/2512406616 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ecf9a700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34e81601e0 0x7f34e80b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34edf9c700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e8160b70 0x7f34e81f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ed79b700 1 -- 172.21.15.116:0/2512406616 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e8160b70 msgr2=0x7f34e81f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ed79b700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e8160b70 0x7f34e81f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ed79b700 1 -- 172.21.15.116:0/2512406616 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34e81601e0 msgr2=0x7f34e80b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ed79b700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34e81601e0 0x7f34e80b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ed79b700 1 -- 172.21.15.116:0/2512406616 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80094a0 con 0x7f34e80b87a0 2023-05-12T09:07:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ecf9a700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34e81601e0 0x7f34e80b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34edf9c700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e8160b70 0x7f34e81f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ed79b700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80b87a0 0x7f34e80b3960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34e400e9b0 tx=0x7f34e400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.496+0000 7f34ddffb700 1 -- 172.21.15.116:0/2512406616 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4009710 con 0x7f34e80b87a0 2023-05-12T09:07:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.497+0000 7f34ddffb700 1 -- 172.21.15.116:0/2512406616 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e400c850 con 0x7f34e80b87a0 2023-05-12T09:07:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.497+0000 7f34ef9ff700 1 -- 172.21.15.116:0/2512406616 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e80cd980 con 0x7f34e80b87a0 2023-05-12T09:07:36.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.497+0000 7f34ddffb700 1 -- 172.21.15.116:0/2512406616 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e400cbc0 con 0x7f34e80b87a0 2023-05-12T09:07:36.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.497+0000 7f34ef9ff700 1 -- 172.21.15.116:0/2512406616 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e80cd6a0 con 0x7f34e80b87a0 2023-05-12T09:07:36.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.497+0000 7f34ef9ff700 1 -- 172.21.15.116:0/2512406616 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e80d2110 con 0x7f34e80b87a0 2023-05-12T09:07:36.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.500+0000 7f34ddffb700 1 -- 172.21.15.116:0/2512406616 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34e400cd20 con 0x7f34e80b87a0 2023-05-12T09:07:36.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.500+0000 7f34ddffb700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f34cc06ace0 0x7f34cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:36.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.500+0000 7f34ddffb700 1 -- 172.21.15.116:0/2512406616 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f34e408a0a0 con 0x7f34e80b87a0 2023-05-12T09:07:36.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.501+0000 7f34ecf9a700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f34cc06ace0 0x7f34cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:36.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.501+0000 7f34ecf9a700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f34cc06ace0 0x7f34cc06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34d80090b0 tx=0x7f34d8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.504+0000 7f34ddffb700 1 -- 172.21.15.116:0/2512406616 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f34e4058960 con 0x7f34e80b87a0 2023-05-12T09:07:36.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:36.740+0000 7f34ef9ff700 1 -- 172.21.15.116:0/2512406616 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f34e8074430 con 0x7f34e80b87a0 2023-05-12T09:07:37.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.475+0000 7f34ddffb700 1 -- 172.21.15.116:0/2512406616 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f34e40584f0 con 0x7f34e80b87a0 2023-05-12T09:07:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 -- 172.21.15.116:0/2512406616 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f34cc06ace0 msgr2=0x7f34cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f34cc06ace0 0x7f34cc06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34d80090b0 tx=0x7f34d8008030 comp rx=0 tx=0).stop 2023-05-12T09:07:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 -- 172.21.15.116:0/2512406616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80b87a0 msgr2=0x7f34e80b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80b87a0 0x7f34e80b3960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34e400e9b0 tx=0x7f34e400ed70 comp rx=0 tx=0).stop 2023-05-12T09:07:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 -- 172.21.15.116:0/2512406616 shutdown_connections 2023-05-12T09:07:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f34cc06ace0 0x7f34cc06d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34e8160b70 0x7f34e81f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:37.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80b87a0 0x7f34e80b3960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:37.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 --2- 172.21.15.116:0/2512406616 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34e81601e0 0x7f34e80b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:37.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 -- 172.21.15.116:0/2512406616 >> 172.21.15.116:0/2512406616 conn(0x7f34e8071b10 msgr2=0x7f34e80b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:37.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.478+0000 7f34ef9ff700 1 -- 172.21.15.116:0/2512406616 shutdown_connections 2023-05-12T09:07:37.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.479+0000 7f34ef9ff700 1 -- 172.21.15.116:0/2512406616 wait complete. 2023-05-12T09:07:37.501 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-05-12T09:07:37.502 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-12T09:07:37.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.690+0000 7fa0a67ff700 1 Processor -- start 2023-05-12T09:07:37.694 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.690+0000 7fa0a67ff700 1 -- start start 2023-05-12T09:07:37.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa0a67ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa0a00d2110 0x7fa0a0167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:37.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa0a67ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a0161000 con 0x7fa0a00b87a0 2023-05-12T09:07:37.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa0a67ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a00d0020 con 0x7fa0a00cfbf0 2023-05-12T09:07:37.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa0a67ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a00d02d0 con 0x7fa0a00d2110 2023-05-12T09:07:37.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa0a4d9c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa0a00d2110 0x7fa0a0167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:37.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa09ffff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa0a00b87a0 0x7fa0a01601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47730/0 (socket says 172.21.15.116:47730) 2023-05-12T09:07:37.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa09ffff700 1 -- 172.21.15.116:0/612739379 learned_addr learned my addr 172.21.15.116:0/612739379 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:37.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa0a4d9c700 1 -- 172.21.15.116:0/612739379 >> v1:172.21.15.182:6789/0 conn(0x7fa0a00cfbf0 legacy=0x7fa0a01608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:37.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa0a4d9c700 1 -- 172.21.15.116:0/612739379 >> v1:172.21.15.116:6789/0 conn(0x7fa0a00b87a0 legacy=0x7fa0a01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:37.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa0a4d9c700 1 -- 172.21.15.116:0/612739379 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a00cdc60 con 0x7fa0a00d2110 2023-05-12T09:07:37.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.692+0000 7fa09f7fe700 1 -- 172.21.15.116:0/612739379 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960497701 0 0) 0x7fa0a0161000 con 0x7fa0a00b87a0 2023-05-12T09:07:37.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa0a4d9c700 1 --2- 172.21.15.116:0/612739379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 0x7fa0a0167550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa098009d90 tx=0x7fa09800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7b45c8665a2013 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:37.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa09f7fe700 1 -- 172.21.15.116:0/612739379 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09800e070 con 0x7fa0a00d2110 2023-05-12T09:07:37.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa09f7fe700 1 -- 172.21.15.116:0/612739379 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09800bb90 con 0x7fa0a00d2110 2023-05-12T09:07:37.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa09f7fe700 1 -- 172.21.15.116:0/612739379 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098003a20 con 0x7fa0a00d2110 2023-05-12T09:07:37.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa0a67ff700 1 -- 172.21.15.116:0/612739379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 msgr2=0x7fa0a0167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:37.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa0a67ff700 1 --2- 172.21.15.116:0/612739379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 0x7fa0a0167550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa098009d90 tx=0x7fa09800b330 comp rx=0 tx=0).stop 2023-05-12T09:07:37.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa0a67ff700 1 -- 172.21.15.116:0/612739379 shutdown_connections 2023-05-12T09:07:37.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa0a67ff700 1 --2- 172.21.15.116:0/612739379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 0x7fa0a0167550 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:37.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa0a67ff700 1 -- 172.21.15.116:0/612739379 >> 172.21.15.116:0/612739379 conn(0x7fa0a0071b10 msgr2=0x7fa0a0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:37.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa0a67ff700 1 -- 172.21.15.116:0/612739379 shutdown_connections 2023-05-12T09:07:37.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.693+0000 7fa0a67ff700 1 -- 172.21.15.116:0/612739379 wait complete. 2023-05-12T09:07:37.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.695+0000 7fa0a67ff700 1 Processor -- start 2023-05-12T09:07:37.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.695+0000 7fa0a67ff700 1 -- start start 2023-05-12T09:07:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa0a67ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0a00b87a0 0x7fa0a015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa0a67ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0a00cfbf0 0x7fa0a0151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa0a67ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 0x7fa0a0156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa0a67ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a015f460 con 0x7fa0a00d2110 2023-05-12T09:07:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa0a67ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a0156f80 con 0x7fa0a00b87a0 2023-05-12T09:07:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa0a67ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a015d370 con 0x7fa0a00cfbf0 2023-05-12T09:07:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa0a4d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 0x7fa0a0156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:37.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa0a4d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 0x7fa0a0156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33932/0 (socket says 172.21.15.116:33932) 2023-05-12T09:07:37.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa0a4d9c700 1 -- 172.21.15.116:0/3343202002 learned_addr learned my addr 172.21.15.116:0/3343202002 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:37.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa09ffff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0a00b87a0 0x7fa0a015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:37.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.696+0000 7fa097fff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0a00cfbf0 0x7fa0a0151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:37.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa0a4d9c700 1 -- 172.21.15.116:0/3343202002 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0a00cfbf0 msgr2=0x7fa0a0151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:37.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa0a4d9c700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0a00cfbf0 0x7fa0a0151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:37.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa0a4d9c700 1 -- 172.21.15.116:0/3343202002 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0a00b87a0 msgr2=0x7fa0a015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:37.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa0a4d9c700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0a00b87a0 0x7fa0a015cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:37.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa0a4d9c700 1 -- 172.21.15.116:0/3343202002 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa098009a70 con 0x7fa0a00d2110 2023-05-12T09:07:37.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa097fff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0a00cfbf0 0x7fa0a0151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:37.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa0a4d9c700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 0x7fa0a0156a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0072760 tx=0x7fa098004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:37.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa09d7fa700 1 -- 172.21.15.116:0/3343202002 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098012630 con 0x7fa0a00d2110 2023-05-12T09:07:37.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa09d7fa700 1 -- 172.21.15.116:0/3343202002 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0980127b0 con 0x7fa0a00d2110 2023-05-12T09:07:37.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa0a67ff700 1 -- 172.21.15.116:0/3343202002 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a00cd980 con 0x7fa0a00d2110 2023-05-12T09:07:37.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa09d7fa700 1 -- 172.21.15.116:0/3343202002 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098012b60 con 0x7fa0a00d2110 2023-05-12T09:07:37.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.697+0000 7fa0a67ff700 1 -- 172.21.15.116:0/3343202002 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a00cd6a0 con 0x7fa0a00d2110 2023-05-12T09:07:37.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.698+0000 7fa0a67ff700 1 -- 172.21.15.116:0/3343202002 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a0167a90 con 0x7fa0a00d2110 2023-05-12T09:07:37.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.699+0000 7fa09d7fa700 1 -- 172.21.15.116:0/3343202002 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa098012cc0 con 0x7fa0a00d2110 2023-05-12T09:07:37.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.700+0000 7fa09d7fa700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa08006ace0 0x7fa08006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:37.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.700+0000 7fa09d7fa700 1 -- 172.21.15.116:0/3343202002 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa09808bdc0 con 0x7fa0a00d2110 2023-05-12T09:07:37.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.700+0000 7fa09ffff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa08006ace0 0x7fa08006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:37.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.701+0000 7fa09ffff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa08006ace0 0x7fa08006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa090000f60 tx=0x7fa090007e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:37.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.704+0000 7fa09d7fa700 1 -- 172.21.15.116:0/3343202002 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa098056c10 con 0x7fa0a00d2110 2023-05-12T09:07:37.942 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:37.939+0000 7fa0a67ff700 1 -- 172.21.15.116:0/3343202002 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa0a00c9d40 con 0x7fa0a00d2110 2023-05-12T09:07:38.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.481+0000 7fa09d7fa700 1 -- 172.21.15.116:0/3343202002 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa09805a230 con 0x7fa0a00d2110 2023-05-12T09:07:38.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.483+0000 7fa0a67ff700 1 -- 172.21.15.116:0/3343202002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa08006ace0 msgr2=0x7fa08006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:38.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.483+0000 7fa0a67ff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa08006ace0 0x7fa08006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa090000f60 tx=0x7fa090007e70 comp rx=0 tx=0).stop 2023-05-12T09:07:38.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.483+0000 7fa0a67ff700 1 -- 172.21.15.116:0/3343202002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 msgr2=0x7fa0a0156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:38.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.483+0000 7fa0a67ff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 0x7fa0a0156a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0072760 tx=0x7fa098004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.484+0000 7fa0a67ff700 1 -- 172.21.15.116:0/3343202002 shutdown_connections 2023-05-12T09:07:38.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.484+0000 7fa0a67ff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a00d2110 0x7fa0a0156a40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.484+0000 7fa0a67ff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa0a00b87a0 0x7fa0a015cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.484+0000 7fa0a67ff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa08006ace0 0x7fa08006d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.484+0000 7fa0a67ff700 1 --2- 172.21.15.116:0/3343202002 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa0a00cfbf0 0x7fa0a0151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.484+0000 7fa0a67ff700 1 -- 172.21.15.116:0/3343202002 >> 172.21.15.116:0/3343202002 conn(0x7fa0a0071b10 msgr2=0x7fa0a00d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:38.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.484+0000 7fa0a67ff700 1 -- 172.21.15.116:0/3343202002 shutdown_connections 2023-05-12T09:07:38.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.484+0000 7fa0a67ff700 1 -- 172.21.15.116:0/3343202002 wait complete. 2023-05-12T09:07:38.505 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-12T09:07:38.505 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:07:38.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.692+0000 7fc953fff700 1 Processor -- start 2023-05-12T09:07:38.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.692+0000 7fc953fff700 1 -- start start 2023-05-12T09:07:38.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.693+0000 7fc953fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc94c0b87a0 0x7fc94c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:38.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.693+0000 7fc953fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc94c160d40 0x7fc94c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:38.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.693+0000 7fc953fff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c0cdc60 con 0x7fc94c1601e0 2023-05-12T09:07:38.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.693+0000 7fc953fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c0d02d0 con 0x7fc94c0b87a0 2023-05-12T09:07:38.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.693+0000 7fc953fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0d0cb0 con 0x7fc94c160d40 2023-05-12T09:07:38.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.694+0000 7fc951d9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc94c0b87a0 0x7fc94c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:38.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.694+0000 7fc951d9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc94c0b87a0 0x7fc94c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33948/0 (socket says 172.21.15.116:33948) 2023-05-12T09:07:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.694+0000 7fc951d9b700 1 -- 172.21.15.116:0/1899158969 learned_addr learned my addr 172.21.15.116:0/1899158969 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.694+0000 7fc95259c700 1 --2- 172.21.15.116:0/1899158969 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc94c160d40 0x7fc94c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.694+0000 7fc951d9b700 1 -- 172.21.15.116:0/1899158969 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc94c160d40 msgr2=0x7fc94c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.694+0000 7fc951d9b700 1 --2- 172.21.15.116:0/1899158969 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc94c160d40 0x7fc94c0d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.694+0000 7fc951d9b700 1 -- 172.21.15.116:0/1899158969 >> v1:172.21.15.182:6789/0 conn(0x7fc94c1601e0 legacy=0x7fc94c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.694+0000 7fc951d9b700 1 -- 172.21.15.116:0/1899158969 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0cd6a0 con 0x7fc94c0b87a0 2023-05-12T09:07:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.694+0000 7fc951d9b700 1 --2- 172.21.15.116:0/1899158969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c0b87a0 0x7fc94c0cfbf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9480098f0 tx=0x7fc948009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c865eb3014d2e9ec server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:38.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc950d99700 1 -- 172.21.15.116:0/1899158969 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948011830 con 0x7fc94c0b87a0 2023-05-12T09:07:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc950d99700 1 -- 172.21.15.116:0/1899158969 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc948011990 con 0x7fc94c0b87a0 2023-05-12T09:07:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc950d99700 1 -- 172.21.15.116:0/1899158969 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948011d20 con 0x7fc94c0b87a0 2023-05-12T09:07:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc953fff700 1 -- 172.21.15.116:0/1899158969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c0b87a0 msgr2=0x7fc94c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc953fff700 1 --2- 172.21.15.116:0/1899158969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c0b87a0 0x7fc94c0cfbf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9480098f0 tx=0x7fc948009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc953fff700 1 -- 172.21.15.116:0/1899158969 shutdown_connections 2023-05-12T09:07:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc953fff700 1 --2- 172.21.15.116:0/1899158969 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc94c160d40 0x7fc94c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc953fff700 1 --2- 172.21.15.116:0/1899158969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c0b87a0 0x7fc94c0cfbf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc953fff700 1 -- 172.21.15.116:0/1899158969 >> 172.21.15.116:0/1899158969 conn(0x7fc94c071b10 msgr2=0x7fc94c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc953fff700 1 -- 172.21.15.116:0/1899158969 shutdown_connections 2023-05-12T09:07:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.695+0000 7fc953fff700 1 -- 172.21.15.116:0/1899158969 wait complete. 2023-05-12T09:07:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.697+0000 7fc953fff700 1 Processor -- start 2023-05-12T09:07:38.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.697+0000 7fc953fff700 1 -- start start 2023-05-12T09:07:38.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.698+0000 7fc953fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc94c0b87a0 0x7fc94c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:38.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.698+0000 7fc953fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc94c1601e0 0x7fc94c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:38.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.698+0000 7fc953fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c160d40 0x7fc94c150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:38.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.698+0000 7fc953fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c15dbd0 con 0x7fc94c160d40 2023-05-12T09:07:38.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.698+0000 7fc953fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c150eb0 con 0x7fc94c1601e0 2023-05-12T09:07:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.698+0000 7fc953fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c9f80 con 0x7fc94c0b87a0 2023-05-12T09:07:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.698+0000 7fc95259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c160d40 0x7fc94c150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.698+0000 7fc95259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c160d40 0x7fc94c150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33956/0 (socket says 172.21.15.116:33956) 2023-05-12T09:07:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.698+0000 7fc95259c700 1 -- 172.21.15.116:0/2442118814 learned_addr learned my addr 172.21.15.116:0/2442118814 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc951d9b700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc94c0b87a0 0x7fc94c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc95159a700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc94c1601e0 0x7fc94c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:38.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc95259c700 1 -- 172.21.15.116:0/2442118814 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc94c0b87a0 msgr2=0x7fc94c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:38.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc95259c700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc94c0b87a0 0x7fc94c15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc95259c700 1 -- 172.21.15.116:0/2442118814 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc94c1601e0 msgr2=0x7fc94c0ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:38.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc95259c700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc94c1601e0 0x7fc94c0ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc95259c700 1 -- 172.21.15.116:0/2442118814 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948009550 con 0x7fc94c160d40 2023-05-12T09:07:38.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc95259c700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c160d40 0x7fc94c150970 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc94400efc0 tx=0x7fc94400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:38.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc9427fc700 1 -- 172.21.15.116:0/2442118814 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944009ba0 con 0x7fc94c160d40 2023-05-12T09:07:38.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc9427fc700 1 -- 172.21.15.116:0/2442118814 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94400f040 con 0x7fc94c160d40 2023-05-12T09:07:38.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc9427fc700 1 -- 172.21.15.116:0/2442118814 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944014480 con 0x7fc94c160d40 2023-05-12T09:07:38.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc953fff700 1 -- 172.21.15.116:0/2442118814 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c0d1640 con 0x7fc94c160d40 2023-05-12T09:07:38.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.699+0000 7fc953fff700 1 -- 172.21.15.116:0/2442118814 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c0cd980 con 0x7fc94c160d40 2023-05-12T09:07:38.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.701+0000 7fc953fff700 1 -- 172.21.15.116:0/2442118814 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c0d17d0 con 0x7fc94c160d40 2023-05-12T09:07:38.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.701+0000 7fc9427fc700 1 -- 172.21.15.116:0/2442118814 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9440145e0 con 0x7fc94c160d40 2023-05-12T09:07:38.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.702+0000 7fc9427fc700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc93006ace0 0x7fc93006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.702+0000 7fc9427fc700 1 -- 172.21.15.116:0/2442118814 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc94408a020 con 0x7fc94c160d40 2023-05-12T09:07:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.703+0000 7fc951d9b700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc93006ace0 0x7fc93006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.703+0000 7fc951d9b700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc93006ace0 0x7fc93006d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc948009c40 tx=0x7fc948008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.707+0000 7fc9427fc700 1 -- 172.21.15.116:0/2442118814 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc944054e70 con 0x7fc94c160d40 2023-05-12T09:07:38.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.943+0000 7fc953fff700 1 -- 172.21.15.116:0/2442118814 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc94c074430 con 0x7fc94c160d40 2023-05-12T09:07:38.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.943+0000 7fc9427fc700 1 -- 172.21.15.116:0/2442118814 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7fc944058490 con 0x7fc94c160d40 2023-05-12T09:07:38.947 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:38.947 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:07:10.529423+0000","modified":"2023-05-12T09:07:38.475430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-12T09:07:38.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.945+0000 7fc953fff700 1 -- 172.21.15.116:0/2442118814 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc93006ace0 msgr2=0x7fc93006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:38.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc93006ace0 0x7fc93006d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc948009c40 tx=0x7fc948008030 comp rx=0 tx=0).stop 2023-05-12T09:07:38.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 -- 172.21.15.116:0/2442118814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c160d40 msgr2=0x7fc94c150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:38.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c160d40 0x7fc94c150970 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc94400efc0 tx=0x7fc94400c3a0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 -- 172.21.15.116:0/2442118814 shutdown_connections 2023-05-12T09:07:38.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc94c160d40 0x7fc94c150970 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc93006ace0 0x7fc93006d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc94c0b87a0 0x7fc94c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 --2- 172.21.15.116:0/2442118814 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc94c1601e0 0x7fc94c0ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:38.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 -- 172.21.15.116:0/2442118814 >> 172.21.15.116:0/2442118814 conn(0x7fc94c071b10 msgr2=0x7fc94c071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:38.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 -- 172.21.15.116:0/2442118814 shutdown_connections 2023-05-12T09:07:38.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:38.946+0000 7fc953fff700 1 -- 172.21.15.116:0/2442118814 wait complete. 2023-05-12T09:07:38.951 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 9 2023-05-12T09:07:38.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:39.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.146+0000 7fc4215ff700 1 Processor -- start 2023-05-12T09:07:39.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.146+0000 7fc4215ff700 1 -- start start 2023-05-12T09:07:39.151 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.147+0000 7fc4215ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc41c0b87a0 0x7fc41c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.151 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.147+0000 7fc4215ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc41c160d40 0x7fc41c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.152 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.147+0000 7fc4215ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c0cdc60 con 0x7fc41c1601e0 2023-05-12T09:07:39.152 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.147+0000 7fc4215ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c0d02d0 con 0x7fc41c160d40 2023-05-12T09:07:39.152 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.147+0000 7fc4215ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c0d0cb0 con 0x7fc41c0b87a0 2023-05-12T09:07:39.152 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc41b7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc41c160d40 0x7fc41c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.152 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc41b7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc41c160d40 0x7fc41c0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33966/0 (socket says 172.21.15.116:33966) 2023-05-12T09:07:39.152 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc41b7fe700 1 -- 172.21.15.116:0/3225319406 learned_addr learned my addr 172.21.15.116:0/3225319406 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:39.153 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc41affd700 1 --2- 172.21.15.116:0/3225319406 >> v2:172.21.15.182:3300/0 conn(0x7fc41c0b87a0 0x7fc41c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.153 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc41b7fe700 1 -- 172.21.15.116:0/3225319406 >> v2:172.21.15.182:3300/0 conn(0x7fc41c0b87a0 msgr2=0x7fc41c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:39.153 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc41b7fe700 1 --2- 172.21.15.116:0/3225319406 >> v2:172.21.15.182:3300/0 conn(0x7fc41c0b87a0 0x7fc41c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.153 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc41b7fe700 1 -- 172.21.15.116:0/3225319406 >> v1:172.21.15.182:6789/0 conn(0x7fc41c1601e0 legacy=0x7fc41c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.153 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc41b7fe700 1 -- 172.21.15.116:0/3225319406 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0cd6a0 con 0x7fc41c160d40 2023-05-12T09:07:39.153 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc41affd700 1 --2- 172.21.15.116:0/3225319406 >> v2:172.21.15.182:3300/0 conn(0x7fc41c0b87a0 0x7fc41c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:39.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc41b7fe700 1 --2- 172.21.15.116:0/3225319406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c160d40 0x7fc41c0d1100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0b4ac0 tx=0x7fc41400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc30ea08ae014ba server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:39.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.148+0000 7fc419ffb700 1 -- 172.21.15.116:0/3225319406 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400e070 con 0x7fc41c160d40 2023-05-12T09:07:39.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.149+0000 7fc419ffb700 1 -- 172.21.15.116:0/3225319406 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41400b980 con 0x7fc41c160d40 2023-05-12T09:07:39.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.149+0000 7fc419ffb700 1 -- 172.21.15.116:0/3225319406 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400bd30 con 0x7fc41c160d40 2023-05-12T09:07:39.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.149+0000 7fc4215ff700 1 -- 172.21.15.116:0/3225319406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c160d40 msgr2=0x7fc41c0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.149+0000 7fc4215ff700 1 --2- 172.21.15.116:0/3225319406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c160d40 0x7fc41c0d1100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0b4ac0 tx=0x7fc41400b330 comp rx=0 tx=0).stop 2023-05-12T09:07:39.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.149+0000 7fc4215ff700 1 -- 172.21.15.116:0/3225319406 shutdown_connections 2023-05-12T09:07:39.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.149+0000 7fc4215ff700 1 --2- 172.21.15.116:0/3225319406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c160d40 0x7fc41c0d1100 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.149+0000 7fc4215ff700 1 --2- 172.21.15.116:0/3225319406 >> v2:172.21.15.182:3300/0 conn(0x7fc41c0b87a0 0x7fc41c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.149+0000 7fc4215ff700 1 -- 172.21.15.116:0/3225319406 >> 172.21.15.116:0/3225319406 conn(0x7fc41c071b10 msgr2=0x7fc41c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:39.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.149+0000 7fc4215ff700 1 -- 172.21.15.116:0/3225319406 shutdown_connections 2023-05-12T09:07:39.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.149+0000 7fc4215ff700 1 -- 172.21.15.116:0/3225319406 wait complete. 2023-05-12T09:07:39.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.151+0000 7fc4215ff700 1 Processor -- start 2023-05-12T09:07:39.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.151+0000 7fc4215ff700 1 -- start start 2023-05-12T09:07:39.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc4215ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc41c0b87a0 0x7fc41c153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc4215ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c1601e0 0x7fc41c0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc4215ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc41c160d40 0x7fc41c0c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc4215ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c155c50 con 0x7fc41c1601e0 2023-05-12T09:07:39.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc4215ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0c8290 con 0x7fc41c160d40 2023-05-12T09:07:39.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc4215ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0c8570 con 0x7fc41c0b87a0 2023-05-12T09:07:39.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41a7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c1601e0 0x7fc41c0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41a7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c1601e0 0x7fc41c0c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33968/0 (socket says 172.21.15.116:33968) 2023-05-12T09:07:39.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41a7fc700 1 -- 172.21.15.116:0/3523729993 learned_addr learned my addr 172.21.15.116:0/3523729993 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:39.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41a7fc700 1 -- 172.21.15.116:0/3523729993 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc41c0b87a0 msgr2=0x7fc41c153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41affd700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc41c0b87a0 0x7fc41c153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41b7fe700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc41c160d40 0x7fc41c0c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41a7fc700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc41c0b87a0 0x7fc41c153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41a7fc700 1 -- 172.21.15.116:0/3523729993 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc41c160d40 msgr2=0x7fc41c0c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41a7fc700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc41c160d40 0x7fc41c0c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41a7fc700 1 -- 172.21.15.116:0/3523729993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc414009b30 con 0x7fc41c1601e0 2023-05-12T09:07:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41b7fe700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc41c160d40 0x7fc41c0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.152+0000 7fc41affd700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc41c0b87a0 0x7fc41c153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.153+0000 7fc41a7fc700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c1601e0 0x7fc41c0c74f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c490 tx=0x7fc41000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.153+0000 7fc4037fe700 1 -- 172.21.15.116:0/3523729993 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4100052d0 con 0x7fc41c1601e0 2023-05-12T09:07:39.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.153+0000 7fc4037fe700 1 -- 172.21.15.116:0/3523729993 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc410005450 con 0x7fc41c1601e0 2023-05-12T09:07:39.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.153+0000 7fc4215ff700 1 -- 172.21.15.116:0/3523729993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41c0d1640 con 0x7fc41c1601e0 2023-05-12T09:07:39.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.153+0000 7fc4037fe700 1 -- 172.21.15.116:0/3523729993 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410006aa0 con 0x7fc41c1601e0 2023-05-12T09:07:39.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.153+0000 7fc4215ff700 1 -- 172.21.15.116:0/3523729993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c0cd980 con 0x7fc41c1601e0 2023-05-12T09:07:39.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.154+0000 7fc4215ff700 1 -- 172.21.15.116:0/3523729993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41c0d17d0 con 0x7fc41c1601e0 2023-05-12T09:07:39.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.155+0000 7fc4037fe700 1 -- 172.21.15.116:0/3523729993 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc410003680 con 0x7fc41c1601e0 2023-05-12T09:07:39.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.156+0000 7fc4037fe700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc40806ace0 0x7fc40806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.156+0000 7fc4037fe700 1 -- 172.21.15.116:0/3523729993 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc410088b20 con 0x7fc41c1601e0 2023-05-12T09:07:39.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.156+0000 7fc41affd700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc40806ace0 0x7fc40806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.157+0000 7fc41affd700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc40806ace0 0x7fc40806d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009a00 tx=0x7fc40c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:39.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.160+0000 7fc4037fe700 1 -- 172.21.15.116:0/3523729993 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc410053840 con 0x7fc41c1601e0 2023-05-12T09:07:39.356 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.353+0000 7fc4215ff700 1 -- 172.21.15.116:0/3523729993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc41c074430 con 0x7fc41c1601e0 2023-05-12T09:07:39.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.355+0000 7fc4037fe700 1 -- 172.21.15.116:0/3523729993 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7fc410056e60 con 0x7fc41c1601e0 2023-05-12T09:07:39.358 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:39.358 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:39.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 -- 172.21.15.116:0/3523729993 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc40806ace0 msgr2=0x7fc40806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc40806ace0 0x7fc40806d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009a00 tx=0x7fc40c008040 comp rx=0 tx=0).stop 2023-05-12T09:07:39.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 -- 172.21.15.116:0/3523729993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c1601e0 msgr2=0x7fc41c0c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c1601e0 0x7fc41c0c74f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c490 tx=0x7fc41000c850 comp rx=0 tx=0).stop 2023-05-12T09:07:39.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 -- 172.21.15.116:0/3523729993 shutdown_connections 2023-05-12T09:07:39.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc41c160d40 0x7fc41c0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc40806ace0 0x7fc40806d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc41c0b87a0 0x7fc41c153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 --2- 172.21.15.116:0/3523729993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc41c1601e0 0x7fc41c0c74f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 -- 172.21.15.116:0/3523729993 >> 172.21.15.116:0/3523729993 conn(0x7fc41c071b10 msgr2=0x7fc41c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:39.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 -- 172.21.15.116:0/3523729993 shutdown_connections 2023-05-12T09:07:39.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.357+0000 7fc4215ff700 1 -- 172.21.15.116:0/3523729993 wait complete. 2023-05-12T09:07:39.378 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-12T09:07:39.379 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-12T09:07:39.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.561+0000 7f2e509ff700 1 Processor -- start 2023-05-12T09:07:39.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.562+0000 7f2e509ff700 1 -- start start 2023-05-12T09:07:39.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.563+0000 7f2e509ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c0b87a0 0x7f2e4c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.563+0000 7f2e509ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f2e4c160d40 0x7f2e4c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.563+0000 7f2e509ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c0cdc60 con 0x7f2e4c1601e0 2023-05-12T09:07:39.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.563+0000 7f2e509ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c0d02d0 con 0x7f2e4c160d40 2023-05-12T09:07:39.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.563+0000 7f2e509ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0d0cb0 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.563+0000 7f2e4a59c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c0b87a0 0x7f2e4c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.563+0000 7f2e4ad9d700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f2e4c160d40 0x7f2e4c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.563+0000 7f2e4ad9d700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f2e4c160d40 0x7f2e4c0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:41730/0 (socket says 172.21.15.116:41730) 2023-05-12T09:07:39.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.563+0000 7f2e4ad9d700 1 -- 172.21.15.116:0/956521985 learned_addr learned my addr 172.21.15.116:0/956521985 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:39.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.563+0000 7f2e43fff700 1 --1- 172.21.15.116:0/956521985 >> v1:172.21.15.182:6789/0 conn(0x7f2e4c1601e0 0x7f2e4c160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:54326/0 (socket says 172.21.15.116:54326) 2023-05-12T09:07:39.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.564+0000 7f2e49d9b700 1 -- 172.21.15.116:0/956521985 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736192401 0 0) 0x7f2e4c0cdc60 con 0x7f2e4c1601e0 2023-05-12T09:07:39.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.564+0000 7f2e49d9b700 1 -- 172.21.15.116:0/956521985 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e380035b0 con 0x7f2e4c1601e0 2023-05-12T09:07:39.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.564+0000 7f2e4a59c700 1 -- 172.21.15.116:0/956521985 >> v2:172.21.15.182:3300/0 conn(0x7f2e4c160d40 msgr2=0x7f2e4c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:39.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.564+0000 7f2e4a59c700 1 --2- 172.21.15.116:0/956521985 >> v2:172.21.15.182:3300/0 conn(0x7f2e4c160d40 0x7f2e4c0d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.564+0000 7f2e4a59c700 1 -- 172.21.15.116:0/956521985 >> v1:172.21.15.182:6789/0 conn(0x7f2e4c1601e0 legacy=0x7f2e4c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.564+0000 7f2e4a59c700 1 -- 172.21.15.116:0/956521985 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0cd6a0 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.564+0000 7f2e4ad9d700 1 --2- 172.21.15.116:0/956521985 >> v2:172.21.15.182:3300/0 conn(0x7f2e4c160d40 0x7f2e4c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:39.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.564+0000 7f2e4a59c700 1 --2- 172.21.15.116:0/956521985 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c0b87a0 0x7f2e4c0cfbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009840 tx=0x7f2e3c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5e41dc0cf6b752 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:39.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.564+0000 7f2e49d9b700 1 -- 172.21.15.116:0/956521985 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c011830 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.565+0000 7f2e49d9b700 1 -- 172.21.15.116:0/956521985 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c011990 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.565+0000 7f2e49d9b700 1 -- 172.21.15.116:0/956521985 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c011d20 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.565+0000 7f2e509ff700 1 -- 172.21.15.116:0/956521985 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c0b87a0 msgr2=0x7f2e4c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.565+0000 7f2e509ff700 1 --2- 172.21.15.116:0/956521985 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c0b87a0 0x7f2e4c0cfbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009840 tx=0x7f2e3c009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:39.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.565+0000 7f2e509ff700 1 -- 172.21.15.116:0/956521985 shutdown_connections 2023-05-12T09:07:39.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.565+0000 7f2e509ff700 1 --2- 172.21.15.116:0/956521985 >> v2:172.21.15.182:3300/0 conn(0x7f2e4c160d40 0x7f2e4c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.565+0000 7f2e509ff700 1 --2- 172.21.15.116:0/956521985 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c0b87a0 0x7f2e4c0cfbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.565+0000 7f2e509ff700 1 -- 172.21.15.116:0/956521985 >> 172.21.15.116:0/956521985 conn(0x7f2e4c071b10 msgr2=0x7f2e4c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:39.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.565+0000 7f2e509ff700 1 -- 172.21.15.116:0/956521985 shutdown_connections 2023-05-12T09:07:39.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.565+0000 7f2e509ff700 1 -- 172.21.15.116:0/956521985 wait complete. 2023-05-12T09:07:39.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.567+0000 7f2e509ff700 1 Processor -- start 2023-05-12T09:07:39.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.567+0000 7f2e509ff700 1 -- start start 2023-05-12T09:07:39.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e509ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e4c0b87a0 0x7f2e4c159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e509ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c1601e0 0x7f2e4c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e509ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2e4c160d40 0x7f2e4c1f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e509ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1f3680 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e509ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1f2a50 con 0x7f2e4c160d40 2023-05-12T09:07:39.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e509ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1f2d30 con 0x7f2e4c1601e0 2023-05-12T09:07:39.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e4a59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e4c0b87a0 0x7f2e4c159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e4a59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e4c0b87a0 0x7f2e4c159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33972/0 (socket says 172.21.15.116:33972) 2023-05-12T09:07:39.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e4a59c700 1 -- 172.21.15.116:0/276866063 learned_addr learned my addr 172.21.15.116:0/276866063 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:39.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e43fff700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c1601e0 0x7f2e4c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.568+0000 7f2e4ad9d700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2e4c160d40 0x7f2e4c1f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e4a59c700 1 -- 172.21.15.116:0/276866063 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c1601e0 msgr2=0x7f2e4c159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e4a59c700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c1601e0 0x7f2e4c159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e4a59c700 1 -- 172.21.15.116:0/276866063 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2e4c160d40 msgr2=0x7f2e4c1f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e4a59c700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2e4c160d40 0x7f2e4c1f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e4a59c700 1 -- 172.21.15.116:0/276866063 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e44009b30 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e43fff700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c1601e0 0x7f2e4c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:39.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e4a59c700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e4c0b87a0 0x7f2e4c159300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0090b0 tx=0x7f2e3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:39.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e42ffd700 1 -- 172.21.15.116:0/276866063 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0036a0 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e509ff700 1 -- 172.21.15.116:0/276866063 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c0094a0 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e42ffd700 1 -- 172.21.15.116:0/276866063 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c01f070 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e42ffd700 1 -- 172.21.15.116:0/276866063 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c003a40 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.569+0000 7f2e509ff700 1 -- 172.21.15.116:0/276866063 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c0d1640 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.570+0000 7f2e509ff700 1 -- 172.21.15.116:0/276866063 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c0cd980 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.571+0000 7f2e42ffd700 1 -- 172.21.15.116:0/276866063 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e3c003ba0 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.572+0000 7f2e42ffd700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2e2c06ace0 0x7f2e2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:39.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.572+0000 7f2e42ffd700 1 -- 172.21.15.116:0/276866063 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e3c021070 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.572+0000 7f2e43fff700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2e2c06ace0 0x7f2e2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:39.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.573+0000 7f2e43fff700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2e2c06ace0 0x7f2e2c06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c1f5470 tx=0x7f2e34007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:39.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.576+0000 7f2e42ffd700 1 -- 172.21.15.116:0/276866063 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2e3c055e10 con 0x7f2e4c0b87a0 2023-05-12T09:07:39.771 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.768+0000 7f2e509ff700 1 -- 172.21.15.116:0/276866063 --> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e4c1f37c0 con 0x7f2e2c06ace0 2023-05-12T09:07:39.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.781+0000 7f2e42ffd700 1 -- 172.21.15.116:0/276866063 <== mgr.4106 v2:172.21.15.116:6832/3989593778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367556 (secure 0 0 0) 0x7f2e34005bb0 con 0x7f2e2c06ace0 2023-05-12T09:07:39.788 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:39.790 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.785+0000 7f2e509ff700 1 -- 172.21.15.116:0/276866063 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2e2c06ace0 msgr2=0x7f2e2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.790 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.785+0000 7f2e509ff700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2e2c06ace0 0x7f2e2c06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c1f5470 tx=0x7f2e34007ca0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.785+0000 7f2e509ff700 1 -- 172.21.15.116:0/276866063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e4c0b87a0 msgr2=0x7f2e4c159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:39.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.785+0000 7f2e509ff700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e4c0b87a0 0x7f2e4c159300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0090b0 tx=0x7f2e3c004750 comp rx=0 tx=0).stop 2023-05-12T09:07:39.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.785+0000 7f2e509ff700 1 -- 172.21.15.116:0/276866063 shutdown_connections 2023-05-12T09:07:39.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.785+0000 7f2e509ff700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2e4c160d40 0x7f2e4c1f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.785+0000 7f2e509ff700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e4c0b87a0 0x7f2e4c159300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.785+0000 7f2e509ff700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2e2c06ace0 0x7f2e2c06d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.785+0000 7f2e509ff700 1 --2- 172.21.15.116:0/276866063 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2e4c1601e0 0x7f2e4c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:39.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.785+0000 7f2e509ff700 1 -- 172.21.15.116:0/276866063 >> 172.21.15.116:0/276866063 conn(0x7f2e4c071b10 msgr2=0x7f2e4c15c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:39.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.786+0000 7f2e509ff700 1 -- 172.21.15.116:0/276866063 shutdown_connections 2023-05-12T09:07:39.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:39.786+0000 7f2e509ff700 1 -- 172.21.15.116:0/276866063 wait complete. 2023-05-12T09:07:39.792 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2023-05-12T09:07:39.806 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-05-12T09:07:39.574259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67068,"kb_used_data":3196,"kb_used_omap":0,"kb_used_meta":63808,"kb_avail":754907652,"statfs":{"total":773094113280,"available":773025435648,"internally_reserved":0,"allocated":3272704,"data_stored":2023677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65339392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002942"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056869+0000","last_change":"2023-05-12T09:07:10.552182+0000","last_active":"2023-05-12T09:07:15.056869+0000","last_peered":"2023-05-12T09:07:15.056869+0000","last_clean":"2023-05-12T09:07:15.056869+0000","last_became_active":"2023-05-12T09:07:10.551926+0000","last_became_peered":"2023-05-12T09:07:10.551926+0000","last_unstale":"2023-05-12T09:07:15.056869+0000","last_undegraded":"2023-05-12T09:07:15.056869+0000","last_fullsized":"2023-05-12T09:07:15.056869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:06:10.158751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098056+0000","last_change":"2023-05-12T09:07:10.565186+0000","last_active":"2023-05-12T09:07:15.098056+0000","last_peered":"2023-05-12T09:07:15.098056+0000","last_clean":"2023-05-12T09:07:15.098056+0000","last_became_active":"2023-05-12T09:07:10.564909+0000","last_became_peered":"2023-05-12T09:07:10.564909+0000","last_unstale":"2023-05-12T09:07:15.098056+0000","last_undegraded":"2023-05-12T09:07:15.098056+0000","last_fullsized":"2023-05-12T09:07:15.098056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:58:56.835652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099010+0000","last_change":"2023-05-12T09:07:10.573666+0000","last_active":"2023-05-12T09:07:15.099010+0000","last_peered":"2023-05-12T09:07:15.099010+0000","last_clean":"2023-05-12T09:07:15.099010+0000","last_became_active":"2023-05-12T09:07:10.573426+0000","last_became_peered":"2023-05-12T09:07:10.573426+0000","last_unstale":"2023-05-12T09:07:15.099010+0000","last_undegraded":"2023-05-12T09:07:15.099010+0000","last_fullsized":"2023-05-12T09:07:15.099010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:31:46.429695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058452+0000","last_change":"2023-05-12T09:07:10.549143+0000","last_active":"2023-05-12T09:07:15.058452+0000","last_peered":"2023-05-12T09:07:15.058452+0000","last_clean":"2023-05-12T09:07:15.058452+0000","last_became_active":"2023-05-12T09:07:10.548812+0000","last_became_peered":"2023-05-12T09:07:10.548812+0000","last_unstale":"2023-05-12T09:07:15.058452+0000","last_undegraded":"2023-05-12T09:07:15.058452+0000","last_fullsized":"2023-05-12T09:07:15.058452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:58:25.521877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097939+0000","last_change":"2023-05-12T09:07:10.553470+0000","last_active":"2023-05-12T09:07:15.097939+0000","last_peered":"2023-05-12T09:07:15.097939+0000","last_clean":"2023-05-12T09:07:15.097939+0000","last_became_active":"2023-05-12T09:07:10.552853+0000","last_became_peered":"2023-05-12T09:07:10.552853+0000","last_unstale":"2023-05-12T09:07:15.097939+0000","last_undegraded":"2023-05-12T09:07:15.097939+0000","last_fullsized":"2023-05-12T09:07:15.097939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:46:06.379380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099031+0000","last_change":"2023-05-12T09:07:10.572964+0000","last_active":"2023-05-12T09:07:15.099031+0000","last_peered":"2023-05-12T09:07:15.099031+0000","last_clean":"2023-05-12T09:07:15.099031+0000","last_became_active":"2023-05-12T09:07:10.572655+0000","last_became_peered":"2023-05-12T09:07:10.572655+0000","last_unstale":"2023-05-12T09:07:15.099031+0000","last_undegraded":"2023-05-12T09:07:15.099031+0000","last_fullsized":"2023-05-12T09:07:15.099031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:54.558448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098226+0000","last_change":"2023-05-12T09:07:10.568411+0000","last_active":"2023-05-12T09:07:15.098226+0000","last_peered":"2023-05-12T09:07:15.098226+0000","last_clean":"2023-05-12T09:07:15.098226+0000","last_became_active":"2023-05-12T09:07:10.567921+0000","last_became_peered":"2023-05-12T09:07:10.567921+0000","last_unstale":"2023-05-12T09:07:15.098226+0000","last_undegraded":"2023-05-12T09:07:15.098226+0000","last_fullsized":"2023-05-12T09:07:15.098226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098049+0000","last_change":"2023-05-12T09:07:10.567670+0000","last_active":"2023-05-12T09:07:15.098049+0000","last_peered":"2023-05-12T09:07:15.098049+0000","last_clean":"2023-05-12T09:07:15.098049+0000","last_became_active":"2023-05-12T09:07:10.567354+0000","last_became_peered":"2023-05-12T09:07:10.567354+0000","last_unstale":"2023-05-12T09:07:15.098049+0000","last_undegraded":"2023-05-12T09:07:15.098049+0000","last_fullsized":"2023-05-12T09:07:15.098049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:24:11.877400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097017+0000","last_change":"2023-05-12T09:07:10.559800+0000","last_active":"2023-05-12T09:07:15.097017+0000","last_peered":"2023-05-12T09:07:15.097017+0000","last_clean":"2023-05-12T09:07:15.097017+0000","last_became_active":"2023-05-12T09:07:10.559373+0000","last_became_peered":"2023-05-12T09:07:10.559373+0000","last_unstale":"2023-05-12T09:07:15.097017+0000","last_undegraded":"2023-05-12T09:07:15.097017+0000","last_fullsized":"2023-05-12T09:07:15.097017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098405+0000","last_change":"2023-05-12T09:07:10.557392+0000","last_active":"2023-05-12T09:07:15.098405+0000","last_peered":"2023-05-12T09:07:15.098405+0000","last_clean":"2023-05-12T09:07:15.098405+0000","last_became_active":"2023-05-12T09:07:10.557036+0000","last_became_peered":"2023-05-12T09:07:10.557036+0000","last_unstale":"2023-05-12T09:07:15.098405+0000","last_undegraded":"2023-05-12T09:07:15.098405+0000","last_fullsized":"2023-05-12T09:07:15.098405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:01.116544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099397+0000","last_change":"2023-05-12T09:07:10.569606+0000","last_active":"2023-05-12T09:07:15.099397+0000","last_peered":"2023-05-12T09:07:15.099397+0000","last_clean":"2023-05-12T09:07:15.099397+0000","last_became_active":"2023-05-12T09:07:10.569341+0000","last_became_peered":"2023-05-12T09:07:10.569341+0000","last_unstale":"2023-05-12T09:07:15.099397+0000","last_undegraded":"2023-05-12T09:07:15.099397+0000","last_fullsized":"2023-05-12T09:07:15.099397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:10.845175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056685+0000","last_change":"2023-05-12T09:07:10.572853+0000","last_active":"2023-05-12T09:07:15.056685+0000","last_peered":"2023-05-12T09:07:15.056685+0000","last_clean":"2023-05-12T09:07:15.056685+0000","last_became_active":"2023-05-12T09:07:10.572602+0000","last_became_peered":"2023-05-12T09:07:10.572602+0000","last_unstale":"2023-05-12T09:07:15.056685+0000","last_undegraded":"2023-05-12T09:07:15.056685+0000","last_fullsized":"2023-05-12T09:07:15.056685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:27:20.881878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056707+0000","last_change":"2023-05-12T09:07:10.556787+0000","last_active":"2023-05-12T09:07:15.056707+0000","last_peered":"2023-05-12T09:07:15.056707+0000","last_clean":"2023-05-12T09:07:15.056707+0000","last_became_active":"2023-05-12T09:07:10.556536+0000","last_became_peered":"2023-05-12T09:07:10.556536+0000","last_unstale":"2023-05-12T09:07:15.056707+0000","last_undegraded":"2023-05-12T09:07:15.056707+0000","last_fullsized":"2023-05-12T09:07:15.056707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:49.471362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098243+0000","last_change":"2023-05-12T09:07:10.552674+0000","last_active":"2023-05-12T09:07:15.098243+0000","last_peered":"2023-05-12T09:07:15.098243+0000","last_clean":"2023-05-12T09:07:15.098243+0000","last_became_active":"2023-05-12T09:07:10.552398+0000","last_became_peered":"2023-05-12T09:07:10.552398+0000","last_unstale":"2023-05-12T09:07:15.098243+0000","last_undegraded":"2023-05-12T09:07:15.098243+0000","last_fullsized":"2023-05-12T09:07:15.098243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:11.449230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097981+0000","last_change":"2023-05-12T09:07:10.568235+0000","last_active":"2023-05-12T09:07:15.097981+0000","last_peered":"2023-05-12T09:07:15.097981+0000","last_clean":"2023-05-12T09:07:15.097981+0000","last_became_active":"2023-05-12T09:07:10.567553+0000","last_became_peered":"2023-05-12T09:07:10.567553+0000","last_unstale":"2023-05-12T09:07:15.097981+0000","last_undegraded":"2023-05-12T09:07:15.097981+0000","last_fullsized":"2023-05-12T09:07:15.097981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099513+0000","last_change":"2023-05-12T09:07:10.572841+0000","last_active":"2023-05-12T09:07:15.099513+0000","last_peered":"2023-05-12T09:07:15.099513+0000","last_clean":"2023-05-12T09:07:15.099513+0000","last_became_active":"2023-05-12T09:07:10.572568+0000","last_became_peered":"2023-05-12T09:07:10.572568+0000","last_unstale":"2023-05-12T09:07:15.099513+0000","last_undegraded":"2023-05-12T09:07:15.099513+0000","last_fullsized":"2023-05-12T09:07:15.099513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:58.012080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097155+0000","last_change":"2023-05-12T09:07:10.547094+0000","last_active":"2023-05-12T09:07:15.097155+0000","last_peered":"2023-05-12T09:07:15.097155+0000","last_clean":"2023-05-12T09:07:15.097155+0000","last_became_active":"2023-05-12T09:07:10.546792+0000","last_became_peered":"2023-05-12T09:07:10.546792+0000","last_unstale":"2023-05-12T09:07:15.097155+0000","last_undegraded":"2023-05-12T09:07:15.097155+0000","last_fullsized":"2023-05-12T09:07:15.097155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099265+0000","last_change":"2023-05-12T09:07:10.565515+0000","last_active":"2023-05-12T09:07:15.099265+0000","last_peered":"2023-05-12T09:07:15.099265+0000","last_clean":"2023-05-12T09:07:15.099265+0000","last_became_active":"2023-05-12T09:07:10.565207+0000","last_became_peered":"2023-05-12T09:07:10.565207+0000","last_unstale":"2023-05-12T09:07:15.099265+0000","last_undegraded":"2023-05-12T09:07:15.099265+0000","last_fullsized":"2023-05-12T09:07:15.099265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:49.560027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057002+0000","last_change":"2023-05-12T09:07:10.544063+0000","last_active":"2023-05-12T09:07:15.057002+0000","last_peered":"2023-05-12T09:07:15.057002+0000","last_clean":"2023-05-12T09:07:15.057002+0000","last_became_active":"2023-05-12T09:07:10.543808+0000","last_became_peered":"2023-05-12T09:07:10.543808+0000","last_unstale":"2023-05-12T09:07:15.057002+0000","last_undegraded":"2023-05-12T09:07:15.057002+0000","last_fullsized":"2023-05-12T09:07:15.057002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:31:21.496742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099598+0000","last_change":"2023-05-12T09:07:10.572909+0000","last_active":"2023-05-12T09:07:15.099598+0000","last_peered":"2023-05-12T09:07:15.099598+0000","last_clean":"2023-05-12T09:07:15.099598+0000","last_became_active":"2023-05-12T09:07:10.572159+0000","last_became_peered":"2023-05-12T09:07:10.572159+0000","last_unstale":"2023-05-12T09:07:15.099598+0000","last_undegraded":"2023-05-12T09:07:15.099598+0000","last_fullsized":"2023-05-12T09:07:15.099598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:08.244006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097642+0000","last_change":"2023-05-12T09:07:10.561695+0000","last_active":"2023-05-12T09:07:15.097642+0000","last_peered":"2023-05-12T09:07:15.097642+0000","last_clean":"2023-05-12T09:07:15.097642+0000","last_became_active":"2023-05-12T09:07:10.561421+0000","last_became_peered":"2023-05-12T09:07:10.561421+0000","last_unstale":"2023-05-12T09:07:15.097642+0000","last_undegraded":"2023-05-12T09:07:15.097642+0000","last_fullsized":"2023-05-12T09:07:15.097642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097054+0000","last_change":"2023-05-12T09:07:10.556885+0000","last_active":"2023-05-12T09:07:15.097054+0000","last_peered":"2023-05-12T09:07:15.097054+0000","last_clean":"2023-05-12T09:07:15.097054+0000","last_became_active":"2023-05-12T09:07:10.556648+0000","last_became_peered":"2023-05-12T09:07:10.556648+0000","last_unstale":"2023-05-12T09:07:15.097054+0000","last_undegraded":"2023-05-12T09:07:15.097054+0000","last_fullsized":"2023-05-12T09:07:15.097054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:29.216512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058586+0000","last_change":"2023-05-12T09:07:10.552009+0000","last_active":"2023-05-12T09:07:15.058586+0000","last_peered":"2023-05-12T09:07:15.058586+0000","last_clean":"2023-05-12T09:07:15.058586+0000","last_became_active":"2023-05-12T09:07:10.551526+0000","last_became_peered":"2023-05-12T09:07:10.551526+0000","last_unstale":"2023-05-12T09:07:15.058586+0000","last_undegraded":"2023-05-12T09:07:15.058586+0000","last_fullsized":"2023-05-12T09:07:15.058586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:29:40.632493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097137+0000","last_change":"2023-05-12T09:07:10.565180+0000","last_active":"2023-05-12T09:07:15.097137+0000","last_peered":"2023-05-12T09:07:15.097137+0000","last_clean":"2023-05-12T09:07:15.097137+0000","last_became_active":"2023-05-12T09:07:10.564257+0000","last_became_peered":"2023-05-12T09:07:10.564257+0000","last_unstale":"2023-05-12T09:07:15.097137+0000","last_undegraded":"2023-05-12T09:07:15.097137+0000","last_fullsized":"2023-05-12T09:07:15.097137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:01.116544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097918+0000","last_change":"2023-05-12T09:07:10.566527+0000","last_active":"2023-05-12T09:07:15.097918+0000","last_peered":"2023-05-12T09:07:15.097918+0000","last_clean":"2023-05-12T09:07:15.097918+0000","last_became_active":"2023-05-12T09:07:10.566257+0000","last_became_peered":"2023-05-12T09:07:10.566257+0000","last_unstale":"2023-05-12T09:07:15.097918+0000","last_undegraded":"2023-05-12T09:07:15.097918+0000","last_fullsized":"2023-05-12T09:07:15.097918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097456+0000","last_change":"2023-05-12T09:07:10.569619+0000","last_active":"2023-05-12T09:07:15.097456+0000","last_peered":"2023-05-12T09:07:15.097456+0000","last_clean":"2023-05-12T09:07:15.097456+0000","last_became_active":"2023-05-12T09:07:10.569336+0000","last_became_peered":"2023-05-12T09:07:10.569336+0000","last_unstale":"2023-05-12T09:07:15.097456+0000","last_undegraded":"2023-05-12T09:07:15.097456+0000","last_fullsized":"2023-05-12T09:07:15.097456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099394+0000","last_change":"2023-05-12T09:07:10.560495+0000","last_active":"2023-05-12T09:07:15.099394+0000","last_peered":"2023-05-12T09:07:15.099394+0000","last_clean":"2023-05-12T09:07:15.099394+0000","last_became_active":"2023-05-12T09:07:10.560049+0000","last_became_peered":"2023-05-12T09:07:10.560049+0000","last_unstale":"2023-05-12T09:07:15.099394+0000","last_undegraded":"2023-05-12T09:07:15.099394+0000","last_fullsized":"2023-05-12T09:07:15.099394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:27:05.047259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099295+0000","last_change":"2023-05-12T09:07:14.597955+0000","last_active":"2023-05-12T09:07:15.099295+0000","last_peered":"2023-05-12T09:07:15.099295+0000","last_clean":"2023-05-12T09:07:15.099295+0000","last_became_active":"2023-05-12T09:07:14.597429+0000","last_became_peered":"2023-05-12T09:07:14.597429+0000","last_unstale":"2023-05-12T09:07:15.099295+0000","last_undegraded":"2023-05-12T09:07:15.099295+0000","last_fullsized":"2023-05-12T09:07:15.099295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:42.341874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098315+0000","last_change":"2023-05-12T09:07:10.075419+0000","last_active":"2023-05-12T09:07:15.098315+0000","last_peered":"2023-05-12T09:07:15.098315+0000","last_clean":"2023-05-12T09:07:15.098315+0000","last_became_active":"2023-05-12T09:07:10.075045+0000","last_became_peered":"2023-05-12T09:07:10.075045+0000","last_unstale":"2023-05-12T09:07:15.098315+0000","last_undegraded":"2023-05-12T09:07:15.098315+0000","last_fullsized":"2023-05-12T09:07:15.098315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:46:05.372940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059049+0000","last_change":"2023-05-12T09:07:10.556737+0000","last_active":"2023-05-12T09:07:15.059049+0000","last_peered":"2023-05-12T09:07:15.059049+0000","last_clean":"2023-05-12T09:07:15.059049+0000","last_became_active":"2023-05-12T09:07:10.556495+0000","last_became_peered":"2023-05-12T09:07:10.556495+0000","last_unstale":"2023-05-12T09:07:15.059049+0000","last_undegraded":"2023-05-12T09:07:15.059049+0000","last_fullsized":"2023-05-12T09:07:15.059049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:49.560027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058830+0000","last_change":"2023-05-12T09:07:14.581307+0000","last_active":"2023-05-12T09:07:15.058830+0000","last_peered":"2023-05-12T09:07:15.058830+0000","last_clean":"2023-05-12T09:07:15.058830+0000","last_became_active":"2023-05-12T09:07:14.580877+0000","last_became_peered":"2023-05-12T09:07:14.580877+0000","last_unstale":"2023-05-12T09:07:15.058830+0000","last_undegraded":"2023-05-12T09:07:15.058830+0000","last_fullsized":"2023-05-12T09:07:15.058830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:19:01.287710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096438+0000","last_change":"2023-05-12T09:07:10.072878+0000","last_active":"2023-05-12T09:07:15.096438+0000","last_peered":"2023-05-12T09:07:15.096438+0000","last_clean":"2023-05-12T09:07:15.096438+0000","last_became_active":"2023-05-12T09:07:10.072354+0000","last_became_peered":"2023-05-12T09:07:10.072354+0000","last_unstale":"2023-05-12T09:07:15.096438+0000","last_undegraded":"2023-05-12T09:07:15.096438+0000","last_fullsized":"2023-05-12T09:07:15.096438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:58:55.829212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097423+0000","last_change":"2023-05-12T09:07:10.560312+0000","last_active":"2023-05-12T09:07:15.097423+0000","last_peered":"2023-05-12T09:07:15.097423+0000","last_clean":"2023-05-12T09:07:15.097423+0000","last_became_active":"2023-05-12T09:07:10.560026+0000","last_became_peered":"2023-05-12T09:07:10.560026+0000","last_unstale":"2023-05-12T09:07:15.097423+0000","last_undegraded":"2023-05-12T09:07:15.097423+0000","last_fullsized":"2023-05-12T09:07:15.097423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:51.153107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097572+0000","last_change":"2023-05-12T09:07:14.588155+0000","last_active":"2023-05-12T09:07:15.097572+0000","last_peered":"2023-05-12T09:07:15.097572+0000","last_clean":"2023-05-12T09:07:15.097572+0000","last_became_active":"2023-05-12T09:07:14.587745+0000","last_became_peered":"2023-05-12T09:07:14.587745+0000","last_unstale":"2023-05-12T09:07:15.097572+0000","last_undegraded":"2023-05-12T09:07:15.097572+0000","last_fullsized":"2023-05-12T09:07:15.097572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:42:22.571545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058871+0000","last_change":"2023-05-12T09:07:10.080957+0000","last_active":"2023-05-12T09:07:15.058871+0000","last_peered":"2023-05-12T09:07:15.058871+0000","last_clean":"2023-05-12T09:07:15.058871+0000","last_became_active":"2023-05-12T09:07:10.080662+0000","last_became_peered":"2023-05-12T09:07:10.080662+0000","last_unstale":"2023-05-12T09:07:15.058871+0000","last_undegraded":"2023-05-12T09:07:15.058871+0000","last_fullsized":"2023-05-12T09:07:15.058871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:52:11.295716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059156+0000","last_change":"2023-05-12T09:07:10.563118+0000","last_active":"2023-05-12T09:07:15.059156+0000","last_peered":"2023-05-12T09:07:15.059156+0000","last_clean":"2023-05-12T09:07:15.059156+0000","last_became_active":"2023-05-12T09:07:10.562749+0000","last_became_peered":"2023-05-12T09:07:10.562749+0000","last_unstale":"2023-05-12T09:07:15.059156+0000","last_undegraded":"2023-05-12T09:07:15.059156+0000","last_fullsized":"2023-05-12T09:07:15.059156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:13:26.432067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058101+0000","last_change":"2023-05-12T09:07:14.581060+0000","last_active":"2023-05-12T09:07:15.058101+0000","last_peered":"2023-05-12T09:07:15.058101+0000","last_clean":"2023-05-12T09:07:15.058101+0000","last_became_active":"2023-05-12T09:07:14.580610+0000","last_became_peered":"2023-05-12T09:07:14.580610+0000","last_unstale":"2023-05-12T09:07:15.058101+0000","last_undegraded":"2023-05-12T09:07:15.058101+0000","last_fullsized":"2023-05-12T09:07:15.058101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T21:04:50.690412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097268+0000","last_change":"2023-05-12T09:07:10.068667+0000","last_active":"2023-05-12T09:07:15.097268+0000","last_peered":"2023-05-12T09:07:15.097268+0000","last_clean":"2023-05-12T09:07:15.097268+0000","last_became_active":"2023-05-12T09:07:10.068386+0000","last_became_peered":"2023-05-12T09:07:10.068386+0000","last_unstale":"2023-05-12T09:07:15.097268+0000","last_undegraded":"2023-05-12T09:07:15.097268+0000","last_fullsized":"2023-05-12T09:07:15.097268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:34:33.760261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058741+0000","last_change":"2023-05-12T09:07:10.565793+0000","last_active":"2023-05-12T09:07:15.058741+0000","last_peered":"2023-05-12T09:07:15.058741+0000","last_clean":"2023-05-12T09:07:15.058741+0000","last_became_active":"2023-05-12T09:07:10.565550+0000","last_became_peered":"2023-05-12T09:07:10.565550+0000","last_unstale":"2023-05-12T09:07:15.058741+0000","last_undegraded":"2023-05-12T09:07:15.058741+0000","last_fullsized":"2023-05-12T09:07:15.058741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:14:42.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096926+0000","last_change":"2023-05-12T09:07:14.595717+0000","last_active":"2023-05-12T09:07:15.096926+0000","last_peered":"2023-05-12T09:07:15.096926+0000","last_clean":"2023-05-12T09:07:15.096926+0000","last_became_active":"2023-05-12T09:07:14.595257+0000","last_became_peered":"2023-05-12T09:07:14.595257+0000","last_unstale":"2023-05-12T09:07:15.096926+0000","last_undegraded":"2023-05-12T09:07:15.096926+0000","last_fullsized":"2023-05-12T09:07:15.096926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:14.949895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098244+0000","last_change":"2023-05-12T09:07:10.070218+0000","last_active":"2023-05-12T09:07:15.098244+0000","last_peered":"2023-05-12T09:07:15.098244+0000","last_clean":"2023-05-12T09:07:15.098244+0000","last_became_active":"2023-05-12T09:07:10.069889+0000","last_became_peered":"2023-05-12T09:07:10.069889+0000","last_unstale":"2023-05-12T09:07:15.098244+0000","last_undegraded":"2023-05-12T09:07:15.098244+0000","last_fullsized":"2023-05-12T09:07:15.098244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:42.081422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058443+0000","last_change":"2023-05-12T09:07:10.560559+0000","last_active":"2023-05-12T09:07:15.058443+0000","last_peered":"2023-05-12T09:07:15.058443+0000","last_clean":"2023-05-12T09:07:15.058443+0000","last_became_active":"2023-05-12T09:07:10.560373+0000","last_became_peered":"2023-05-12T09:07:10.560373+0000","last_unstale":"2023-05-12T09:07:15.058443+0000","last_undegraded":"2023-05-12T09:07:15.058443+0000","last_fullsized":"2023-05-12T09:07:15.058443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:39.228924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059243+0000","last_change":"2023-05-12T09:07:14.598817+0000","last_active":"2023-05-12T09:07:15.059243+0000","last_peered":"2023-05-12T09:07:15.059243+0000","last_clean":"2023-05-12T09:07:15.059243+0000","last_became_active":"2023-05-12T09:07:14.598424+0000","last_became_peered":"2023-05-12T09:07:14.598424+0000","last_unstale":"2023-05-12T09:07:15.059243+0000","last_undegraded":"2023-05-12T09:07:15.059243+0000","last_fullsized":"2023-05-12T09:07:15.059243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:14.345840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097760+0000","last_change":"2023-05-12T09:07:10.079800+0000","last_active":"2023-05-12T09:07:15.097760+0000","last_peered":"2023-05-12T09:07:15.097760+0000","last_clean":"2023-05-12T09:07:15.097760+0000","last_became_active":"2023-05-12T09:07:10.079511+0000","last_became_peered":"2023-05-12T09:07:10.079511+0000","last_unstale":"2023-05-12T09:07:15.097760+0000","last_undegraded":"2023-05-12T09:07:15.097760+0000","last_fullsized":"2023-05-12T09:07:15.097760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:12.733875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097492+0000","last_change":"2023-05-12T09:07:10.567328+0000","last_active":"2023-05-12T09:07:15.097492+0000","last_peered":"2023-05-12T09:07:15.097492+0000","last_clean":"2023-05-12T09:07:15.097492+0000","last_became_active":"2023-05-12T09:07:10.566882+0000","last_became_peered":"2023-05-12T09:07:10.566882+0000","last_unstale":"2023-05-12T09:07:15.097492+0000","last_undegraded":"2023-05-12T09:07:15.097492+0000","last_fullsized":"2023-05-12T09:07:15.097492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:27:05.047259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097631+0000","last_change":"2023-05-12T09:07:14.585280+0000","last_active":"2023-05-12T09:07:15.097631+0000","last_peered":"2023-05-12T09:07:15.097631+0000","last_clean":"2023-05-12T09:07:15.097631+0000","last_became_active":"2023-05-12T09:07:14.584873+0000","last_became_peered":"2023-05-12T09:07:14.584873+0000","last_unstale":"2023-05-12T09:07:15.097631+0000","last_undegraded":"2023-05-12T09:07:15.097631+0000","last_fullsized":"2023-05-12T09:07:15.097631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:17.240980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:29.211417+0000","last_change":"2023-05-12T09:07:10.069756+0000","last_active":"2023-05-12T09:07:29.211417+0000","last_peered":"2023-05-12T09:07:29.211417+0000","last_clean":"2023-05-12T09:07:29.211417+0000","last_became_active":"2023-05-12T09:07:10.069451+0000","last_became_peered":"2023-05-12T09:07:10.069451+0000","last_unstale":"2023-05-12T09:07:29.211417+0000","last_undegraded":"2023-05-12T09:07:29.211417+0000","last_fullsized":"2023-05-12T09:07:29.211417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:09:04.714440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098689+0000","last_change":"2023-05-12T09:07:10.565252+0000","last_active":"2023-05-12T09:07:15.098689+0000","last_peered":"2023-05-12T09:07:15.098689+0000","last_clean":"2023-05-12T09:07:15.098689+0000","last_became_active":"2023-05-12T09:07:10.564960+0000","last_became_peered":"2023-05-12T09:07:10.564960+0000","last_unstale":"2023-05-12T09:07:15.098689+0000","last_undegraded":"2023-05-12T09:07:15.098689+0000","last_fullsized":"2023-05-12T09:07:15.098689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:08:57.701341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099521+0000","last_change":"2023-05-12T09:07:14.595988+0000","last_active":"2023-05-12T09:07:15.099521+0000","last_peered":"2023-05-12T09:07:15.099521+0000","last_clean":"2023-05-12T09:07:15.099521+0000","last_became_active":"2023-05-12T09:07:14.595488+0000","last_became_peered":"2023-05-12T09:07:14.595488+0000","last_unstale":"2023-05-12T09:07:15.099521+0000","last_undegraded":"2023-05-12T09:07:15.099521+0000","last_fullsized":"2023-05-12T09:07:15.099521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:17.240980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097496+0000","last_change":"2023-05-12T09:07:10.079093+0000","last_active":"2023-05-12T09:07:15.097496+0000","last_peered":"2023-05-12T09:07:15.097496+0000","last_clean":"2023-05-12T09:07:15.097496+0000","last_became_active":"2023-05-12T09:07:10.078795+0000","last_became_peered":"2023-05-12T09:07:10.078795+0000","last_unstale":"2023-05-12T09:07:15.097496+0000","last_undegraded":"2023-05-12T09:07:15.097496+0000","last_fullsized":"2023-05-12T09:07:15.097496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:21.054528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058869+0000","last_change":"2023-05-12T09:07:10.565215+0000","last_active":"2023-05-12T09:07:15.058869+0000","last_peered":"2023-05-12T09:07:15.058869+0000","last_clean":"2023-05-12T09:07:15.058869+0000","last_became_active":"2023-05-12T09:07:10.564963+0000","last_became_peered":"2023-05-12T09:07:10.564963+0000","last_unstale":"2023-05-12T09:07:15.058869+0000","last_undegraded":"2023-05-12T09:07:15.058869+0000","last_fullsized":"2023-05-12T09:07:15.058869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:35.146554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059099+0000","last_change":"2023-05-12T09:07:14.584072+0000","last_active":"2023-05-12T09:07:15.059099+0000","last_peered":"2023-05-12T09:07:15.059099+0000","last_clean":"2023-05-12T09:07:15.059099+0000","last_became_active":"2023-05-12T09:07:14.583584+0000","last_became_peered":"2023-05-12T09:07:14.583584+0000","last_unstale":"2023-05-12T09:07:15.059099+0000","last_undegraded":"2023-05-12T09:07:15.059099+0000","last_fullsized":"2023-05-12T09:07:15.059099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:42.341874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097258+0000","last_change":"2023-05-12T09:07:10.066744+0000","last_active":"2023-05-12T09:07:15.097258+0000","last_peered":"2023-05-12T09:07:15.097258+0000","last_clean":"2023-05-12T09:07:15.097258+0000","last_became_active":"2023-05-12T09:07:10.066464+0000","last_became_peered":"2023-05-12T09:07:10.066464+0000","last_unstale":"2023-05-12T09:07:15.097258+0000","last_undegraded":"2023-05-12T09:07:15.097258+0000","last_fullsized":"2023-05-12T09:07:15.097258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:38:11.562367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099293+0000","last_change":"2023-05-12T09:07:10.560309+0000","last_active":"2023-05-12T09:07:15.099293+0000","last_peered":"2023-05-12T09:07:15.099293+0000","last_clean":"2023-05-12T09:07:15.099293+0000","last_became_active":"2023-05-12T09:07:10.559669+0000","last_became_peered":"2023-05-12T09:07:10.559669+0000","last_unstale":"2023-05-12T09:07:15.099293+0000","last_undegraded":"2023-05-12T09:07:15.099293+0000","last_fullsized":"2023-05-12T09:07:15.099293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059044+0000","last_change":"2023-05-12T09:07:14.583910+0000","last_active":"2023-05-12T09:07:15.059044+0000","last_peered":"2023-05-12T09:07:15.059044+0000","last_clean":"2023-05-12T09:07:15.059044+0000","last_became_active":"2023-05-12T09:07:14.583260+0000","last_became_peered":"2023-05-12T09:07:14.583260+0000","last_unstale":"2023-05-12T09:07:15.059044+0000","last_undegraded":"2023-05-12T09:07:15.059044+0000","last_fullsized":"2023-05-12T09:07:15.059044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:11.744671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098106+0000","last_change":"2023-05-12T09:07:10.078179+0000","last_active":"2023-05-12T09:07:15.098106+0000","last_peered":"2023-05-12T09:07:15.098106+0000","last_clean":"2023-05-12T09:07:15.098106+0000","last_became_active":"2023-05-12T09:07:10.077837+0000","last_became_peered":"2023-05-12T09:07:10.077837+0000","last_unstale":"2023-05-12T09:07:15.098106+0000","last_undegraded":"2023-05-12T09:07:15.098106+0000","last_fullsized":"2023-05-12T09:07:15.098106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:28.210072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097897+0000","last_change":"2023-05-12T09:07:10.560712+0000","last_active":"2023-05-12T09:07:15.097897+0000","last_peered":"2023-05-12T09:07:15.097897+0000","last_clean":"2023-05-12T09:07:15.097897+0000","last_became_active":"2023-05-12T09:07:10.560481+0000","last_became_peered":"2023-05-12T09:07:10.560481+0000","last_unstale":"2023-05-12T09:07:15.097897+0000","last_undegraded":"2023-05-12T09:07:15.097897+0000","last_fullsized":"2023-05-12T09:07:15.097897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:37:03.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097898+0000","last_change":"2023-05-12T09:07:14.590864+0000","last_active":"2023-05-12T09:07:15.097898+0000","last_peered":"2023-05-12T09:07:15.097898+0000","last_clean":"2023-05-12T09:07:15.097898+0000","last_became_active":"2023-05-12T09:07:14.590469+0000","last_became_peered":"2023-05-12T09:07:14.590469+0000","last_unstale":"2023-05-12T09:07:15.097898+0000","last_undegraded":"2023-05-12T09:07:15.097898+0000","last_fullsized":"2023-05-12T09:07:15.097898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:28:30.258916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058132+0000","last_change":"2023-05-12T09:07:10.076195+0000","last_active":"2023-05-12T09:07:15.058132+0000","last_peered":"2023-05-12T09:07:15.058132+0000","last_clean":"2023-05-12T09:07:15.058132+0000","last_became_active":"2023-05-12T09:07:10.075812+0000","last_became_peered":"2023-05-12T09:07:10.075812+0000","last_unstale":"2023-05-12T09:07:15.058132+0000","last_undegraded":"2023-05-12T09:07:15.058132+0000","last_fullsized":"2023-05-12T09:07:15.058132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:18:52.025513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059357+0000","last_change":"2023-05-12T09:07:10.563115+0000","last_active":"2023-05-12T09:07:15.059357+0000","last_peered":"2023-05-12T09:07:15.059357+0000","last_clean":"2023-05-12T09:07:15.059357+0000","last_became_active":"2023-05-12T09:07:10.562845+0000","last_became_peered":"2023-05-12T09:07:10.562845+0000","last_unstale":"2023-05-12T09:07:15.059357+0000","last_undegraded":"2023-05-12T09:07:15.059357+0000","last_fullsized":"2023-05-12T09:07:15.059357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:20:22.733100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098372+0000","last_change":"2023-05-12T09:07:14.591597+0000","last_active":"2023-05-12T09:07:15.098372+0000","last_peered":"2023-05-12T09:07:15.098372+0000","last_clean":"2023-05-12T09:07:15.098372+0000","last_became_active":"2023-05-12T09:07:14.591185+0000","last_became_peered":"2023-05-12T09:07:14.591185+0000","last_unstale":"2023-05-12T09:07:15.098372+0000","last_undegraded":"2023-05-12T09:07:15.098372+0000","last_fullsized":"2023-05-12T09:07:15.098372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:38:16.069472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097483+0000","last_change":"2023-05-12T09:07:10.079275+0000","last_active":"2023-05-12T09:07:15.097483+0000","last_peered":"2023-05-12T09:07:15.097483+0000","last_clean":"2023-05-12T09:07:15.097483+0000","last_became_active":"2023-05-12T09:07:10.078985+0000","last_became_peered":"2023-05-12T09:07:10.078985+0000","last_unstale":"2023-05-12T09:07:15.097483+0000","last_undegraded":"2023-05-12T09:07:15.097483+0000","last_fullsized":"2023-05-12T09:07:15.097483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:29:57.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097914+0000","last_change":"2023-05-12T09:07:10.558991+0000","last_active":"2023-05-12T09:07:15.097914+0000","last_peered":"2023-05-12T09:07:15.097914+0000","last_clean":"2023-05-12T09:07:15.097914+0000","last_became_active":"2023-05-12T09:07:10.558695+0000","last_became_peered":"2023-05-12T09:07:10.558695+0000","last_unstale":"2023-05-12T09:07:15.097914+0000","last_undegraded":"2023-05-12T09:07:15.097914+0000","last_fullsized":"2023-05-12T09:07:15.097914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:00:26.351184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056464+0000","last_change":"2023-05-12T09:07:14.586265+0000","last_active":"2023-05-12T09:07:15.056464+0000","last_peered":"2023-05-12T09:07:15.056464+0000","last_clean":"2023-05-12T09:07:15.056464+0000","last_became_active":"2023-05-12T09:07:14.585710+0000","last_became_peered":"2023-05-12T09:07:14.585710+0000","last_unstale":"2023-05-12T09:07:15.056464+0000","last_undegraded":"2023-05-12T09:07:15.056464+0000","last_fullsized":"2023-05-12T09:07:15.056464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:05:38.749407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097889+0000","last_change":"2023-05-12T09:07:10.079611+0000","last_active":"2023-05-12T09:07:15.097889+0000","last_peered":"2023-05-12T09:07:15.097889+0000","last_clean":"2023-05-12T09:07:15.097889+0000","last_became_active":"2023-05-12T09:07:10.079324+0000","last_became_peered":"2023-05-12T09:07:10.079324+0000","last_unstale":"2023-05-12T09:07:15.097889+0000","last_undegraded":"2023-05-12T09:07:15.097889+0000","last_fullsized":"2023-05-12T09:07:15.097889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:34.152879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098310+0000","last_change":"2023-05-12T09:07:10.569420+0000","last_active":"2023-05-12T09:07:15.098310+0000","last_peered":"2023-05-12T09:07:15.098310+0000","last_clean":"2023-05-12T09:07:15.098310+0000","last_became_active":"2023-05-12T09:07:10.569160+0000","last_became_peered":"2023-05-12T09:07:10.569160+0000","last_unstale":"2023-05-12T09:07:15.098310+0000","last_undegraded":"2023-05-12T09:07:15.098310+0000","last_fullsized":"2023-05-12T09:07:15.098310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:01:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056628+0000","last_change":"2023-05-12T09:07:14.585639+0000","last_active":"2023-05-12T09:07:15.056628+0000","last_peered":"2023-05-12T09:07:15.056628+0000","last_clean":"2023-05-12T09:07:15.056628+0000","last_became_active":"2023-05-12T09:07:14.585153+0000","last_became_peered":"2023-05-12T09:07:14.585153+0000","last_unstale":"2023-05-12T09:07:15.056628+0000","last_undegraded":"2023-05-12T09:07:15.056628+0000","last_fullsized":"2023-05-12T09:07:15.056628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:02:03.620298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097546+0000","last_change":"2023-05-12T09:07:10.073391+0000","last_active":"2023-05-12T09:07:15.097546+0000","last_peered":"2023-05-12T09:07:15.097546+0000","last_clean":"2023-05-12T09:07:15.097546+0000","last_became_active":"2023-05-12T09:07:10.073069+0000","last_became_peered":"2023-05-12T09:07:10.073069+0000","last_unstale":"2023-05-12T09:07:15.097546+0000","last_undegraded":"2023-05-12T09:07:15.097546+0000","last_fullsized":"2023-05-12T09:07:15.097546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:24.289481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058350+0000","last_change":"2023-05-12T09:07:10.567111+0000","last_active":"2023-05-12T09:07:15.058350+0000","last_peered":"2023-05-12T09:07:15.058350+0000","last_clean":"2023-05-12T09:07:15.058350+0000","last_became_active":"2023-05-12T09:07:10.566663+0000","last_became_peered":"2023-05-12T09:07:10.566663+0000","last_unstale":"2023-05-12T09:07:15.058350+0000","last_undegraded":"2023-05-12T09:07:15.058350+0000","last_fullsized":"2023-05-12T09:07:15.058350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:32:58.490075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056879+0000","last_change":"2023-05-12T09:07:14.591606+0000","last_active":"2023-05-12T09:07:15.056879+0000","last_peered":"2023-05-12T09:07:15.056879+0000","last_clean":"2023-05-12T09:07:15.056879+0000","last_became_active":"2023-05-12T09:07:14.591207+0000","last_became_peered":"2023-05-12T09:07:14.591207+0000","last_unstale":"2023-05-12T09:07:15.056879+0000","last_undegraded":"2023-05-12T09:07:15.056879+0000","last_fullsized":"2023-05-12T09:07:15.056879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:47:06.214488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097650+0000","last_change":"2023-05-12T09:07:10.072631+0000","last_active":"2023-05-12T09:07:15.097650+0000","last_peered":"2023-05-12T09:07:15.097650+0000","last_clean":"2023-05-12T09:07:15.097650+0000","last_became_active":"2023-05-12T09:07:10.072337+0000","last_became_peered":"2023-05-12T09:07:10.072337+0000","last_unstale":"2023-05-12T09:07:15.097650+0000","last_undegraded":"2023-05-12T09:07:15.097650+0000","last_fullsized":"2023-05-12T09:07:15.097650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:57:12.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098158+0000","last_change":"2023-05-12T09:07:10.565145+0000","last_active":"2023-05-12T09:07:15.098158+0000","last_peered":"2023-05-12T09:07:15.098158+0000","last_clean":"2023-05-12T09:07:15.098158+0000","last_became_active":"2023-05-12T09:07:10.564875+0000","last_became_peered":"2023-05-12T09:07:10.564875+0000","last_unstale":"2023-05-12T09:07:15.098158+0000","last_undegraded":"2023-05-12T09:07:15.098158+0000","last_fullsized":"2023-05-12T09:07:15.098158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:19.840466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056750+0000","last_change":"2023-05-12T09:07:14.587809+0000","last_active":"2023-05-12T09:07:15.056750+0000","last_peered":"2023-05-12T09:07:15.056750+0000","last_clean":"2023-05-12T09:07:15.056750+0000","last_became_active":"2023-05-12T09:07:14.587214+0000","last_became_peered":"2023-05-12T09:07:14.587214+0000","last_unstale":"2023-05-12T09:07:15.056750+0000","last_undegraded":"2023-05-12T09:07:15.056750+0000","last_fullsized":"2023-05-12T09:07:15.056750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:13:57.325469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059145+0000","last_change":"2023-05-12T09:07:10.080418+0000","last_active":"2023-05-12T09:07:15.059145+0000","last_peered":"2023-05-12T09:07:15.059145+0000","last_clean":"2023-05-12T09:07:15.059145+0000","last_became_active":"2023-05-12T09:07:10.080097+0000","last_became_peered":"2023-05-12T09:07:10.080097+0000","last_unstale":"2023-05-12T09:07:15.059145+0000","last_undegraded":"2023-05-12T09:07:15.059145+0000","last_fullsized":"2023-05-12T09:07:15.059145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:36.409374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098730+0000","last_change":"2023-05-12T09:07:10.572418+0000","last_active":"2023-05-12T09:07:15.098730+0000","last_peered":"2023-05-12T09:07:15.098730+0000","last_clean":"2023-05-12T09:07:15.098730+0000","last_became_active":"2023-05-12T09:07:10.571808+0000","last_became_peered":"2023-05-12T09:07:10.571808+0000","last_unstale":"2023-05-12T09:07:15.098730+0000","last_undegraded":"2023-05-12T09:07:15.098730+0000","last_fullsized":"2023-05-12T09:07:15.098730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:41.253320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097248+0000","last_change":"2023-05-12T09:07:14.590970+0000","last_active":"2023-05-12T09:07:15.097248+0000","last_peered":"2023-05-12T09:07:15.097248+0000","last_clean":"2023-05-12T09:07:15.097248+0000","last_became_active":"2023-05-12T09:07:14.590573+0000","last_became_peered":"2023-05-12T09:07:14.590573+0000","last_unstale":"2023-05-12T09:07:15.097248+0000","last_undegraded":"2023-05-12T09:07:15.097248+0000","last_fullsized":"2023-05-12T09:07:15.097248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:28.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058408+0000","last_change":"2023-05-12T09:07:10.071121+0000","last_active":"2023-05-12T09:07:15.058408+0000","last_peered":"2023-05-12T09:07:15.058408+0000","last_clean":"2023-05-12T09:07:15.058408+0000","last_became_active":"2023-05-12T09:07:10.070840+0000","last_became_peered":"2023-05-12T09:07:10.070840+0000","last_unstale":"2023-05-12T09:07:15.058408+0000","last_undegraded":"2023-05-12T09:07:15.058408+0000","last_fullsized":"2023-05-12T09:07:15.058408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:30.198454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098441+0000","last_change":"2023-05-12T09:07:10.566231+0000","last_active":"2023-05-12T09:07:15.098441+0000","last_peered":"2023-05-12T09:07:15.098441+0000","last_clean":"2023-05-12T09:07:15.098441+0000","last_became_active":"2023-05-12T09:07:10.565893+0000","last_became_peered":"2023-05-12T09:07:10.565893+0000","last_unstale":"2023-05-12T09:07:15.098441+0000","last_undegraded":"2023-05-12T09:07:15.098441+0000","last_fullsized":"2023-05-12T09:07:15.098441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:39.228924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098881+0000","last_change":"2023-05-12T09:07:14.593678+0000","last_active":"2023-05-12T09:07:15.098881+0000","last_peered":"2023-05-12T09:07:15.098881+0000","last_clean":"2023-05-12T09:07:15.098881+0000","last_became_active":"2023-05-12T09:07:14.593316+0000","last_became_peered":"2023-05-12T09:07:14.593316+0000","last_unstale":"2023-05-12T09:07:15.098881+0000","last_undegraded":"2023-05-12T09:07:15.098881+0000","last_fullsized":"2023-05-12T09:07:15.098881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:30:02.274700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097913+0000","last_change":"2023-05-12T09:07:10.063181+0000","last_active":"2023-05-12T09:07:15.097913+0000","last_peered":"2023-05-12T09:07:15.097913+0000","last_clean":"2023-05-12T09:07:15.097913+0000","last_became_active":"2023-05-12T09:07:10.062780+0000","last_became_peered":"2023-05-12T09:07:10.062780+0000","last_unstale":"2023-05-12T09:07:15.097913+0000","last_undegraded":"2023-05-12T09:07:15.097913+0000","last_fullsized":"2023-05-12T09:07:15.097913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:17.984136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099317+0000","last_change":"2023-05-12T09:07:10.565492+0000","last_active":"2023-05-12T09:07:15.099317+0000","last_peered":"2023-05-12T09:07:15.099317+0000","last_clean":"2023-05-12T09:07:15.099317+0000","last_became_active":"2023-05-12T09:07:10.565230+0000","last_became_peered":"2023-05-12T09:07:10.565230+0000","last_unstale":"2023-05-12T09:07:15.099317+0000","last_undegraded":"2023-05-12T09:07:15.099317+0000","last_fullsized":"2023-05-12T09:07:15.099317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:37.415814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098778+0000","last_change":"2023-05-12T09:07:14.598561+0000","last_active":"2023-05-12T09:07:15.098778+0000","last_peered":"2023-05-12T09:07:15.098778+0000","last_clean":"2023-05-12T09:07:15.098778+0000","last_became_active":"2023-05-12T09:07:14.598166+0000","last_became_peered":"2023-05-12T09:07:14.598166+0000","last_unstale":"2023-05-12T09:07:15.098778+0000","last_undegraded":"2023-05-12T09:07:15.098778+0000","last_fullsized":"2023-05-12T09:07:15.098778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:57:23.396980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058526+0000","last_change":"2023-05-12T09:07:10.073569+0000","last_active":"2023-05-12T09:07:15.058526+0000","last_peered":"2023-05-12T09:07:15.058526+0000","last_clean":"2023-05-12T09:07:15.058526+0000","last_became_active":"2023-05-12T09:07:10.073359+0000","last_became_peered":"2023-05-12T09:07:10.073359+0000","last_unstale":"2023-05-12T09:07:15.058526+0000","last_undegraded":"2023-05-12T09:07:15.058526+0000","last_fullsized":"2023-05-12T09:07:15.058526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:03:07.204680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098024+0000","last_change":"2023-05-12T09:07:10.564749+0000","last_active":"2023-05-12T09:07:15.098024+0000","last_peered":"2023-05-12T09:07:15.098024+0000","last_clean":"2023-05-12T09:07:15.098024+0000","last_became_active":"2023-05-12T09:07:10.564200+0000","last_became_peered":"2023-05-12T09:07:10.564200+0000","last_unstale":"2023-05-12T09:07:15.098024+0000","last_undegraded":"2023-05-12T09:07:15.098024+0000","last_fullsized":"2023-05-12T09:07:15.098024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:29.216512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099214+0000","last_change":"2023-05-12T09:07:14.598427+0000","last_active":"2023-05-12T09:07:15.099214+0000","last_peered":"2023-05-12T09:07:15.099214+0000","last_clean":"2023-05-12T09:07:15.099214+0000","last_became_active":"2023-05-12T09:07:14.598011+0000","last_became_peered":"2023-05-12T09:07:14.598011+0000","last_unstale":"2023-05-12T09:07:15.099214+0000","last_undegraded":"2023-05-12T09:07:15.099214+0000","last_fullsized":"2023-05-12T09:07:15.099214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:52:15.802821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059169+0000","last_change":"2023-05-12T09:07:10.073900+0000","last_active":"2023-05-12T09:07:15.059169+0000","last_peered":"2023-05-12T09:07:15.059169+0000","last_clean":"2023-05-12T09:07:15.059169+0000","last_became_active":"2023-05-12T09:07:10.073595+0000","last_became_peered":"2023-05-12T09:07:10.073595+0000","last_unstale":"2023-05-12T09:07:15.059169+0000","last_undegraded":"2023-05-12T09:07:15.059169+0000","last_fullsized":"2023-05-12T09:07:15.059169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:09:04.714440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098675+0000","last_change":"2023-05-12T09:07:04.835422+0000","last_active":"2023-05-12T09:07:15.098675+0000","last_peered":"2023-05-12T09:07:15.098675+0000","last_clean":"2023-05-12T09:07:15.098675+0000","last_became_active":"2023-05-12T09:07:04.834944+0000","last_became_peered":"2023-05-12T09:07:04.834944+0000","last_unstale":"2023-05-12T09:07:15.098675+0000","last_undegraded":"2023-05-12T09:07:15.098675+0000","last_fullsized":"2023-05-12T09:07:15.098675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:29:34.402135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058443+0000","last_change":"2023-05-12T09:07:10.557866+0000","last_active":"2023-05-12T09:07:15.058443+0000","last_peered":"2023-05-12T09:07:15.058443+0000","last_clean":"2023-05-12T09:07:15.058443+0000","last_became_active":"2023-05-12T09:07:10.557613+0000","last_became_peered":"2023-05-12T09:07:10.557613+0000","last_unstale":"2023-05-12T09:07:15.058443+0000","last_undegraded":"2023-05-12T09:07:15.058443+0000","last_fullsized":"2023-05-12T09:07:15.058443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:41.253320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058370+0000","last_change":"2023-05-12T09:07:14.596466+0000","last_active":"2023-05-12T09:07:15.058370+0000","last_peered":"2023-05-12T09:07:15.058370+0000","last_clean":"2023-05-12T09:07:15.058370+0000","last_became_active":"2023-05-12T09:07:14.595765+0000","last_became_peered":"2023-05-12T09:07:14.595765+0000","last_unstale":"2023-05-12T09:07:15.058370+0000","last_undegraded":"2023-05-12T09:07:15.058370+0000","last_fullsized":"2023-05-12T09:07:15.058370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:23.341131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058733+0000","last_change":"2023-05-12T09:07:04.828759+0000","last_active":"2023-05-12T09:07:15.058733+0000","last_peered":"2023-05-12T09:07:15.058733+0000","last_clean":"2023-05-12T09:07:15.058733+0000","last_became_active":"2023-05-12T09:07:04.828460+0000","last_became_peered":"2023-05-12T09:07:04.828460+0000","last_unstale":"2023-05-12T09:07:15.058733+0000","last_undegraded":"2023-05-12T09:07:15.058733+0000","last_fullsized":"2023-05-12T09:07:15.058733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:08:51.470983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097285+0000","last_change":"2023-05-12T09:07:10.074451+0000","last_active":"2023-05-12T09:07:15.097285+0000","last_peered":"2023-05-12T09:07:15.097285+0000","last_clean":"2023-05-12T09:07:15.097285+0000","last_became_active":"2023-05-12T09:07:10.074189+0000","last_became_peered":"2023-05-12T09:07:10.074189+0000","last_unstale":"2023-05-12T09:07:15.097285+0000","last_undegraded":"2023-05-12T09:07:15.097285+0000","last_fullsized":"2023-05-12T09:07:15.097285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:31:30.209986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098050+0000","last_change":"2023-05-12T09:07:10.574648+0000","last_active":"2023-05-12T09:07:15.098050+0000","last_peered":"2023-05-12T09:07:15.098050+0000","last_clean":"2023-05-12T09:07:15.098050+0000","last_became_active":"2023-05-12T09:07:10.573975+0000","last_became_peered":"2023-05-12T09:07:10.573975+0000","last_unstale":"2023-05-12T09:07:15.098050+0000","last_undegraded":"2023-05-12T09:07:15.098050+0000","last_fullsized":"2023-05-12T09:07:15.098050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:11:46.901235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098514+0000","last_change":"2023-05-12T09:07:14.596807+0000","last_active":"2023-05-12T09:07:15.098514+0000","last_peered":"2023-05-12T09:07:15.098514+0000","last_clean":"2023-05-12T09:07:15.098514+0000","last_became_active":"2023-05-12T09:07:14.596455+0000","last_became_peered":"2023-05-12T09:07:14.596455+0000","last_unstale":"2023-05-12T09:07:15.098514+0000","last_undegraded":"2023-05-12T09:07:15.098514+0000","last_fullsized":"2023-05-12T09:07:15.098514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:15.456994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096671+0000","last_change":"2023-05-12T09:07:04.830658+0000","last_active":"2023-05-12T09:07:15.096671+0000","last_peered":"2023-05-12T09:07:15.096671+0000","last_clean":"2023-05-12T09:07:15.096671+0000","last_became_active":"2023-05-12T09:07:04.830354+0000","last_became_peered":"2023-05-12T09:07:04.830354+0000","last_unstale":"2023-05-12T09:07:15.096671+0000","last_undegraded":"2023-05-12T09:07:15.096671+0000","last_fullsized":"2023-05-12T09:07:15.096671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:25:54.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097236+0000","last_change":"2023-05-12T09:07:04.830850+0000","last_active":"2023-05-12T09:07:15.097236+0000","last_peered":"2023-05-12T09:07:15.097236+0000","last_clean":"2023-05-12T09:07:15.097236+0000","last_became_active":"2023-05-12T09:07:04.829577+0000","last_became_peered":"2023-05-12T09:07:04.829577+0000","last_unstale":"2023-05-12T09:07:15.097236+0000","last_undegraded":"2023-05-12T09:07:15.097236+0000","last_fullsized":"2023-05-12T09:07:15.097236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:42.458296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096795+0000","last_change":"2023-05-12T09:07:10.078248+0000","last_active":"2023-05-12T09:07:15.096795+0000","last_peered":"2023-05-12T09:07:15.096795+0000","last_clean":"2023-05-12T09:07:15.096795+0000","last_became_active":"2023-05-12T09:07:10.077994+0000","last_became_peered":"2023-05-12T09:07:10.077994+0000","last_unstale":"2023-05-12T09:07:15.096795+0000","last_undegraded":"2023-05-12T09:07:15.096795+0000","last_fullsized":"2023-05-12T09:07:15.096795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:34.152879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097764+0000","last_change":"2023-05-12T09:07:10.557403+0000","last_active":"2023-05-12T09:07:15.097764+0000","last_peered":"2023-05-12T09:07:15.097764+0000","last_clean":"2023-05-12T09:07:15.097764+0000","last_became_active":"2023-05-12T09:07:10.557170+0000","last_became_peered":"2023-05-12T09:07:10.557170+0000","last_unstale":"2023-05-12T09:07:15.097764+0000","last_undegraded":"2023-05-12T09:07:15.097764+0000","last_fullsized":"2023-05-12T09:07:15.097764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:41:05.519844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057360+0000","last_change":"2023-05-12T09:07:14.588875+0000","last_active":"2023-05-12T09:07:15.057360+0000","last_peered":"2023-05-12T09:07:15.057360+0000","last_clean":"2023-05-12T09:07:15.057360+0000","last_became_active":"2023-05-12T09:07:14.587235+0000","last_became_peered":"2023-05-12T09:07:14.587235+0000","last_unstale":"2023-05-12T09:07:15.057360+0000","last_undegraded":"2023-05-12T09:07:15.057360+0000","last_fullsized":"2023-05-12T09:07:15.057360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:48.344758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097643+0000","last_change":"2023-05-12T09:07:05.258677+0000","last_active":"2023-05-12T09:07:15.097643+0000","last_peered":"2023-05-12T09:07:15.097643+0000","last_clean":"2023-05-12T09:07:15.097643+0000","last_became_active":"2023-05-12T09:07:05.258372+0000","last_became_peered":"2023-05-12T09:07:05.258372+0000","last_unstale":"2023-05-12T09:07:15.097643+0000","last_undegraded":"2023-05-12T09:07:15.097643+0000","last_fullsized":"2023-05-12T09:07:15.097643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:26:58.816901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096485+0000","last_change":"2023-05-12T09:07:10.071185+0000","last_active":"2023-05-12T09:07:15.096485+0000","last_peered":"2023-05-12T09:07:15.096485+0000","last_clean":"2023-05-12T09:07:15.096485+0000","last_became_active":"2023-05-12T09:07:10.070930+0000","last_became_peered":"2023-05-12T09:07:10.070930+0000","last_unstale":"2023-05-12T09:07:15.096485+0000","last_undegraded":"2023-05-12T09:07:15.096485+0000","last_fullsized":"2023-05-12T09:07:15.096485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:10.442791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098132+0000","last_change":"2023-05-12T09:07:10.565103+0000","last_active":"2023-05-12T09:07:15.098132+0000","last_peered":"2023-05-12T09:07:15.098132+0000","last_clean":"2023-05-12T09:07:15.098132+0000","last_became_active":"2023-05-12T09:07:10.564782+0000","last_became_peered":"2023-05-12T09:07:10.564782+0000","last_unstale":"2023-05-12T09:07:15.098132+0000","last_undegraded":"2023-05-12T09:07:15.098132+0000","last_fullsized":"2023-05-12T09:07:15.098132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098635+0000","last_change":"2023-05-12T09:07:14.585727+0000","last_active":"2023-05-12T09:07:15.098635+0000","last_peered":"2023-05-12T09:07:15.098635+0000","last_clean":"2023-05-12T09:07:15.098635+0000","last_became_active":"2023-05-12T09:07:14.585342+0000","last_became_peered":"2023-05-12T09:07:14.585342+0000","last_unstale":"2023-05-12T09:07:15.098635+0000","last_undegraded":"2023-05-12T09:07:15.098635+0000","last_fullsized":"2023-05-12T09:07:15.098635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:34:38.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097101+0000","last_change":"2023-05-12T09:07:05.258599+0000","last_active":"2023-05-12T09:07:15.097101+0000","last_peered":"2023-05-12T09:07:15.097101+0000","last_clean":"2023-05-12T09:07:15.097101+0000","last_became_active":"2023-05-12T09:07:05.258301+0000","last_became_peered":"2023-05-12T09:07:05.258301+0000","last_unstale":"2023-05-12T09:07:15.097101+0000","last_undegraded":"2023-05-12T09:07:15.097101+0000","last_fullsized":"2023-05-12T09:07:15.097101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:36.857503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058798+0000","last_change":"2023-05-12T09:07:10.077809+0000","last_active":"2023-05-12T09:07:15.058798+0000","last_peered":"2023-05-12T09:07:15.058798+0000","last_clean":"2023-05-12T09:07:15.058798+0000","last_became_active":"2023-05-12T09:07:10.077502+0000","last_became_peered":"2023-05-12T09:07:10.077502+0000","last_unstale":"2023-05-12T09:07:15.058798+0000","last_undegraded":"2023-05-12T09:07:15.058798+0000","last_fullsized":"2023-05-12T09:07:15.058798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:31:45.423256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058539+0000","last_change":"2023-05-12T09:07:10.569701+0000","last_active":"2023-05-12T09:07:15.058539+0000","last_peered":"2023-05-12T09:07:15.058539+0000","last_clean":"2023-05-12T09:07:15.058539+0000","last_became_active":"2023-05-12T09:07:10.569342+0000","last_became_peered":"2023-05-12T09:07:10.569342+0000","last_unstale":"2023-05-12T09:07:15.058539+0000","last_undegraded":"2023-05-12T09:07:15.058539+0000","last_fullsized":"2023-05-12T09:07:15.058539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:59:18.361363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098305+0000","last_change":"2023-05-12T09:07:14.589783+0000","last_active":"2023-05-12T09:07:15.098305+0000","last_peered":"2023-05-12T09:07:15.098305+0000","last_clean":"2023-05-12T09:07:15.098305+0000","last_became_active":"2023-05-12T09:07:14.589383+0000","last_became_peered":"2023-05-12T09:07:14.589383+0000","last_unstale":"2023-05-12T09:07:15.098305+0000","last_undegraded":"2023-05-12T09:07:15.098305+0000","last_fullsized":"2023-05-12T09:07:15.098305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:42.729589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097652+0000","last_change":"2023-05-12T09:07:05.258734+0000","last_active":"2023-05-12T09:07:15.097652+0000","last_peered":"2023-05-12T09:07:15.097652+0000","last_clean":"2023-05-12T09:07:15.097652+0000","last_became_active":"2023-05-12T09:07:05.258376+0000","last_became_peered":"2023-05-12T09:07:05.258376+0000","last_unstale":"2023-05-12T09:07:15.097652+0000","last_undegraded":"2023-05-12T09:07:15.097652+0000","last_fullsized":"2023-05-12T09:07:15.097652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:41:23.293447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098911+0000","last_change":"2023-05-12T09:07:10.073268+0000","last_active":"2023-05-12T09:07:15.098911+0000","last_peered":"2023-05-12T09:07:15.098911+0000","last_clean":"2023-05-12T09:07:15.098911+0000","last_became_active":"2023-05-12T09:07:10.072997+0000","last_became_peered":"2023-05-12T09:07:10.072997+0000","last_unstale":"2023-05-12T09:07:15.098911+0000","last_undegraded":"2023-05-12T09:07:15.098911+0000","last_fullsized":"2023-05-12T09:07:15.098911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:14:41.536722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096597+0000","last_change":"2023-05-12T09:07:10.561961+0000","last_active":"2023-05-12T09:07:15.096597+0000","last_peered":"2023-05-12T09:07:15.096597+0000","last_clean":"2023-05-12T09:07:15.096597+0000","last_became_active":"2023-05-12T09:07:10.561690+0000","last_became_peered":"2023-05-12T09:07:10.561690+0000","last_unstale":"2023-05-12T09:07:15.096597+0000","last_undegraded":"2023-05-12T09:07:15.096597+0000","last_fullsized":"2023-05-12T09:07:15.096597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:43.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058733+0000","last_change":"2023-05-12T09:07:14.585070+0000","last_active":"2023-05-12T09:07:15.058733+0000","last_peered":"2023-05-12T09:07:15.058733+0000","last_clean":"2023-05-12T09:07:15.058733+0000","last_became_active":"2023-05-12T09:07:14.584656+0000","last_became_peered":"2023-05-12T09:07:14.584656+0000","last_unstale":"2023-05-12T09:07:15.058733+0000","last_undegraded":"2023-05-12T09:07:15.058733+0000","last_fullsized":"2023-05-12T09:07:15.058733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:53:19.096515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058688+0000","last_change":"2023-05-12T09:07:05.258598+0000","last_active":"2023-05-12T09:07:15.058688+0000","last_peered":"2023-05-12T09:07:15.058688+0000","last_clean":"2023-05-12T09:07:15.058688+0000","last_became_active":"2023-05-12T09:07:05.258280+0000","last_became_peered":"2023-05-12T09:07:05.258280+0000","last_unstale":"2023-05-12T09:07:15.058688+0000","last_undegraded":"2023-05-12T09:07:15.058688+0000","last_fullsized":"2023-05-12T09:07:15.058688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:50.177616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096736+0000","last_change":"2023-05-12T09:07:10.072051+0000","last_active":"2023-05-12T09:07:15.096736+0000","last_peered":"2023-05-12T09:07:15.096736+0000","last_clean":"2023-05-12T09:07:15.096736+0000","last_became_active":"2023-05-12T09:07:10.071775+0000","last_became_peered":"2023-05-12T09:07:10.071775+0000","last_unstale":"2023-05-12T09:07:15.096736+0000","last_undegraded":"2023-05-12T09:07:15.096736+0000","last_fullsized":"2023-05-12T09:07:15.096736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:10.949889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097922+0000","last_change":"2023-05-12T09:07:10.558361+0000","last_active":"2023-05-12T09:07:15.097922+0000","last_peered":"2023-05-12T09:07:15.097922+0000","last_clean":"2023-05-12T09:07:15.097922+0000","last_became_active":"2023-05-12T09:07:10.557975+0000","last_became_peered":"2023-05-12T09:07:10.557975+0000","last_unstale":"2023-05-12T09:07:15.097922+0000","last_undegraded":"2023-05-12T09:07:15.097922+0000","last_fullsized":"2023-05-12T09:07:15.097922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:01:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097799+0000","last_change":"2023-05-12T09:07:14.587172+0000","last_active":"2023-05-12T09:07:15.097799+0000","last_peered":"2023-05-12T09:07:15.097799+0000","last_clean":"2023-05-12T09:07:15.097799+0000","last_became_active":"2023-05-12T09:07:14.586671+0000","last_became_peered":"2023-05-12T09:07:14.586671+0000","last_unstale":"2023-05-12T09:07:15.097799+0000","last_undegraded":"2023-05-12T09:07:15.097799+0000","last_fullsized":"2023-05-12T09:07:15.097799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:11:50.401900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059054+0000","last_change":"2023-05-12T09:07:04.830787+0000","last_active":"2023-05-12T09:07:15.059054+0000","last_peered":"2023-05-12T09:07:15.059054+0000","last_clean":"2023-05-12T09:07:15.059054+0000","last_became_active":"2023-05-12T09:07:04.830492+0000","last_became_peered":"2023-05-12T09:07:04.830492+0000","last_unstale":"2023-05-12T09:07:15.059054+0000","last_undegraded":"2023-05-12T09:07:15.059054+0000","last_fullsized":"2023-05-12T09:07:15.059054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:18:33.956760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099144+0000","last_change":"2023-05-12T09:07:10.072970+0000","last_active":"2023-05-12T09:07:15.099144+0000","last_peered":"2023-05-12T09:07:15.099144+0000","last_clean":"2023-05-12T09:07:15.099144+0000","last_became_active":"2023-05-12T09:07:10.072670+0000","last_became_peered":"2023-05-12T09:07:10.072670+0000","last_unstale":"2023-05-12T09:07:15.099144+0000","last_undegraded":"2023-05-12T09:07:15.099144+0000","last_fullsized":"2023-05-12T09:07:15.099144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:21.054528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097023+0000","last_change":"2023-05-12T09:07:10.565493+0000","last_active":"2023-05-12T09:07:15.097023+0000","last_peered":"2023-05-12T09:07:15.097023+0000","last_clean":"2023-05-12T09:07:15.097023+0000","last_became_active":"2023-05-12T09:07:10.565202+0000","last_became_peered":"2023-05-12T09:07:10.565202+0000","last_unstale":"2023-05-12T09:07:15.097023+0000","last_undegraded":"2023-05-12T09:07:15.097023+0000","last_fullsized":"2023-05-12T09:07:15.097023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:22.060968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096821+0000","last_change":"2023-05-12T09:07:14.595394+0000","last_active":"2023-05-12T09:07:15.096821+0000","last_peered":"2023-05-12T09:07:15.096821+0000","last_clean":"2023-05-12T09:07:15.096821+0000","last_became_active":"2023-05-12T09:07:14.594978+0000","last_became_peered":"2023-05-12T09:07:14.594978+0000","last_unstale":"2023-05-12T09:07:15.096821+0000","last_undegraded":"2023-05-12T09:07:15.096821+0000","last_fullsized":"2023-05-12T09:07:15.096821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:52.189320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097791+0000","last_change":"2023-05-12T09:07:10.078522+0000","last_active":"2023-05-12T09:07:15.097791+0000","last_peered":"2023-05-12T09:07:15.097791+0000","last_clean":"2023-05-12T09:07:15.097791+0000","last_became_active":"2023-05-12T09:07:10.078295+0000","last_became_peered":"2023-05-12T09:07:10.078295+0000","last_unstale":"2023-05-12T09:07:15.097791+0000","last_undegraded":"2023-05-12T09:07:15.097791+0000","last_fullsized":"2023-05-12T09:07:15.097791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:17.984136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057055+0000","last_change":"2023-05-12T09:07:10.560192+0000","last_active":"2023-05-12T09:07:15.057055+0000","last_peered":"2023-05-12T09:07:15.057055+0000","last_clean":"2023-05-12T09:07:15.057055+0000","last_became_active":"2023-05-12T09:07:10.559897+0000","last_became_peered":"2023-05-12T09:07:10.559897+0000","last_unstale":"2023-05-12T09:07:15.057055+0000","last_undegraded":"2023-05-12T09:07:15.057055+0000","last_fullsized":"2023-05-12T09:07:15.057055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:25:50.021542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097222+0000","last_change":"2023-05-12T09:07:14.590573+0000","last_active":"2023-05-12T09:07:15.097222+0000","last_peered":"2023-05-12T09:07:15.097222+0000","last_clean":"2023-05-12T09:07:15.097222+0000","last_became_active":"2023-05-12T09:07:14.590176+0000","last_became_peered":"2023-05-12T09:07:14.590176+0000","last_unstale":"2023-05-12T09:07:15.097222+0000","last_undegraded":"2023-05-12T09:07:15.097222+0000","last_fullsized":"2023-05-12T09:07:15.097222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:15.456994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097418+0000","last_change":"2023-05-12T09:07:10.080277+0000","last_active":"2023-05-12T09:07:15.097418+0000","last_peered":"2023-05-12T09:07:15.097418+0000","last_clean":"2023-05-12T09:07:15.097418+0000","last_became_active":"2023-05-12T09:07:10.079936+0000","last_became_peered":"2023-05-12T09:07:10.079936+0000","last_unstale":"2023-05-12T09:07:15.097418+0000","last_undegraded":"2023-05-12T09:07:15.097418+0000","last_fullsized":"2023-05-12T09:07:15.097418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:03:06.647253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098333+0000","last_change":"2023-05-12T09:07:10.569555+0000","last_active":"2023-05-12T09:07:15.098333+0000","last_peered":"2023-05-12T09:07:15.098333+0000","last_clean":"2023-05-12T09:07:15.098333+0000","last_became_active":"2023-05-12T09:07:10.569253+0000","last_became_peered":"2023-05-12T09:07:10.569253+0000","last_unstale":"2023-05-12T09:07:15.098333+0000","last_undegraded":"2023-05-12T09:07:15.098333+0000","last_fullsized":"2023-05-12T09:07:15.098333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:19.840466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098745+0000","last_change":"2023-05-12T09:07:14.588834+0000","last_active":"2023-05-12T09:07:15.098745+0000","last_peered":"2023-05-12T09:07:15.098745+0000","last_clean":"2023-05-12T09:07:15.098745+0000","last_became_active":"2023-05-12T09:07:14.588451+0000","last_became_peered":"2023-05-12T09:07:14.588451+0000","last_unstale":"2023-05-12T09:07:15.098745+0000","last_undegraded":"2023-05-12T09:07:15.098745+0000","last_fullsized":"2023-05-12T09:07:15.098745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:52.189320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099255+0000","last_change":"2023-05-12T09:07:10.078506+0000","last_active":"2023-05-12T09:07:15.099255+0000","last_peered":"2023-05-12T09:07:15.099255+0000","last_clean":"2023-05-12T09:07:15.099255+0000","last_became_active":"2023-05-12T09:07:10.078243+0000","last_became_peered":"2023-05-12T09:07:10.078243+0000","last_unstale":"2023-05-12T09:07:15.099255+0000","last_undegraded":"2023-05-12T09:07:15.099255+0000","last_fullsized":"2023-05-12T09:07:15.099255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:24.289481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098134+0000","last_change":"2023-05-12T09:07:10.570203+0000","last_active":"2023-05-12T09:07:15.098134+0000","last_peered":"2023-05-12T09:07:15.098134+0000","last_clean":"2023-05-12T09:07:15.098134+0000","last_became_active":"2023-05-12T09:07:10.569917+0000","last_became_peered":"2023-05-12T09:07:10.569917+0000","last_unstale":"2023-05-12T09:07:15.098134+0000","last_undegraded":"2023-05-12T09:07:15.098134+0000","last_fullsized":"2023-05-12T09:07:15.098134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:37:03.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098605+0000","last_change":"2023-05-12T09:07:14.591389+0000","last_active":"2023-05-12T09:07:15.098605+0000","last_peered":"2023-05-12T09:07:15.098605+0000","last_clean":"2023-05-12T09:07:15.098605+0000","last_became_active":"2023-05-12T09:07:14.591029+0000","last_became_peered":"2023-05-12T09:07:14.591029+0000","last_unstale":"2023-05-12T09:07:15.098605+0000","last_undegraded":"2023-05-12T09:07:15.098605+0000","last_fullsized":"2023-05-12T09:07:15.098605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:50:10.131123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059215+0000","last_change":"2023-05-12T09:07:10.066391+0000","last_active":"2023-05-12T09:07:15.059215+0000","last_peered":"2023-05-12T09:07:15.059215+0000","last_clean":"2023-05-12T09:07:15.059215+0000","last_became_active":"2023-05-12T09:07:10.066135+0000","last_became_peered":"2023-05-12T09:07:10.066135+0000","last_unstale":"2023-05-12T09:07:15.059215+0000","last_undegraded":"2023-05-12T09:07:15.059215+0000","last_fullsized":"2023-05-12T09:07:15.059215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:57.005641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058832+0000","last_change":"2023-05-12T09:07:10.552090+0000","last_active":"2023-05-12T09:07:15.058832+0000","last_peered":"2023-05-12T09:07:15.058832+0000","last_clean":"2023-05-12T09:07:15.058832+0000","last_became_active":"2023-05-12T09:07:10.551802+0000","last_became_peered":"2023-05-12T09:07:10.551802+0000","last_unstale":"2023-05-12T09:07:15.058832+0000","last_undegraded":"2023-05-12T09:07:15.058832+0000","last_fullsized":"2023-05-12T09:07:15.058832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:54.558448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096851+0000","last_change":"2023-05-12T09:07:14.585407+0000","last_active":"2023-05-12T09:07:15.096851+0000","last_peered":"2023-05-12T09:07:15.096851+0000","last_clean":"2023-05-12T09:07:15.096851+0000","last_became_active":"2023-05-12T09:07:14.585059+0000","last_became_peered":"2023-05-12T09:07:14.585059+0000","last_unstale":"2023-05-12T09:07:15.096851+0000","last_undegraded":"2023-05-12T09:07:15.096851+0000","last_fullsized":"2023-05-12T09:07:15.096851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:30:02.274700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097402+0000","last_change":"2023-05-12T09:07:10.068737+0000","last_active":"2023-05-12T09:07:15.097402+0000","last_peered":"2023-05-12T09:07:15.097402+0000","last_clean":"2023-05-12T09:07:15.097402+0000","last_became_active":"2023-05-12T09:07:10.068427+0000","last_became_peered":"2023-05-12T09:07:10.068427+0000","last_unstale":"2023-05-12T09:07:15.097402+0000","last_undegraded":"2023-05-12T09:07:15.097402+0000","last_fullsized":"2023-05-12T09:07:15.097402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:49:41.703805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098946+0000","last_change":"2023-05-12T09:07:10.565243+0000","last_active":"2023-05-12T09:07:15.098946+0000","last_peered":"2023-05-12T09:07:15.098946+0000","last_clean":"2023-05-12T09:07:15.098946+0000","last_became_active":"2023-05-12T09:07:10.564923+0000","last_became_peered":"2023-05-12T09:07:10.564923+0000","last_unstale":"2023-05-12T09:07:15.098946+0000","last_undegraded":"2023-05-12T09:07:15.098946+0000","last_fullsized":"2023-05-12T09:07:15.098946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:35.146554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058306+0000","last_change":"2023-05-12T09:07:10.554737+0000","last_active":"2023-05-12T09:07:15.058306+0000","last_peered":"2023-05-12T09:07:15.058306+0000","last_clean":"2023-05-12T09:07:15.058306+0000","last_became_active":"2023-05-12T09:07:10.554481+0000","last_became_peered":"2023-05-12T09:07:10.554481+0000","last_unstale":"2023-05-12T09:07:15.058306+0000","last_undegraded":"2023-05-12T09:07:15.058306+0000","last_fullsized":"2023-05-12T09:07:15.058306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:07:09.286879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058533+0000","last_change":"2023-05-12T09:07:10.551816+0000","last_active":"2023-05-12T09:07:15.058533+0000","last_peered":"2023-05-12T09:07:15.058533+0000","last_clean":"2023-05-12T09:07:15.058533+0000","last_became_active":"2023-05-12T09:07:10.551522+0000","last_became_peered":"2023-05-12T09:07:10.551522+0000","last_unstale":"2023-05-12T09:07:15.058533+0000","last_undegraded":"2023-05-12T09:07:15.058533+0000","last_fullsized":"2023-05-12T09:07:15.058533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:50:06.630457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098592+0000","last_change":"2023-05-12T09:07:10.565765+0000","last_active":"2023-05-12T09:07:15.098592+0000","last_peered":"2023-05-12T09:07:15.098592+0000","last_clean":"2023-05-12T09:07:15.098592+0000","last_became_active":"2023-05-12T09:07:10.565493+0000","last_became_peered":"2023-05-12T09:07:10.565493+0000","last_unstale":"2023-05-12T09:07:15.098592+0000","last_undegraded":"2023-05-12T09:07:15.098592+0000","last_fullsized":"2023-05-12T09:07:15.098592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:03:08.211119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058766+0000","last_change":"2023-05-12T09:07:10.558789+0000","last_active":"2023-05-12T09:07:15.058766+0000","last_peered":"2023-05-12T09:07:15.058766+0000","last_clean":"2023-05-12T09:07:15.058766+0000","last_became_active":"2023-05-12T09:07:10.557767+0000","last_became_peered":"2023-05-12T09:07:10.557767+0000","last_unstale":"2023-05-12T09:07:15.058766+0000","last_undegraded":"2023-05-12T09:07:15.058766+0000","last_fullsized":"2023-05-12T09:07:15.058766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:57:19.896315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097817+0000","last_change":"2023-05-12T09:07:10.566888+0000","last_active":"2023-05-12T09:07:15.097817+0000","last_peered":"2023-05-12T09:07:15.097817+0000","last_clean":"2023-05-12T09:07:15.097817+0000","last_became_active":"2023-05-12T09:07:10.566580+0000","last_became_peered":"2023-05-12T09:07:10.566580+0000","last_unstale":"2023-05-12T09:07:15.097817+0000","last_undegraded":"2023-05-12T09:07:15.097817+0000","last_fullsized":"2023-05-12T09:07:15.097817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:35.159319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9248,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362592,"statfs":{"total":96636764160,"available":96627294208,"internally_reserved":0,"allocated":876544,"data_stored":699108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9220,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362620,"statfs":{"total":96636764160,"available":96627322880,"internally_reserved":0,"allocated":847872,"data_stored":695098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8132,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363708,"statfs":{"total":96636764160,"available":96628436992,"internally_reserved":0,"allocated":258048,"data_stored":105312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8132,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363708,"statfs":{"total":96636764160,"available":96628436992,"internally_reserved":0,"allocated":258048,"data_stored":104820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8212,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363628,"statfs":{"total":96636764160,"available":96628355072,"internally_reserved":0,"allocated":274432,"data_stored":108580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":104021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-12T09:07:39.815 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-12T09:07:39.892 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:07:39.896 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:07:40.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.031+0000 7f44ae5ff700 1 Processor -- start 2023-05-12T09:07:40.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.032+0000 7f44ae5ff700 1 -- start start 2023-05-12T09:07:40.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.033+0000 7f44ae5ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f44a80cd760 0x7f44a80cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.033+0000 7f44ae5ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f44a815cf10 0x7f44a806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.033+0000 7f44ae5ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a80cc9e0 con 0x7f44a80adf70 2023-05-12T09:07:40.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.033+0000 7f44ae5ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a80cd580 con 0x7f44a80cd760 2023-05-12T09:07:40.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.033+0000 7f44ae5ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a815de20 con 0x7f44a815cf10 2023-05-12T09:07:40.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.033+0000 7f44a7fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f44a80cd760 0x7f44a80cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.033+0000 7f449ffff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f44a80adf70 0x7f44a80cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47734/0 (socket says 172.21.15.116:47734) 2023-05-12T09:07:40.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.033+0000 7f449ffff700 1 -- 172.21.15.116:0/1582367681 learned_addr learned my addr 172.21.15.116:0/1582367681 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:40.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.033+0000 7f44acb9c700 1 --2- 172.21.15.116:0/1582367681 >> v2:172.21.15.182:3300/0 conn(0x7f44a815cf10 0x7f44a806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.034+0000 7f44a77fe700 1 -- 172.21.15.116:0/1582367681 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823033682 0 0) 0x7f44a80cc9e0 con 0x7f44a80adf70 2023-05-12T09:07:40.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.034+0000 7f44a7fff700 1 -- 172.21.15.116:0/1582367681 >> v2:172.21.15.182:3300/0 conn(0x7f44a815cf10 msgr2=0x7f44a806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:40.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.034+0000 7f44a7fff700 1 --2- 172.21.15.116:0/1582367681 >> v2:172.21.15.182:3300/0 conn(0x7f44a815cf10 0x7f44a806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.034+0000 7f44a7fff700 1 -- 172.21.15.116:0/1582367681 >> v1:172.21.15.116:6789/0 conn(0x7f44a80adf70 legacy=0x7f44a80cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.034+0000 7f44a7fff700 1 -- 172.21.15.116:0/1582367681 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80ce070 con 0x7f44a80cd760 2023-05-12T09:07:40.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.034+0000 7f44a7fff700 1 --2- 172.21.15.116:0/1582367681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a80cd760 0x7f44a80cdb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f44a8072030 tx=0x7f4498009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85820faa25d67f6 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:40.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.034+0000 7f44a77fe700 1 -- 172.21.15.116:0/1582367681 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498011830 con 0x7f44a80cd760 2023-05-12T09:07:40.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.034+0000 7f44a77fe700 1 -- 172.21.15.116:0/1582367681 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4498011990 con 0x7f44a80cd760 2023-05-12T09:07:40.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.034+0000 7f44a77fe700 1 -- 172.21.15.116:0/1582367681 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498011d20 con 0x7f44a80cd760 2023-05-12T09:07:40.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.035+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1582367681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a80cd760 msgr2=0x7f44a80cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.035+0000 7f44ae5ff700 1 --2- 172.21.15.116:0/1582367681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a80cd760 0x7f44a80cdb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f44a8072030 tx=0x7f4498009b20 comp rx=0 tx=0).stop 2023-05-12T09:07:40.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.035+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1582367681 shutdown_connections 2023-05-12T09:07:40.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.035+0000 7f44ae5ff700 1 --2- 172.21.15.116:0/1582367681 >> v2:172.21.15.182:3300/0 conn(0x7f44a815cf10 0x7f44a806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.035+0000 7f44ae5ff700 1 --2- 172.21.15.116:0/1582367681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a80cd760 0x7f44a80cdb30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.035+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1582367681 >> 172.21.15.116:0/1582367681 conn(0x7f44a80cf720 msgr2=0x7f44a80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:40.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.035+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1582367681 shutdown_connections 2023-05-12T09:07:40.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.035+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1582367681 wait complete. 2023-05-12T09:07:40.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.037+0000 7f44ae5ff700 1 Processor -- start 2023-05-12T09:07:40.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.037+0000 7f44ae5ff700 1 -- start start 2023-05-12T09:07:40.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44ae5ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f44a80adf70 0x7f44a80cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44ae5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f44a80cd760 0x7f44a814f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44ae5ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a815cf10 0x7f44a80b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44ae5ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80cac60 con 0x7f44a815cf10 2023-05-12T09:07:40.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44ae5ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80c9d70 con 0x7f44a80adf70 2023-05-12T09:07:40.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44ae5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80ca050 con 0x7f44a80cd760 2023-05-12T09:07:40.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44acb9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a815cf10 0x7f44a80b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44a7fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f44a80adf70 0x7f44a80cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44acb9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a815cf10 0x7f44a80b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33996/0 (socket says 172.21.15.116:33996) 2023-05-12T09:07:40.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44acb9c700 1 -- 172.21.15.116:0/1406571611 learned_addr learned my addr 172.21.15.116:0/1406571611 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:40.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f449ffff700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f44a80cd760 0x7f44a814f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44acb9c700 1 -- 172.21.15.116:0/1406571611 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f44a80cd760 msgr2=0x7f44a814f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44acb9c700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f44a80cd760 0x7f44a814f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44acb9c700 1 -- 172.21.15.116:0/1406571611 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f44a80adf70 msgr2=0x7f44a80cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44acb9c700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f44a80adf70 0x7f44a80cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.038+0000 7f44acb9c700 1 -- 172.21.15.116:0/1406571611 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44980094a0 con 0x7f44a815cf10 2023-05-12T09:07:40.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.039+0000 7f44acb9c700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a815cf10 0x7f44a80b2440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f44a000efc0 tx=0x7f44a000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:40.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.039+0000 7f44a57fa700 1 -- 172.21.15.116:0/1406571611 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000cad0 con 0x7f44a815cf10 2023-05-12T09:07:40.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.039+0000 7f44a57fa700 1 -- 172.21.15.116:0/1406571611 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a000f040 con 0x7f44a815cf10 2023-05-12T09:07:40.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.039+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1406571611 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a815db40 con 0x7f44a815cf10 2023-05-12T09:07:40.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.039+0000 7f44a57fa700 1 -- 172.21.15.116:0/1406571611 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000ce70 con 0x7f44a815cf10 2023-05-12T09:07:40.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.039+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1406571611 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a815d860 con 0x7f44a815cf10 2023-05-12T09:07:40.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.040+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1406571611 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a80cc670 con 0x7f44a815cf10 2023-05-12T09:07:40.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.041+0000 7f44a57fa700 1 -- 172.21.15.116:0/1406571611 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44a0014480 con 0x7f44a815cf10 2023-05-12T09:07:40.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.042+0000 7f44a57fa700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f448806ace0 0x7f448806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.042+0000 7f44a57fa700 1 -- 172.21.15.116:0/1406571611 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f44a0089f60 con 0x7f44a815cf10 2023-05-12T09:07:40.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.042+0000 7f44a7fff700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f448806ace0 0x7f448806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.043+0000 7f44a7fff700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f448806ace0 0x7f448806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f44980090b0 tx=0x7f4498008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:40.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.046+0000 7f44a57fa700 1 -- 172.21.15.116:0/1406571611 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f44a0054c80 con 0x7f44a815cf10 2023-05-12T09:07:40.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.236+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1406571611 --> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44a80cada0 con 0x7f448806ace0 2023-05-12T09:07:40.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.246+0000 7f44a57fa700 1 -- 172.21.15.116:0/1406571611 <== mgr.4106 v2:172.21.15.116:6832/3989593778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367556 (secure 0 0 0) 0x7f44a80cada0 con 0x7f448806ace0 2023-05-12T09:07:40.253 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:40.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.250+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1406571611 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f448806ace0 msgr2=0x7f448806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.250+0000 7f44ae5ff700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f448806ace0 0x7f448806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f44980090b0 tx=0x7f4498008030 comp rx=0 tx=0).stop 2023-05-12T09:07:40.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.250+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1406571611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a815cf10 msgr2=0x7f44a80b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.250+0000 7f44ae5ff700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a815cf10 0x7f44a80b2440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f44a000efc0 tx=0x7f44a000c0c0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.251+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1406571611 shutdown_connections 2023-05-12T09:07:40.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.251+0000 7f44ae5ff700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44a815cf10 0x7f44a80b2440 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.251+0000 7f44ae5ff700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f44a80adf70 0x7f44a80cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.251+0000 7f44ae5ff700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f448806ace0 0x7f448806d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.251+0000 7f44ae5ff700 1 --2- 172.21.15.116:0/1406571611 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f44a80cd760 0x7f44a814f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.251+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1406571611 >> 172.21.15.116:0/1406571611 conn(0x7f44a80cf720 msgr2=0x7f44a8159010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:40.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.251+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1406571611 shutdown_connections 2023-05-12T09:07:40.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.251+0000 7f44ae5ff700 1 -- 172.21.15.116:0/1406571611 wait complete. 2023-05-12T09:07:40.257 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2023-05-12T09:07:40.271 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-05-12T09:07:39.574259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67068,"kb_used_data":3196,"kb_used_omap":0,"kb_used_meta":63808,"kb_avail":754907652,"statfs":{"total":773094113280,"available":773025435648,"internally_reserved":0,"allocated":3272704,"data_stored":2023677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65339392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002942"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056869+0000","last_change":"2023-05-12T09:07:10.552182+0000","last_active":"2023-05-12T09:07:15.056869+0000","last_peered":"2023-05-12T09:07:15.056869+0000","last_clean":"2023-05-12T09:07:15.056869+0000","last_became_active":"2023-05-12T09:07:10.551926+0000","last_became_peered":"2023-05-12T09:07:10.551926+0000","last_unstale":"2023-05-12T09:07:15.056869+0000","last_undegraded":"2023-05-12T09:07:15.056869+0000","last_fullsized":"2023-05-12T09:07:15.056869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:06:10.158751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098056+0000","last_change":"2023-05-12T09:07:10.565186+0000","last_active":"2023-05-12T09:07:15.098056+0000","last_peered":"2023-05-12T09:07:15.098056+0000","last_clean":"2023-05-12T09:07:15.098056+0000","last_became_active":"2023-05-12T09:07:10.564909+0000","last_became_peered":"2023-05-12T09:07:10.564909+0000","last_unstale":"2023-05-12T09:07:15.098056+0000","last_undegraded":"2023-05-12T09:07:15.098056+0000","last_fullsized":"2023-05-12T09:07:15.098056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:58:56.835652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099010+0000","last_change":"2023-05-12T09:07:10.573666+0000","last_active":"2023-05-12T09:07:15.099010+0000","last_peered":"2023-05-12T09:07:15.099010+0000","last_clean":"2023-05-12T09:07:15.099010+0000","last_became_active":"2023-05-12T09:07:10.573426+0000","last_became_peered":"2023-05-12T09:07:10.573426+0000","last_unstale":"2023-05-12T09:07:15.099010+0000","last_undegraded":"2023-05-12T09:07:15.099010+0000","last_fullsized":"2023-05-12T09:07:15.099010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:31:46.429695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058452+0000","last_change":"2023-05-12T09:07:10.549143+0000","last_active":"2023-05-12T09:07:15.058452+0000","last_peered":"2023-05-12T09:07:15.058452+0000","last_clean":"2023-05-12T09:07:15.058452+0000","last_became_active":"2023-05-12T09:07:10.548812+0000","last_became_peered":"2023-05-12T09:07:10.548812+0000","last_unstale":"2023-05-12T09:07:15.058452+0000","last_undegraded":"2023-05-12T09:07:15.058452+0000","last_fullsized":"2023-05-12T09:07:15.058452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:58:25.521877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097939+0000","last_change":"2023-05-12T09:07:10.553470+0000","last_active":"2023-05-12T09:07:15.097939+0000","last_peered":"2023-05-12T09:07:15.097939+0000","last_clean":"2023-05-12T09:07:15.097939+0000","last_became_active":"2023-05-12T09:07:10.552853+0000","last_became_peered":"2023-05-12T09:07:10.552853+0000","last_unstale":"2023-05-12T09:07:15.097939+0000","last_undegraded":"2023-05-12T09:07:15.097939+0000","last_fullsized":"2023-05-12T09:07:15.097939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:46:06.379380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099031+0000","last_change":"2023-05-12T09:07:10.572964+0000","last_active":"2023-05-12T09:07:15.099031+0000","last_peered":"2023-05-12T09:07:15.099031+0000","last_clean":"2023-05-12T09:07:15.099031+0000","last_became_active":"2023-05-12T09:07:10.572655+0000","last_became_peered":"2023-05-12T09:07:10.572655+0000","last_unstale":"2023-05-12T09:07:15.099031+0000","last_undegraded":"2023-05-12T09:07:15.099031+0000","last_fullsized":"2023-05-12T09:07:15.099031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:54.558448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098226+0000","last_change":"2023-05-12T09:07:10.568411+0000","last_active":"2023-05-12T09:07:15.098226+0000","last_peered":"2023-05-12T09:07:15.098226+0000","last_clean":"2023-05-12T09:07:15.098226+0000","last_became_active":"2023-05-12T09:07:10.567921+0000","last_became_peered":"2023-05-12T09:07:10.567921+0000","last_unstale":"2023-05-12T09:07:15.098226+0000","last_undegraded":"2023-05-12T09:07:15.098226+0000","last_fullsized":"2023-05-12T09:07:15.098226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098049+0000","last_change":"2023-05-12T09:07:10.567670+0000","last_active":"2023-05-12T09:07:15.098049+0000","last_peered":"2023-05-12T09:07:15.098049+0000","last_clean":"2023-05-12T09:07:15.098049+0000","last_became_active":"2023-05-12T09:07:10.567354+0000","last_became_peered":"2023-05-12T09:07:10.567354+0000","last_unstale":"2023-05-12T09:07:15.098049+0000","last_undegraded":"2023-05-12T09:07:15.098049+0000","last_fullsized":"2023-05-12T09:07:15.098049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:24:11.877400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097017+0000","last_change":"2023-05-12T09:07:10.559800+0000","last_active":"2023-05-12T09:07:15.097017+0000","last_peered":"2023-05-12T09:07:15.097017+0000","last_clean":"2023-05-12T09:07:15.097017+0000","last_became_active":"2023-05-12T09:07:10.559373+0000","last_became_peered":"2023-05-12T09:07:10.559373+0000","last_unstale":"2023-05-12T09:07:15.097017+0000","last_undegraded":"2023-05-12T09:07:15.097017+0000","last_fullsized":"2023-05-12T09:07:15.097017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098405+0000","last_change":"2023-05-12T09:07:10.557392+0000","last_active":"2023-05-12T09:07:15.098405+0000","last_peered":"2023-05-12T09:07:15.098405+0000","last_clean":"2023-05-12T09:07:15.098405+0000","last_became_active":"2023-05-12T09:07:10.557036+0000","last_became_peered":"2023-05-12T09:07:10.557036+0000","last_unstale":"2023-05-12T09:07:15.098405+0000","last_undegraded":"2023-05-12T09:07:15.098405+0000","last_fullsized":"2023-05-12T09:07:15.098405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:01.116544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099397+0000","last_change":"2023-05-12T09:07:10.569606+0000","last_active":"2023-05-12T09:07:15.099397+0000","last_peered":"2023-05-12T09:07:15.099397+0000","last_clean":"2023-05-12T09:07:15.099397+0000","last_became_active":"2023-05-12T09:07:10.569341+0000","last_became_peered":"2023-05-12T09:07:10.569341+0000","last_unstale":"2023-05-12T09:07:15.099397+0000","last_undegraded":"2023-05-12T09:07:15.099397+0000","last_fullsized":"2023-05-12T09:07:15.099397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:10.845175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056685+0000","last_change":"2023-05-12T09:07:10.572853+0000","last_active":"2023-05-12T09:07:15.056685+0000","last_peered":"2023-05-12T09:07:15.056685+0000","last_clean":"2023-05-12T09:07:15.056685+0000","last_became_active":"2023-05-12T09:07:10.572602+0000","last_became_peered":"2023-05-12T09:07:10.572602+0000","last_unstale":"2023-05-12T09:07:15.056685+0000","last_undegraded":"2023-05-12T09:07:15.056685+0000","last_fullsized":"2023-05-12T09:07:15.056685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:27:20.881878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056707+0000","last_change":"2023-05-12T09:07:10.556787+0000","last_active":"2023-05-12T09:07:15.056707+0000","last_peered":"2023-05-12T09:07:15.056707+0000","last_clean":"2023-05-12T09:07:15.056707+0000","last_became_active":"2023-05-12T09:07:10.556536+0000","last_became_peered":"2023-05-12T09:07:10.556536+0000","last_unstale":"2023-05-12T09:07:15.056707+0000","last_undegraded":"2023-05-12T09:07:15.056707+0000","last_fullsized":"2023-05-12T09:07:15.056707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:49.471362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098243+0000","last_change":"2023-05-12T09:07:10.552674+0000","last_active":"2023-05-12T09:07:15.098243+0000","last_peered":"2023-05-12T09:07:15.098243+0000","last_clean":"2023-05-12T09:07:15.098243+0000","last_became_active":"2023-05-12T09:07:10.552398+0000","last_became_peered":"2023-05-12T09:07:10.552398+0000","last_unstale":"2023-05-12T09:07:15.098243+0000","last_undegraded":"2023-05-12T09:07:15.098243+0000","last_fullsized":"2023-05-12T09:07:15.098243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:11.449230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097981+0000","last_change":"2023-05-12T09:07:10.568235+0000","last_active":"2023-05-12T09:07:15.097981+0000","last_peered":"2023-05-12T09:07:15.097981+0000","last_clean":"2023-05-12T09:07:15.097981+0000","last_became_active":"2023-05-12T09:07:10.567553+0000","last_became_peered":"2023-05-12T09:07:10.567553+0000","last_unstale":"2023-05-12T09:07:15.097981+0000","last_undegraded":"2023-05-12T09:07:15.097981+0000","last_fullsized":"2023-05-12T09:07:15.097981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099513+0000","last_change":"2023-05-12T09:07:10.572841+0000","last_active":"2023-05-12T09:07:15.099513+0000","last_peered":"2023-05-12T09:07:15.099513+0000","last_clean":"2023-05-12T09:07:15.099513+0000","last_became_active":"2023-05-12T09:07:10.572568+0000","last_became_peered":"2023-05-12T09:07:10.572568+0000","last_unstale":"2023-05-12T09:07:15.099513+0000","last_undegraded":"2023-05-12T09:07:15.099513+0000","last_fullsized":"2023-05-12T09:07:15.099513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:58.012080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097155+0000","last_change":"2023-05-12T09:07:10.547094+0000","last_active":"2023-05-12T09:07:15.097155+0000","last_peered":"2023-05-12T09:07:15.097155+0000","last_clean":"2023-05-12T09:07:15.097155+0000","last_became_active":"2023-05-12T09:07:10.546792+0000","last_became_peered":"2023-05-12T09:07:10.546792+0000","last_unstale":"2023-05-12T09:07:15.097155+0000","last_undegraded":"2023-05-12T09:07:15.097155+0000","last_fullsized":"2023-05-12T09:07:15.097155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099265+0000","last_change":"2023-05-12T09:07:10.565515+0000","last_active":"2023-05-12T09:07:15.099265+0000","last_peered":"2023-05-12T09:07:15.099265+0000","last_clean":"2023-05-12T09:07:15.099265+0000","last_became_active":"2023-05-12T09:07:10.565207+0000","last_became_peered":"2023-05-12T09:07:10.565207+0000","last_unstale":"2023-05-12T09:07:15.099265+0000","last_undegraded":"2023-05-12T09:07:15.099265+0000","last_fullsized":"2023-05-12T09:07:15.099265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:49.560027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057002+0000","last_change":"2023-05-12T09:07:10.544063+0000","last_active":"2023-05-12T09:07:15.057002+0000","last_peered":"2023-05-12T09:07:15.057002+0000","last_clean":"2023-05-12T09:07:15.057002+0000","last_became_active":"2023-05-12T09:07:10.543808+0000","last_became_peered":"2023-05-12T09:07:10.543808+0000","last_unstale":"2023-05-12T09:07:15.057002+0000","last_undegraded":"2023-05-12T09:07:15.057002+0000","last_fullsized":"2023-05-12T09:07:15.057002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:31:21.496742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099598+0000","last_change":"2023-05-12T09:07:10.572909+0000","last_active":"2023-05-12T09:07:15.099598+0000","last_peered":"2023-05-12T09:07:15.099598+0000","last_clean":"2023-05-12T09:07:15.099598+0000","last_became_active":"2023-05-12T09:07:10.572159+0000","last_became_peered":"2023-05-12T09:07:10.572159+0000","last_unstale":"2023-05-12T09:07:15.099598+0000","last_undegraded":"2023-05-12T09:07:15.099598+0000","last_fullsized":"2023-05-12T09:07:15.099598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:08.244006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097642+0000","last_change":"2023-05-12T09:07:10.561695+0000","last_active":"2023-05-12T09:07:15.097642+0000","last_peered":"2023-05-12T09:07:15.097642+0000","last_clean":"2023-05-12T09:07:15.097642+0000","last_became_active":"2023-05-12T09:07:10.561421+0000","last_became_peered":"2023-05-12T09:07:10.561421+0000","last_unstale":"2023-05-12T09:07:15.097642+0000","last_undegraded":"2023-05-12T09:07:15.097642+0000","last_fullsized":"2023-05-12T09:07:15.097642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097054+0000","last_change":"2023-05-12T09:07:10.556885+0000","last_active":"2023-05-12T09:07:15.097054+0000","last_peered":"2023-05-12T09:07:15.097054+0000","last_clean":"2023-05-12T09:07:15.097054+0000","last_became_active":"2023-05-12T09:07:10.556648+0000","last_became_peered":"2023-05-12T09:07:10.556648+0000","last_unstale":"2023-05-12T09:07:15.097054+0000","last_undegraded":"2023-05-12T09:07:15.097054+0000","last_fullsized":"2023-05-12T09:07:15.097054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:29.216512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058586+0000","last_change":"2023-05-12T09:07:10.552009+0000","last_active":"2023-05-12T09:07:15.058586+0000","last_peered":"2023-05-12T09:07:15.058586+0000","last_clean":"2023-05-12T09:07:15.058586+0000","last_became_active":"2023-05-12T09:07:10.551526+0000","last_became_peered":"2023-05-12T09:07:10.551526+0000","last_unstale":"2023-05-12T09:07:15.058586+0000","last_undegraded":"2023-05-12T09:07:15.058586+0000","last_fullsized":"2023-05-12T09:07:15.058586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:29:40.632493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097137+0000","last_change":"2023-05-12T09:07:10.565180+0000","last_active":"2023-05-12T09:07:15.097137+0000","last_peered":"2023-05-12T09:07:15.097137+0000","last_clean":"2023-05-12T09:07:15.097137+0000","last_became_active":"2023-05-12T09:07:10.564257+0000","last_became_peered":"2023-05-12T09:07:10.564257+0000","last_unstale":"2023-05-12T09:07:15.097137+0000","last_undegraded":"2023-05-12T09:07:15.097137+0000","last_fullsized":"2023-05-12T09:07:15.097137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:01.116544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097918+0000","last_change":"2023-05-12T09:07:10.566527+0000","last_active":"2023-05-12T09:07:15.097918+0000","last_peered":"2023-05-12T09:07:15.097918+0000","last_clean":"2023-05-12T09:07:15.097918+0000","last_became_active":"2023-05-12T09:07:10.566257+0000","last_became_peered":"2023-05-12T09:07:10.566257+0000","last_unstale":"2023-05-12T09:07:15.097918+0000","last_undegraded":"2023-05-12T09:07:15.097918+0000","last_fullsized":"2023-05-12T09:07:15.097918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097456+0000","last_change":"2023-05-12T09:07:10.569619+0000","last_active":"2023-05-12T09:07:15.097456+0000","last_peered":"2023-05-12T09:07:15.097456+0000","last_clean":"2023-05-12T09:07:15.097456+0000","last_became_active":"2023-05-12T09:07:10.569336+0000","last_became_peered":"2023-05-12T09:07:10.569336+0000","last_unstale":"2023-05-12T09:07:15.097456+0000","last_undegraded":"2023-05-12T09:07:15.097456+0000","last_fullsized":"2023-05-12T09:07:15.097456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099394+0000","last_change":"2023-05-12T09:07:10.560495+0000","last_active":"2023-05-12T09:07:15.099394+0000","last_peered":"2023-05-12T09:07:15.099394+0000","last_clean":"2023-05-12T09:07:15.099394+0000","last_became_active":"2023-05-12T09:07:10.560049+0000","last_became_peered":"2023-05-12T09:07:10.560049+0000","last_unstale":"2023-05-12T09:07:15.099394+0000","last_undegraded":"2023-05-12T09:07:15.099394+0000","last_fullsized":"2023-05-12T09:07:15.099394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:27:05.047259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099295+0000","last_change":"2023-05-12T09:07:14.597955+0000","last_active":"2023-05-12T09:07:15.099295+0000","last_peered":"2023-05-12T09:07:15.099295+0000","last_clean":"2023-05-12T09:07:15.099295+0000","last_became_active":"2023-05-12T09:07:14.597429+0000","last_became_peered":"2023-05-12T09:07:14.597429+0000","last_unstale":"2023-05-12T09:07:15.099295+0000","last_undegraded":"2023-05-12T09:07:15.099295+0000","last_fullsized":"2023-05-12T09:07:15.099295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:42.341874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098315+0000","last_change":"2023-05-12T09:07:10.075419+0000","last_active":"2023-05-12T09:07:15.098315+0000","last_peered":"2023-05-12T09:07:15.098315+0000","last_clean":"2023-05-12T09:07:15.098315+0000","last_became_active":"2023-05-12T09:07:10.075045+0000","last_became_peered":"2023-05-12T09:07:10.075045+0000","last_unstale":"2023-05-12T09:07:15.098315+0000","last_undegraded":"2023-05-12T09:07:15.098315+0000","last_fullsized":"2023-05-12T09:07:15.098315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:46:05.372940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059049+0000","last_change":"2023-05-12T09:07:10.556737+0000","last_active":"2023-05-12T09:07:15.059049+0000","last_peered":"2023-05-12T09:07:15.059049+0000","last_clean":"2023-05-12T09:07:15.059049+0000","last_became_active":"2023-05-12T09:07:10.556495+0000","last_became_peered":"2023-05-12T09:07:10.556495+0000","last_unstale":"2023-05-12T09:07:15.059049+0000","last_undegraded":"2023-05-12T09:07:15.059049+0000","last_fullsized":"2023-05-12T09:07:15.059049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:49.560027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058830+0000","last_change":"2023-05-12T09:07:14.581307+0000","last_active":"2023-05-12T09:07:15.058830+0000","last_peered":"2023-05-12T09:07:15.058830+0000","last_clean":"2023-05-12T09:07:15.058830+0000","last_became_active":"2023-05-12T09:07:14.580877+0000","last_became_peered":"2023-05-12T09:07:14.580877+0000","last_unstale":"2023-05-12T09:07:15.058830+0000","last_undegraded":"2023-05-12T09:07:15.058830+0000","last_fullsized":"2023-05-12T09:07:15.058830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:19:01.287710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096438+0000","last_change":"2023-05-12T09:07:10.072878+0000","last_active":"2023-05-12T09:07:15.096438+0000","last_peered":"2023-05-12T09:07:15.096438+0000","last_clean":"2023-05-12T09:07:15.096438+0000","last_became_active":"2023-05-12T09:07:10.072354+0000","last_became_peered":"2023-05-12T09:07:10.072354+0000","last_unstale":"2023-05-12T09:07:15.096438+0000","last_undegraded":"2023-05-12T09:07:15.096438+0000","last_fullsized":"2023-05-12T09:07:15.096438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:58:55.829212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097423+0000","last_change":"2023-05-12T09:07:10.560312+0000","last_active":"2023-05-12T09:07:15.097423+0000","last_peered":"2023-05-12T09:07:15.097423+0000","last_clean":"2023-05-12T09:07:15.097423+0000","last_became_active":"2023-05-12T09:07:10.560026+0000","last_became_peered":"2023-05-12T09:07:10.560026+0000","last_unstale":"2023-05-12T09:07:15.097423+0000","last_undegraded":"2023-05-12T09:07:15.097423+0000","last_fullsized":"2023-05-12T09:07:15.097423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:51.153107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097572+0000","last_change":"2023-05-12T09:07:14.588155+0000","last_active":"2023-05-12T09:07:15.097572+0000","last_peered":"2023-05-12T09:07:15.097572+0000","last_clean":"2023-05-12T09:07:15.097572+0000","last_became_active":"2023-05-12T09:07:14.587745+0000","last_became_peered":"2023-05-12T09:07:14.587745+0000","last_unstale":"2023-05-12T09:07:15.097572+0000","last_undegraded":"2023-05-12T09:07:15.097572+0000","last_fullsized":"2023-05-12T09:07:15.097572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:42:22.571545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058871+0000","last_change":"2023-05-12T09:07:10.080957+0000","last_active":"2023-05-12T09:07:15.058871+0000","last_peered":"2023-05-12T09:07:15.058871+0000","last_clean":"2023-05-12T09:07:15.058871+0000","last_became_active":"2023-05-12T09:07:10.080662+0000","last_became_peered":"2023-05-12T09:07:10.080662+0000","last_unstale":"2023-05-12T09:07:15.058871+0000","last_undegraded":"2023-05-12T09:07:15.058871+0000","last_fullsized":"2023-05-12T09:07:15.058871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:52:11.295716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059156+0000","last_change":"2023-05-12T09:07:10.563118+0000","last_active":"2023-05-12T09:07:15.059156+0000","last_peered":"2023-05-12T09:07:15.059156+0000","last_clean":"2023-05-12T09:07:15.059156+0000","last_became_active":"2023-05-12T09:07:10.562749+0000","last_became_peered":"2023-05-12T09:07:10.562749+0000","last_unstale":"2023-05-12T09:07:15.059156+0000","last_undegraded":"2023-05-12T09:07:15.059156+0000","last_fullsized":"2023-05-12T09:07:15.059156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:13:26.432067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058101+0000","last_change":"2023-05-12T09:07:14.581060+0000","last_active":"2023-05-12T09:07:15.058101+0000","last_peered":"2023-05-12T09:07:15.058101+0000","last_clean":"2023-05-12T09:07:15.058101+0000","last_became_active":"2023-05-12T09:07:14.580610+0000","last_became_peered":"2023-05-12T09:07:14.580610+0000","last_unstale":"2023-05-12T09:07:15.058101+0000","last_undegraded":"2023-05-12T09:07:15.058101+0000","last_fullsized":"2023-05-12T09:07:15.058101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T21:04:50.690412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097268+0000","last_change":"2023-05-12T09:07:10.068667+0000","last_active":"2023-05-12T09:07:15.097268+0000","last_peered":"2023-05-12T09:07:15.097268+0000","last_clean":"2023-05-12T09:07:15.097268+0000","last_became_active":"2023-05-12T09:07:10.068386+0000","last_became_peered":"2023-05-12T09:07:10.068386+0000","last_unstale":"2023-05-12T09:07:15.097268+0000","last_undegraded":"2023-05-12T09:07:15.097268+0000","last_fullsized":"2023-05-12T09:07:15.097268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:34:33.760261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058741+0000","last_change":"2023-05-12T09:07:10.565793+0000","last_active":"2023-05-12T09:07:15.058741+0000","last_peered":"2023-05-12T09:07:15.058741+0000","last_clean":"2023-05-12T09:07:15.058741+0000","last_became_active":"2023-05-12T09:07:10.565550+0000","last_became_peered":"2023-05-12T09:07:10.565550+0000","last_unstale":"2023-05-12T09:07:15.058741+0000","last_undegraded":"2023-05-12T09:07:15.058741+0000","last_fullsized":"2023-05-12T09:07:15.058741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:14:42.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096926+0000","last_change":"2023-05-12T09:07:14.595717+0000","last_active":"2023-05-12T09:07:15.096926+0000","last_peered":"2023-05-12T09:07:15.096926+0000","last_clean":"2023-05-12T09:07:15.096926+0000","last_became_active":"2023-05-12T09:07:14.595257+0000","last_became_peered":"2023-05-12T09:07:14.595257+0000","last_unstale":"2023-05-12T09:07:15.096926+0000","last_undegraded":"2023-05-12T09:07:15.096926+0000","last_fullsized":"2023-05-12T09:07:15.096926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:14.949895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098244+0000","last_change":"2023-05-12T09:07:10.070218+0000","last_active":"2023-05-12T09:07:15.098244+0000","last_peered":"2023-05-12T09:07:15.098244+0000","last_clean":"2023-05-12T09:07:15.098244+0000","last_became_active":"2023-05-12T09:07:10.069889+0000","last_became_peered":"2023-05-12T09:07:10.069889+0000","last_unstale":"2023-05-12T09:07:15.098244+0000","last_undegraded":"2023-05-12T09:07:15.098244+0000","last_fullsized":"2023-05-12T09:07:15.098244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:42.081422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058443+0000","last_change":"2023-05-12T09:07:10.560559+0000","last_active":"2023-05-12T09:07:15.058443+0000","last_peered":"2023-05-12T09:07:15.058443+0000","last_clean":"2023-05-12T09:07:15.058443+0000","last_became_active":"2023-05-12T09:07:10.560373+0000","last_became_peered":"2023-05-12T09:07:10.560373+0000","last_unstale":"2023-05-12T09:07:15.058443+0000","last_undegraded":"2023-05-12T09:07:15.058443+0000","last_fullsized":"2023-05-12T09:07:15.058443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:39.228924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059243+0000","last_change":"2023-05-12T09:07:14.598817+0000","last_active":"2023-05-12T09:07:15.059243+0000","last_peered":"2023-05-12T09:07:15.059243+0000","last_clean":"2023-05-12T09:07:15.059243+0000","last_became_active":"2023-05-12T09:07:14.598424+0000","last_became_peered":"2023-05-12T09:07:14.598424+0000","last_unstale":"2023-05-12T09:07:15.059243+0000","last_undegraded":"2023-05-12T09:07:15.059243+0000","last_fullsized":"2023-05-12T09:07:15.059243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:14.345840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097760+0000","last_change":"2023-05-12T09:07:10.079800+0000","last_active":"2023-05-12T09:07:15.097760+0000","last_peered":"2023-05-12T09:07:15.097760+0000","last_clean":"2023-05-12T09:07:15.097760+0000","last_became_active":"2023-05-12T09:07:10.079511+0000","last_became_peered":"2023-05-12T09:07:10.079511+0000","last_unstale":"2023-05-12T09:07:15.097760+0000","last_undegraded":"2023-05-12T09:07:15.097760+0000","last_fullsized":"2023-05-12T09:07:15.097760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:12.733875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097492+0000","last_change":"2023-05-12T09:07:10.567328+0000","last_active":"2023-05-12T09:07:15.097492+0000","last_peered":"2023-05-12T09:07:15.097492+0000","last_clean":"2023-05-12T09:07:15.097492+0000","last_became_active":"2023-05-12T09:07:10.566882+0000","last_became_peered":"2023-05-12T09:07:10.566882+0000","last_unstale":"2023-05-12T09:07:15.097492+0000","last_undegraded":"2023-05-12T09:07:15.097492+0000","last_fullsized":"2023-05-12T09:07:15.097492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:27:05.047259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097631+0000","last_change":"2023-05-12T09:07:14.585280+0000","last_active":"2023-05-12T09:07:15.097631+0000","last_peered":"2023-05-12T09:07:15.097631+0000","last_clean":"2023-05-12T09:07:15.097631+0000","last_became_active":"2023-05-12T09:07:14.584873+0000","last_became_peered":"2023-05-12T09:07:14.584873+0000","last_unstale":"2023-05-12T09:07:15.097631+0000","last_undegraded":"2023-05-12T09:07:15.097631+0000","last_fullsized":"2023-05-12T09:07:15.097631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:17.240980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:29.211417+0000","last_change":"2023-05-12T09:07:10.069756+0000","last_active":"2023-05-12T09:07:29.211417+0000","last_peered":"2023-05-12T09:07:29.211417+0000","last_clean":"2023-05-12T09:07:29.211417+0000","last_became_active":"2023-05-12T09:07:10.069451+0000","last_became_peered":"2023-05-12T09:07:10.069451+0000","last_unstale":"2023-05-12T09:07:29.211417+0000","last_undegraded":"2023-05-12T09:07:29.211417+0000","last_fullsized":"2023-05-12T09:07:29.211417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:09:04.714440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098689+0000","last_change":"2023-05-12T09:07:10.565252+0000","last_active":"2023-05-12T09:07:15.098689+0000","last_peered":"2023-05-12T09:07:15.098689+0000","last_clean":"2023-05-12T09:07:15.098689+0000","last_became_active":"2023-05-12T09:07:10.564960+0000","last_became_peered":"2023-05-12T09:07:10.564960+0000","last_unstale":"2023-05-12T09:07:15.098689+0000","last_undegraded":"2023-05-12T09:07:15.098689+0000","last_fullsized":"2023-05-12T09:07:15.098689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:08:57.701341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099521+0000","last_change":"2023-05-12T09:07:14.595988+0000","last_active":"2023-05-12T09:07:15.099521+0000","last_peered":"2023-05-12T09:07:15.099521+0000","last_clean":"2023-05-12T09:07:15.099521+0000","last_became_active":"2023-05-12T09:07:14.595488+0000","last_became_peered":"2023-05-12T09:07:14.595488+0000","last_unstale":"2023-05-12T09:07:15.099521+0000","last_undegraded":"2023-05-12T09:07:15.099521+0000","last_fullsized":"2023-05-12T09:07:15.099521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:17.240980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097496+0000","last_change":"2023-05-12T09:07:10.079093+0000","last_active":"2023-05-12T09:07:15.097496+0000","last_peered":"2023-05-12T09:07:15.097496+0000","last_clean":"2023-05-12T09:07:15.097496+0000","last_became_active":"2023-05-12T09:07:10.078795+0000","last_became_peered":"2023-05-12T09:07:10.078795+0000","last_unstale":"2023-05-12T09:07:15.097496+0000","last_undegraded":"2023-05-12T09:07:15.097496+0000","last_fullsized":"2023-05-12T09:07:15.097496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:21.054528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058869+0000","last_change":"2023-05-12T09:07:10.565215+0000","last_active":"2023-05-12T09:07:15.058869+0000","last_peered":"2023-05-12T09:07:15.058869+0000","last_clean":"2023-05-12T09:07:15.058869+0000","last_became_active":"2023-05-12T09:07:10.564963+0000","last_became_peered":"2023-05-12T09:07:10.564963+0000","last_unstale":"2023-05-12T09:07:15.058869+0000","last_undegraded":"2023-05-12T09:07:15.058869+0000","last_fullsized":"2023-05-12T09:07:15.058869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:35.146554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059099+0000","last_change":"2023-05-12T09:07:14.584072+0000","last_active":"2023-05-12T09:07:15.059099+0000","last_peered":"2023-05-12T09:07:15.059099+0000","last_clean":"2023-05-12T09:07:15.059099+0000","last_became_active":"2023-05-12T09:07:14.583584+0000","last_became_peered":"2023-05-12T09:07:14.583584+0000","last_unstale":"2023-05-12T09:07:15.059099+0000","last_undegraded":"2023-05-12T09:07:15.059099+0000","last_fullsized":"2023-05-12T09:07:15.059099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:42.341874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097258+0000","last_change":"2023-05-12T09:07:10.066744+0000","last_active":"2023-05-12T09:07:15.097258+0000","last_peered":"2023-05-12T09:07:15.097258+0000","last_clean":"2023-05-12T09:07:15.097258+0000","last_became_active":"2023-05-12T09:07:10.066464+0000","last_became_peered":"2023-05-12T09:07:10.066464+0000","last_unstale":"2023-05-12T09:07:15.097258+0000","last_undegraded":"2023-05-12T09:07:15.097258+0000","last_fullsized":"2023-05-12T09:07:15.097258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:38:11.562367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099293+0000","last_change":"2023-05-12T09:07:10.560309+0000","last_active":"2023-05-12T09:07:15.099293+0000","last_peered":"2023-05-12T09:07:15.099293+0000","last_clean":"2023-05-12T09:07:15.099293+0000","last_became_active":"2023-05-12T09:07:10.559669+0000","last_became_peered":"2023-05-12T09:07:10.559669+0000","last_unstale":"2023-05-12T09:07:15.099293+0000","last_undegraded":"2023-05-12T09:07:15.099293+0000","last_fullsized":"2023-05-12T09:07:15.099293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059044+0000","last_change":"2023-05-12T09:07:14.583910+0000","last_active":"2023-05-12T09:07:15.059044+0000","last_peered":"2023-05-12T09:07:15.059044+0000","last_clean":"2023-05-12T09:07:15.059044+0000","last_became_active":"2023-05-12T09:07:14.583260+0000","last_became_peered":"2023-05-12T09:07:14.583260+0000","last_unstale":"2023-05-12T09:07:15.059044+0000","last_undegraded":"2023-05-12T09:07:15.059044+0000","last_fullsized":"2023-05-12T09:07:15.059044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:11.744671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098106+0000","last_change":"2023-05-12T09:07:10.078179+0000","last_active":"2023-05-12T09:07:15.098106+0000","last_peered":"2023-05-12T09:07:15.098106+0000","last_clean":"2023-05-12T09:07:15.098106+0000","last_became_active":"2023-05-12T09:07:10.077837+0000","last_became_peered":"2023-05-12T09:07:10.077837+0000","last_unstale":"2023-05-12T09:07:15.098106+0000","last_undegraded":"2023-05-12T09:07:15.098106+0000","last_fullsized":"2023-05-12T09:07:15.098106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:28.210072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097897+0000","last_change":"2023-05-12T09:07:10.560712+0000","last_active":"2023-05-12T09:07:15.097897+0000","last_peered":"2023-05-12T09:07:15.097897+0000","last_clean":"2023-05-12T09:07:15.097897+0000","last_became_active":"2023-05-12T09:07:10.560481+0000","last_became_peered":"2023-05-12T09:07:10.560481+0000","last_unstale":"2023-05-12T09:07:15.097897+0000","last_undegraded":"2023-05-12T09:07:15.097897+0000","last_fullsized":"2023-05-12T09:07:15.097897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:37:03.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097898+0000","last_change":"2023-05-12T09:07:14.590864+0000","last_active":"2023-05-12T09:07:15.097898+0000","last_peered":"2023-05-12T09:07:15.097898+0000","last_clean":"2023-05-12T09:07:15.097898+0000","last_became_active":"2023-05-12T09:07:14.590469+0000","last_became_peered":"2023-05-12T09:07:14.590469+0000","last_unstale":"2023-05-12T09:07:15.097898+0000","last_undegraded":"2023-05-12T09:07:15.097898+0000","last_fullsized":"2023-05-12T09:07:15.097898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:28:30.258916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058132+0000","last_change":"2023-05-12T09:07:10.076195+0000","last_active":"2023-05-12T09:07:15.058132+0000","last_peered":"2023-05-12T09:07:15.058132+0000","last_clean":"2023-05-12T09:07:15.058132+0000","last_became_active":"2023-05-12T09:07:10.075812+0000","last_became_peered":"2023-05-12T09:07:10.075812+0000","last_unstale":"2023-05-12T09:07:15.058132+0000","last_undegraded":"2023-05-12T09:07:15.058132+0000","last_fullsized":"2023-05-12T09:07:15.058132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:18:52.025513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059357+0000","last_change":"2023-05-12T09:07:10.563115+0000","last_active":"2023-05-12T09:07:15.059357+0000","last_peered":"2023-05-12T09:07:15.059357+0000","last_clean":"2023-05-12T09:07:15.059357+0000","last_became_active":"2023-05-12T09:07:10.562845+0000","last_became_peered":"2023-05-12T09:07:10.562845+0000","last_unstale":"2023-05-12T09:07:15.059357+0000","last_undegraded":"2023-05-12T09:07:15.059357+0000","last_fullsized":"2023-05-12T09:07:15.059357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:20:22.733100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098372+0000","last_change":"2023-05-12T09:07:14.591597+0000","last_active":"2023-05-12T09:07:15.098372+0000","last_peered":"2023-05-12T09:07:15.098372+0000","last_clean":"2023-05-12T09:07:15.098372+0000","last_became_active":"2023-05-12T09:07:14.591185+0000","last_became_peered":"2023-05-12T09:07:14.591185+0000","last_unstale":"2023-05-12T09:07:15.098372+0000","last_undegraded":"2023-05-12T09:07:15.098372+0000","last_fullsized":"2023-05-12T09:07:15.098372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:38:16.069472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097483+0000","last_change":"2023-05-12T09:07:10.079275+0000","last_active":"2023-05-12T09:07:15.097483+0000","last_peered":"2023-05-12T09:07:15.097483+0000","last_clean":"2023-05-12T09:07:15.097483+0000","last_became_active":"2023-05-12T09:07:10.078985+0000","last_became_peered":"2023-05-12T09:07:10.078985+0000","last_unstale":"2023-05-12T09:07:15.097483+0000","last_undegraded":"2023-05-12T09:07:15.097483+0000","last_fullsized":"2023-05-12T09:07:15.097483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:29:57.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097914+0000","last_change":"2023-05-12T09:07:10.558991+0000","last_active":"2023-05-12T09:07:15.097914+0000","last_peered":"2023-05-12T09:07:15.097914+0000","last_clean":"2023-05-12T09:07:15.097914+0000","last_became_active":"2023-05-12T09:07:10.558695+0000","last_became_peered":"2023-05-12T09:07:10.558695+0000","last_unstale":"2023-05-12T09:07:15.097914+0000","last_undegraded":"2023-05-12T09:07:15.097914+0000","last_fullsized":"2023-05-12T09:07:15.097914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:00:26.351184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056464+0000","last_change":"2023-05-12T09:07:14.586265+0000","last_active":"2023-05-12T09:07:15.056464+0000","last_peered":"2023-05-12T09:07:15.056464+0000","last_clean":"2023-05-12T09:07:15.056464+0000","last_became_active":"2023-05-12T09:07:14.585710+0000","last_became_peered":"2023-05-12T09:07:14.585710+0000","last_unstale":"2023-05-12T09:07:15.056464+0000","last_undegraded":"2023-05-12T09:07:15.056464+0000","last_fullsized":"2023-05-12T09:07:15.056464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:05:38.749407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097889+0000","last_change":"2023-05-12T09:07:10.079611+0000","last_active":"2023-05-12T09:07:15.097889+0000","last_peered":"2023-05-12T09:07:15.097889+0000","last_clean":"2023-05-12T09:07:15.097889+0000","last_became_active":"2023-05-12T09:07:10.079324+0000","last_became_peered":"2023-05-12T09:07:10.079324+0000","last_unstale":"2023-05-12T09:07:15.097889+0000","last_undegraded":"2023-05-12T09:07:15.097889+0000","last_fullsized":"2023-05-12T09:07:15.097889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:34.152879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098310+0000","last_change":"2023-05-12T09:07:10.569420+0000","last_active":"2023-05-12T09:07:15.098310+0000","last_peered":"2023-05-12T09:07:15.098310+0000","last_clean":"2023-05-12T09:07:15.098310+0000","last_became_active":"2023-05-12T09:07:10.569160+0000","last_became_peered":"2023-05-12T09:07:10.569160+0000","last_unstale":"2023-05-12T09:07:15.098310+0000","last_undegraded":"2023-05-12T09:07:15.098310+0000","last_fullsized":"2023-05-12T09:07:15.098310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:01:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056628+0000","last_change":"2023-05-12T09:07:14.585639+0000","last_active":"2023-05-12T09:07:15.056628+0000","last_peered":"2023-05-12T09:07:15.056628+0000","last_clean":"2023-05-12T09:07:15.056628+0000","last_became_active":"2023-05-12T09:07:14.585153+0000","last_became_peered":"2023-05-12T09:07:14.585153+0000","last_unstale":"2023-05-12T09:07:15.056628+0000","last_undegraded":"2023-05-12T09:07:15.056628+0000","last_fullsized":"2023-05-12T09:07:15.056628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:02:03.620298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097546+0000","last_change":"2023-05-12T09:07:10.073391+0000","last_active":"2023-05-12T09:07:15.097546+0000","last_peered":"2023-05-12T09:07:15.097546+0000","last_clean":"2023-05-12T09:07:15.097546+0000","last_became_active":"2023-05-12T09:07:10.073069+0000","last_became_peered":"2023-05-12T09:07:10.073069+0000","last_unstale":"2023-05-12T09:07:15.097546+0000","last_undegraded":"2023-05-12T09:07:15.097546+0000","last_fullsized":"2023-05-12T09:07:15.097546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:24.289481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058350+0000","last_change":"2023-05-12T09:07:10.567111+0000","last_active":"2023-05-12T09:07:15.058350+0000","last_peered":"2023-05-12T09:07:15.058350+0000","last_clean":"2023-05-12T09:07:15.058350+0000","last_became_active":"2023-05-12T09:07:10.566663+0000","last_became_peered":"2023-05-12T09:07:10.566663+0000","last_unstale":"2023-05-12T09:07:15.058350+0000","last_undegraded":"2023-05-12T09:07:15.058350+0000","last_fullsized":"2023-05-12T09:07:15.058350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:32:58.490075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056879+0000","last_change":"2023-05-12T09:07:14.591606+0000","last_active":"2023-05-12T09:07:15.056879+0000","last_peered":"2023-05-12T09:07:15.056879+0000","last_clean":"2023-05-12T09:07:15.056879+0000","last_became_active":"2023-05-12T09:07:14.591207+0000","last_became_peered":"2023-05-12T09:07:14.591207+0000","last_unstale":"2023-05-12T09:07:15.056879+0000","last_undegraded":"2023-05-12T09:07:15.056879+0000","last_fullsized":"2023-05-12T09:07:15.056879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:47:06.214488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097650+0000","last_change":"2023-05-12T09:07:10.072631+0000","last_active":"2023-05-12T09:07:15.097650+0000","last_peered":"2023-05-12T09:07:15.097650+0000","last_clean":"2023-05-12T09:07:15.097650+0000","last_became_active":"2023-05-12T09:07:10.072337+0000","last_became_peered":"2023-05-12T09:07:10.072337+0000","last_unstale":"2023-05-12T09:07:15.097650+0000","last_undegraded":"2023-05-12T09:07:15.097650+0000","last_fullsized":"2023-05-12T09:07:15.097650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:57:12.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098158+0000","last_change":"2023-05-12T09:07:10.565145+0000","last_active":"2023-05-12T09:07:15.098158+0000","last_peered":"2023-05-12T09:07:15.098158+0000","last_clean":"2023-05-12T09:07:15.098158+0000","last_became_active":"2023-05-12T09:07:10.564875+0000","last_became_peered":"2023-05-12T09:07:10.564875+0000","last_unstale":"2023-05-12T09:07:15.098158+0000","last_undegraded":"2023-05-12T09:07:15.098158+0000","last_fullsized":"2023-05-12T09:07:15.098158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:19.840466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056750+0000","last_change":"2023-05-12T09:07:14.587809+0000","last_active":"2023-05-12T09:07:15.056750+0000","last_peered":"2023-05-12T09:07:15.056750+0000","last_clean":"2023-05-12T09:07:15.056750+0000","last_became_active":"2023-05-12T09:07:14.587214+0000","last_became_peered":"2023-05-12T09:07:14.587214+0000","last_unstale":"2023-05-12T09:07:15.056750+0000","last_undegraded":"2023-05-12T09:07:15.056750+0000","last_fullsized":"2023-05-12T09:07:15.056750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:13:57.325469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059145+0000","last_change":"2023-05-12T09:07:10.080418+0000","last_active":"2023-05-12T09:07:15.059145+0000","last_peered":"2023-05-12T09:07:15.059145+0000","last_clean":"2023-05-12T09:07:15.059145+0000","last_became_active":"2023-05-12T09:07:10.080097+0000","last_became_peered":"2023-05-12T09:07:10.080097+0000","last_unstale":"2023-05-12T09:07:15.059145+0000","last_undegraded":"2023-05-12T09:07:15.059145+0000","last_fullsized":"2023-05-12T09:07:15.059145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:36.409374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098730+0000","last_change":"2023-05-12T09:07:10.572418+0000","last_active":"2023-05-12T09:07:15.098730+0000","last_peered":"2023-05-12T09:07:15.098730+0000","last_clean":"2023-05-12T09:07:15.098730+0000","last_became_active":"2023-05-12T09:07:10.571808+0000","last_became_peered":"2023-05-12T09:07:10.571808+0000","last_unstale":"2023-05-12T09:07:15.098730+0000","last_undegraded":"2023-05-12T09:07:15.098730+0000","last_fullsized":"2023-05-12T09:07:15.098730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:41.253320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097248+0000","last_change":"2023-05-12T09:07:14.590970+0000","last_active":"2023-05-12T09:07:15.097248+0000","last_peered":"2023-05-12T09:07:15.097248+0000","last_clean":"2023-05-12T09:07:15.097248+0000","last_became_active":"2023-05-12T09:07:14.590573+0000","last_became_peered":"2023-05-12T09:07:14.590573+0000","last_unstale":"2023-05-12T09:07:15.097248+0000","last_undegraded":"2023-05-12T09:07:15.097248+0000","last_fullsized":"2023-05-12T09:07:15.097248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:28.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058408+0000","last_change":"2023-05-12T09:07:10.071121+0000","last_active":"2023-05-12T09:07:15.058408+0000","last_peered":"2023-05-12T09:07:15.058408+0000","last_clean":"2023-05-12T09:07:15.058408+0000","last_became_active":"2023-05-12T09:07:10.070840+0000","last_became_peered":"2023-05-12T09:07:10.070840+0000","last_unstale":"2023-05-12T09:07:15.058408+0000","last_undegraded":"2023-05-12T09:07:15.058408+0000","last_fullsized":"2023-05-12T09:07:15.058408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:30.198454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098441+0000","last_change":"2023-05-12T09:07:10.566231+0000","last_active":"2023-05-12T09:07:15.098441+0000","last_peered":"2023-05-12T09:07:15.098441+0000","last_clean":"2023-05-12T09:07:15.098441+0000","last_became_active":"2023-05-12T09:07:10.565893+0000","last_became_peered":"2023-05-12T09:07:10.565893+0000","last_unstale":"2023-05-12T09:07:15.098441+0000","last_undegraded":"2023-05-12T09:07:15.098441+0000","last_fullsized":"2023-05-12T09:07:15.098441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:39.228924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098881+0000","last_change":"2023-05-12T09:07:14.593678+0000","last_active":"2023-05-12T09:07:15.098881+0000","last_peered":"2023-05-12T09:07:15.098881+0000","last_clean":"2023-05-12T09:07:15.098881+0000","last_became_active":"2023-05-12T09:07:14.593316+0000","last_became_peered":"2023-05-12T09:07:14.593316+0000","last_unstale":"2023-05-12T09:07:15.098881+0000","last_undegraded":"2023-05-12T09:07:15.098881+0000","last_fullsized":"2023-05-12T09:07:15.098881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:30:02.274700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097913+0000","last_change":"2023-05-12T09:07:10.063181+0000","last_active":"2023-05-12T09:07:15.097913+0000","last_peered":"2023-05-12T09:07:15.097913+0000","last_clean":"2023-05-12T09:07:15.097913+0000","last_became_active":"2023-05-12T09:07:10.062780+0000","last_became_peered":"2023-05-12T09:07:10.062780+0000","last_unstale":"2023-05-12T09:07:15.097913+0000","last_undegraded":"2023-05-12T09:07:15.097913+0000","last_fullsized":"2023-05-12T09:07:15.097913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:17.984136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099317+0000","last_change":"2023-05-12T09:07:10.565492+0000","last_active":"2023-05-12T09:07:15.099317+0000","last_peered":"2023-05-12T09:07:15.099317+0000","last_clean":"2023-05-12T09:07:15.099317+0000","last_became_active":"2023-05-12T09:07:10.565230+0000","last_became_peered":"2023-05-12T09:07:10.565230+0000","last_unstale":"2023-05-12T09:07:15.099317+0000","last_undegraded":"2023-05-12T09:07:15.099317+0000","last_fullsized":"2023-05-12T09:07:15.099317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:37.415814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098778+0000","last_change":"2023-05-12T09:07:14.598561+0000","last_active":"2023-05-12T09:07:15.098778+0000","last_peered":"2023-05-12T09:07:15.098778+0000","last_clean":"2023-05-12T09:07:15.098778+0000","last_became_active":"2023-05-12T09:07:14.598166+0000","last_became_peered":"2023-05-12T09:07:14.598166+0000","last_unstale":"2023-05-12T09:07:15.098778+0000","last_undegraded":"2023-05-12T09:07:15.098778+0000","last_fullsized":"2023-05-12T09:07:15.098778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:57:23.396980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058526+0000","last_change":"2023-05-12T09:07:10.073569+0000","last_active":"2023-05-12T09:07:15.058526+0000","last_peered":"2023-05-12T09:07:15.058526+0000","last_clean":"2023-05-12T09:07:15.058526+0000","last_became_active":"2023-05-12T09:07:10.073359+0000","last_became_peered":"2023-05-12T09:07:10.073359+0000","last_unstale":"2023-05-12T09:07:15.058526+0000","last_undegraded":"2023-05-12T09:07:15.058526+0000","last_fullsized":"2023-05-12T09:07:15.058526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:03:07.204680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098024+0000","last_change":"2023-05-12T09:07:10.564749+0000","last_active":"2023-05-12T09:07:15.098024+0000","last_peered":"2023-05-12T09:07:15.098024+0000","last_clean":"2023-05-12T09:07:15.098024+0000","last_became_active":"2023-05-12T09:07:10.564200+0000","last_became_peered":"2023-05-12T09:07:10.564200+0000","last_unstale":"2023-05-12T09:07:15.098024+0000","last_undegraded":"2023-05-12T09:07:15.098024+0000","last_fullsized":"2023-05-12T09:07:15.098024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:29.216512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099214+0000","last_change":"2023-05-12T09:07:14.598427+0000","last_active":"2023-05-12T09:07:15.099214+0000","last_peered":"2023-05-12T09:07:15.099214+0000","last_clean":"2023-05-12T09:07:15.099214+0000","last_became_active":"2023-05-12T09:07:14.598011+0000","last_became_peered":"2023-05-12T09:07:14.598011+0000","last_unstale":"2023-05-12T09:07:15.099214+0000","last_undegraded":"2023-05-12T09:07:15.099214+0000","last_fullsized":"2023-05-12T09:07:15.099214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:52:15.802821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059169+0000","last_change":"2023-05-12T09:07:10.073900+0000","last_active":"2023-05-12T09:07:15.059169+0000","last_peered":"2023-05-12T09:07:15.059169+0000","last_clean":"2023-05-12T09:07:15.059169+0000","last_became_active":"2023-05-12T09:07:10.073595+0000","last_became_peered":"2023-05-12T09:07:10.073595+0000","last_unstale":"2023-05-12T09:07:15.059169+0000","last_undegraded":"2023-05-12T09:07:15.059169+0000","last_fullsized":"2023-05-12T09:07:15.059169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:09:04.714440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098675+0000","last_change":"2023-05-12T09:07:04.835422+0000","last_active":"2023-05-12T09:07:15.098675+0000","last_peered":"2023-05-12T09:07:15.098675+0000","last_clean":"2023-05-12T09:07:15.098675+0000","last_became_active":"2023-05-12T09:07:04.834944+0000","last_became_peered":"2023-05-12T09:07:04.834944+0000","last_unstale":"2023-05-12T09:07:15.098675+0000","last_undegraded":"2023-05-12T09:07:15.098675+0000","last_fullsized":"2023-05-12T09:07:15.098675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:29:34.402135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058443+0000","last_change":"2023-05-12T09:07:10.557866+0000","last_active":"2023-05-12T09:07:15.058443+0000","last_peered":"2023-05-12T09:07:15.058443+0000","last_clean":"2023-05-12T09:07:15.058443+0000","last_became_active":"2023-05-12T09:07:10.557613+0000","last_became_peered":"2023-05-12T09:07:10.557613+0000","last_unstale":"2023-05-12T09:07:15.058443+0000","last_undegraded":"2023-05-12T09:07:15.058443+0000","last_fullsized":"2023-05-12T09:07:15.058443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:41.253320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058370+0000","last_change":"2023-05-12T09:07:14.596466+0000","last_active":"2023-05-12T09:07:15.058370+0000","last_peered":"2023-05-12T09:07:15.058370+0000","last_clean":"2023-05-12T09:07:15.058370+0000","last_became_active":"2023-05-12T09:07:14.595765+0000","last_became_peered":"2023-05-12T09:07:14.595765+0000","last_unstale":"2023-05-12T09:07:15.058370+0000","last_undegraded":"2023-05-12T09:07:15.058370+0000","last_fullsized":"2023-05-12T09:07:15.058370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:23.341131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058733+0000","last_change":"2023-05-12T09:07:04.828759+0000","last_active":"2023-05-12T09:07:15.058733+0000","last_peered":"2023-05-12T09:07:15.058733+0000","last_clean":"2023-05-12T09:07:15.058733+0000","last_became_active":"2023-05-12T09:07:04.828460+0000","last_became_peered":"2023-05-12T09:07:04.828460+0000","last_unstale":"2023-05-12T09:07:15.058733+0000","last_undegraded":"2023-05-12T09:07:15.058733+0000","last_fullsized":"2023-05-12T09:07:15.058733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:08:51.470983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097285+0000","last_change":"2023-05-12T09:07:10.074451+0000","last_active":"2023-05-12T09:07:15.097285+0000","last_peered":"2023-05-12T09:07:15.097285+0000","last_clean":"2023-05-12T09:07:15.097285+0000","last_became_active":"2023-05-12T09:07:10.074189+0000","last_became_peered":"2023-05-12T09:07:10.074189+0000","last_unstale":"2023-05-12T09:07:15.097285+0000","last_undegraded":"2023-05-12T09:07:15.097285+0000","last_fullsized":"2023-05-12T09:07:15.097285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:31:30.209986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098050+0000","last_change":"2023-05-12T09:07:10.574648+0000","last_active":"2023-05-12T09:07:15.098050+0000","last_peered":"2023-05-12T09:07:15.098050+0000","last_clean":"2023-05-12T09:07:15.098050+0000","last_became_active":"2023-05-12T09:07:10.573975+0000","last_became_peered":"2023-05-12T09:07:10.573975+0000","last_unstale":"2023-05-12T09:07:15.098050+0000","last_undegraded":"2023-05-12T09:07:15.098050+0000","last_fullsized":"2023-05-12T09:07:15.098050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:11:46.901235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098514+0000","last_change":"2023-05-12T09:07:14.596807+0000","last_active":"2023-05-12T09:07:15.098514+0000","last_peered":"2023-05-12T09:07:15.098514+0000","last_clean":"2023-05-12T09:07:15.098514+0000","last_became_active":"2023-05-12T09:07:14.596455+0000","last_became_peered":"2023-05-12T09:07:14.596455+0000","last_unstale":"2023-05-12T09:07:15.098514+0000","last_undegraded":"2023-05-12T09:07:15.098514+0000","last_fullsized":"2023-05-12T09:07:15.098514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:15.456994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096671+0000","last_change":"2023-05-12T09:07:04.830658+0000","last_active":"2023-05-12T09:07:15.096671+0000","last_peered":"2023-05-12T09:07:15.096671+0000","last_clean":"2023-05-12T09:07:15.096671+0000","last_became_active":"2023-05-12T09:07:04.830354+0000","last_became_peered":"2023-05-12T09:07:04.830354+0000","last_unstale":"2023-05-12T09:07:15.096671+0000","last_undegraded":"2023-05-12T09:07:15.096671+0000","last_fullsized":"2023-05-12T09:07:15.096671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:25:54.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097236+0000","last_change":"2023-05-12T09:07:04.830850+0000","last_active":"2023-05-12T09:07:15.097236+0000","last_peered":"2023-05-12T09:07:15.097236+0000","last_clean":"2023-05-12T09:07:15.097236+0000","last_became_active":"2023-05-12T09:07:04.829577+0000","last_became_peered":"2023-05-12T09:07:04.829577+0000","last_unstale":"2023-05-12T09:07:15.097236+0000","last_undegraded":"2023-05-12T09:07:15.097236+0000","last_fullsized":"2023-05-12T09:07:15.097236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:42.458296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096795+0000","last_change":"2023-05-12T09:07:10.078248+0000","last_active":"2023-05-12T09:07:15.096795+0000","last_peered":"2023-05-12T09:07:15.096795+0000","last_clean":"2023-05-12T09:07:15.096795+0000","last_became_active":"2023-05-12T09:07:10.077994+0000","last_became_peered":"2023-05-12T09:07:10.077994+0000","last_unstale":"2023-05-12T09:07:15.096795+0000","last_undegraded":"2023-05-12T09:07:15.096795+0000","last_fullsized":"2023-05-12T09:07:15.096795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:34.152879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097764+0000","last_change":"2023-05-12T09:07:10.557403+0000","last_active":"2023-05-12T09:07:15.097764+0000","last_peered":"2023-05-12T09:07:15.097764+0000","last_clean":"2023-05-12T09:07:15.097764+0000","last_became_active":"2023-05-12T09:07:10.557170+0000","last_became_peered":"2023-05-12T09:07:10.557170+0000","last_unstale":"2023-05-12T09:07:15.097764+0000","last_undegraded":"2023-05-12T09:07:15.097764+0000","last_fullsized":"2023-05-12T09:07:15.097764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:41:05.519844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057360+0000","last_change":"2023-05-12T09:07:14.588875+0000","last_active":"2023-05-12T09:07:15.057360+0000","last_peered":"2023-05-12T09:07:15.057360+0000","last_clean":"2023-05-12T09:07:15.057360+0000","last_became_active":"2023-05-12T09:07:14.587235+0000","last_became_peered":"2023-05-12T09:07:14.587235+0000","last_unstale":"2023-05-12T09:07:15.057360+0000","last_undegraded":"2023-05-12T09:07:15.057360+0000","last_fullsized":"2023-05-12T09:07:15.057360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:48.344758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097643+0000","last_change":"2023-05-12T09:07:05.258677+0000","last_active":"2023-05-12T09:07:15.097643+0000","last_peered":"2023-05-12T09:07:15.097643+0000","last_clean":"2023-05-12T09:07:15.097643+0000","last_became_active":"2023-05-12T09:07:05.258372+0000","last_became_peered":"2023-05-12T09:07:05.258372+0000","last_unstale":"2023-05-12T09:07:15.097643+0000","last_undegraded":"2023-05-12T09:07:15.097643+0000","last_fullsized":"2023-05-12T09:07:15.097643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:26:58.816901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096485+0000","last_change":"2023-05-12T09:07:10.071185+0000","last_active":"2023-05-12T09:07:15.096485+0000","last_peered":"2023-05-12T09:07:15.096485+0000","last_clean":"2023-05-12T09:07:15.096485+0000","last_became_active":"2023-05-12T09:07:10.070930+0000","last_became_peered":"2023-05-12T09:07:10.070930+0000","last_unstale":"2023-05-12T09:07:15.096485+0000","last_undegraded":"2023-05-12T09:07:15.096485+0000","last_fullsized":"2023-05-12T09:07:15.096485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:10.442791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098132+0000","last_change":"2023-05-12T09:07:10.565103+0000","last_active":"2023-05-12T09:07:15.098132+0000","last_peered":"2023-05-12T09:07:15.098132+0000","last_clean":"2023-05-12T09:07:15.098132+0000","last_became_active":"2023-05-12T09:07:10.564782+0000","last_became_peered":"2023-05-12T09:07:10.564782+0000","last_unstale":"2023-05-12T09:07:15.098132+0000","last_undegraded":"2023-05-12T09:07:15.098132+0000","last_fullsized":"2023-05-12T09:07:15.098132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098635+0000","last_change":"2023-05-12T09:07:14.585727+0000","last_active":"2023-05-12T09:07:15.098635+0000","last_peered":"2023-05-12T09:07:15.098635+0000","last_clean":"2023-05-12T09:07:15.098635+0000","last_became_active":"2023-05-12T09:07:14.585342+0000","last_became_peered":"2023-05-12T09:07:14.585342+0000","last_unstale":"2023-05-12T09:07:15.098635+0000","last_undegraded":"2023-05-12T09:07:15.098635+0000","last_fullsized":"2023-05-12T09:07:15.098635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:34:38.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097101+0000","last_change":"2023-05-12T09:07:05.258599+0000","last_active":"2023-05-12T09:07:15.097101+0000","last_peered":"2023-05-12T09:07:15.097101+0000","last_clean":"2023-05-12T09:07:15.097101+0000","last_became_active":"2023-05-12T09:07:05.258301+0000","last_became_peered":"2023-05-12T09:07:05.258301+0000","last_unstale":"2023-05-12T09:07:15.097101+0000","last_undegraded":"2023-05-12T09:07:15.097101+0000","last_fullsized":"2023-05-12T09:07:15.097101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:36.857503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058798+0000","last_change":"2023-05-12T09:07:10.077809+0000","last_active":"2023-05-12T09:07:15.058798+0000","last_peered":"2023-05-12T09:07:15.058798+0000","last_clean":"2023-05-12T09:07:15.058798+0000","last_became_active":"2023-05-12T09:07:10.077502+0000","last_became_peered":"2023-05-12T09:07:10.077502+0000","last_unstale":"2023-05-12T09:07:15.058798+0000","last_undegraded":"2023-05-12T09:07:15.058798+0000","last_fullsized":"2023-05-12T09:07:15.058798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:31:45.423256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058539+0000","last_change":"2023-05-12T09:07:10.569701+0000","last_active":"2023-05-12T09:07:15.058539+0000","last_peered":"2023-05-12T09:07:15.058539+0000","last_clean":"2023-05-12T09:07:15.058539+0000","last_became_active":"2023-05-12T09:07:10.569342+0000","last_became_peered":"2023-05-12T09:07:10.569342+0000","last_unstale":"2023-05-12T09:07:15.058539+0000","last_undegraded":"2023-05-12T09:07:15.058539+0000","last_fullsized":"2023-05-12T09:07:15.058539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:59:18.361363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098305+0000","last_change":"2023-05-12T09:07:14.589783+0000","last_active":"2023-05-12T09:07:15.098305+0000","last_peered":"2023-05-12T09:07:15.098305+0000","last_clean":"2023-05-12T09:07:15.098305+0000","last_became_active":"2023-05-12T09:07:14.589383+0000","last_became_peered":"2023-05-12T09:07:14.589383+0000","last_unstale":"2023-05-12T09:07:15.098305+0000","last_undegraded":"2023-05-12T09:07:15.098305+0000","last_fullsized":"2023-05-12T09:07:15.098305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:42.729589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097652+0000","last_change":"2023-05-12T09:07:05.258734+0000","last_active":"2023-05-12T09:07:15.097652+0000","last_peered":"2023-05-12T09:07:15.097652+0000","last_clean":"2023-05-12T09:07:15.097652+0000","last_became_active":"2023-05-12T09:07:05.258376+0000","last_became_peered":"2023-05-12T09:07:05.258376+0000","last_unstale":"2023-05-12T09:07:15.097652+0000","last_undegraded":"2023-05-12T09:07:15.097652+0000","last_fullsized":"2023-05-12T09:07:15.097652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:41:23.293447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098911+0000","last_change":"2023-05-12T09:07:10.073268+0000","last_active":"2023-05-12T09:07:15.098911+0000","last_peered":"2023-05-12T09:07:15.098911+0000","last_clean":"2023-05-12T09:07:15.098911+0000","last_became_active":"2023-05-12T09:07:10.072997+0000","last_became_peered":"2023-05-12T09:07:10.072997+0000","last_unstale":"2023-05-12T09:07:15.098911+0000","last_undegraded":"2023-05-12T09:07:15.098911+0000","last_fullsized":"2023-05-12T09:07:15.098911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:14:41.536722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096597+0000","last_change":"2023-05-12T09:07:10.561961+0000","last_active":"2023-05-12T09:07:15.096597+0000","last_peered":"2023-05-12T09:07:15.096597+0000","last_clean":"2023-05-12T09:07:15.096597+0000","last_became_active":"2023-05-12T09:07:10.561690+0000","last_became_peered":"2023-05-12T09:07:10.561690+0000","last_unstale":"2023-05-12T09:07:15.096597+0000","last_undegraded":"2023-05-12T09:07:15.096597+0000","last_fullsized":"2023-05-12T09:07:15.096597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:43.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058733+0000","last_change":"2023-05-12T09:07:14.585070+0000","last_active":"2023-05-12T09:07:15.058733+0000","last_peered":"2023-05-12T09:07:15.058733+0000","last_clean":"2023-05-12T09:07:15.058733+0000","last_became_active":"2023-05-12T09:07:14.584656+0000","last_became_peered":"2023-05-12T09:07:14.584656+0000","last_unstale":"2023-05-12T09:07:15.058733+0000","last_undegraded":"2023-05-12T09:07:15.058733+0000","last_fullsized":"2023-05-12T09:07:15.058733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:53:19.096515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058688+0000","last_change":"2023-05-12T09:07:05.258598+0000","last_active":"2023-05-12T09:07:15.058688+0000","last_peered":"2023-05-12T09:07:15.058688+0000","last_clean":"2023-05-12T09:07:15.058688+0000","last_became_active":"2023-05-12T09:07:05.258280+0000","last_became_peered":"2023-05-12T09:07:05.258280+0000","last_unstale":"2023-05-12T09:07:15.058688+0000","last_undegraded":"2023-05-12T09:07:15.058688+0000","last_fullsized":"2023-05-12T09:07:15.058688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:50.177616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096736+0000","last_change":"2023-05-12T09:07:10.072051+0000","last_active":"2023-05-12T09:07:15.096736+0000","last_peered":"2023-05-12T09:07:15.096736+0000","last_clean":"2023-05-12T09:07:15.096736+0000","last_became_active":"2023-05-12T09:07:10.071775+0000","last_became_peered":"2023-05-12T09:07:10.071775+0000","last_unstale":"2023-05-12T09:07:15.096736+0000","last_undegraded":"2023-05-12T09:07:15.096736+0000","last_fullsized":"2023-05-12T09:07:15.096736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:10.949889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097922+0000","last_change":"2023-05-12T09:07:10.558361+0000","last_active":"2023-05-12T09:07:15.097922+0000","last_peered":"2023-05-12T09:07:15.097922+0000","last_clean":"2023-05-12T09:07:15.097922+0000","last_became_active":"2023-05-12T09:07:10.557975+0000","last_became_peered":"2023-05-12T09:07:10.557975+0000","last_unstale":"2023-05-12T09:07:15.097922+0000","last_undegraded":"2023-05-12T09:07:15.097922+0000","last_fullsized":"2023-05-12T09:07:15.097922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:01:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097799+0000","last_change":"2023-05-12T09:07:14.587172+0000","last_active":"2023-05-12T09:07:15.097799+0000","last_peered":"2023-05-12T09:07:15.097799+0000","last_clean":"2023-05-12T09:07:15.097799+0000","last_became_active":"2023-05-12T09:07:14.586671+0000","last_became_peered":"2023-05-12T09:07:14.586671+0000","last_unstale":"2023-05-12T09:07:15.097799+0000","last_undegraded":"2023-05-12T09:07:15.097799+0000","last_fullsized":"2023-05-12T09:07:15.097799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:11:50.401900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059054+0000","last_change":"2023-05-12T09:07:04.830787+0000","last_active":"2023-05-12T09:07:15.059054+0000","last_peered":"2023-05-12T09:07:15.059054+0000","last_clean":"2023-05-12T09:07:15.059054+0000","last_became_active":"2023-05-12T09:07:04.830492+0000","last_became_peered":"2023-05-12T09:07:04.830492+0000","last_unstale":"2023-05-12T09:07:15.059054+0000","last_undegraded":"2023-05-12T09:07:15.059054+0000","last_fullsized":"2023-05-12T09:07:15.059054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:18:33.956760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099144+0000","last_change":"2023-05-12T09:07:10.072970+0000","last_active":"2023-05-12T09:07:15.099144+0000","last_peered":"2023-05-12T09:07:15.099144+0000","last_clean":"2023-05-12T09:07:15.099144+0000","last_became_active":"2023-05-12T09:07:10.072670+0000","last_became_peered":"2023-05-12T09:07:10.072670+0000","last_unstale":"2023-05-12T09:07:15.099144+0000","last_undegraded":"2023-05-12T09:07:15.099144+0000","last_fullsized":"2023-05-12T09:07:15.099144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:21.054528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097023+0000","last_change":"2023-05-12T09:07:10.565493+0000","last_active":"2023-05-12T09:07:15.097023+0000","last_peered":"2023-05-12T09:07:15.097023+0000","last_clean":"2023-05-12T09:07:15.097023+0000","last_became_active":"2023-05-12T09:07:10.565202+0000","last_became_peered":"2023-05-12T09:07:10.565202+0000","last_unstale":"2023-05-12T09:07:15.097023+0000","last_undegraded":"2023-05-12T09:07:15.097023+0000","last_fullsized":"2023-05-12T09:07:15.097023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:22.060968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096821+0000","last_change":"2023-05-12T09:07:14.595394+0000","last_active":"2023-05-12T09:07:15.096821+0000","last_peered":"2023-05-12T09:07:15.096821+0000","last_clean":"2023-05-12T09:07:15.096821+0000","last_became_active":"2023-05-12T09:07:14.594978+0000","last_became_peered":"2023-05-12T09:07:14.594978+0000","last_unstale":"2023-05-12T09:07:15.096821+0000","last_undegraded":"2023-05-12T09:07:15.096821+0000","last_fullsized":"2023-05-12T09:07:15.096821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:52.189320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097791+0000","last_change":"2023-05-12T09:07:10.078522+0000","last_active":"2023-05-12T09:07:15.097791+0000","last_peered":"2023-05-12T09:07:15.097791+0000","last_clean":"2023-05-12T09:07:15.097791+0000","last_became_active":"2023-05-12T09:07:10.078295+0000","last_became_peered":"2023-05-12T09:07:10.078295+0000","last_unstale":"2023-05-12T09:07:15.097791+0000","last_undegraded":"2023-05-12T09:07:15.097791+0000","last_fullsized":"2023-05-12T09:07:15.097791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:17.984136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057055+0000","last_change":"2023-05-12T09:07:10.560192+0000","last_active":"2023-05-12T09:07:15.057055+0000","last_peered":"2023-05-12T09:07:15.057055+0000","last_clean":"2023-05-12T09:07:15.057055+0000","last_became_active":"2023-05-12T09:07:10.559897+0000","last_became_peered":"2023-05-12T09:07:10.559897+0000","last_unstale":"2023-05-12T09:07:15.057055+0000","last_undegraded":"2023-05-12T09:07:15.057055+0000","last_fullsized":"2023-05-12T09:07:15.057055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:25:50.021542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097222+0000","last_change":"2023-05-12T09:07:14.590573+0000","last_active":"2023-05-12T09:07:15.097222+0000","last_peered":"2023-05-12T09:07:15.097222+0000","last_clean":"2023-05-12T09:07:15.097222+0000","last_became_active":"2023-05-12T09:07:14.590176+0000","last_became_peered":"2023-05-12T09:07:14.590176+0000","last_unstale":"2023-05-12T09:07:15.097222+0000","last_undegraded":"2023-05-12T09:07:15.097222+0000","last_fullsized":"2023-05-12T09:07:15.097222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:15.456994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097418+0000","last_change":"2023-05-12T09:07:10.080277+0000","last_active":"2023-05-12T09:07:15.097418+0000","last_peered":"2023-05-12T09:07:15.097418+0000","last_clean":"2023-05-12T09:07:15.097418+0000","last_became_active":"2023-05-12T09:07:10.079936+0000","last_became_peered":"2023-05-12T09:07:10.079936+0000","last_unstale":"2023-05-12T09:07:15.097418+0000","last_undegraded":"2023-05-12T09:07:15.097418+0000","last_fullsized":"2023-05-12T09:07:15.097418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:03:06.647253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098333+0000","last_change":"2023-05-12T09:07:10.569555+0000","last_active":"2023-05-12T09:07:15.098333+0000","last_peered":"2023-05-12T09:07:15.098333+0000","last_clean":"2023-05-12T09:07:15.098333+0000","last_became_active":"2023-05-12T09:07:10.569253+0000","last_became_peered":"2023-05-12T09:07:10.569253+0000","last_unstale":"2023-05-12T09:07:15.098333+0000","last_undegraded":"2023-05-12T09:07:15.098333+0000","last_fullsized":"2023-05-12T09:07:15.098333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:19.840466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098745+0000","last_change":"2023-05-12T09:07:14.588834+0000","last_active":"2023-05-12T09:07:15.098745+0000","last_peered":"2023-05-12T09:07:15.098745+0000","last_clean":"2023-05-12T09:07:15.098745+0000","last_became_active":"2023-05-12T09:07:14.588451+0000","last_became_peered":"2023-05-12T09:07:14.588451+0000","last_unstale":"2023-05-12T09:07:15.098745+0000","last_undegraded":"2023-05-12T09:07:15.098745+0000","last_fullsized":"2023-05-12T09:07:15.098745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:52.189320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099255+0000","last_change":"2023-05-12T09:07:10.078506+0000","last_active":"2023-05-12T09:07:15.099255+0000","last_peered":"2023-05-12T09:07:15.099255+0000","last_clean":"2023-05-12T09:07:15.099255+0000","last_became_active":"2023-05-12T09:07:10.078243+0000","last_became_peered":"2023-05-12T09:07:10.078243+0000","last_unstale":"2023-05-12T09:07:15.099255+0000","last_undegraded":"2023-05-12T09:07:15.099255+0000","last_fullsized":"2023-05-12T09:07:15.099255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:24.289481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098134+0000","last_change":"2023-05-12T09:07:10.570203+0000","last_active":"2023-05-12T09:07:15.098134+0000","last_peered":"2023-05-12T09:07:15.098134+0000","last_clean":"2023-05-12T09:07:15.098134+0000","last_became_active":"2023-05-12T09:07:10.569917+0000","last_became_peered":"2023-05-12T09:07:10.569917+0000","last_unstale":"2023-05-12T09:07:15.098134+0000","last_undegraded":"2023-05-12T09:07:15.098134+0000","last_fullsized":"2023-05-12T09:07:15.098134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:37:03.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098605+0000","last_change":"2023-05-12T09:07:14.591389+0000","last_active":"2023-05-12T09:07:15.098605+0000","last_peered":"2023-05-12T09:07:15.098605+0000","last_clean":"2023-05-12T09:07:15.098605+0000","last_became_active":"2023-05-12T09:07:14.591029+0000","last_became_peered":"2023-05-12T09:07:14.591029+0000","last_unstale":"2023-05-12T09:07:15.098605+0000","last_undegraded":"2023-05-12T09:07:15.098605+0000","last_fullsized":"2023-05-12T09:07:15.098605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:50:10.131123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059215+0000","last_change":"2023-05-12T09:07:10.066391+0000","last_active":"2023-05-12T09:07:15.059215+0000","last_peered":"2023-05-12T09:07:15.059215+0000","last_clean":"2023-05-12T09:07:15.059215+0000","last_became_active":"2023-05-12T09:07:10.066135+0000","last_became_peered":"2023-05-12T09:07:10.066135+0000","last_unstale":"2023-05-12T09:07:15.059215+0000","last_undegraded":"2023-05-12T09:07:15.059215+0000","last_fullsized":"2023-05-12T09:07:15.059215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:57.005641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058832+0000","last_change":"2023-05-12T09:07:10.552090+0000","last_active":"2023-05-12T09:07:15.058832+0000","last_peered":"2023-05-12T09:07:15.058832+0000","last_clean":"2023-05-12T09:07:15.058832+0000","last_became_active":"2023-05-12T09:07:10.551802+0000","last_became_peered":"2023-05-12T09:07:10.551802+0000","last_unstale":"2023-05-12T09:07:15.058832+0000","last_undegraded":"2023-05-12T09:07:15.058832+0000","last_fullsized":"2023-05-12T09:07:15.058832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:54.558448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096851+0000","last_change":"2023-05-12T09:07:14.585407+0000","last_active":"2023-05-12T09:07:15.096851+0000","last_peered":"2023-05-12T09:07:15.096851+0000","last_clean":"2023-05-12T09:07:15.096851+0000","last_became_active":"2023-05-12T09:07:14.585059+0000","last_became_peered":"2023-05-12T09:07:14.585059+0000","last_unstale":"2023-05-12T09:07:15.096851+0000","last_undegraded":"2023-05-12T09:07:15.096851+0000","last_fullsized":"2023-05-12T09:07:15.096851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:30:02.274700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097402+0000","last_change":"2023-05-12T09:07:10.068737+0000","last_active":"2023-05-12T09:07:15.097402+0000","last_peered":"2023-05-12T09:07:15.097402+0000","last_clean":"2023-05-12T09:07:15.097402+0000","last_became_active":"2023-05-12T09:07:10.068427+0000","last_became_peered":"2023-05-12T09:07:10.068427+0000","last_unstale":"2023-05-12T09:07:15.097402+0000","last_undegraded":"2023-05-12T09:07:15.097402+0000","last_fullsized":"2023-05-12T09:07:15.097402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:49:41.703805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098946+0000","last_change":"2023-05-12T09:07:10.565243+0000","last_active":"2023-05-12T09:07:15.098946+0000","last_peered":"2023-05-12T09:07:15.098946+0000","last_clean":"2023-05-12T09:07:15.098946+0000","last_became_active":"2023-05-12T09:07:10.564923+0000","last_became_peered":"2023-05-12T09:07:10.564923+0000","last_unstale":"2023-05-12T09:07:15.098946+0000","last_undegraded":"2023-05-12T09:07:15.098946+0000","last_fullsized":"2023-05-12T09:07:15.098946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:35.146554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058306+0000","last_change":"2023-05-12T09:07:10.554737+0000","last_active":"2023-05-12T09:07:15.058306+0000","last_peered":"2023-05-12T09:07:15.058306+0000","last_clean":"2023-05-12T09:07:15.058306+0000","last_became_active":"2023-05-12T09:07:10.554481+0000","last_became_peered":"2023-05-12T09:07:10.554481+0000","last_unstale":"2023-05-12T09:07:15.058306+0000","last_undegraded":"2023-05-12T09:07:15.058306+0000","last_fullsized":"2023-05-12T09:07:15.058306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:07:09.286879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058533+0000","last_change":"2023-05-12T09:07:10.551816+0000","last_active":"2023-05-12T09:07:15.058533+0000","last_peered":"2023-05-12T09:07:15.058533+0000","last_clean":"2023-05-12T09:07:15.058533+0000","last_became_active":"2023-05-12T09:07:10.551522+0000","last_became_peered":"2023-05-12T09:07:10.551522+0000","last_unstale":"2023-05-12T09:07:15.058533+0000","last_undegraded":"2023-05-12T09:07:15.058533+0000","last_fullsized":"2023-05-12T09:07:15.058533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:50:06.630457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098592+0000","last_change":"2023-05-12T09:07:10.565765+0000","last_active":"2023-05-12T09:07:15.098592+0000","last_peered":"2023-05-12T09:07:15.098592+0000","last_clean":"2023-05-12T09:07:15.098592+0000","last_became_active":"2023-05-12T09:07:10.565493+0000","last_became_peered":"2023-05-12T09:07:10.565493+0000","last_unstale":"2023-05-12T09:07:15.098592+0000","last_undegraded":"2023-05-12T09:07:15.098592+0000","last_fullsized":"2023-05-12T09:07:15.098592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:03:08.211119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058766+0000","last_change":"2023-05-12T09:07:10.558789+0000","last_active":"2023-05-12T09:07:15.058766+0000","last_peered":"2023-05-12T09:07:15.058766+0000","last_clean":"2023-05-12T09:07:15.058766+0000","last_became_active":"2023-05-12T09:07:10.557767+0000","last_became_peered":"2023-05-12T09:07:10.557767+0000","last_unstale":"2023-05-12T09:07:15.058766+0000","last_undegraded":"2023-05-12T09:07:15.058766+0000","last_fullsized":"2023-05-12T09:07:15.058766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:57:19.896315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097817+0000","last_change":"2023-05-12T09:07:10.566888+0000","last_active":"2023-05-12T09:07:15.097817+0000","last_peered":"2023-05-12T09:07:15.097817+0000","last_clean":"2023-05-12T09:07:15.097817+0000","last_became_active":"2023-05-12T09:07:10.566580+0000","last_became_peered":"2023-05-12T09:07:10.566580+0000","last_unstale":"2023-05-12T09:07:15.097817+0000","last_undegraded":"2023-05-12T09:07:15.097817+0000","last_fullsized":"2023-05-12T09:07:15.097817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:35.159319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9248,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362592,"statfs":{"total":96636764160,"available":96627294208,"internally_reserved":0,"allocated":876544,"data_stored":699108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9220,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362620,"statfs":{"total":96636764160,"available":96627322880,"internally_reserved":0,"allocated":847872,"data_stored":695098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8132,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363708,"statfs":{"total":96636764160,"available":96628436992,"internally_reserved":0,"allocated":258048,"data_stored":105312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8132,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363708,"statfs":{"total":96636764160,"available":96628436992,"internally_reserved":0,"allocated":258048,"data_stored":104820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8212,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363628,"statfs":{"total":96636764160,"available":96628355072,"internally_reserved":0,"allocated":274432,"data_stored":108580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":104021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-12T09:07:40.279 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-12T09:07:40.280 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-12T09:07:40.280 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-12T09:07:40.281 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-12T09:07:40.281 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-12T09:07:40.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.493+0000 7f7094bff700 1 Processor -- start 2023-05-12T09:07:40.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.494+0000 7f7094bff700 1 -- start start 2023-05-12T09:07:40.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f7094bff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f70900b87a0 0x7f70900cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f7094bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f7090160d40 0x7f70900d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f7094bff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70900cdc60 con 0x7f70901601e0 2023-05-12T09:07:40.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f7094bff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70900d02d0 con 0x7f70900b87a0 2023-05-12T09:07:40.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f7094bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70900d0cb0 con 0x7f7090160d40 2023-05-12T09:07:40.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f708e59c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f70900b87a0 0x7f70900cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f708e59c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f70900b87a0 0x7f70900cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34010/0 (socket says 172.21.15.116:34010) 2023-05-12T09:07:40.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f708e59c700 1 -- 172.21.15.116:0/2337726258 learned_addr learned my addr 172.21.15.116:0/2337726258 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:40.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f708ed9d700 1 --2- 172.21.15.116:0/2337726258 >> v2:172.21.15.182:3300/0 conn(0x7f7090160d40 0x7f70900d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f708e59c700 1 -- 172.21.15.116:0/2337726258 >> v2:172.21.15.182:3300/0 conn(0x7f7090160d40 msgr2=0x7f70900d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:40.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f708e59c700 1 --2- 172.21.15.116:0/2337726258 >> v2:172.21.15.182:3300/0 conn(0x7f7090160d40 0x7f70900d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.495+0000 7f708e59c700 1 -- 172.21.15.116:0/2337726258 >> v1:172.21.15.182:6789/0 conn(0x7f70901601e0 legacy=0x7f7090160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:40.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.496+0000 7f708e59c700 1 -- 172.21.15.116:0/2337726258 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70900cd6a0 con 0x7f70900b87a0 2023-05-12T09:07:40.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.496+0000 7f708e59c700 1 --2- 172.21.15.116:0/2337726258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 0x7f70900cfbf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70900d0820 tx=0x7f7080009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885e8e52ce2bb2c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:40.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.496+0000 7f708dd9b700 1 -- 172.21.15.116:0/2337726258 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080011830 con 0x7f70900b87a0 2023-05-12T09:07:40.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.496+0000 7f708dd9b700 1 -- 172.21.15.116:0/2337726258 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7080011990 con 0x7f70900b87a0 2023-05-12T09:07:40.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.496+0000 7f708dd9b700 1 -- 172.21.15.116:0/2337726258 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080011d20 con 0x7f70900b87a0 2023-05-12T09:07:40.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.496+0000 7f7094bff700 1 -- 172.21.15.116:0/2337726258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 msgr2=0x7f70900cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.496+0000 7f7094bff700 1 --2- 172.21.15.116:0/2337726258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 0x7f70900cfbf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70900d0820 tx=0x7f7080009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:40.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.497+0000 7f7094bff700 1 -- 172.21.15.116:0/2337726258 shutdown_connections 2023-05-12T09:07:40.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.497+0000 7f7094bff700 1 --2- 172.21.15.116:0/2337726258 >> v2:172.21.15.182:3300/0 conn(0x7f7090160d40 0x7f70900d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.497+0000 7f7094bff700 1 --2- 172.21.15.116:0/2337726258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 0x7f70900cfbf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.497+0000 7f7094bff700 1 -- 172.21.15.116:0/2337726258 >> 172.21.15.116:0/2337726258 conn(0x7f7090071b10 msgr2=0x7f7090071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:40.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.497+0000 7f7094bff700 1 -- 172.21.15.116:0/2337726258 shutdown_connections 2023-05-12T09:07:40.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.497+0000 7f7094bff700 1 -- 172.21.15.116:0/2337726258 wait complete. 2023-05-12T09:07:40.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.498+0000 7f7094bff700 1 Processor -- start 2023-05-12T09:07:40.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.498+0000 7f7094bff700 1 -- start start 2023-05-12T09:07:40.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.499+0000 7f7094bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 0x7f70901e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.499+0000 7f7094bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70901601e0 0x7f70901512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.499+0000 7f7094bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7090160d40 0x7f70901e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.499+0000 7f7094bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70901e68e0 con 0x7f70900b87a0 2023-05-12T09:07:40.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.499+0000 7f7094bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70901e6bc0 con 0x7f70901601e0 2023-05-12T09:07:40.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.499+0000 7f7094bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70901e6ea0 con 0x7f7090160d40 2023-05-12T09:07:40.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.499+0000 7f708e59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 0x7f70901e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f708e59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 0x7f70901e7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34012/0 (socket says 172.21.15.116:34012) 2023-05-12T09:07:40.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f708e59c700 1 -- 172.21.15.116:0/4236718057 learned_addr learned my addr 172.21.15.116:0/4236718057 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:40.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f7087fff700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70901601e0 0x7f70901512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f708ed9d700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7090160d40 0x7f70901e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f708e59c700 1 -- 172.21.15.116:0/4236718057 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7090160d40 msgr2=0x7f70901e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f708e59c700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7090160d40 0x7f70901e5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f708e59c700 1 -- 172.21.15.116:0/4236718057 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70901601e0 msgr2=0x7f70901512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f708e59c700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70901601e0 0x7f70901512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f708e59c700 1 -- 172.21.15.116:0/4236718057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080009550 con 0x7f70900b87a0 2023-05-12T09:07:40.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f7087fff700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70901601e0 0x7f70901512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:40.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f708e59c700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 0x7f70901e7980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7080009870 tx=0x7f7080004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:40.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f7086ffd700 1 -- 172.21.15.116:0/4236718057 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800045b0 con 0x7f70900b87a0 2023-05-12T09:07:40.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f7086ffd700 1 -- 172.21.15.116:0/4236718057 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708001f070 con 0x7f70900b87a0 2023-05-12T09:07:40.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f7094bff700 1 -- 172.21.15.116:0/4236718057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70900d1640 con 0x7f70900b87a0 2023-05-12T09:07:40.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.500+0000 7f7086ffd700 1 -- 172.21.15.116:0/4236718057 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800038e0 con 0x7f70900b87a0 2023-05-12T09:07:40.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.501+0000 7f7094bff700 1 -- 172.21.15.116:0/4236718057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70900cd980 con 0x7f70900b87a0 2023-05-12T09:07:40.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.501+0000 7f7094bff700 1 -- 172.21.15.116:0/4236718057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70900d17d0 con 0x7f70900b87a0 2023-05-12T09:07:40.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.502+0000 7f7086ffd700 1 -- 172.21.15.116:0/4236718057 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7080021030 con 0x7f70900b87a0 2023-05-12T09:07:40.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.503+0000 7f7086ffd700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f707006ace0 0x7f707006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.503+0000 7f7086ffd700 1 -- 172.21.15.116:0/4236718057 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f708008ac80 con 0x7f70900b87a0 2023-05-12T09:07:40.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.504+0000 7f7087fff700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f707006ace0 0x7f707006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.504+0000 7f7087fff700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f707006ace0 0x7f707006d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f70900c99c0 tx=0x7f7078009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:40.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.508+0000 7f7086ffd700 1 -- 172.21.15.116:0/4236718057 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7080055a30 con 0x7f70900b87a0 2023-05-12T09:07:40.759 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.756+0000 7f7094bff700 1 -- 172.21.15.116:0/4236718057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7090074430 con 0x7f70900b87a0 2023-05-12T09:07:40.762 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.760+0000 7f7086ffd700 1 -- 172.21.15.116:0/4236718057 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170847 (secure 0 0 0) 0x7f7080059050 con 0x7f70900b87a0 2023-05-12T09:07:40.764 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:40.766 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 -- 172.21.15.116:0/4236718057 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f707006ace0 msgr2=0x7f707006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.766 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f707006ace0 0x7f707006d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f70900c99c0 tx=0x7f7078009040 comp rx=0 tx=0).stop 2023-05-12T09:07:40.766 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 -- 172.21.15.116:0/4236718057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 msgr2=0x7f70901e7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.766 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 0x7f70901e7980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7080009870 tx=0x7f7080004750 comp rx=0 tx=0).stop 2023-05-12T09:07:40.766 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 -- 172.21.15.116:0/4236718057 shutdown_connections 2023-05-12T09:07:40.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f707006ace0 0x7f707006d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7090160d40 0x7f70901e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70900b87a0 0x7f70901e7980 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 --2- 172.21.15.116:0/4236718057 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70901601e0 0x7f70901512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 -- 172.21.15.116:0/4236718057 >> 172.21.15.116:0/4236718057 conn(0x7f7090071b10 msgr2=0x7f70900cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:40.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 -- 172.21.15.116:0/4236718057 shutdown_connections 2023-05-12T09:07:40.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.763+0000 7f7094bff700 1 -- 172.21.15.116:0/4236718057 wait complete. 2023-05-12T09:07:40.783 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":5,"active_gid":4106,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3989593778},{"type":"v1","addr":"172.21.15.116:6833","nonce":3989593778}]},"active_addr":"172.21.15.116:6833/3989593778","active_change":"2023-05-12T09:06:57.544953+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":4283622664}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":3562285462}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":82277730}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":3754432138}]}]} 2023-05-12T09:07:40.787 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-12T09:07:40.787 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-12T09:07:40.788 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:40.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.967+0000 7fbfd77ff700 1 Processor -- start 2023-05-12T09:07:40.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.967+0000 7fbfd77ff700 1 -- start start 2023-05-12T09:07:40.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.969+0000 7fbfd77ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fbfd00b87a0 0x7fbfd00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.969+0000 7fbfd77ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd0160d40 0x7fbfd00d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.969+0000 7fbfd77ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd00cdc60 con 0x7fbfd01601e0 2023-05-12T09:07:40.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.969+0000 7fbfd77ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd00d02d0 con 0x7fbfd00b87a0 2023-05-12T09:07:40.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.969+0000 7fbfd77ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00d0cb0 con 0x7fbfd0160d40 2023-05-12T09:07:40.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.969+0000 7fbfd5d9c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd0160d40 0x7fbfd00d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.969+0000 7fbfd559b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fbfd00b87a0 0x7fbfd00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.969+0000 7fbfd5d9c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd0160d40 0x7fbfd00d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:33090/0 (socket says 172.21.15.116:33090) 2023-05-12T09:07:40.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.969+0000 7fbfd5d9c700 1 -- 172.21.15.116:0/577150571 learned_addr learned my addr 172.21.15.116:0/577150571 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:40.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.970+0000 7fbfd5d9c700 1 -- 172.21.15.116:0/577150571 >> v2:172.21.15.182:3300/0 conn(0x7fbfd00b87a0 msgr2=0x7fbfd00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:40.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.970+0000 7fbfd5d9c700 1 --2- 172.21.15.116:0/577150571 >> v2:172.21.15.182:3300/0 conn(0x7fbfd00b87a0 0x7fbfd00cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.970+0000 7fbfd5d9c700 1 -- 172.21.15.116:0/577150571 >> v1:172.21.15.182:6789/0 conn(0x7fbfd01601e0 legacy=0x7fbfd0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.970+0000 7fbfd5d9c700 1 -- 172.21.15.116:0/577150571 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd00cd6a0 con 0x7fbfd0160d40 2023-05-12T09:07:40.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.970+0000 7fbfd5d9c700 1 --2- 172.21.15.116:0/577150571 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd0160d40 0x7fbfd00d1100 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009e50 tx=0x7fbfc800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17304566e7781e36 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:40.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.970+0000 7fbfc7fff700 1 -- 172.21.15.116:0/577150571 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc800e070 con 0x7fbfd0160d40 2023-05-12T09:07:40.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.970+0000 7fbfc7fff700 1 -- 172.21.15.116:0/577150571 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc800b910 con 0x7fbfd0160d40 2023-05-12T09:07:40.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.970+0000 7fbfc7fff700 1 -- 172.21.15.116:0/577150571 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc800bcc0 con 0x7fbfd0160d40 2023-05-12T09:07:40.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.971+0000 7fbfd77ff700 1 -- 172.21.15.116:0/577150571 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd0160d40 msgr2=0x7fbfd00d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.971+0000 7fbfd77ff700 1 --2- 172.21.15.116:0/577150571 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd0160d40 0x7fbfd00d1100 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009e50 tx=0x7fbfc800b330 comp rx=0 tx=0).stop 2023-05-12T09:07:40.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.971+0000 7fbfd77ff700 1 -- 172.21.15.116:0/577150571 shutdown_connections 2023-05-12T09:07:40.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.971+0000 7fbfd77ff700 1 --2- 172.21.15.116:0/577150571 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd0160d40 0x7fbfd00d1100 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.971+0000 7fbfd77ff700 1 --2- 172.21.15.116:0/577150571 >> v2:172.21.15.182:3300/0 conn(0x7fbfd00b87a0 0x7fbfd00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.971+0000 7fbfd77ff700 1 -- 172.21.15.116:0/577150571 >> 172.21.15.116:0/577150571 conn(0x7fbfd0071b10 msgr2=0x7fbfd0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:40.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.971+0000 7fbfd77ff700 1 -- 172.21.15.116:0/577150571 shutdown_connections 2023-05-12T09:07:40.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.971+0000 7fbfd77ff700 1 -- 172.21.15.116:0/577150571 wait complete. 2023-05-12T09:07:40.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.972+0000 7fbfd77ff700 1 Processor -- start 2023-05-12T09:07:40.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.973+0000 7fbfd77ff700 1 -- start start 2023-05-12T09:07:40.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.973+0000 7fbfd77ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbfd00b87a0 0x7fbfd00c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.973+0000 7fbfd77ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd01601e0 0x7fbfd00d3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd77ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfd0160d40 0x7fbfd00c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd77ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00c79d0 con 0x7fbfd0160d40 2023-05-12T09:07:40.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd77ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00c7cb0 con 0x7fbfd00b87a0 2023-05-12T09:07:40.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd77ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00c7f90 con 0x7fbfd01601e0 2023-05-12T09:07:40.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd559b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbfd00b87a0 0x7fbfd00c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd5d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfd0160d40 0x7fbfd00c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd559b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbfd00b87a0 0x7fbfd00c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:41788/0 (socket says 172.21.15.116:41788) 2023-05-12T09:07:40.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd559b700 1 -- 172.21.15.116:0/3386641608 learned_addr learned my addr 172.21.15.116:0/3386641608 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:40.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd4d9a700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd01601e0 0x7fbfd00d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd5d9c700 1 -- 172.21.15.116:0/3386641608 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd01601e0 msgr2=0x7fbfd00d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd5d9c700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd01601e0 0x7fbfd00d3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd5d9c700 1 -- 172.21.15.116:0/3386641608 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbfd00b87a0 msgr2=0x7fbfd00c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:40.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd5d9c700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbfd00b87a0 0x7fbfd00c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:40.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd5d9c700 1 -- 172.21.15.116:0/3386641608 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc8009b30 con 0x7fbfd0160d40 2023-05-12T09:07:40.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.974+0000 7fbfd5d9c700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfd0160d40 0x7fbfd00c6c60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8015000 tx=0x7fbfc8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:40.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.975+0000 7fbfc5ffb700 1 -- 172.21.15.116:0/3386641608 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8004800 con 0x7fbfd0160d40 2023-05-12T09:07:40.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.975+0000 7fbfc5ffb700 1 -- 172.21.15.116:0/3386641608 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc8004960 con 0x7fbfd0160d40 2023-05-12T09:07:40.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.975+0000 7fbfd77ff700 1 -- 172.21.15.116:0/3386641608 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd00d1640 con 0x7fbfd0160d40 2023-05-12T09:07:40.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.975+0000 7fbfc5ffb700 1 -- 172.21.15.116:0/3386641608 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc801b670 con 0x7fbfd0160d40 2023-05-12T09:07:40.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.975+0000 7fbfd77ff700 1 -- 172.21.15.116:0/3386641608 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd00cd980 con 0x7fbfd0160d40 2023-05-12T09:07:40.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.976+0000 7fbfd77ff700 1 -- 172.21.15.116:0/3386641608 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd00d17d0 con 0x7fbfd0160d40 2023-05-12T09:07:40.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.977+0000 7fbfc5ffb700 1 -- 172.21.15.116:0/3386641608 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbfc801b7d0 con 0x7fbfd0160d40 2023-05-12T09:07:40.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.978+0000 7fbfc5ffb700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbfb406ace0 0x7fbfb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:40.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.978+0000 7fbfc5ffb700 1 -- 172.21.15.116:0/3386641608 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbfc808ac60 con 0x7fbfd0160d40 2023-05-12T09:07:40.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.978+0000 7fbfd559b700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbfb406ace0 0x7fbfb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:40.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.979+0000 7fbfd559b700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbfb406ace0 0x7fbfb406d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbfd015ebb0 tx=0x7fbfcc009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:40.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:40.982+0000 7fbfc5ffb700 1 -- 172.21.15.116:0/3386641608 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbfc8055a10 con 0x7fbfd0160d40 2023-05-12T09:07:41.179 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.176+0000 7fbfd77ff700 1 -- 172.21.15.116:0/3386641608 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfd0074430 con 0x7fbfd0160d40 2023-05-12T09:07:41.180 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.177+0000 7fbfc5ffb700 1 -- 172.21.15.116:0/3386641608 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7fbfc8059030 con 0x7fbfd0160d40 2023-05-12T09:07:41.181 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:41.181 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:41.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.179+0000 7fbfd77ff700 1 -- 172.21.15.116:0/3386641608 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbfb406ace0 msgr2=0x7fbfb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.179+0000 7fbfd77ff700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbfb406ace0 0x7fbfb406d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbfd015ebb0 tx=0x7fbfcc009210 comp rx=0 tx=0).stop 2023-05-12T09:07:41.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.179+0000 7fbfd77ff700 1 -- 172.21.15.116:0/3386641608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfd0160d40 msgr2=0x7fbfd00c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.179+0000 7fbfd77ff700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfd0160d40 0x7fbfd00c6c60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8015000 tx=0x7fbfc8004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.180+0000 7fbfd77ff700 1 -- 172.21.15.116:0/3386641608 shutdown_connections 2023-05-12T09:07:41.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.180+0000 7fbfd77ff700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfd0160d40 0x7fbfd00c6c60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.180+0000 7fbfd77ff700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbfd00b87a0 0x7fbfd00c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.180+0000 7fbfd77ff700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbfb406ace0 0x7fbfb406d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.180+0000 7fbfd77ff700 1 --2- 172.21.15.116:0/3386641608 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbfd01601e0 0x7fbfd00d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.180+0000 7fbfd77ff700 1 -- 172.21.15.116:0/3386641608 >> 172.21.15.116:0/3386641608 conn(0x7fbfd0071b10 msgr2=0x7fbfd00cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:41.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.180+0000 7fbfd77ff700 1 -- 172.21.15.116:0/3386641608 shutdown_connections 2023-05-12T09:07:41.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.180+0000 7fbfd77ff700 1 -- 172.21.15.116:0/3386641608 wait complete. 2023-05-12T09:07:41.200 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-12T09:07:41.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:41.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.380+0000 7f76c49ff700 1 Processor -- start 2023-05-12T09:07:41.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.380+0000 7f76c49ff700 1 -- start start 2023-05-12T09:07:41.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.381+0000 7f76c49ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f76c015a280 0x7f76c015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.381+0000 7f76c49ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c015d6e0 con 0x7f76c00cd640 2023-05-12T09:07:41.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.381+0000 7f76c49ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c015d9c0 con 0x7f76c00d0b50 2023-05-12T09:07:41.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.381+0000 7f76c49ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c015dca0 con 0x7f76c015a280 2023-05-12T09:07:41.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76b7fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f76c00cd640 0x7f76c00cfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:47748/0 (socket says 172.21.15.116:47748) 2023-05-12T09:07:41.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76b7fff700 1 -- 172.21.15.116:0/1348100848 learned_addr learned my addr 172.21.15.116:0/1348100848 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:41.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76be59c700 1 --2- 172.21.15.116:0/1348100848 >> v2:172.21.15.182:3300/0 conn(0x7f76c015a280 0x7f76c015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76bdd9b700 1 -- 172.21.15.116:0/1348100848 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557050309 0 0) 0x7f76c015d6e0 con 0x7f76c00cd640 2023-05-12T09:07:41.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76bdd9b700 1 -- 172.21.15.116:0/1348100848 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ac0035b0 con 0x7f76c00cd640 2023-05-12T09:07:41.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76bdd9b700 1 -- 172.21.15.116:0/1348100848 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970230471 0 0) 0x7f76c015d9c0 con 0x7f76c00d0b50 2023-05-12T09:07:41.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76bdd9b700 1 -- 172.21.15.116:0/1348100848 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c015d6e0 con 0x7f76c00d0b50 2023-05-12T09:07:41.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76bdd9b700 1 -- 172.21.15.116:0/1348100848 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 314425211 0 0) 0x7f76ac0035b0 con 0x7f76c00cd640 2023-05-12T09:07:41.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76be59c700 1 -- 172.21.15.116:0/1348100848 >> v1:172.21.15.182:6789/0 conn(0x7f76c00d0b50 legacy=0x7f76c006bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76be59c700 1 -- 172.21.15.116:0/1348100848 >> v1:172.21.15.116:6789/0 conn(0x7f76c00cd640 legacy=0x7f76c00cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.382+0000 7f76be59c700 1 -- 172.21.15.116:0/1348100848 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c00cf370 con 0x7f76c015a280 2023-05-12T09:07:41.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.383+0000 7f76be59c700 1 --2- 172.21.15.116:0/1348100848 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76c015a280 0x7f76c015cd70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009840 tx=0x7f76b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13eafeb08242469a server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:41.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.383+0000 7f76bdd9b700 1 -- 172.21.15.116:0/1348100848 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8001670 con 0x7f76c015a280 2023-05-12T09:07:41.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.383+0000 7f76bdd9b700 1 -- 172.21.15.116:0/1348100848 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b0004030 con 0x7f76c015a280 2023-05-12T09:07:41.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.383+0000 7f76bdd9b700 1 -- 172.21.15.116:0/1348100848 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b00043c0 con 0x7f76c015a280 2023-05-12T09:07:41.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.383+0000 7f76c49ff700 1 -- 172.21.15.116:0/1348100848 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76c015a280 msgr2=0x7f76c015cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.383+0000 7f76c49ff700 1 --2- 172.21.15.116:0/1348100848 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76c015a280 0x7f76c015cd70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009840 tx=0x7f76b0009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:41.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.383+0000 7f76c49ff700 1 -- 172.21.15.116:0/1348100848 shutdown_connections 2023-05-12T09:07:41.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.383+0000 7f76c49ff700 1 --2- 172.21.15.116:0/1348100848 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76c015a280 0x7f76c015cd70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.383+0000 7f76c49ff700 1 -- 172.21.15.116:0/1348100848 >> 172.21.15.116:0/1348100848 conn(0x7f76c0066260 msgr2=0x7f76c0071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:41.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.384+0000 7f76c49ff700 1 -- 172.21.15.116:0/1348100848 shutdown_connections 2023-05-12T09:07:41.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.384+0000 7f76c49ff700 1 -- 172.21.15.116:0/1348100848 wait complete. 2023-05-12T09:07:41.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.385+0000 7f76c49ff700 1 Processor -- start 2023-05-12T09:07:41.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.385+0000 7f76c49ff700 1 -- start start 2023-05-12T09:07:41.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.386+0000 7f76c49ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76c00cd640 0x7f76c00b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.386+0000 7f76c49ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76c00d0b50 0x7f76c0157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.386+0000 7f76c49ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76c015a280 0x7f76c00d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.386+0000 7f76c49ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c01f5bc0 con 0x7f76c00cd640 2023-05-12T09:07:41.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.386+0000 7f76c49ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c01f5da0 con 0x7f76c00d0b50 2023-05-12T09:07:41.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.386+0000 7f76c49ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c01f6080 con 0x7f76c015a280 2023-05-12T09:07:41.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.386+0000 7f76be59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76c00cd640 0x7f76c00b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.386+0000 7f76be59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76c00cd640 0x7f76c00b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34030/0 (socket says 172.21.15.116:34030) 2023-05-12T09:07:41.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.386+0000 7f76be59c700 1 -- 172.21.15.116:0/2203238786 learned_addr learned my addr 172.21.15.116:0/2203238786 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:41.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76be59c700 1 -- 172.21.15.116:0/2203238786 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76c015a280 msgr2=0x7f76c00d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76be59c700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76c015a280 0x7f76c00d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76be59c700 1 -- 172.21.15.116:0/2203238786 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76c00d0b50 msgr2=0x7f76c0157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76b7fff700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76c00d0b50 0x7f76c0157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76be59c700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76c00d0b50 0x7f76c0157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76be59c700 1 -- 172.21.15.116:0/2203238786 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b00094a0 con 0x7f76c00cd640 2023-05-12T09:07:41.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76b7fff700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76c00d0b50 0x7f76c0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:41.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76be59c700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76c00cd640 0x7f76c00b75b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76b000a010 tx=0x7f76b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:41.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76b6ffd700 1 -- 172.21.15.116:0/2203238786 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0003db0 con 0x7f76c00cd640 2023-05-12T09:07:41.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76b6ffd700 1 -- 172.21.15.116:0/2203238786 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b001f070 con 0x7f76c00cd640 2023-05-12T09:07:41.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76c49ff700 1 -- 172.21.15.116:0/2203238786 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c015a650 con 0x7f76c00cd640 2023-05-12T09:07:41.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.387+0000 7f76b6ffd700 1 -- 172.21.15.116:0/2203238786 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0011870 con 0x7f76c00cd640 2023-05-12T09:07:41.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.388+0000 7f76c49ff700 1 -- 172.21.15.116:0/2203238786 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c00cf650 con 0x7f76c00cd640 2023-05-12T09:07:41.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.389+0000 7f76c49ff700 1 -- 172.21.15.116:0/2203238786 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c015a7e0 con 0x7f76c00cd640 2023-05-12T09:07:41.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.389+0000 7f76b6ffd700 1 -- 172.21.15.116:0/2203238786 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76b0021030 con 0x7f76c00cd640 2023-05-12T09:07:41.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.390+0000 7f76b6ffd700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f76a006ace0 0x7f76a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.390+0000 7f76b6ffd700 1 -- 172.21.15.116:0/2203238786 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f76b008ab90 con 0x7f76c00cd640 2023-05-12T09:07:41.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.390+0000 7f76b7fff700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f76a006ace0 0x7f76a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.391+0000 7f76b7fff700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f76a006ace0 0x7f76a006d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76a8001eb0 tx=0x7f76a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:41.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.395+0000 7f76b6ffd700 1 -- 172.21.15.116:0/2203238786 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f76b0055940 con 0x7f76c00cd640 2023-05-12T09:07:41.599 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.596+0000 7f76c49ff700 1 -- 172.21.15.116:0/2203238786 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76c00cdf50 con 0x7f76c00cd640 2023-05-12T09:07:41.600 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.597+0000 7f76b6ffd700 1 -- 172.21.15.116:0/2203238786 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7f76b0058f60 con 0x7f76c00cd640 2023-05-12T09:07:41.601 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:41.601 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:41.604 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 -- 172.21.15.116:0/2203238786 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f76a006ace0 msgr2=0x7f76a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.604 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f76a006ace0 0x7f76a006d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76a8001eb0 tx=0x7f76a8009040 comp rx=0 tx=0).stop 2023-05-12T09:07:41.604 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 -- 172.21.15.116:0/2203238786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76c00cd640 msgr2=0x7f76c00b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.604 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76c00cd640 0x7f76c00b75b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76b000a010 tx=0x7f76b0004750 comp rx=0 tx=0).stop 2023-05-12T09:07:41.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 -- 172.21.15.116:0/2203238786 shutdown_connections 2023-05-12T09:07:41.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f76a006ace0 0x7f76a006d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76c015a280 0x7f76c00d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76c00cd640 0x7f76c00b75b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 --2- 172.21.15.116:0/2203238786 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76c00d0b50 0x7f76c0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 -- 172.21.15.116:0/2203238786 >> 172.21.15.116:0/2203238786 conn(0x7f76c0066260 msgr2=0x7f76c015c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:41.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 -- 172.21.15.116:0/2203238786 shutdown_connections 2023-05-12T09:07:41.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.601+0000 7f76c49ff700 1 -- 172.21.15.116:0/2203238786 wait complete. 2023-05-12T09:07:41.630 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-12T09:07:41.630 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-12T09:07:41.631 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-12T09:07:41.631 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-12T09:07:41.632 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-12T09:07:41.632 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-12T09:07:41.633 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-12T09:07:41.633 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-12T09:07:41.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.966+0000 7f1aa3fff700 1 Processor -- start 2023-05-12T09:07:41.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.967+0000 7f1aa3fff700 1 -- start start 2023-05-12T09:07:41.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.969+0000 7f1aa3fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1a9c0cc6b0 0x7f1a9c1697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.969+0000 7f1aa3fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1a9c169d30 0x7f1a9c16a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.969+0000 7f1aa3fff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9c0cd270 con 0x7f1a9c16da20 2023-05-12T09:07:41.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.969+0000 7f1aa3fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c089dc0 con 0x7f1a9c0cc6b0 2023-05-12T09:07:41.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.969+0000 7f1aa3fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c16a6b0 con 0x7f1a9c169d30 2023-05-12T09:07:41.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.969+0000 7f1aa259c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1a9c169d30 0x7f1a9c16a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.969+0000 7f1aa1d9b700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f1a9c16da20 0x7f1a9c0714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:46266/0 (socket says 172.21.15.116:46266) 2023-05-12T09:07:41.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.969+0000 7f1aa1d9b700 1 -- 172.21.15.116:0/4045264824 learned_addr learned my addr 172.21.15.116:0/4045264824 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:41.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.970+0000 7f1aa159a700 1 --2- 172.21.15.116:0/4045264824 >> v2:172.21.15.116:3300/0 conn(0x7f1a9c0cc6b0 0x7f1a9c1697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.970+0000 7f1aa259c700 1 -- 172.21.15.116:0/4045264824 >> v2:172.21.15.116:3300/0 conn(0x7f1a9c0cc6b0 msgr2=0x7f1a9c1697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:41.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.970+0000 7f1aa259c700 1 --2- 172.21.15.116:0/4045264824 >> v2:172.21.15.116:3300/0 conn(0x7f1a9c0cc6b0 0x7f1a9c1697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.970+0000 7f1aa259c700 1 -- 172.21.15.116:0/4045264824 >> v1:172.21.15.182:6789/0 conn(0x7f1a9c16da20 legacy=0x7f1a9c0714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.970+0000 7f1aa259c700 1 -- 172.21.15.116:0/4045264824 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c0ccf90 con 0x7f1a9c169d30 2023-05-12T09:07:41.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.970+0000 7f0c467ff700 1 Processor -- start 2023-05-12T09:07:41.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.970+0000 7f0c467ff700 1 -- start start 2023-05-12T09:07:41.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.971+0000 7f51027ff700 1 Processor -- start 2023-05-12T09:07:41.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.971+0000 7f1aa259c700 1 --2- 172.21.15.116:0/4045264824 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1a9c169d30 0x7f1a9c16a170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800bae0 tx=0x7f1a9800bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c60305aac8e5321 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:41.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.971+0000 7f51027ff700 1 -- start start 2023-05-12T09:07:41.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.972+0000 7f1aa0d99700 1 -- 172.21.15.116:0/4045264824 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9800dd30 con 0x7f1a9c169d30 2023-05-12T09:07:41.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.972+0000 7f1aa0d99700 1 -- 172.21.15.116:0/4045264824 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9800de90 con 0x7f1a9c169d30 2023-05-12T09:07:41.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.972+0000 7f1aa0d99700 1 -- 172.21.15.116:0/4045264824 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98010690 con 0x7f1a9c169d30 2023-05-12T09:07:41.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f1aa3fff700 1 -- 172.21.15.116:0/4045264824 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1a9c169d30 msgr2=0x7f1a9c16a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f1aa3fff700 1 --2- 172.21.15.116:0/4045264824 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1a9c169d30 0x7f1a9c16a170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800bae0 tx=0x7f1a9800bdf0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f1aa3fff700 1 -- 172.21.15.116:0/4045264824 shutdown_connections 2023-05-12T09:07:41.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f1aa3fff700 1 --2- 172.21.15.116:0/4045264824 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1a9c169d30 0x7f1a9c16a170 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f1aa3fff700 1 --2- 172.21.15.116:0/4045264824 >> v2:172.21.15.116:3300/0 conn(0x7f1a9c0cc6b0 0x7f1a9c1697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f1aa3fff700 1 -- 172.21.15.116:0/4045264824 >> 172.21.15.116:0/4045264824 conn(0x7f1a9c0cf6e0 msgr2=0x7f1a9c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:41.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f51027ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50fc0ad690 0x7f50fc0adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f51027ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f50fc0c19c0 0x7f50fc0c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f51027ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50fc0cd1f0 con 0x7f50fc160d20 2023-05-12T09:07:41.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f51027ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50fc1610f0 con 0x7f50fc0c19c0 2023-05-12T09:07:41.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.973+0000 7f51027ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc0c2320 con 0x7f50fc0ad690 2023-05-12T09:07:41.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.974+0000 7f1aa3fff700 1 -- 172.21.15.116:0/4045264824 shutdown_connections 2023-05-12T09:07:41.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.974+0000 7f50fbfff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f50fc160d20 0x7f50fc06cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60420/0 (socket says 172.21.15.116:60420) 2023-05-12T09:07:41.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.974+0000 7f50fbfff700 1 -- 172.21.15.116:0/2309356151 learned_addr learned my addr 172.21.15.116:0/2309356151 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:41.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.975+0000 7f5100d9c700 1 --2- 172.21.15.116:0/2309356151 >> v2:172.21.15.116:3300/0 conn(0x7f50fc0c19c0 0x7f50fc0c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.976+0000 7f5100d9c700 1 -- 172.21.15.116:0/2309356151 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50fc0ad690 msgr2=0x7f50fc0adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:41.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.976+0000 7f5100d9c700 1 --2- 172.21.15.116:0/2309356151 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50fc0ad690 0x7f50fc0adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.976+0000 7f5100d9c700 1 -- 172.21.15.116:0/2309356151 >> v1:172.21.15.116:6789/0 conn(0x7f50fc160d20 legacy=0x7f50fc06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.976+0000 7f5100d9c700 1 -- 172.21.15.116:0/2309356151 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc0cc670 con 0x7f50fc0c19c0 2023-05-12T09:07:41.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.976+0000 7f5100d9c700 1 --2- 172.21.15.116:0/2309356151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50fc0c19c0 0x7f50fc0c1de0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009d90 tx=0x7f50f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae67cd81884f875 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:41.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.977+0000 7f0c467ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0c400ad930 0x7f0c400add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.977+0000 7f0c467ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0c40160fd0 0x7f0c4006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.977+0000 7f0c467ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c40070af0 con 0x7f0c4006c6c0 2023-05-12T09:07:41.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.977+0000 7f0c467ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c400ae240 con 0x7f0c40160fd0 2023-05-12T09:07:41.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.977+0000 7f0c467ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40161530 con 0x7f0c400ad930 2023-05-12T09:07:41.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.978+0000 7f0c44d9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f0c4006c6c0 0x7f0c40070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60424/0 (socket says 172.21.15.116:60424) 2023-05-12T09:07:41.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.978+0000 7f0c44d9c700 1 -- 172.21.15.116:0/3866156617 learned_addr learned my addr 172.21.15.116:0/3866156617 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:41.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.974+0000 7f1aa3fff700 1 -- 172.21.15.116:0/4045264824 wait complete. 2023-05-12T09:07:41.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.977+0000 7f1aa3fff700 1 Processor -- start 2023-05-12T09:07:41.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.977+0000 7f1aa3fff700 1 -- start start 2023-05-12T09:07:41.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.977+0000 7f50fb7fe700 1 -- 172.21.15.116:0/2309356151 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400e070 con 0x7f50fc0c19c0 2023-05-12T09:07:41.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.977+0000 7f50fb7fe700 1 -- 172.21.15.116:0/2309356151 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f400bbd0 con 0x7f50fc0c19c0 2023-05-12T09:07:41.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.977+0000 7f50fb7fe700 1 -- 172.21.15.116:0/2309356151 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4012430 con 0x7f50fc0c19c0 2023-05-12T09:07:41.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.978+0000 7f51027ff700 1 -- 172.21.15.116:0/2309356151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50fc0c19c0 msgr2=0x7f50fc0c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.978+0000 7f51027ff700 1 --2- 172.21.15.116:0/2309356151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50fc0c19c0 0x7f50fc0c1de0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009d90 tx=0x7f50f400b330 comp rx=0 tx=0).stop 2023-05-12T09:07:41.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.978+0000 7f0c3ffff700 1 --2- 172.21.15.116:0/3866156617 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0c400ad930 0x7f0c400add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.978+0000 7f1aa3fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1a9c0cc6b0 0x7f1a9c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.979+0000 7f1aa3fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1a9c169d30 0x7f1a9c162450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.979+0000 7f1aa3fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a9c16da20 0x7f1a9c0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.979+0000 7f1aa3fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c0b18c0 con 0x7f1a9c16da20 2023-05-12T09:07:41.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.979+0000 7f1aa3fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c0b3e10 con 0x7f1a9c0cc6b0 2023-05-12T09:07:41.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.979+0000 7f1aa3fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c161800 con 0x7f1a9c169d30 2023-05-12T09:07:41.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.979+0000 7f1aa159a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1a9c169d30 0x7f1a9c162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f1aa1d9b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1a9c0cc6b0 0x7f1a9c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f1aa259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a9c16da20 0x7f1a9c0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f1aa259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a9c16da20 0x7f1a9c0c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57012/0 (socket says 172.21.15.116:57012) 2023-05-12T09:07:41.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f1aa259c700 1 -- 172.21.15.116:0/2939206222 learned_addr learned my addr 172.21.15.116:0/2939206222 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:41.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f0c3ffff700 1 -- 172.21.15.116:0/3866156617 >> v2:172.21.15.116:3300/0 conn(0x7f0c40160fd0 msgr2=0x7f0c4006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:41.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f0c3ffff700 1 --2- 172.21.15.116:0/3866156617 >> v2:172.21.15.116:3300/0 conn(0x7f0c40160fd0 0x7f0c4006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.989 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f0c3ffff700 1 -- 172.21.15.116:0/3866156617 >> v1:172.21.15.116:6789/0 conn(0x7f0c4006c6c0 legacy=0x7f0c40070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.989 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f0c3ffff700 1 -- 172.21.15.116:0/3866156617 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40161810 con 0x7f0c400ad930 2023-05-12T09:07:41.989 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.981+0000 7f0c3ffff700 1 --2- 172.21.15.116:0/3866156617 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0c400ad930 0x7f0c400add00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009840 tx=0x7f0c30009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f83224466712609a server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:41.989 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f1aa259c700 1 -- 172.21.15.116:0/2939206222 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1a9c169d30 msgr2=0x7f1a9c162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f1aa259c700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1a9c169d30 0x7f1a9c162450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f1aa259c700 1 -- 172.21.15.116:0/2939206222 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1a9c0cc6b0 msgr2=0x7f1a9c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f1aa259c700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1a9c0cc6b0 0x7f1a9c0b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f1aa259c700 1 -- 172.21.15.116:0/2939206222 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9800b740 con 0x7f1a9c16da20 2023-05-12T09:07:41.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f51027ff700 1 -- 172.21.15.116:0/2309356151 shutdown_connections 2023-05-12T09:07:41.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f51027ff700 1 --2- 172.21.15.116:0/2309356151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50fc0c19c0 0x7f50fc0c1de0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f51027ff700 1 --2- 172.21.15.116:0/2309356151 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50fc0ad690 0x7f50fc0adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.980+0000 7f51027ff700 1 -- 172.21.15.116:0/2309356151 >> 172.21.15.116:0/2309356151 conn(0x7f50fc0cf720 msgr2=0x7f50fc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:41.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.981+0000 7f1aa259c700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a9c16da20 0x7f1a9c0c82f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800b2c0 tx=0x7f1a98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:41.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.981+0000 7f3baf5ff700 1 Processor -- start 2023-05-12T09:07:41.992 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.981+0000 7f0c3effd700 1 -- 172.21.15.116:0/3866156617 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30004230 con 0x7f0c400ad930 2023-05-12T09:07:41.992 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.981+0000 7f0c3effd700 1 -- 172.21.15.116:0/3866156617 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c30004390 con 0x7f0c400ad930 2023-05-12T09:07:41.992 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.981+0000 7f0c3effd700 1 -- 172.21.15.116:0/3866156617 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300036a0 con 0x7f0c400ad930 2023-05-12T09:07:41.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.981+0000 7f3baf5ff700 1 -- start start 2023-05-12T09:07:41.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.981+0000 7f12b2dff700 1 Processor -- start 2023-05-12T09:07:41.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.982+0000 7f12b2dff700 1 -- start start 2023-05-12T09:07:41.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.982+0000 7f0c467ff700 1 -- 172.21.15.116:0/3866156617 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0c400ad930 msgr2=0x7f0c400add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.982+0000 7f0c467ff700 1 --2- 172.21.15.116:0/3866156617 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0c400ad930 0x7f0c400add00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009840 tx=0x7f0c30009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:41.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f0c467ff700 1 -- 172.21.15.116:0/3866156617 shutdown_connections 2023-05-12T09:07:41.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f0c467ff700 1 --2- 172.21.15.116:0/3866156617 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0c400ad930 0x7f0c400add00 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009840 tx=0x7f0c30009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:41.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f0c467ff700 1 --2- 172.21.15.116:0/3866156617 >> v2:172.21.15.116:3300/0 conn(0x7f0c40160fd0 0x7f0c4006a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f0c467ff700 1 -- 172.21.15.116:0/3866156617 >> 172.21.15.116:0/3866156617 conn(0x7f0c400cf6e0 msgr2=0x7f0c400cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:41.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.982+0000 7f1a927fc700 1 -- 172.21.15.116:0/2939206222 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9801d070 con 0x7f1a9c16da20 2023-05-12T09:07:41.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f1a927fc700 1 -- 172.21.15.116:0/2939206222 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a98003a90 con 0x7f1a9c16da20 2023-05-12T09:07:41.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f1a927fc700 1 -- 172.21.15.116:0/2939206222 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98003e20 con 0x7f1a9c16da20 2023-05-12T09:07:41.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c16d240 con 0x7f1a9c16da20 2023-05-12T09:07:41.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c16cf60 con 0x7f1a9c16da20 2023-05-12T09:07:41.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f3baf5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3ba80ce990 0x7f3ba80cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.996 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f3baf5ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba80b04b0 con 0x7f3ba80b17a0 2023-05-12T09:07:41.996 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f3baf5ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba80b01f0 con 0x7f3ba80b69a0 2023-05-12T09:07:41.996 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f3baf5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba80cf340 con 0x7f3ba80ce990 2023-05-12T09:07:41.996 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f51027ff700 1 -- 172.21.15.116:0/2309356151 shutdown_connections 2023-05-12T09:07:41.997 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f12b2dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f12ac0ad930 0x7f12ac0add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.997 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f12b2dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f12ac160fd0 0x7f12ac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:41.997 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f12b2dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac070af0 con 0x7f12ac06c6c0 2023-05-12T09:07:41.997 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f12b2dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac0ae240 con 0x7f12ac160fd0 2023-05-12T09:07:41.998 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f12b2dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac161530 con 0x7f12ac0ad930 2023-05-12T09:07:41.998 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f12b0b9b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f12ac0ad930 0x7f12ac0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.998 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f12b0b9b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f12ac0ad930 0x7f12ac0add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58308/0 (socket says 172.21.15.116:58308) 2023-05-12T09:07:41.998 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f12b0b9b700 1 -- 172.21.15.116:0/2865659196 learned_addr learned my addr 172.21.15.116:0/2865659196 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:41.998 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f12abfff700 1 --2- 172.21.15.116:0/2865659196 >> v2:172.21.15.116:3300/0 conn(0x7f12ac160fd0 0x7f12ac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:41.998 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f3badb9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f3ba80b17a0 0x7f3ba80b1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60430/0 (socket says 172.21.15.116:60430) 2023-05-12T09:07:41.999 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f3badb9c700 1 -- 172.21.15.116:0/739940158 learned_addr learned my addr 172.21.15.116:0/739940158 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:41.999 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.985+0000 7f12b0b9b700 1 -- 172.21.15.116:0/2865659196 >> v2:172.21.15.116:3300/0 conn(0x7f12ac160fd0 msgr2=0x7f12ac06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:41.999 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.985+0000 7f12b0b9b700 1 --2- 172.21.15.116:0/2865659196 >> v2:172.21.15.116:3300/0 conn(0x7f12ac160fd0 0x7f12ac06a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:41.999 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.985+0000 7f12b0b9b700 1 -- 172.21.15.116:0/2865659196 >> v1:172.21.15.182:6789/0 conn(0x7f12ac06c6c0 legacy=0x7f12ac070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:41.999 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.985+0000 7f12b0b9b700 1 -- 172.21.15.116:0/2865659196 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac161810 con 0x7f12ac0ad930 2023-05-12T09:07:42.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.985+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717145631 0 0) 0x7f3ba80b04b0 con 0x7f3ba80b17a0 2023-05-12T09:07:42.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.985+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b940035b0 con 0x7f3ba80b17a0 2023-05-12T09:07:42.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f12b0b9b700 1 --2- 172.21.15.116:0/2865659196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f12ac0ad930 0x7f12ac0add00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0706a0 tx=0x7f129c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d711663c127bfe3 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236220463 0 0) 0x7f3b940035b0 con 0x7f3ba80b17a0 2023-05-12T09:07:42.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3ba80ce990 msgr2=0x7f3ba80cee00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-12T09:07:42.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 --2- 172.21.15.116:0/739940158 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3ba80ce990 0x7f3ba80cee00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 >> v1:172.21.15.182:6789/0 conn(0x7f3ba80b69a0 legacy=0x7f3ba80af3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-12T09:07:42.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba80b0700 con 0x7f3ba80b17a0 2023-05-12T09:07:42.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f3ba00019f0 con 0x7f3ba80b17a0 2023-05-12T09:07:42.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 >> v1:172.21.15.116:6789/0 conn(0x7f3ba80b17a0 legacy=0x7f3ba80b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 --2- 172.21.15.116:0/739940158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b94003a30 0x7f3b94003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 --2- 172.21.15.116:0/739940158 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b94004850 0x7f3b94004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 --2- 172.21.15.116:0/739940158 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b94005200 0x7f3b9400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba80cf340 con 0x7f3b94003a30 2023-05-12T09:07:42.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9400c160 con 0x7f3b94005200 2023-05-12T09:07:42.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9400c320 con 0x7f3b94004850 2023-05-12T09:07:42.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f0c467ff700 1 -- 172.21.15.116:0/3866156617 shutdown_connections 2023-05-12T09:07:42.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.983+0000 7f0c467ff700 1 -- 172.21.15.116:0/3866156617 wait complete. 2023-05-12T09:07:42.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f0c467ff700 1 Processor -- start 2023-05-12T09:07:42.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.987+0000 7f1a927fc700 1 -- 172.21.15.116:0/2939206222 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a98022470 con 0x7f1a9c16da20 2023-05-12T09:07:42.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a84000fc0 con 0x7f1a9c16da20 2023-05-12T09:07:42.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.984+0000 7f51027ff700 1 -- 172.21.15.116:0/2309356151 wait complete. 2023-05-12T09:07:42.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f51027ff700 1 Processor -- start 2023-05-12T09:07:42.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.987+0000 7fd6e0fff700 1 Processor -- start 2023-05-12T09:07:42.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.987+0000 7fd6e0fff700 1 -- start start 2023-05-12T09:07:42.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f12ab7fe700 1 -- 172.21.15.116:0/2865659196 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c011830 con 0x7f12ac0ad930 2023-05-12T09:07:42.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f12ab7fe700 1 -- 172.21.15.116:0/2865659196 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c011990 con 0x7f12ac0ad930 2023-05-12T09:07:42.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f12ab7fe700 1 -- 172.21.15.116:0/2865659196 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c011d20 con 0x7f12ac0ad930 2023-05-12T09:07:42.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.987+0000 7f12b2dff700 1 -- 172.21.15.116:0/2865659196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f12ac0ad930 msgr2=0x7f12ac0add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.987+0000 7f12b2dff700 1 --2- 172.21.15.116:0/2865659196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f12ac0ad930 0x7f12ac0add00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0706a0 tx=0x7f129c009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f12b2dff700 1 -- 172.21.15.116:0/2865659196 shutdown_connections 2023-05-12T09:07:42.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f12b2dff700 1 --2- 172.21.15.116:0/2865659196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f12ac0ad930 0x7f12ac0add00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f12b2dff700 1 --2- 172.21.15.116:0/2865659196 >> v2:172.21.15.116:3300/0 conn(0x7f12ac160fd0 0x7f12ac06a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f12b2dff700 1 -- 172.21.15.116:0/2865659196 >> 172.21.15.116:0/2865659196 conn(0x7f12ac0cf6e0 msgr2=0x7f12ac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.986+0000 7f0c467ff700 1 -- start start 2023-05-12T09:07:42.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f0c467ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c4006c6c0 0x7f0c400c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f0c467ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0c40160fd0 0x7f0c401eb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f0c467ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0c400c3cb0 0x7f0c400b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f0c467ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401ea3f0 con 0x7f0c4006c6c0 2023-05-12T09:07:42.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f0c467ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401ea6d0 con 0x7f0c400c3cb0 2023-05-12T09:07:42.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f0c467ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401ea9b0 con 0x7f0c40160fd0 2023-05-12T09:07:42.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f0c44d9c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0c400c3cb0 0x7f0c400b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f0c44d9c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0c400c3cb0 0x7f0c400b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58324/0 (socket says 172.21.15.116:58324) 2023-05-12T09:07:42.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f0c44d9c700 1 -- 172.21.15.116:0/2480471439 learned_addr learned my addr 172.21.15.116:0/2480471439 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.989+0000 7f1a927fc700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1a8006adb0 0x7f1a8006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.987+0000 7f51027ff700 1 -- start start 2023-05-12T09:07:42.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f51027ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50fc0ad690 0x7f50fc0c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f51027ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50fc0c19c0 0x7f50fc15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f51027ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f50fc160d20 0x7f50fc14d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f51027ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc14b840 con 0x7f50fc0c19c0 2023-05-12T09:07:42.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f51027ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc0c3570 con 0x7f50fc160d20 2023-05-12T09:07:42.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7f51027ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc0c3850 con 0x7f50fc0ad690 2023-05-12T09:07:42.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7fd6e0fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 0x7fd6dc06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7fd6e0fff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fd6dc0ad690 0x7fd6dc0adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7fd6e0fff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc0cd1f0 con 0x7fd6dc0c19c0 2023-05-12T09:07:42.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.989+0000 7fd6e0fff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc1610f0 con 0x7fd6dc0ad690 2023-05-12T09:07:42.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.989+0000 7fd6e0fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0cc670 con 0x7fd6dc160d20 2023-05-12T09:07:42.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.989+0000 7fd6da59c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 0x7fd6dc06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.989+0000 7fd6da59c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 0x7fd6dc06cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49012/0 (socket says 172.21.15.116:49012) 2023-05-12T09:07:42.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.989+0000 7fd6da59c700 1 -- 172.21.15.116:0/2283372670 learned_addr learned my addr 172.21.15.116:0/2283372670 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.989+0000 7f12b2dff700 1 -- 172.21.15.116:0/2865659196 shutdown_connections 2023-05-12T09:07:42.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.989+0000 7f12b2dff700 1 -- 172.21.15.116:0/2865659196 wait complete. 2023-05-12T09:07:42.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.989+0000 7f3bacb9a700 1 --2- 172.21.15.116:0/739940158 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b94004850 0x7f3b94004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.988+0000 7faeb91ff700 1 Processor -- start 2023-05-12T09:07:42.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.989+0000 7f1a927fc700 1 -- 172.21.15.116:0/2939206222 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a9808ab80 con 0x7f1a9c16da20 2023-05-12T09:07:42.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f1aa1d9b700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1a8006adb0 0x7f1a8006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f1a927fc700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:6809/2195307728,v1:172.21.15.116:6811/2195307728] conn(0x7f1a80074a00 0x7f1a80076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f1a927fc700 1 -- 172.21.15.116:0/2939206222 --> [v2:172.21.15.116:6809/2195307728,v1:172.21.15.116:6811/2195307728] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a80077500 con 0x7f1a80074a00 2023-05-12T09:07:42.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f0c44d9c700 1 -- 172.21.15.116:0/2480471439 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0c40160fd0 msgr2=0x7f0c401eb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f0c44d9c700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0c40160fd0 0x7f0c401eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f0c44d9c700 1 -- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c4006c6c0 msgr2=0x7f0c400c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f0c44d9c700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c4006c6c0 0x7f0c400c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f0c44d9c700 1 -- 172.21.15.116:0/2480471439 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c300094a0 con 0x7f0c400c3cb0 2023-05-12T09:07:42.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f0c44d9c700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0c400c3cb0 0x7f0c400b1c50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0c38002000 tx=0x7f0c3800a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f1a927fc700 1 -- 172.21.15.116:0/2939206222 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a980559f0 con 0x7f1a9c16da20 2023-05-12T09:07:42.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7fd6da59c700 1 -- 172.21.15.116:0/2283372670 >> v2:172.21.15.182:3300/0 conn(0x7fd6dc0ad690 msgr2=0x7fd6dc0adb30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-12T09:07:42.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7fd6da59c700 1 --2- 172.21.15.116:0/2283372670 >> v2:172.21.15.182:3300/0 conn(0x7fd6dc0ad690 0x7fd6dc0adb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7fd6da59c700 1 -- 172.21.15.116:0/2283372670 >> v1:172.21.15.182:6789/0 conn(0x7fd6dc0c19c0 legacy=0x7fd6dc0c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7fd6da59c700 1 -- 172.21.15.116:0/2283372670 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0cc950 con 0x7fd6dc160d20 2023-05-12T09:07:42.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f3bacb9a700 1 -- 172.21.15.116:0/739940158 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b94005200 msgr2=0x7f3b9400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f3bacb9a700 1 --2- 172.21.15.116:0/739940158 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b94005200 0x7f3b9400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f3bacb9a700 1 -- 172.21.15.116:0/739940158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b94003a30 msgr2=0x7f3b94003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f3bacb9a700 1 --2- 172.21.15.116:0/739940158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b94003a30 0x7f3b94003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f3bacb9a700 1 -- 172.21.15.116:0/739940158 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba80b0700 con 0x7f3b94004850 2023-05-12T09:07:42.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f3bacb9a700 1 --2- 172.21.15.116:0/739940158 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b94004850 0x7f3b94004cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80718c0 tx=0x7f3b94005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4bbc2087293ca3f server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f1aa159a700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:6809/2195307728,v1:172.21.15.116:6811/2195307728] conn(0x7f1a80074a00 0x7f1a80076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f1aa1d9b700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1a8006adb0 0x7f1a8006d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a94005c60 tx=0x7f1a94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98011620 con 0x7f3b94004850 2023-05-12T09:07:42.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b98011780 con 0x7f3b94004850 2023-05-12T09:07:42.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f3b9ffff700 1 -- 172.21.15.116:0/739940158 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98011b10 con 0x7f3b94004850 2023-05-12T09:07:42.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7faeb91ff700 1 -- start start 2023-05-12T09:07:42.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7faeb91ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7faeb415c590 0x7faeb4160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7faeb91ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faeb40cf010 0x7faeb40cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7faeb91ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cfd80 0x7faeb40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7faeb91ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb40cd520 con 0x7faeb40cf010 2023-05-12T09:07:42.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7faeb91ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb40d2640 con 0x7faeb415c590 2023-05-12T09:07:42.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7faeb91ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb41610d0 con 0x7faeb40cfd80 2023-05-12T09:07:42.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7f3baf5ff700 1 -- 172.21.15.116:0/739940158 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b94004850 msgr2=0x7f3b94004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7f3baf5ff700 1 --2- 172.21.15.116:0/739940158 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3b94004850 0x7f3b94004cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80718c0 tx=0x7f3b94005880 comp rx=0 tx=0).stop 2023-05-12T09:07:42.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f12b2dff700 1 Processor -- start 2023-05-12T09:07:42.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7f12b2dff700 1 -- start start 2023-05-12T09:07:42.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7fd6da59c700 1 --2- 172.21.15.116:0/2283372670 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 0x7fd6dc06cb90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00098f0 tx=0x7fd6d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7240f4864414d81 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f0c3cff9700 1 -- 172.21.15.116:0/2480471439 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800ad40 con 0x7f0c400c3cb0 2023-05-12T09:07:42.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f0c3cff9700 1 -- 172.21.15.116:0/2480471439 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c380070d0 con 0x7f0c400c3cb0 2023-05-12T09:07:42.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f0c3cff9700 1 -- 172.21.15.116:0/2480471439 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800aea0 con 0x7f0c400c3cb0 2023-05-12T09:07:42.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c40161dd0 con 0x7f0c400c3cb0 2023-05-12T09:07:42.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.991+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c40161af0 con 0x7f0c400c3cb0 2023-05-12T09:07:42.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c4006ace0 con 0x7f0c400c3cb0 2023-05-12T09:07:42.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7f1aa159a700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:6809/2195307728,v1:172.21.15.116:6811/2195307728] conn(0x7f1a80074a00 0x7f1a80076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f5100d9c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f50fc160d20 0x7f50fc14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f5100d9c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f50fc160d20 0x7f50fc14d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58334/0 (socket says 172.21.15.116:58334) 2023-05-12T09:07:42.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.990+0000 7f5100d9c700 1 -- 172.21.15.116:0/60615219 learned_addr learned my addr 172.21.15.116:0/60615219 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7f3badb9c700 1 -- 172.21.15.116:0/739940158 reap_dead start 2023-05-12T09:07:42.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.992+0000 7f50f3fff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50fc0c19c0 0x7f50fc15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7fd6d959a700 1 -- 172.21.15.116:0/2283372670 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0004230 con 0x7fd6dc160d20 2023-05-12T09:07:42.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7fd6d959a700 1 -- 172.21.15.116:0/2283372670 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d0004390 con 0x7fd6dc160d20 2023-05-12T09:07:42.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7fd6d959a700 1 -- 172.21.15.116:0/2283372670 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00036a0 con 0x7fd6dc160d20 2023-05-12T09:07:42.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7f3baf5ff700 1 -- 172.21.15.116:0/739940158 shutdown_connections 2023-05-12T09:07:42.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7f3baf5ff700 1 -- 172.21.15.116:0/739940158 >> 172.21.15.116:0/739940158 conn(0x7f3ba809a090 msgr2=0x7f3ba80d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7faeb359e700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cfd80 0x7faeb40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7faeb359e700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cfd80 0x7faeb40d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49026/0 (socket says 172.21.15.116:49026) 2023-05-12T09:07:42.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7faeb359e700 1 -- 172.21.15.116:0/2125615648 learned_addr learned my addr 172.21.15.116:0/2125615648 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7faeaa59c700 1 --2- 172.21.15.116:0/2125615648 >> v2:172.21.15.116:3300/0 conn(0x7faeb40cf010 0x7faeb40cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7f50fbfff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50fc0ad690 0x7f50fc0c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f50fbfff700 1 -- 172.21.15.116:0/60615219 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f50fc160d20 msgr2=0x7f50fc14d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f50fbfff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f50fc160d20 0x7f50fc14d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f50fbfff700 1 -- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50fc0c19c0 msgr2=0x7f50fc15e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f50fbfff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50fc0c19c0 0x7f50fc15e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f50fbfff700 1 -- 172.21.15.116:0/60615219 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4009a70 con 0x7f50fc0ad690 2023-05-12T09:07:42.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f50f3fff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50fc0c19c0 0x7f50fc15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:42.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7fd6e0fff700 1 -- 172.21.15.116:0/2283372670 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 msgr2=0x7fd6dc06cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7fd6e0fff700 1 --2- 172.21.15.116:0/2283372670 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 0x7fd6dc06cb90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00098f0 tx=0x7fd6d0009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:42.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7f3baf5ff700 1 -- 172.21.15.116:0/739940158 shutdown_connections 2023-05-12T09:07:42.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7faeb2d9d700 1 --2- 172.21.15.116:0/2125615648 >> v2:172.21.15.182:3300/0 conn(0x7faeb415c590 0x7faeb4160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7faeb359e700 1 -- 172.21.15.116:0/2125615648 >> v2:172.21.15.182:3300/0 conn(0x7faeb415c590 msgr2=0x7faeb4160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7faeb359e700 1 --2- 172.21.15.116:0/2125615648 >> v2:172.21.15.182:3300/0 conn(0x7faeb415c590 0x7faeb4160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7faeb359e700 1 -- 172.21.15.116:0/2125615648 >> v2:172.21.15.116:3300/0 conn(0x7faeb40cf010 msgr2=0x7faeb40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7faeb359e700 1 --2- 172.21.15.116:0/2125615648 >> v2:172.21.15.116:3300/0 conn(0x7faeb40cf010 0x7faeb40cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.993+0000 7faeb359e700 1 -- 172.21.15.116:0/2125615648 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40d01e0 con 0x7faeb40cfd80 2023-05-12T09:07:42.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7faeb359e700 1 --2- 172.21.15.116:0/2125615648 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cfd80 0x7faeb40d0aa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faeb40d0a50 tx=0x7faeac009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b920a6bf38e0e37 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f12b2dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f12ac06c6c0 0x7f12ac159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f12b2dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12ac0ad930 0x7f12ac1595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f12b2dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12ac160fd0 0x7f12ac1e7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f12b2dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac1f7430 con 0x7f12ac0ad930 2023-05-12T09:07:42.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f12b2dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac15d180 con 0x7f12ac06c6c0 2023-05-12T09:07:42.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f12b2dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac1f6a90 con 0x7f12ac160fd0 2023-05-12T09:07:42.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7fd6e0fff700 1 -- 172.21.15.116:0/2283372670 shutdown_connections 2023-05-12T09:07:42.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7fd6e0fff700 1 --2- 172.21.15.116:0/2283372670 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 0x7fd6dc06cb90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7fd6e0fff700 1 --2- 172.21.15.116:0/2283372670 >> v2:172.21.15.182:3300/0 conn(0x7fd6dc0ad690 0x7fd6dc0adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7fd6e0fff700 1 -- 172.21.15.116:0/2283372670 >> 172.21.15.116:0/2283372670 conn(0x7fd6dc0cf720 msgr2=0x7fd6dc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f1a927fc700 1 -- 172.21.15.116:0/2939206222 <== osd.1 v2:172.21.15.116:6809/2195307728 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1a80077500 con 0x7f1a80074a00 2023-05-12T09:07:42.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7f50fbfff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50fc0ad690 0x7f50fc0c2f00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00c3c0 tx=0x7f50ec00c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7f50f97fa700 1 -- 172.21.15.116:0/60615219 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec005b40 con 0x7f50fc0ad690 2023-05-12T09:07:42.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7f50f97fa700 1 -- 172.21.15.116:0/60615219 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec005ca0 con 0x7f50fc0ad690 2023-05-12T09:07:42.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7f50f97fa700 1 -- 172.21.15.116:0/60615219 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec0072d0 con 0x7f50fc0ad690 2023-05-12T09:07:42.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7f12b0b9b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f12ac06c6c0 0x7f12ac159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7f12b0b9b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f12ac06c6c0 0x7f12ac159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58356/0 (socket says 172.21.15.116:58356) 2023-05-12T09:07:42.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7f12b0b9b700 1 -- 172.21.15.116:0/2914690131 learned_addr learned my addr 172.21.15.116:0/2914690131 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7f12abfff700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12ac0ad930 0x7f12ac1595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7faeb259c700 1 -- 172.21.15.116:0/2125615648 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac00b870 con 0x7faeb40cfd80 2023-05-12T09:07:42.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7faeb259c700 1 -- 172.21.15.116:0/2125615648 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac00b9d0 con 0x7faeb40cfd80 2023-05-12T09:07:42.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.995+0000 7faeb259c700 1 -- 172.21.15.116:0/2125615648 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac00bd40 con 0x7faeb40cfd80 2023-05-12T09:07:42.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7faeb91ff700 1 -- 172.21.15.116:0/2125615648 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cfd80 msgr2=0x7faeb40d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7faeb91ff700 1 --2- 172.21.15.116:0/2125615648 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cfd80 0x7faeb40d0aa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faeb40d0a50 tx=0x7faeac009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.994+0000 7f3baf5ff700 1 -- 172.21.15.116:0/739940158 wait complete. 2023-05-12T09:07:42.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7f12abfff700 1 -- 172.21.15.116:0/2914690131 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12ac160fd0 msgr2=0x7f12ac1e7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7f12abfff700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12ac160fd0 0x7f12ac1e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7f12abfff700 1 -- 172.21.15.116:0/2914690131 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f12ac06c6c0 msgr2=0x7f12ac159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7f12abfff700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f12ac06c6c0 0x7f12ac159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7f12abfff700 1 -- 172.21.15.116:0/2914690131 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c009550 con 0x7f12ac0ad930 2023-05-12T09:07:42.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7f12abfff700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12ac0ad930 0x7f12ac1595c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12a000e900 tx=0x7f12a000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7f3baf5ff700 1 Processor -- start 2023-05-12T09:07:42.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc0ccc30 con 0x7f50fc0ad690 2023-05-12T09:07:42.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc0cc950 con 0x7f50fc0ad690 2023-05-12T09:07:42.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.997+0000 7faeb91ff700 1 -- 172.21.15.116:0/2125615648 shutdown_connections 2023-05-12T09:07:42.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.997+0000 7faeb91ff700 1 --2- 172.21.15.116:0/2125615648 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cfd80 0x7faeb40d0aa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.997+0000 7faeb91ff700 1 --2- 172.21.15.116:0/2125615648 >> v2:172.21.15.182:3300/0 conn(0x7faeb415c590 0x7faeb4160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.997+0000 7faeb91ff700 1 --2- 172.21.15.116:0/2125615648 >> v2:172.21.15.116:3300/0 conn(0x7faeb40cf010 0x7faeb40cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.997+0000 7faeb91ff700 1 -- 172.21.15.116:0/2125615648 >> 172.21.15.116:0/2125615648 conn(0x7faeb4071b10 msgr2=0x7faeb4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.997+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50fc0ccf10 con 0x7f50fc0ad690 2023-05-12T09:07:42.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.997+0000 7f3baf5ff700 1 -- start start 2023-05-12T09:07:42.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.997+0000 7f3baf5ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b94004850 0x7f3ba81f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f3baf5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3ba815a1c0 0x7f3ba809d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f3baf5ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ba8202410 0x7f3ba8202890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f3baf5ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba81f2ae0 con 0x7f3ba8202410 2023-05-12T09:07:42.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f3baf5ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba809dd80 con 0x7f3b94004850 2023-05-12T09:07:42.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f3baf5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba81f2140 con 0x7f3ba815a1c0 2023-05-12T09:07:42.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.997+0000 7faeb91ff700 1 -- 172.21.15.116:0/2125615648 shutdown_connections 2023-05-12T09:07:42.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f23fedff700 1 Processor -- start 2023-05-12T09:07:42.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f23fedff700 1 -- start start 2023-05-12T09:07:42.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f3bad39b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b94004850 0x7f3ba81f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f3bad39b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b94004850 0x7f3ba81f2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58370/0 (socket says 172.21.15.116:58370) 2023-05-12T09:07:42.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f3bad39b700 1 -- 172.21.15.116:0/3784831554 learned_addr learned my addr 172.21.15.116:0/3784831554 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f3bacb9a700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3ba815a1c0 0x7f3ba809d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f3badb9c700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ba8202410 0x7f3ba8202890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7faeb91ff700 1 -- 172.21.15.116:0/2125615648 wait complete. 2023-05-12T09:07:42.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.996+0000 7f0c3cff9700 1 -- 172.21.15.116:0/2480471439 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c38007480 con 0x7f0c400c3cb0 2023-05-12T09:07:42.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f0c3cff9700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0c2c06adb0 0x7f0c2c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.998+0000 7f0c3cff9700 1 -- 172.21.15.116:0/2480471439 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0c38089f60 con 0x7f0c400c3cb0 2023-05-12T09:07:42.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f0c3cff9700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:6808/179733737,v1:172.21.15.116:6810/179733737] conn(0x7f0c2c074a80 0x7f0c2c076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f0c3cff9700 1 -- 172.21.15.116:0/2480471439 --> [v2:172.21.15.116:6808/179733737,v1:172.21.15.116:6810/179733737] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c2c077580 con 0x7f0c2c074a80 2023-05-12T09:07:42.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f0c3cff9700 1 -- 172.21.15.116:0/2480471439 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c3808a310 con 0x7f0c400c3cb0 2023-05-12T09:07:42.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f12a97fa700 1 -- 172.21.15.116:0/2914690131 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a000ee50 con 0x7f12ac0ad930 2023-05-12T09:07:42.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f12a97fa700 1 -- 172.21.15.116:0/2914690131 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a000c850 con 0x7f12ac0ad930 2023-05-12T09:07:42.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f12a97fa700 1 -- 172.21.15.116:0/2914690131 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a000cbc0 con 0x7f12ac0ad930 2023-05-12T09:07:42.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f3badb9c700 1 -- 172.21.15.116:0/3784831554 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3ba815a1c0 msgr2=0x7f3ba809d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f3badb9c700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3ba815a1c0 0x7f3ba809d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f3badb9c700 1 -- 172.21.15.116:0/3784831554 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b94004850 msgr2=0x7f3ba81f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f3badb9c700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3b94004850 0x7f3ba81f2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f3badb9c700 1 -- 172.21.15.116:0/3784831554 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba80b0cc0 con 0x7f3ba8202410 2023-05-12T09:07:42.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:41.999+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac161dd0 con 0x7f12ac0ad930 2023-05-12T09:07:42.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.000+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ac161af0 con 0x7f12ac0ad930 2023-05-12T09:07:42.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.000+0000 7f23fedff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f23f80cacf0 0x7f23f80add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.000+0000 7f23fedff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f23f80cbc20 0x7f23f815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.000+0000 7f23fedff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f23f80c90c0 0x7f23f806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.000+0000 7f23fedff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f8158d10 con 0x7f23f80cbc20 2023-05-12T09:07:42.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.000+0000 7f23fedff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f815d2f0 con 0x7f23f80cacf0 2023-05-12T09:07:42.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.000+0000 7f23fedff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80cd5b0 con 0x7f23f80c90c0 2023-05-12T09:07:42.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f0c3ffff700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0c2c06adb0 0x7f0c2c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.000+0000 7f50f97fa700 1 -- 172.21.15.116:0/60615219 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f50ec007430 con 0x7f50fc0ad690 2023-05-12T09:07:42.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.000+0000 7faeb91ff700 1 Processor -- start 2023-05-12T09:07:42.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7faeb91ff700 1 -- start start 2023-05-12T09:07:42.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23f7fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f23f80cbc20 0x7f23f815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23f7fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f23f80cbc20 0x7f23f815cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57092/0 (socket says 172.21.15.116:57092) 2023-05-12T09:07:42.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23f7fff700 1 -- 172.21.15.116:0/3060977427 learned_addr learned my addr 172.21.15.116:0/3060977427 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23fd39c700 1 --2- 172.21.15.116:0/3060977427 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f23f80c90c0 0x7f23f806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23fcb9b700 1 --2- 172.21.15.116:0/3060977427 >> v2:172.21.15.182:3300/0 conn(0x7f23f80cacf0 0x7f23f80add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23f7fff700 1 -- 172.21.15.116:0/3060977427 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f23f80c90c0 msgr2=0x7f23f806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23f7fff700 1 --2- 172.21.15.116:0/3060977427 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f23f80c90c0 0x7f23f806a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23f7fff700 1 -- 172.21.15.116:0/3060977427 >> v2:172.21.15.182:3300/0 conn(0x7f23f80cacf0 msgr2=0x7f23f80add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23f7fff700 1 --2- 172.21.15.116:0/3060977427 >> v2:172.21.15.182:3300/0 conn(0x7f23f80cacf0 0x7f23f80add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23f7fff700 1 -- 172.21.15.116:0/3060977427 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80ccff0 con 0x7f23f80cbc20 2023-05-12T09:07:42.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f23fcb9b700 1 --2- 172.21.15.116:0/3060977427 >> v2:172.21.15.182:3300/0 conn(0x7f23f80cacf0 0x7f23f80add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:42.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.002+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12ac06ace0 con 0x7f12ac0ad930 2023-05-12T09:07:42.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.002+0000 7f23f7fff700 1 --2- 172.21.15.116:0/3060977427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f80cbc20 0x7f23f815cdb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f23f80cc190 tx=0x7f23e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a8a312d033484a server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.001+0000 7f50f97fa700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f50dc06adb0 0x7f50dc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.002+0000 7f50f97fa700 1 -- 172.21.15.116:0/60615219 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f50ec089380 con 0x7f50fc0ad690 2023-05-12T09:07:42.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.002+0000 7f0c3ffff700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0c2c06adb0 0x7f0c2c06d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c400b1650 tx=0x7f0c30010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.000+0000 7fd6e0fff700 1 -- 172.21.15.116:0/2283372670 shutdown_connections 2023-05-12T09:07:42.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.002+0000 7f50f97fa700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:6824/4207784314,v1:172.21.15.116:6825/4207784314] conn(0x7f50dc074a80 0x7f50dc076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.002+0000 7f50f97fa700 1 -- 172.21.15.116:0/60615219 --> [v2:172.21.15.116:6824/4207784314,v1:172.21.15.116:6825/4207784314] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50dc077580 con 0x7f50dc074a80 2023-05-12T09:07:42.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.002+0000 7f50f97fa700 1 -- 172.21.15.116:0/60615219 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50ec089730 con 0x7f50fc0ad690 2023-05-12T09:07:42.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.002+0000 7faeb91ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cf010 0x7faeb41fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.002+0000 7faeb91ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faeb40cfd80 0x7faeb4156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7f50f3fff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f50dc06adb0 0x7f50dc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7f0c3f7fe700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:6808/179733737,v1:172.21.15.116:6810/179733737] conn(0x7f0c2c074a80 0x7f0c2c076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7f5100d9c700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:6824/4207784314,v1:172.21.15.116:6825/4207784314] conn(0x7f50dc074a80 0x7f50dc076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7faeb91ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faeb415c590 0x7faeb4159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7faeb91ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb4158320 con 0x7faeb415c590 2023-05-12T09:07:42.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7faeb91ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb41fa5f0 con 0x7faeb40cfd80 2023-05-12T09:07:42.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7faeb91ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb415cc20 con 0x7faeb40cf010 2023-05-12T09:07:42.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7faeb2d9d700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cf010 0x7faeb41fa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7faeaa59c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faeb40cfd80 0x7faeb4156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7faeb2d9d700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cf010 0x7faeb41fa0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49052/0 (socket says 172.21.15.116:49052) 2023-05-12T09:07:42.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7faeb2d9d700 1 -- 172.21.15.116:0/77765555 learned_addr learned my addr 172.21.15.116:0/77765555 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7faeb359e700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faeb415c590 0x7faeb4159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.003+0000 7f23f77fe700 1 -- 172.21.15.116:0/3060977427 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4011830 con 0x7f23f80cbc20 2023-05-12T09:07:42.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7f23f77fe700 1 -- 172.21.15.116:0/3060977427 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e4011990 con 0x7f23f80cbc20 2023-05-12T09:07:42.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7f23f77fe700 1 -- 172.21.15.116:0/3060977427 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4011d20 con 0x7f23f80cbc20 2023-05-12T09:07:42.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7f3badb9c700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ba8202410 0x7f3ba8202890 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8072aa0 tx=0x7f3ba000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7faeb2d9d700 1 -- 172.21.15.116:0/77765555 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faeb40cfd80 msgr2=0x7faeb4156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7faeb2d9d700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faeb40cfd80 0x7faeb4156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7faeb2d9d700 1 -- 172.21.15.116:0/77765555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faeb415c590 msgr2=0x7faeb4159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7faeb2d9d700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faeb415c590 0x7faeb4159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7faeb2d9d700 1 -- 172.21.15.116:0/77765555 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac009550 con 0x7faeb40cf010 2023-05-12T09:07:42.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7f5100d9c700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:6824/4207784314,v1:172.21.15.116:6825/4207784314] conn(0x7f50dc074a80 0x7f50dc076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7faeb2d9d700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cf010 0x7faeb41fa0b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c7f0 tx=0x7fae9c00cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7f3b9dffb700 1 -- 172.21.15.116:0/3784831554 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000ad30 con 0x7f3ba8202410 2023-05-12T09:07:42.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7f3b9dffb700 1 -- 172.21.15.116:0/3784831554 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba00020f0 con 0x7f3ba8202410 2023-05-12T09:07:42.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba80b09e0 con 0x7f3ba8202410 2023-05-12T09:07:42.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.005+0000 7f0c3f7fe700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:6808/179733737,v1:172.21.15.116:6810/179733737] conn(0x7f0c2c074a80 0x7f0c2c076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.005+0000 7fd6e0fff700 1 -- 172.21.15.116:0/2283372670 wait complete. 2023-05-12T09:07:42.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.004+0000 7f12a97fa700 1 -- 172.21.15.116:0/2914690131 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12a000cd20 con 0x7f12ac0ad930 2023-05-12T09:07:42.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.005+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba80b0fa0 con 0x7f3ba8202410 2023-05-12T09:07:42.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ba8074430 con 0x7f3ba8202410 2023-05-12T09:07:42.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f3b9dffb700 1 -- 172.21.15.116:0/3784831554 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0007310 con 0x7f3ba8202410 2023-05-12T09:07:42.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.005+0000 7faeabfff700 1 -- 172.21.15.116:0/77765555 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c011800 con 0x7faeb40cf010 2023-05-12T09:07:42.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.005+0000 7faeabfff700 1 -- 172.21.15.116:0/77765555 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c011960 con 0x7faeb40cf010 2023-05-12T09:07:42.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.005+0000 7faeabfff700 1 -- 172.21.15.116:0/77765555 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c011cd0 con 0x7faeb40cf010 2023-05-12T09:07:42.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb40cf560 con 0x7faeb40cf010 2023-05-12T09:07:42.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb40b23c0 con 0x7faeb40cf010 2023-05-12T09:07:42.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.005+0000 7f23fedff700 1 -- 172.21.15.116:0/3060977427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f80cbc20 msgr2=0x7f23f815cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.005+0000 7f23fedff700 1 --2- 172.21.15.116:0/3060977427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f80cbc20 0x7f23f815cdb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f23f80cc190 tx=0x7f23e4009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f23fedff700 1 -- 172.21.15.116:0/3060977427 shutdown_connections 2023-05-12T09:07:42.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f23fedff700 1 --2- 172.21.15.116:0/3060977427 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f23f80c90c0 0x7f23f806a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f23fedff700 1 --2- 172.21.15.116:0/3060977427 >> v2:172.21.15.182:3300/0 conn(0x7f23f80cacf0 0x7f23f80add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f23fedff700 1 --2- 172.21.15.116:0/3060977427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f80cbc20 0x7f23f815cdb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f23fedff700 1 -- 172.21.15.116:0/3060977427 >> 172.21.15.116:0/3060977427 conn(0x7f23f80cf6e0 msgr2=0x7f23f80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f12a97fa700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f129806adb0 0x7f129806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f12a97fa700 1 -- 172.21.15.116:0/2914690131 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12a0089670 con 0x7f12ac0ad930 2023-05-12T09:07:42.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f12a97fa700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.182:6816/716845104,v1:172.21.15.182:6818/716845104] conn(0x7f1298074a80 0x7f1298076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f12a97fa700 1 -- 172.21.15.116:0/2914690131 --> [v2:172.21.15.182:6816/716845104,v1:172.21.15.182:6818/716845104] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1298077580 con 0x7f1298074a80 2023-05-12T09:07:42.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.006+0000 7f12a97fa700 1 -- 172.21.15.116:0/2914690131 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12a008bc90 con 0x7f12ac0ad930 2023-05-12T09:07:42.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.007+0000 7f0c3cff9700 1 -- 172.21.15.116:0/2480471439 <== osd.0 v2:172.21.15.116:6808/179733737 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0c2c077580 con 0x7f0c2c074a80 2023-05-12T09:07:42.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.007+0000 7f23fedff700 1 -- 172.21.15.116:0/3060977427 shutdown_connections 2023-05-12T09:07:42.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.007+0000 7f50f3fff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f50dc06adb0 0x7f50dc06d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f50fc15f790 tx=0x7f50e40090e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.007+0000 7f50f97fa700 1 -- 172.21.15.116:0/60615219 <== osd.2 v2:172.21.15.116:6824/4207784314 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f50dc077580 con 0x7f50dc074a80 2023-05-12T09:07:42.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.007+0000 7fd6e0fff700 1 Processor -- start 2023-05-12T09:07:42.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.007+0000 7f12b139c700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.182:6816/716845104,v1:172.21.15.182:6818/716845104] conn(0x7f1298074a80 0x7f1298076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.008+0000 7fd6e0fff700 1 -- start start 2023-05-12T09:07:42.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.007+0000 7f12b0b9b700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f129806adb0 0x7f129806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.007+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faeb40cd770 con 0x7faeb40cf010 2023-05-12T09:07:42.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.009+0000 7f12b139c700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.182:6816/716845104,v1:172.21.15.182:6818/716845104] conn(0x7f1298074a80 0x7f1298076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.009+0000 7f12b0b9b700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f129806adb0 0x7f129806d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0cacd0 tx=0x7f129c01d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.009+0000 7fd6e0fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd6dc0ad690 0x7fd6dc0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.009+0000 7fd6da59c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd6dc0ad690 0x7fd6dc0ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.009+0000 7fd6da59c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd6dc0ad690 0x7fd6dc0ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58396/0 (socket says 172.21.15.116:58396) 2023-05-12T09:07:42.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.009+0000 7fd6e0fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6dc0c19c0 0x7fd6dc15f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.010+0000 7fd6e0fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 0x7fd6dc15f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.010+0000 7fd6e0fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0af880 con 0x7fd6dc0c19c0 2023-05-12T09:07:42.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.010+0000 7fd6e0fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0aec00 con 0x7fd6dc0ad690 2023-05-12T09:07:42.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.010+0000 7fd6e0fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0aeee0 con 0x7fd6dc160d20 2023-05-12T09:07:42.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.010+0000 7fd6da59c700 1 -- 172.21.15.116:0/1015870036 learned_addr learned my addr 172.21.15.116:0/1015870036 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.007+0000 7f23fedff700 1 -- 172.21.15.116:0/3060977427 wait complete. 2023-05-12T09:07:42.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.010+0000 7f23fedff700 1 Processor -- start 2023-05-12T09:07:42.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.010+0000 7fd6dad9d700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 0x7fd6dc15f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.009+0000 7f3b9dffb700 1 -- 172.21.15.116:0/3784831554 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ba0007470 con 0x7f3ba8202410 2023-05-12T09:07:42.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.011+0000 7fd6d9d9b700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6dc0c19c0 0x7fd6dc15f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.011+0000 7fd6dad9d700 1 -- 172.21.15.116:0/1015870036 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd6dc0ad690 msgr2=0x7fd6dc0ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.011+0000 7fd6dad9d700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd6dc0ad690 0x7fd6dc0ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.011+0000 7fd6dad9d700 1 -- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6dc0c19c0 msgr2=0x7fd6dc15f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.011+0000 7fd6dad9d700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6dc0c19c0 0x7fd6dc15f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.011+0000 7fd6dad9d700 1 -- 172.21.15.116:0/1015870036 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0009550 con 0x7fd6dc160d20 2023-05-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.011+0000 7fd6d9d9b700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6dc0c19c0 0x7fd6dc15f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.011+0000 7f3b9dffb700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3b8c06adb0 0x7f3b8c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.011+0000 7f3b9dffb700 1 -- 172.21.15.116:0/3784831554 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ba0089990 con 0x7f3ba8202410 2023-05-12T09:07:42.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.012+0000 7f3b9dffb700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.182:6800/2534244617,v1:172.21.15.182:6801/2534244617] conn(0x7f3b8c074a80 0x7f3b8c076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.012+0000 7f3b9dffb700 1 -- 172.21.15.116:0/3784831554 --> [v2:172.21.15.182:6800/2534244617,v1:172.21.15.182:6801/2534244617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b8c077580 con 0x7f3b8c074a80 2023-05-12T09:07:42.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.012+0000 7f3b9dffb700 1 -- 172.21.15.116:0/3784831554 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ba0089d40 con 0x7f3ba8202410 2023-05-12T09:07:42.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.012+0000 7f3bad39b700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3b8c06adb0 0x7f3b8c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.012+0000 7f12a97fa700 1 -- 172.21.15.116:0/2914690131 <== osd.4 v2:172.21.15.182:6816/716845104 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1298077580 con 0x7f1298074a80 2023-05-12T09:07:42.072 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.012+0000 7faeabfff700 1 -- 172.21.15.116:0/77765555 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae9c004020 con 0x7faeb40cf010 2023-05-12T09:07:42.072 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.012+0000 7f23fedff700 1 -- start start 2023-05-12T09:07:42.072 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.013+0000 7f3bad39b700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3b8c06adb0 0x7f3b8c06d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80b2e40 tx=0x7f3ba4009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.073 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.013+0000 7f3bacb9a700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.182:6800/2534244617,v1:172.21.15.182:6801/2534244617] conn(0x7f3b8c074a80 0x7f3b8c076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.073 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.013+0000 7faeabfff700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae9406adb0 0x7fae9406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.073 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.013+0000 7faeabfff700 1 -- 172.21.15.116:0/77765555 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fae9c0897f0 con 0x7faeb40cf010 2023-05-12T09:07:42.073 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.013+0000 7faeabfff700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.182:6817/2483408776,v1:172.21.15.182:6819/2483408776] conn(0x7fae94074a80 0x7fae94076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.073 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7faeabfff700 1 -- 172.21.15.116:0/77765555 --> [v2:172.21.15.182:6817/2483408776,v1:172.21.15.182:6819/2483408776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae94077580 con 0x7fae94074a80 2023-05-12T09:07:42.073 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7faeabfff700 1 -- 172.21.15.116:0/77765555 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae9c089ba0 con 0x7faeb40cf010 2023-05-12T09:07:42.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7faeaa59c700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae9406adb0 0x7fae9406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7f23fedff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f80c90c0 0x7f23f80c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7faeb359e700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.182:6817/2483408776,v1:172.21.15.182:6819/2483408776] conn(0x7fae94074a80 0x7fae94076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7f23fedff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f23f80cacf0 0x7f23f80c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7f23fedff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f23f80cbc20 0x7f23f80c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7f23fedff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80c1da0 con 0x7f23f80c90c0 2023-05-12T09:07:42.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7f23fedff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80b40e0 con 0x7f23f80cacf0 2023-05-12T09:07:42.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7f23fedff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80b3040 con 0x7f23f80cbc20 2023-05-12T09:07:42.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.015+0000 7faeaa59c700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae9406adb0 0x7fae9406d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faeb41f9600 tx=0x7faea40098d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.013+0000 7fd6dad9d700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 0x7fd6dc15f650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400be00 tx=0x7fd6d4009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.013+0000 7fd6caffd700 1 -- 172.21.15.116:0/1015870036 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400cc10 con 0x7fd6dc160d20 2023-05-12T09:07:42.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7fd6caffd700 1 -- 172.21.15.116:0/1015870036 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d400cd70 con 0x7fd6dc160d20 2023-05-12T09:07:42.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7fd6caffd700 1 -- 172.21.15.116:0/1015870036 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4003c40 con 0x7fd6dc160d20 2023-05-12T09:07:42.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.015+0000 7faeb359e700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.182:6817/2483408776,v1:172.21.15.182:6819/2483408776] conn(0x7fae94074a80 0x7fae94076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc0ccf10 con 0x7fd6dc160d20 2023-05-12T09:07:42.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.014+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc0ccc30 con 0x7fd6dc160d20 2023-05-12T09:07:42.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.015+0000 7f23f7fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f23f80cacf0 0x7f23f80c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.015+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6c0000fc0 con 0x7fd6dc160d20 2023-05-12T09:07:42.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.015+0000 7f23f7fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f23f80cacf0 0x7f23f80c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58402/0 (socket says 172.21.15.116:58402) 2023-05-12T09:07:42.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.015+0000 7f23f7fff700 1 -- 172.21.15.116:0/1917262523 learned_addr learned my addr 172.21.15.116:0/1917262523 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.016+0000 7faeabfff700 1 -- 172.21.15.116:0/77765555 <== osd.6 v2:172.21.15.182:6817/2483408776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fae94077580 con 0x7fae94074a80 2023-05-12T09:07:42.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.016+0000 7f23fcb9b700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f80c90c0 0x7f23f80c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.016+0000 7f23f7fff700 1 -- 172.21.15.116:0/1917262523 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f23f80cbc20 msgr2=0x7f23f80c4a60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-12T09:07:42.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.016+0000 7f23f7fff700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f23f80cbc20 0x7f23f80c4a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.016+0000 7f23f7fff700 1 -- 172.21.15.116:0/1917262523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f80c90c0 msgr2=0x7f23f80c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.016+0000 7f23f7fff700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f80c90c0 0x7f23f80c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.016+0000 7f23f7fff700 1 -- 172.21.15.116:0/1917262523 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e4009550 con 0x7f23f80cacf0 2023-05-12T09:07:42.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.016+0000 7f23fcb9b700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f80c90c0 0x7f23f80c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:42.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.017+0000 7f23f7fff700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f23f80cacf0 0x7f23f80c4520 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000c00 tx=0x7f23e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.017+0000 7f23f57fa700 1 -- 172.21.15.116:0/1917262523 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4004380 con 0x7f23f80cacf0 2023-05-12T09:07:42.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.017+0000 7f23f57fa700 1 -- 172.21.15.116:0/1917262523 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e401f070 con 0x7f23f80cacf0 2023-05-12T09:07:42.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.017+0000 7f23f57fa700 1 -- 172.21.15.116:0/1917262523 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e40036a0 con 0x7f23f80cacf0 2023-05-12T09:07:42.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.017+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f806cc40 con 0x7f23f80cacf0 2023-05-12T09:07:42.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.018+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f80cd2d0 con 0x7f23f80cacf0 2023-05-12T09:07:42.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.019+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23f806cf20 con 0x7f23f80cacf0 2023-05-12T09:07:42.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.019+0000 7f3bacb9a700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.182:6800/2534244617,v1:172.21.15.182:6801/2534244617] conn(0x7f3b8c074a80 0x7f3b8c076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.020+0000 7fd6caffd700 1 -- 172.21.15.116:0/1015870036 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6d4014440 con 0x7fd6dc160d20 2023-05-12T09:07:42.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.021+0000 7f3b9dffb700 1 -- 172.21.15.116:0/3784831554 <== osd.5 v2:172.21.15.182:6800/2534244617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3b8c077580 con 0x7f3b8c074a80 2023-05-12T09:07:42.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.021+0000 7fd6caffd700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd6bc06adb0 0x7fd6bc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.021+0000 7fd6caffd700 1 -- 172.21.15.116:0/1015870036 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd6d4089f50 con 0x7fd6dc160d20 2023-05-12T09:07:42.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.022+0000 7fd6caffd700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:6800/1873865019,v1:172.21.15.116:6801/1873865019] conn(0x7fd6bc074a80 0x7fd6bc076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.022+0000 7fd6caffd700 1 -- 172.21.15.116:0/1015870036 --> [v2:172.21.15.116:6800/1873865019,v1:172.21.15.116:6801/1873865019] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6bc077580 con 0x7fd6bc074a80 2023-05-12T09:07:42.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.022+0000 7fd6caffd700 1 -- 172.21.15.116:0/1015870036 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6d408a300 con 0x7fd6dc160d20 2023-05-12T09:07:42.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.022+0000 7f23f57fa700 1 -- 172.21.15.116:0/1917262523 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23e4021030 con 0x7f23f80cacf0 2023-05-12T09:07:42.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.022+0000 7fd6da59c700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd6bc06adb0 0x7fd6bc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.023+0000 7f23f57fa700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f23dc06adb0 0x7f23dc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.024+0000 7f23f57fa700 1 -- 172.21.15.116:0/1917262523 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23e408b190 con 0x7f23f80cacf0 2023-05-12T09:07:42.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.024+0000 7fd6da59c700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd6bc06adb0 0x7fd6bc06d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0004720 tx=0x7fd6d0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.024+0000 7f23f57fa700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.182:6808/273358957,v1:172.21.15.182:6809/273358957] conn(0x7f23dc074a80 0x7f23dc076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.024+0000 7f23f57fa700 1 -- 172.21.15.116:0/1917262523 --> [v2:172.21.15.182:6808/273358957,v1:172.21.15.182:6809/273358957] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23dc077580 con 0x7f23dc074a80 2023-05-12T09:07:42.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.024+0000 7f23f57fa700 1 -- 172.21.15.116:0/1917262523 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23e408b540 con 0x7f23f80cacf0 2023-05-12T09:07:42.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.024+0000 7f23fcb9b700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f23dc06adb0 0x7f23dc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.025+0000 7f23fd39c700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.182:6808/273358957,v1:172.21.15.182:6809/273358957] conn(0x7f23dc074a80 0x7f23dc076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.026+0000 7f23fd39c700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.182:6808/273358957,v1:172.21.15.182:6809/273358957] conn(0x7f23dc074a80 0x7f23dc076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.026+0000 7f23fcb9b700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f23dc06adb0 0x7f23dc06d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f23ec006fd0 tx=0x7f23ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.026+0000 7fd6d9d9b700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:6800/1873865019,v1:172.21.15.116:6801/1873865019] conn(0x7fd6bc074a80 0x7fd6bc076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.026+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 --> [v2:172.21.15.116:6809/2195307728,v1:172.21.15.116:6811/2195307728] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a84002d40 con 0x7f1a80074a00 2023-05-12T09:07:42.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.029+0000 7f1a927fc700 1 -- 172.21.15.116:0/2939206222 <== osd.1 v2:172.21.15.116:6809/2195307728 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a84002d40 con 0x7f1a80074a00 2023-05-12T09:07:42.088 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.029+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:6809/2195307728,v1:172.21.15.116:6811/2195307728] conn(0x7f1a80074a00 msgr2=0x7f1a80076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.088 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.029+0000 7f1aa3fff700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:6809/2195307728,v1:172.21.15.116:6811/2195307728] conn(0x7f1a80074a00 0x7f1a80076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.088 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.028+0000 7f23f57fa700 1 -- 172.21.15.116:0/1917262523 <== osd.7 v2:172.21.15.182:6808/273358957 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f23dc077580 con 0x7f23dc074a80 2023-05-12T09:07:42.088 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.031+0000 7fd6d9d9b700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:6800/1873865019,v1:172.21.15.116:6801/1873865019] conn(0x7fd6bc074a80 0x7fd6bc076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.089 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.031+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1a8006adb0 msgr2=0x7f1a8006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.089 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.031+0000 7f1aa3fff700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1a8006adb0 0x7f1a8006d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a94005c60 tx=0x7f1a94009040 comp rx=0 tx=0).stop 2023-05-12T09:07:42.089 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.031+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a9c16da20 msgr2=0x7f1a9c0c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.089 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.031+0000 7f1aa3fff700 1 --2- 172.21.15.116:0/2939206222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a9c16da20 0x7f1a9c0c82f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800b2c0 tx=0x7f1a98004750 comp rx=0 tx=0).stop 2023-05-12T09:07:42.089 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.032+0000 7f1aa259c700 1 -- 172.21.15.116:0/2939206222 reap_dead start 2023-05-12T09:07:42.090 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.032+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 shutdown_connections 2023-05-12T09:07:42.090 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.032+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 >> 172.21.15.116:0/2939206222 conn(0x7f1a9c0cf6e0 msgr2=0x7f1a9c0ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.090 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.032+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 shutdown_connections 2023-05-12T09:07:42.090 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.032+0000 7f1aa3fff700 1 -- 172.21.15.116:0/2939206222 wait complete. 2023-05-12T09:07:42.090 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.033+0000 7fd6caffd700 1 -- 172.21.15.116:0/1015870036 <== osd.3 v2:172.21.15.116:6800/1873865019 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd6bc077580 con 0x7fd6bc074a80 2023-05-12T09:07:42.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.035+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 --> [v2:172.21.15.116:6808/179733737,v1:172.21.15.116:6810/179733737] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c401ea810 con 0x7f0c2c074a80 2023-05-12T09:07:42.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.036+0000 7f0c3cff9700 1 -- 172.21.15.116:0/2480471439 <== osd.0 v2:172.21.15.116:6808/179733737 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c401ea810 con 0x7f0c2c074a80 2023-05-12T09:07:42.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.037+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:6808/179733737,v1:172.21.15.116:6810/179733737] conn(0x7f0c2c074a80 msgr2=0x7f0c2c076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.037+0000 7f0c467ff700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:6808/179733737,v1:172.21.15.116:6810/179733737] conn(0x7f0c2c074a80 0x7f0c2c076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.038+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0c2c06adb0 msgr2=0x7f0c2c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.038+0000 7f0c467ff700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0c2c06adb0 0x7f0c2c06d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c400b1650 tx=0x7f0c30010000 comp rx=0 tx=0).stop 2023-05-12T09:07:42.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.038+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0c400c3cb0 msgr2=0x7f0c400b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.038+0000 7f0c467ff700 1 --2- 172.21.15.116:0/2480471439 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0c400c3cb0 0x7f0c400b1c50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0c38002000 tx=0x7f0c3800a340 comp rx=0 tx=0).stop 2023-05-12T09:07:42.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.038+0000 7f0c44d9c700 1 -- 172.21.15.116:0/2480471439 reap_dead start 2023-05-12T09:07:42.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.038+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 shutdown_connections 2023-05-12T09:07:42.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.038+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 >> 172.21.15.116:0/2480471439 conn(0x7f0c400cf6e0 msgr2=0x7f0c400c1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.039+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 shutdown_connections 2023-05-12T09:07:42.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.039+0000 7f0c467ff700 1 -- 172.21.15.116:0/2480471439 wait complete. 2023-05-12T09:07:42.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.043+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 --> [v2:172.21.15.116:6824/4207784314,v1:172.21.15.116:6825/4207784314] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50fc0c3990 con 0x7f50dc074a80 2023-05-12T09:07:42.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.045+0000 7f50f97fa700 1 -- 172.21.15.116:0/60615219 <== osd.2 v2:172.21.15.116:6824/4207784314 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50fc0c3990 con 0x7f50dc074a80 2023-05-12T09:07:42.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.046+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:6824/4207784314,v1:172.21.15.116:6825/4207784314] conn(0x7f50dc074a80 msgr2=0x7f50dc076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.046+0000 7f51027ff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:6824/4207784314,v1:172.21.15.116:6825/4207784314] conn(0x7f50dc074a80 0x7f50dc076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.046+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f50dc06adb0 msgr2=0x7f50dc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.046+0000 7f51027ff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f50dc06adb0 0x7f50dc06d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f50fc15f790 tx=0x7f50e40090e0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.046+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50fc0ad690 msgr2=0x7f50fc0c2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.046+0000 7f51027ff700 1 --2- 172.21.15.116:0/60615219 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50fc0ad690 0x7f50fc0c2f00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00c3c0 tx=0x7f50ec00c6d0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.046+0000 7f5100d9c700 1 -- 172.21.15.116:0/60615219 reap_dead start 2023-05-12T09:07:42.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.046+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 shutdown_connections 2023-05-12T09:07:42.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.046+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 >> 172.21.15.116:0/60615219 conn(0x7f50fc0cf720 msgr2=0x7f50fc162c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.047+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 shutdown_connections 2023-05-12T09:07:42.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.047+0000 7f51027ff700 1 -- 172.21.15.116:0/60615219 wait complete. 2023-05-12T09:07:42.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.048+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 --> [v2:172.21.15.182:6817/2483408776,v1:172.21.15.182:6819/2483408776] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faeb4158460 con 0x7fae94074a80 2023-05-12T09:07:42.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.049+0000 7faeabfff700 1 -- 172.21.15.116:0/77765555 <== osd.6 v2:172.21.15.182:6817/2483408776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faeac00b790 con 0x7fae94074a80 2023-05-12T09:07:42.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.050+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 >> [v2:172.21.15.182:6817/2483408776,v1:172.21.15.182:6819/2483408776] conn(0x7fae94074a80 msgr2=0x7fae94076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.050+0000 7faeb91ff700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.182:6817/2483408776,v1:172.21.15.182:6819/2483408776] conn(0x7fae94074a80 0x7fae94076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.050+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae9406adb0 msgr2=0x7fae9406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.050+0000 7faeb91ff700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae9406adb0 0x7fae9406d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faeb41f9600 tx=0x7faea40098d0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.050+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cf010 msgr2=0x7faeb41fa0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.050+0000 7faeb91ff700 1 --2- 172.21.15.116:0/77765555 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faeb40cf010 0x7faeb41fa0b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c7f0 tx=0x7fae9c00cb00 comp rx=0 tx=0).stop 2023-05-12T09:07:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.050+0000 7faeb359e700 1 -- 172.21.15.116:0/77765555 reap_dead start 2023-05-12T09:07:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.054+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 shutdown_connections 2023-05-12T09:07:42.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.054+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 >> 172.21.15.116:0/77765555 conn(0x7faeb4071b10 msgr2=0x7faeb4160180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.054+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 --> [v2:172.21.15.182:6800/2534244617,v1:172.21.15.182:6801/2534244617] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ba809da50 con 0x7f3b8c074a80 2023-05-12T09:07:42.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.054+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 shutdown_connections 2023-05-12T09:07:42.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.054+0000 7faeb91ff700 1 -- 172.21.15.116:0/77765555 wait complete. 2023-05-12T09:07:42.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.054+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 --> [v2:172.21.15.182:6816/716845104,v1:172.21.15.182:6818/716845104] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f12ac1f7570 con 0x7f1298074a80 2023-05-12T09:07:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.055+0000 7f3b9dffb700 1 -- 172.21.15.116:0/3784831554 <== osd.5 v2:172.21.15.182:6800/2534244617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3ba809da50 con 0x7f3b8c074a80 2023-05-12T09:07:42.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.055+0000 7f12a97fa700 1 -- 172.21.15.116:0/2914690131 <== osd.4 v2:172.21.15.182:6816/716845104 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f12ac1f7570 con 0x7f1298074a80 2023-05-12T09:07:42.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.056+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 >> [v2:172.21.15.182:6800/2534244617,v1:172.21.15.182:6801/2534244617] conn(0x7f3b8c074a80 msgr2=0x7f3b8c076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.056+0000 7f3baf5ff700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.182:6800/2534244617,v1:172.21.15.182:6801/2534244617] conn(0x7f3b8c074a80 0x7f3b8c076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.056+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3b8c06adb0 msgr2=0x7f3b8c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.056+0000 7f3baf5ff700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3b8c06adb0 0x7f3b8c06d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80b2e40 tx=0x7f3ba4009210 comp rx=0 tx=0).stop 2023-05-12T09:07:42.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.056+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ba8202410 msgr2=0x7f3ba8202890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.056+0000 7f3baf5ff700 1 --2- 172.21.15.116:0/3784831554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ba8202410 0x7f3ba8202890 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8072aa0 tx=0x7f3ba000a340 comp rx=0 tx=0).stop 2023-05-12T09:07:42.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.056+0000 7f3badb9c700 1 -- 172.21.15.116:0/3784831554 reap_dead start 2023-05-12T09:07:42.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.056+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 >> [v2:172.21.15.182:6816/716845104,v1:172.21.15.182:6818/716845104] conn(0x7f1298074a80 msgr2=0x7f1298076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.056+0000 7f12b2dff700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.182:6816/716845104,v1:172.21.15.182:6818/716845104] conn(0x7f1298074a80 0x7f1298076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.057+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 shutdown_connections 2023-05-12T09:07:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.057+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 >> 172.21.15.116:0/3784831554 conn(0x7f3ba809a090 msgr2=0x7f3ba80ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.057+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 shutdown_connections 2023-05-12T09:07:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.057+0000 7f3baf5ff700 1 -- 172.21.15.116:0/3784831554 wait complete. 2023-05-12T09:07:42.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.059+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f129806adb0 msgr2=0x7f129806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.059+0000 7f12b2dff700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f129806adb0 0x7f129806d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0cacd0 tx=0x7f129c01d040 comp rx=0 tx=0).stop 2023-05-12T09:07:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.059+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12ac0ad930 msgr2=0x7f12ac1595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.059+0000 7f12b2dff700 1 --2- 172.21.15.116:0/2914690131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12ac0ad930 0x7f12ac1595c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12a000e900 tx=0x7f12a000ec10 comp rx=0 tx=0).stop 2023-05-12T09:07:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.059+0000 7f12b139c700 1 -- 172.21.15.116:0/2914690131 reap_dead start 2023-05-12T09:07:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.059+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 shutdown_connections 2023-05-12T09:07:42.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.059+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 >> 172.21.15.116:0/2914690131 conn(0x7f12ac0cf6e0 msgr2=0x7f12ac0b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.059+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 shutdown_connections 2023-05-12T09:07:42.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.059+0000 7f12b2dff700 1 -- 172.21.15.116:0/2914690131 wait complete. 2023-05-12T09:07:42.105 INFO:teuthology.orchestra.run.smithi116.stdout:55834574859 2023-05-12T09:07:42.106 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-12T09:07:42.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.062+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 --> [v2:172.21.15.182:6808/273358957,v1:172.21.15.182:6809/273358957] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f23f8074430 con 0x7f23dc074a80 2023-05-12T09:07:42.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.063+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 --> [v2:172.21.15.116:6800/1873865019,v1:172.21.15.116:6801/1873865019] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6c0002d40 con 0x7fd6bc074a80 2023-05-12T09:07:42.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.063+0000 7f23f57fa700 1 -- 172.21.15.116:0/1917262523 <== osd.7 v2:172.21.15.182:6808/273358957 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f23f8074430 con 0x7f23dc074a80 2023-05-12T09:07:42.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.064+0000 7fd6caffd700 1 -- 172.21.15.116:0/1015870036 <== osd.3 v2:172.21.15.116:6800/1873865019 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6c0002d40 con 0x7fd6bc074a80 2023-05-12T09:07:42.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.064+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 >> [v2:172.21.15.182:6808/273358957,v1:172.21.15.182:6809/273358957] conn(0x7f23dc074a80 msgr2=0x7f23dc076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.064+0000 7f23fedff700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.182:6808/273358957,v1:172.21.15.182:6809/273358957] conn(0x7f23dc074a80 0x7f23dc076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.064+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f23dc06adb0 msgr2=0x7f23dc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.064+0000 7f23fedff700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f23dc06adb0 0x7f23dc06d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f23ec006fd0 tx=0x7f23ec008040 comp rx=0 tx=0).stop 2023-05-12T09:07:42.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.064+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f23f80cacf0 msgr2=0x7f23f80c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.064+0000 7f23fedff700 1 --2- 172.21.15.116:0/1917262523 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f23f80cacf0 0x7f23f80c4520 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000c00 tx=0x7f23e4004750 comp rx=0 tx=0).stop 2023-05-12T09:07:42.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.064+0000 7f23fd39c700 1 -- 172.21.15.116:0/1917262523 reap_dead start 2023-05-12T09:07:42.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.065+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 shutdown_connections 2023-05-12T09:07:42.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.065+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 >> 172.21.15.116:0/1917262523 conn(0x7f23f80cf6e0 msgr2=0x7f23f8158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.065+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 shutdown_connections 2023-05-12T09:07:42.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.065+0000 7f23fedff700 1 -- 172.21.15.116:0/1917262523 wait complete. 2023-05-12T09:07:42.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.065+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:6800/1873865019,v1:172.21.15.116:6801/1873865019] conn(0x7fd6bc074a80 msgr2=0x7fd6bc076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.065+0000 7fd6e0fff700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:6800/1873865019,v1:172.21.15.116:6801/1873865019] conn(0x7fd6bc074a80 0x7fd6bc076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.111 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:42.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.065+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd6bc06adb0 msgr2=0x7fd6bc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.065+0000 7fd6e0fff700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd6bc06adb0 0x7fd6bc06d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0004720 tx=0x7fd6d0008030 comp rx=0 tx=0).stop 2023-05-12T09:07:42.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.065+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 msgr2=0x7fd6dc15f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.065+0000 7fd6e0fff700 1 --2- 172.21.15.116:0/1015870036 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd6dc160d20 0x7fd6dc15f650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400be00 tx=0x7fd6d4009ed0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.066+0000 7fd6dad9d700 1 -- 172.21.15.116:0/1015870036 reap_dead start 2023-05-12T09:07:42.112 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-12T09:07:42.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.069+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 shutdown_connections 2023-05-12T09:07:42.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.069+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 >> 172.21.15.116:0/1015870036 conn(0x7fd6dc0cf720 msgr2=0x7fd6dc0b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.069+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 shutdown_connections 2023-05-12T09:07:42.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.069+0000 7fd6e0fff700 1 -- 172.21.15.116:0/1015870036 wait complete. 2023-05-12T09:07:42.114 INFO:teuthology.orchestra.run.smithi116.stdout:55834574859 2023-05-12T09:07:42.115 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:42.115 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-12T09:07:42.116 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-12T09:07:42.117 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:42.117 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-12T09:07:42.118 INFO:teuthology.orchestra.run.smithi116.stdout:55834574859 2023-05-12T09:07:42.118 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-12T09:07:42.119 INFO:teuthology.orchestra.run.smithi116.stdout:55834574859 2023-05-12T09:07:42.119 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-12T09:07:42.120 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:42.120 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-12T09:07:42.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.478+0000 7fdab2fff700 1 Processor -- start 2023-05-12T09:07:42.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.479+0000 7fdab2fff700 1 -- start start 2023-05-12T09:07:42.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.480+0000 7fdab2fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdaac0cacf0 0x7fdaac0add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.480+0000 7fdab2fff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fdaac15cdb0 0x7fdaac0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.481+0000 7fdab2fff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac158d10 con 0x7fdaac06a3e0 2023-05-12T09:07:42.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.481+0000 7fdab2fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac0cd5b0 con 0x7fdaac0cacf0 2023-05-12T09:07:42.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.481+0000 7fdab2fff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac0ccff0 con 0x7fdaac15cdb0 2023-05-12T09:07:42.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.482+0000 7fdaabfff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fdaac15cdb0 0x7fdaac0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.482+0000 7fdaabfff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fdaac15cdb0 0x7fdaac0c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58410/0 (socket says 172.21.15.116:58410) 2023-05-12T09:07:42.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.482+0000 7fdaabfff700 1 -- 172.21.15.116:0/4056917907 learned_addr learned my addr 172.21.15.116:0/4056917907 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.482+0000 7fdab0d9b700 1 --2- 172.21.15.116:0/4056917907 >> v2:172.21.15.116:3300/0 conn(0x7fdaac0cacf0 0x7fdaac0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.483+0000 7fdab0d9b700 1 -- 172.21.15.116:0/4056917907 >> v2:172.21.15.182:3300/0 conn(0x7fdaac15cdb0 msgr2=0x7fdaac0c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.483+0000 7fdab0d9b700 1 --2- 172.21.15.116:0/4056917907 >> v2:172.21.15.182:3300/0 conn(0x7fdaac15cdb0 0x7fdaac0c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.483+0000 7fdab0d9b700 1 -- 172.21.15.116:0/4056917907 >> v1:172.21.15.116:6789/0 conn(0x7fdaac06a3e0 legacy=0x7fdaac06a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.483+0000 7fdab0d9b700 1 -- 172.21.15.116:0/4056917907 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac0cd2d0 con 0x7fdaac0cacf0 2023-05-12T09:07:42.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.483+0000 7fdab0d9b700 1 --2- 172.21.15.116:0/4056917907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaac0cacf0 0x7fdaac0add70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdaac06b7d0 tx=0x7fdaa4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208be7a87ffcd4e4 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.484+0000 7f0d893ff700 1 Processor -- start 2023-05-12T09:07:42.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.484+0000 7fdaab7fe700 1 -- 172.21.15.116:0/4056917907 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4011830 con 0x7fdaac0cacf0 2023-05-12T09:07:42.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.484+0000 7fdaab7fe700 1 -- 172.21.15.116:0/4056917907 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa4011990 con 0x7fdaac0cacf0 2023-05-12T09:07:42.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.484+0000 7fdaab7fe700 1 -- 172.21.15.116:0/4056917907 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4011d20 con 0x7fdaac0cacf0 2023-05-12T09:07:42.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.484+0000 7f0d893ff700 1 -- start start 2023-05-12T09:07:42.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.486+0000 7fdab2fff700 1 -- 172.21.15.116:0/4056917907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaac0cacf0 msgr2=0x7fdaac0add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.486+0000 7fdab2fff700 1 --2- 172.21.15.116:0/4056917907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaac0cacf0 0x7fdaac0add70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdaac06b7d0 tx=0x7fdaa4009b20 comp rx=0 tx=0).stop 2023-05-12T09:07:42.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.486+0000 7f0d893ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0d840cbc20 0x7f0d840add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.486+0000 7f0d893ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0d8415cdb0 0x7f0d840c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.486+0000 7f0d893ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d840ccff0 con 0x7f0d84158aa0 2023-05-12T09:07:42.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.486+0000 7f0d893ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840cd2d0 con 0x7f0d8415cdb0 2023-05-12T09:07:42.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.486+0000 7f0d893ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8406cc40 con 0x7f0d840cbc20 2023-05-12T09:07:42.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.487+0000 7f0d827fc700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0d840cbc20 0x7f0d840add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.487+0000 7f0d837fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0d8415cdb0 0x7f0d840c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.487+0000 7f0d837fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0d8415cdb0 0x7f0d840c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57148/0 (socket says 172.21.15.116:57148) 2023-05-12T09:07:42.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.487+0000 7f0d837fe700 1 -- 172.21.15.116:0/2324656097 learned_addr learned my addr 172.21.15.116:0/2324656097 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.488+0000 7f0d827fc700 1 -- 172.21.15.116:0/2324656097 >> v2:172.21.15.116:3300/0 conn(0x7f0d8415cdb0 msgr2=0x7f0d840c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.488+0000 7f0d827fc700 1 --2- 172.21.15.116:0/2324656097 >> v2:172.21.15.116:3300/0 conn(0x7f0d8415cdb0 0x7f0d840c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.488+0000 7f0d827fc700 1 -- 172.21.15.116:0/2324656097 >> v1:172.21.15.116:6789/0 conn(0x7f0d84158aa0 legacy=0x7f0d840cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.488+0000 7f0d827fc700 1 -- 172.21.15.116:0/2324656097 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8406cf20 con 0x7f0d840cbc20 2023-05-12T09:07:42.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.489+0000 7f0d827fc700 1 --2- 172.21.15.116:0/2324656097 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d840cbc20 0x7f0d840add70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d840708e0 tx=0x7f0d74009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b41cad67bd091e01 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.489+0000 7fdab2fff700 1 -- 172.21.15.116:0/4056917907 shutdown_connections 2023-05-12T09:07:42.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.489+0000 7fdab2fff700 1 --2- 172.21.15.116:0/4056917907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaac0cacf0 0x7fdaac0add70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.489+0000 7fdab2fff700 1 --2- 172.21.15.116:0/4056917907 >> v2:172.21.15.182:3300/0 conn(0x7fdaac15cdb0 0x7fdaac0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.489+0000 7fdab2fff700 1 -- 172.21.15.116:0/4056917907 >> 172.21.15.116:0/4056917907 conn(0x7fdaac0cf6e0 msgr2=0x7fdaac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.490+0000 7f0d81ffb700 1 -- 172.21.15.116:0/2324656097 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74004230 con 0x7f0d840cbc20 2023-05-12T09:07:42.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.490+0000 7f0d81ffb700 1 -- 172.21.15.116:0/2324656097 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d74004390 con 0x7f0d840cbc20 2023-05-12T09:07:42.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.490+0000 7f0d81ffb700 1 -- 172.21.15.116:0/2324656097 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d740036a0 con 0x7f0d840cbc20 2023-05-12T09:07:42.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.491+0000 7f0d893ff700 1 -- 172.21.15.116:0/2324656097 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d840cbc20 msgr2=0x7f0d840add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.491+0000 7f0d893ff700 1 --2- 172.21.15.116:0/2324656097 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d840cbc20 0x7f0d840add70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d840708e0 tx=0x7f0d74009b20 comp rx=0 tx=0).stop 2023-05-12T09:07:42.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.492+0000 7f0d893ff700 1 -- 172.21.15.116:0/2324656097 shutdown_connections 2023-05-12T09:07:42.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.492+0000 7f0d893ff700 1 --2- 172.21.15.116:0/2324656097 >> v2:172.21.15.116:3300/0 conn(0x7f0d8415cdb0 0x7f0d840c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.492+0000 7f0d893ff700 1 --2- 172.21.15.116:0/2324656097 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d840cbc20 0x7f0d840add70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.492+0000 7f0d893ff700 1 -- 172.21.15.116:0/2324656097 >> 172.21.15.116:0/2324656097 conn(0x7f0d840cf6e0 msgr2=0x7f0d840cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.494+0000 7f0d893ff700 1 -- 172.21.15.116:0/2324656097 shutdown_connections 2023-05-12T09:07:42.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.494+0000 7f756c5ff700 1 Processor -- start 2023-05-12T09:07:42.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.494+0000 7f756c5ff700 1 -- start start 2023-05-12T09:07:42.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.494+0000 7f0d893ff700 1 -- 172.21.15.116:0/2324656097 wait complete. 2023-05-12T09:07:42.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.496+0000 7f756c5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640ad690 0x7f75640adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.496+0000 7f756c5ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f75640c19c0 0x7f75640c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.496+0000 7f756c5ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75640cd1f0 con 0x7f7564160d20 2023-05-12T09:07:42.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.496+0000 7f756c5ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75641610f0 con 0x7f75640c19c0 2023-05-12T09:07:42.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.496+0000 7f756c5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75640c2320 con 0x7f75640ad690 2023-05-12T09:07:42.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.497+0000 7f7569b9a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640ad690 0x7f75640adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.497+0000 7f7569b9a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640ad690 0x7f75640adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49082/0 (socket says 172.21.15.116:49082) 2023-05-12T09:07:42.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.497+0000 7f7569b9a700 1 -- 172.21.15.116:0/1993643304 learned_addr learned my addr 172.21.15.116:0/1993643304 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.498+0000 7fdab2fff700 1 -- 172.21.15.116:0/4056917907 shutdown_connections 2023-05-12T09:07:42.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.491+0000 7f1ddc9ff700 1 Processor -- start 2023-05-12T09:07:42.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.491+0000 7f1ddc9ff700 1 -- start start 2023-05-12T09:07:42.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.494+0000 7f1ddc9ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f1dd806a3e0 0x7f1dd815cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.494+0000 7f1ddc9ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1dd806a7b0 0x7f1dd806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.494+0000 7f1ddc9ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd806d380 con 0x7f1dd80c9050 2023-05-12T09:07:42.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.494+0000 7f1ddc9ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd80c9b80 con 0x7f1dd806a7b0 2023-05-12T09:07:42.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.494+0000 7f1ddc9ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd8158aa0 con 0x7f1dd806a3e0 2023-05-12T09:07:42.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.494+0000 7f1dd659c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f1dd806a3e0 0x7f1dd815cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.495+0000 7f1dd659c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f1dd806a3e0 0x7f1dd815cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58420/0 (socket says 172.21.15.116:58420) 2023-05-12T09:07:42.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.495+0000 7f1dd659c700 1 -- 172.21.15.116:0/2868424432 learned_addr learned my addr 172.21.15.116:0/2868424432 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.495+0000 7f1dd659c700 1 -- 172.21.15.116:0/2868424432 >> v2:172.21.15.116:3300/0 conn(0x7f1dd806a7b0 msgr2=0x7f1dd806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.495+0000 7f1dd659c700 1 --2- 172.21.15.116:0/2868424432 >> v2:172.21.15.116:3300/0 conn(0x7f1dd806a7b0 0x7f1dd806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.495+0000 7f1dd659c700 1 -- 172.21.15.116:0/2868424432 >> v1:172.21.15.182:6789/0 conn(0x7f1dd80c9050 legacy=0x7f1dd80c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.495+0000 7f1dd659c700 1 -- 172.21.15.116:0/2868424432 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd815d100 con 0x7f1dd806a3e0 2023-05-12T09:07:42.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.495+0000 7f1dd659c700 1 --2- 172.21.15.116:0/2868424432 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a3e0 0x7f1dd815cbc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1dd806b3d0 tx=0x7f1dc800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15b5e533dade34f4 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.496+0000 7f1dd5d9b700 1 -- 172.21.15.116:0/2868424432 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800e070 con 0x7f1dd806a3e0 2023-05-12T09:07:42.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.496+0000 7f1dd5d9b700 1 -- 172.21.15.116:0/2868424432 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800b9c0 con 0x7f1dd806a3e0 2023-05-12T09:07:42.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.496+0000 7f1dd5d9b700 1 -- 172.21.15.116:0/2868424432 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800bd70 con 0x7f1dd806a3e0 2023-05-12T09:07:42.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.497+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/2868424432 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a3e0 msgr2=0x7f1dd815cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.497+0000 7f1ddc9ff700 1 --2- 172.21.15.116:0/2868424432 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a3e0 0x7f1dd815cbc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1dd806b3d0 tx=0x7f1dc800b330 comp rx=0 tx=0).stop 2023-05-12T09:07:42.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.498+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/2868424432 shutdown_connections 2023-05-12T09:07:42.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.498+0000 7f1ddc9ff700 1 --2- 172.21.15.116:0/2868424432 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a3e0 0x7f1dd815cbc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.498+0000 7f1ddc9ff700 1 --2- 172.21.15.116:0/2868424432 >> v2:172.21.15.116:3300/0 conn(0x7f1dd806a7b0 0x7f1dd806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.498+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/2868424432 >> 172.21.15.116:0/2868424432 conn(0x7f1dd80cf720 msgr2=0x7f1dd80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.498+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/2868424432 shutdown_connections 2023-05-12T09:07:42.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.498+0000 7fdab2fff700 1 -- 172.21.15.116:0/4056917907 wait complete. 2023-05-12T09:07:42.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.498+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/2868424432 wait complete. 2023-05-12T09:07:42.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.501+0000 7fdab2fff700 1 Processor -- start 2023-05-12T09:07:42.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.499+0000 7f756ab9c700 1 --2- 172.21.15.116:0/1993643304 >> v2:172.21.15.182:3300/0 conn(0x7f75640c19c0 0x7f75640c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.500+0000 7f7569b9a700 1 -- 172.21.15.116:0/1993643304 >> v2:172.21.15.182:3300/0 conn(0x7f75640c19c0 msgr2=0x7f75640c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.500+0000 7f7569b9a700 1 --2- 172.21.15.116:0/1993643304 >> v2:172.21.15.182:3300/0 conn(0x7f75640c19c0 0x7f75640c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.500+0000 7f7569b9a700 1 -- 172.21.15.116:0/1993643304 >> v1:172.21.15.116:6789/0 conn(0x7f7564160d20 legacy=0x7f756406cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.500+0000 7f7569b9a700 1 -- 172.21.15.116:0/1993643304 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75640cc670 con 0x7f75640ad690 2023-05-12T09:07:42.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.500+0000 7f1ddc9ff700 1 Processor -- start 2023-05-12T09:07:42.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.501+0000 7f1ddc9ff700 1 -- start start 2023-05-12T09:07:42.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.497+0000 7f0d893ff700 1 Processor -- start 2023-05-12T09:07:42.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.497+0000 7f0d893ff700 1 -- start start 2023-05-12T09:07:42.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.499+0000 7f0d893ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d840cbc20 0x7f0d840b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.499+0000 7f0d893ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d84158aa0 0x7f0d840c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.499+0000 7f0d893ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d8415cdb0 0x7f0d840b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.499+0000 7f0d893ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840b2f00 con 0x7f0d840cbc20 2023-05-12T09:07:42.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.499+0000 7f0d893ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840c8290 con 0x7f0d8415cdb0 2023-05-12T09:07:42.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.499+0000 7f0d893ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840b2940 con 0x7f0d84158aa0 2023-05-12T09:07:42.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.502+0000 7f1ddc9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1dd806a3e0 0x7f1dd80c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.502+0000 7f1ddc9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a7b0 0x7f1dd80c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.502+0000 7f1ddc9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dd80c9050 0x7f1dd815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.502+0000 7f1ddc9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8146e80 con 0x7f1dd80c9050 2023-05-12T09:07:42.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.502+0000 7f1ddc9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80c6b50 con 0x7f1dd806a7b0 2023-05-12T09:07:42.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.502+0000 7f1ddc9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80c6010 con 0x7f1dd806a3e0 2023-05-12T09:07:42.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.503+0000 7f1dcdd9b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a7b0 0x7f1dd80c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.503+0000 7f1dcdd9b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a7b0 0x7f1dd80c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58436/0 (socket says 172.21.15.116:58436) 2023-05-12T09:07:42.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.503+0000 7f1dcdd9b700 1 -- 172.21.15.116:0/3225028746 learned_addr learned my addr 172.21.15.116:0/3225028746 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.503+0000 7f1dd659c700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1dd806a3e0 0x7f1dd80c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f0d827fc700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d84158aa0 0x7f0d840c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f0d837fe700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d8415cdb0 0x7f0d840b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.502+0000 7fdab2fff700 1 -- start start 2023-05-12T09:07:42.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7fdab2fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdaac06a3e0 0x7fdaac0c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7fdab2fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdaac0cacf0 0x7fdaac155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7fdab2fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaac15cdb0 0x7fdaac155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7fdab2fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0b2080 con 0x7fdaac15cdb0 2023-05-12T09:07:42.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7fdab2fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac157340 con 0x7fdaac06a3e0 2023-05-12T09:07:42.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7fdab2fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac157620 con 0x7fdaac0cacf0 2023-05-12T09:07:42.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.503+0000 7f1dcdd9b700 1 -- 172.21.15.116:0/3225028746 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1dd806a3e0 msgr2=0x7f1dd80c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.503+0000 7f1dcdd9b700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1dd806a3e0 0x7f1dd80c5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f1dcdd9b700 1 -- 172.21.15.116:0/3225028746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dd80c9050 msgr2=0x7f1dd815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f1dcdd9b700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dd80c9050 0x7f1dd815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f1dcdd9b700 1 -- 172.21.15.116:0/3225028746 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8009b30 con 0x7f1dd806a7b0 2023-05-12T09:07:42.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f1dcdd9b700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a7b0 0x7f1dd80c5ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000b550 tx=0x7f1dc000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f0d837fe700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d8415cdb0 0x7f0d840b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58434/0 (socket says 172.21.15.116:58434) 2023-05-12T09:07:42.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f0d837fe700 1 -- 172.21.15.116:0/1787250964 learned_addr learned my addr 172.21.15.116:0/1787250964 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f0d82ffd700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d840cbc20 0x7f0d840b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7f0d837fe700 1 -- 172.21.15.116:0/1787250964 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d84158aa0 msgr2=0x7f0d840c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7f0d837fe700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d84158aa0 0x7f0d840c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7f0d837fe700 1 -- 172.21.15.116:0/1787250964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d840cbc20 msgr2=0x7f0d840b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7f0d837fe700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d840cbc20 0x7f0d840b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7f0d837fe700 1 -- 172.21.15.116:0/1787250964 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740094a0 con 0x7f0d8415cdb0 2023-05-12T09:07:42.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fdaabfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdaac0cacf0 0x7fdaac155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fdab0d9b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdaac06a3e0 0x7fdaac0c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fdaabfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdaac0cacf0 0x7fdaac155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49100/0 (socket says 172.21.15.116:49100) 2023-05-12T09:07:42.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fdaabfff700 1 -- 172.21.15.116:0/1565174336 learned_addr learned my addr 172.21.15.116:0/1565174336 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fdab159c700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaac15cdb0 0x7fdaac155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f7569b9a700 1 --2- 172.21.15.116:0/1993643304 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640ad690 0x7f75640adb10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7550006fd0 tx=0x7f7550009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fcd69f70e9b0cca server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f1dcf7fe700 1 -- 172.21.15.116:0/3225028746 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0005aa0 con 0x7f1dd806a7b0 2023-05-12T09:07:42.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f1dcf7fe700 1 -- 172.21.15.116:0/3225028746 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc0005c00 con 0x7f1dd806a7b0 2023-05-12T09:07:42.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.504+0000 7f1dcf7fe700 1 -- 172.21.15.116:0/3225028746 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0011630 con 0x7f1dd806a7b0 2023-05-12T09:07:42.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/3225028746 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd80cd4f0 con 0x7f1dd806a7b0 2023-05-12T09:07:42.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fef76bff700 1 Processor -- start 2023-05-12T09:07:42.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fef76bff700 1 -- start start 2023-05-12T09:07:42.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fdab0d9b700 1 -- 172.21.15.116:0/1565174336 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdaac0cacf0 msgr2=0x7fdaac155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fdab0d9b700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdaac0cacf0 0x7fdaac155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fdab0d9b700 1 -- 172.21.15.116:0/1565174336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaac15cdb0 msgr2=0x7fdaac155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.505+0000 7fdab0d9b700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaac15cdb0 0x7fdaac155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.506+0000 7fdab0d9b700 1 -- 172.21.15.116:0/1565174336 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa40094a0 con 0x7fdaac06a3e0 2023-05-12T09:07:42.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.506+0000 7fdaabfff700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdaac0cacf0 0x7fdaac155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:42.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.506+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/3225028746 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd80cd210 con 0x7f1dd806a7b0 2023-05-12T09:07:42.520 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.506+0000 7fc47c7ff700 1 Processor -- start 2023-05-12T09:07:42.520 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.506+0000 7fdab0d9b700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdaac06a3e0 0x7fdaac0c2510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4016000 tx=0x7fdaa4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.520 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.506+0000 7fc47c7ff700 1 -- start start 2023-05-12T09:07:42.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.507+0000 7f7569399700 1 -- 172.21.15.116:0/1993643304 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7550005e30 con 0x7f75640ad690 2023-05-12T09:07:42.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.507+0000 7f7569399700 1 -- 172.21.15.116:0/1993643304 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7550006030 con 0x7f75640ad690 2023-05-12T09:07:42.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.507+0000 7f7569399700 1 -- 172.21.15.116:0/1993643304 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75500063c0 con 0x7f75640ad690 2023-05-12T09:07:42.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.507+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/3225028746 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd806cd30 con 0x7f1dd806a7b0 2023-05-12T09:07:42.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.507+0000 7f0d837fe700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d8415cdb0 0x7f0d840b3450 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00efc0 tx=0x7f0d7c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.507+0000 7fdaa97fa700 1 -- 172.21.15.116:0/1565174336 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4004510 con 0x7fdaac06a3e0 2023-05-12T09:07:42.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.507+0000 7fdaa97fa700 1 -- 172.21.15.116:0/1565174336 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa401f070 con 0x7fdaac06a3e0 2023-05-12T09:07:42.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.507+0000 7fdaa97fa700 1 -- 172.21.15.116:0/1565174336 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40038e0 con 0x7fdaac06a3e0 2023-05-12T09:07:42.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fdab2fff700 1 -- 172.21.15.116:0/1565174336 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac06cf20 con 0x7fdaac06a3e0 2023-05-12T09:07:42.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fef76bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef70160d20 0x7fef7006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fef76bff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fef700c20d0 0x7fef700adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fef76bff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef700cd1f0 con 0x7fef700ad690 2023-05-12T09:07:42.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fef76bff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef701610f0 con 0x7fef700c20d0 2023-05-12T09:07:42.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fef76bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef700cc670 con 0x7fef70160d20 2023-05-12T09:07:42.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fdab2fff700 1 -- 172.21.15.116:0/1565174336 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac06cc40 con 0x7fdaac06a3e0 2023-05-12T09:07:42.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7f3293dff700 1 Processor -- start 2023-05-12T09:07:42.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fef7499b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef70160d20 0x7fef7006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fef7499b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef70160d20 0x7fef7006cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49114/0 (socket says 172.21.15.116:49114) 2023-05-12T09:07:42.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fef7499b700 1 -- 172.21.15.116:0/3687211101 learned_addr learned my addr 172.21.15.116:0/3687211101 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fef7519c700 1 --2- 172.21.15.116:0/3687211101 >> v2:172.21.15.116:3300/0 conn(0x7fef700c20d0 0x7fef700adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fef7499b700 1 -- 172.21.15.116:0/3687211101 >> v2:172.21.15.116:3300/0 conn(0x7fef700c20d0 msgr2=0x7fef700adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fc47c7ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc4740b87a0 0x7fc4740cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fc47c7ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc474160d40 0x7fc4740d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fc47c7ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4740cdc60 con 0x7fc4741601e0 2023-05-12T09:07:42.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fc47c7ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4740d02d0 con 0x7fc474160d40 2023-05-12T09:07:42.527 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7fc47c7ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4740d0cb0 con 0x7fc4740b87a0 2023-05-12T09:07:42.527 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fc47a59b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc4740b87a0 0x7fc4740cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.527 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fef7499b700 1 --2- 172.21.15.116:0/3687211101 >> v2:172.21.15.116:3300/0 conn(0x7fef700c20d0 0x7fef700adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.527 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fef7499b700 1 -- 172.21.15.116:0/3687211101 >> v1:172.21.15.116:6789/0 conn(0x7fef700ad690 legacy=0x7fef700c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.527 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fef7499b700 1 -- 172.21.15.116:0/3687211101 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700cc950 con 0x7fef70160d20 2023-05-12T09:07:42.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fc47a59b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc4740b87a0 0x7fc4740cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58458/0 (socket says 172.21.15.116:58458) 2023-05-12T09:07:42.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fc47a59b700 1 -- 172.21.15.116:0/1421069686 learned_addr learned my addr 172.21.15.116:0/1421069686 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fc47ad9c700 1 --2- 172.21.15.116:0/1421069686 >> v2:172.21.15.116:3300/0 conn(0x7fc474160d40 0x7fc4740d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fc47a59b700 1 -- 172.21.15.116:0/1421069686 >> v2:172.21.15.116:3300/0 conn(0x7fc474160d40 msgr2=0x7fc4740d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fc47a59b700 1 --2- 172.21.15.116:0/1421069686 >> v2:172.21.15.116:3300/0 conn(0x7fc474160d40 0x7fc4740d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fc47a59b700 1 -- 172.21.15.116:0/1421069686 >> v1:172.21.15.182:6789/0 conn(0x7fc4741601e0 legacy=0x7fc474160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fc47a59b700 1 -- 172.21.15.116:0/1421069686 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4740cd6a0 con 0x7fc4740b87a0 2023-05-12T09:07:42.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.509+0000 7fc47ad9c700 1 --2- 172.21.15.116:0/1421069686 >> v2:172.21.15.116:3300/0 conn(0x7fc474160d40 0x7fc4740d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:42.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.508+0000 7f3293dff700 1 -- start start 2023-05-12T09:07:42.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7fef7499b700 1 --2- 172.21.15.116:0/3687211101 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef70160d20 0x7fef7006cb90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef600098f0 tx=0x7fef60009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c332eba37bf3fe server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f756c5ff700 1 -- 172.21.15.116:0/1993643304 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640ad690 msgr2=0x7f75640adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f756c5ff700 1 --2- 172.21.15.116:0/1993643304 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640ad690 0x7f75640adb10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7550006fd0 tx=0x7f7550009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f756c5ff700 1 -- 172.21.15.116:0/1993643304 shutdown_connections 2023-05-12T09:07:42.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f756c5ff700 1 --2- 172.21.15.116:0/1993643304 >> v2:172.21.15.182:3300/0 conn(0x7f75640c19c0 0x7f75640c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f756c5ff700 1 --2- 172.21.15.116:0/1993643304 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640ad690 0x7f75640adb10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f756c5ff700 1 -- 172.21.15.116:0/1993643304 >> 172.21.15.116:0/1993643304 conn(0x7f75640cf720 msgr2=0x7f75640cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7fc47a59b700 1 --2- 172.21.15.116:0/1421069686 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4740b87a0 0x7fc4740cfbf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4740b4ac0 tx=0x7fc470009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c7fd408a6754b15 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f3293dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f328c0ce990 0x7f328c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f3293dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f328c0b17a0 0x7f328c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f3293dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328c0b04b0 con 0x7f328c0b69a0 2023-05-12T09:07:42.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f3293dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328c0cf340 con 0x7f328c0ce990 2023-05-12T09:07:42.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f3293dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328c0b01f0 con 0x7f328c0b17a0 2023-05-12T09:07:42.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7fda92ffd700 1 -- 172.21.15.116:0/1565174336 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda840052f0 con 0x7fdaac06a3e0 2023-05-12T09:07:42.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.510+0000 7f1dcf7fe700 1 -- 172.21.15.116:0/3225028746 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1dc0011790 con 0x7f1dd806a7b0 2023-05-12T09:07:42.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.511+0000 7fef6f7fe700 1 -- 172.21.15.116:0/3687211101 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6000b8a0 con 0x7fef70160d20 2023-05-12T09:07:42.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.511+0000 7fef6f7fe700 1 -- 172.21.15.116:0/3687211101 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6000ba00 con 0x7fef70160d20 2023-05-12T09:07:42.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.511+0000 7fef6f7fe700 1 -- 172.21.15.116:0/3687211101 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6000bd90 con 0x7fef70160d20 2023-05-12T09:07:42.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.511+0000 7f3291b9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f328c0b69a0 0x7f328c0af3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60468/0 (socket says 172.21.15.116:60468) 2023-05-12T09:07:42.534 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.511+0000 7f3291b9b700 1 -- 172.21.15.116:0/1212131857 learned_addr learned my addr 172.21.15.116:0/1212131857 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:42.534 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.511+0000 7f756c5ff700 1 -- 172.21.15.116:0/1993643304 shutdown_connections 2023-05-12T09:07:42.534 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.511+0000 7f756c5ff700 1 -- 172.21.15.116:0/1993643304 wait complete. 2023-05-12T09:07:42.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.511+0000 7f329139a700 1 --2- 172.21.15.116:0/1212131857 >> v2:172.21.15.116:3300/0 conn(0x7f328c0ce990 0x7f328c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7fef76bff700 1 -- 172.21.15.116:0/3687211101 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef70160d20 msgr2=0x7fef7006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7fef76bff700 1 --2- 172.21.15.116:0/3687211101 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef70160d20 0x7fef7006cb90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef600098f0 tx=0x7fef60009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:42.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7f329239c700 1 --2- 172.21.15.116:0/1212131857 >> v2:172.21.15.182:3300/0 conn(0x7f328c0b17a0 0x7f328c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.536 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7f1dcf7fe700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1db806adb0 0x7f1db806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.536 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7f1dcf7fe700 1 -- 172.21.15.116:0/3225028746 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1dc0089720 con 0x7f1dd806a7b0 2023-05-12T09:07:42.536 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7fef76bff700 1 -- 172.21.15.116:0/3687211101 shutdown_connections 2023-05-12T09:07:42.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7fef76bff700 1 --2- 172.21.15.116:0/3687211101 >> v2:172.21.15.116:3300/0 conn(0x7fef700c20d0 0x7fef700adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7fef76bff700 1 --2- 172.21.15.116:0/3687211101 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef70160d20 0x7fef7006cb90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7fef76bff700 1 -- 172.21.15.116:0/3687211101 >> 172.21.15.116:0/3687211101 conn(0x7fef700cf720 msgr2=0x7fef700cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7f1dd659c700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1db806adb0 0x7f1db806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7f329139a700 1 -- 172.21.15.116:0/1212131857 >> v2:172.21.15.182:3300/0 conn(0x7f328c0b17a0 msgr2=0x7f328c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7f329139a700 1 --2- 172.21.15.116:0/1212131857 >> v2:172.21.15.182:3300/0 conn(0x7f328c0b17a0 0x7f328c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.513+0000 7fef76bff700 1 -- 172.21.15.116:0/3687211101 shutdown_connections 2023-05-12T09:07:42.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7f329139a700 1 -- 172.21.15.116:0/1212131857 >> v1:172.21.15.116:6789/0 conn(0x7f328c0b69a0 legacy=0x7f328c0af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.512+0000 7f329139a700 1 -- 172.21.15.116:0/1212131857 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c0b0700 con 0x7f328c0ce990 2023-05-12T09:07:42.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.513+0000 7fef76bff700 1 -- 172.21.15.116:0/3687211101 wait complete. 2023-05-12T09:07:42.540 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.513+0000 7ff3c8bff700 1 Processor -- start 2023-05-12T09:07:42.540 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.513+0000 7f1dd659c700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1db806adb0 0x7f1db806d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8000f80 tx=0x7f1dc8009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.513+0000 7f329139a700 1 --2- 172.21.15.116:0/1212131857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f328c0ce990 0x7f328c0cee00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f328c072ad0 tx=0x7f327c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9283cbf1cde817 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.513+0000 7ff3c8bff700 1 -- start start 2023-05-12T09:07:42.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.514+0000 7f756c5ff700 1 Processor -- start 2023-05-12T09:07:42.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.514+0000 7f3290b99700 1 -- 172.21.15.116:0/1212131857 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c011830 con 0x7f328c0ce990 2023-05-12T09:07:42.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.514+0000 7f3290b99700 1 -- 172.21.15.116:0/1212131857 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c011990 con 0x7f328c0ce990 2023-05-12T09:07:42.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.514+0000 7f3290b99700 1 -- 172.21.15.116:0/1212131857 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c011d00 con 0x7f328c0ce990 2023-05-12T09:07:42.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.514+0000 7f756c5ff700 1 -- start start 2023-05-12T09:07:42.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.514+0000 7f3293dff700 1 -- 172.21.15.116:0/1212131857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f328c0ce990 msgr2=0x7f328c0cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.514+0000 7f3293dff700 1 --2- 172.21.15.116:0/1212131857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f328c0ce990 0x7f328c0cee00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f328c072ad0 tx=0x7f327c009b20 comp rx=0 tx=0).stop 2023-05-12T09:07:42.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7f3293dff700 1 -- 172.21.15.116:0/1212131857 shutdown_connections 2023-05-12T09:07:42.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7f3293dff700 1 --2- 172.21.15.116:0/1212131857 >> v2:172.21.15.182:3300/0 conn(0x7f328c0b17a0 0x7f328c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7f3293dff700 1 --2- 172.21.15.116:0/1212131857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f328c0ce990 0x7f328c0cee00 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f328c072ad0 tx=0x7f327c009b20 comp rx=0 tx=0).stop 2023-05-12T09:07:42.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7f3293dff700 1 -- 172.21.15.116:0/1212131857 >> 172.21.15.116:0/1212131857 conn(0x7f328c09a090 msgr2=0x7f328c0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7f1dcf7fe700 1 -- 172.21.15.116:0/3225028746 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1dc0054550 con 0x7f1dd806a7b0 2023-05-12T09:07:42.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7ff3c8bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c4160d20 0x7ff3c406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7ff3c8bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7ff3c40ad690 0x7ff3c40adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7ff3c8bff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c40cd1f0 con 0x7ff3c40c19c0 2023-05-12T09:07:42.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7ff3c8bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c41610f0 con 0x7ff3c40ad690 2023-05-12T09:07:42.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7ff3c8bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40cc670 con 0x7ff3c4160d20 2023-05-12T09:07:42.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7fef76bff700 1 Processor -- start 2023-05-12T09:07:42.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7f756c5ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75640ad690 0x7f756415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7f756c5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640c19c0 0x7f75640afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7f756c5ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7564160d20 0x7f75640b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7f756c5ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75640af570 con 0x7f75640ad690 2023-05-12T09:07:42.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7f756c5ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75640ae960 con 0x7f7564160d20 2023-05-12T09:07:42.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7f756c5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75640aec40 con 0x7f75640c19c0 2023-05-12T09:07:42.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7f756a39b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75640ad690 0x7f756415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7f756a39b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75640ad690 0x7f756415cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57214/0 (socket says 172.21.15.116:57214) 2023-05-12T09:07:42.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7ff3c259c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c4160d20 0x7ff3c406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7ff3c259c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c4160d20 0x7ff3c406cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49116/0 (socket says 172.21.15.116:49116) 2023-05-12T09:07:42.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7ff3c259c700 1 -- 172.21.15.116:0/3709478202 learned_addr learned my addr 172.21.15.116:0/3709478202 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7ff3c1d9b700 1 --2- 172.21.15.116:0/3709478202 >> v2:172.21.15.182:3300/0 conn(0x7ff3c40ad690 0x7ff3c40adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7ff3c259c700 1 -- 172.21.15.116:0/3709478202 >> v2:172.21.15.182:3300/0 conn(0x7ff3c40ad690 msgr2=0x7ff3c40adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7ff3c259c700 1 --2- 172.21.15.116:0/3709478202 >> v2:172.21.15.182:3300/0 conn(0x7ff3c40ad690 0x7ff3c40adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7ff3c259c700 1 -- 172.21.15.116:0/3709478202 >> v1:172.21.15.116:6789/0 conn(0x7ff3c40c19c0 legacy=0x7ff3c40c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:42.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7ff3c259c700 1 -- 172.21.15.116:0/3709478202 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40cc950 con 0x7ff3c4160d20 2023-05-12T09:07:42.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7ff3c259c700 1 --2- 172.21.15.116:0/3709478202 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c4160d20 0x7ff3c406cb90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40098f0 tx=0x7ff3b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b131c937b2710be server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7ff3c159a700 1 -- 172.21.15.116:0/3709478202 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4004230 con 0x7ff3c4160d20 2023-05-12T09:07:42.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7fc479599700 1 -- 172.21.15.116:0/1421069686 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470004230 con 0x7fc4740b87a0 2023-05-12T09:07:42.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7fc479599700 1 -- 172.21.15.116:0/1421069686 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470004390 con 0x7fc4740b87a0 2023-05-12T09:07:42.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7fc479599700 1 -- 172.21.15.116:0/1421069686 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700036a0 con 0x7fc4740b87a0 2023-05-12T09:07:42.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7fc47c7ff700 1 -- 172.21.15.116:0/1421069686 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4740b87a0 msgr2=0x7fc4740cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7fc47c7ff700 1 --2- 172.21.15.116:0/1421069686 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4740b87a0 0x7fc4740cfbf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4740b4ac0 tx=0x7fc470009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7f7569b9a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640c19c0 0x7f75640afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7f756a39b700 1 -- 172.21.15.116:0/1608963541 learned_addr learned my addr 172.21.15.116:0/1608963541 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.516+0000 7f756ab9c700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7564160d20 0x7f75640b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7ff3c159a700 1 -- 172.21.15.116:0/3709478202 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b4004390 con 0x7ff3c4160d20 2023-05-12T09:07:42.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7ff3c159a700 1 -- 172.21.15.116:0/3709478202 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40036a0 con 0x7ff3c4160d20 2023-05-12T09:07:42.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.515+0000 7fef76bff700 1 -- start start 2023-05-12T09:07:42.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7f3293dff700 1 -- 172.21.15.116:0/1212131857 shutdown_connections 2023-05-12T09:07:42.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7f0d6b7fe700 1 -- 172.21.15.116:0/1787250964 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c003c20 con 0x7f0d8415cdb0 2023-05-12T09:07:42.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fc47c7ff700 1 -- 172.21.15.116:0/1421069686 shutdown_connections 2023-05-12T09:07:42.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fc47c7ff700 1 --2- 172.21.15.116:0/1421069686 >> v2:172.21.15.116:3300/0 conn(0x7fc474160d40 0x7fc4740d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fc47c7ff700 1 --2- 172.21.15.116:0/1421069686 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4740b87a0 0x7fc4740cfbf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fc47c7ff700 1 -- 172.21.15.116:0/1421069686 >> 172.21.15.116:0/1421069686 conn(0x7fc474071b10 msgr2=0x7fc474071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fc47c7ff700 1 -- 172.21.15.116:0/1421069686 shutdown_connections 2023-05-12T09:07:42.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fc47c7ff700 1 -- 172.21.15.116:0/1421069686 wait complete. 2023-05-12T09:07:42.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3709478202 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c4160d20 msgr2=0x7ff3c406cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7ff3c8bff700 1 --2- 172.21.15.116:0/3709478202 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c4160d20 0x7ff3c406cb90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40098f0 tx=0x7ff3b4009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:42.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fef76bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef700ad690 0x7fef7015fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fef76bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef700c20d0 0x7fef700c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fef76bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef70160d20 0x7fef700c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fef76bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef700bea10 con 0x7fef700ad690 2023-05-12T09:07:42.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fef76bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef700c24d0 con 0x7fef70160d20 2023-05-12T09:07:42.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fef76bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef700c52b0 con 0x7fef700c20d0 2023-05-12T09:07:42.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.518+0000 7fef6ffff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef700c20d0 0x7fef700c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.518+0000 7fef6ffff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef700c20d0 0x7fef700c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49138/0 (socket says 172.21.15.116:49138) 2023-05-12T09:07:42.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.518+0000 7fef6ffff700 1 -- 172.21.15.116:0/4042687475 learned_addr learned my addr 172.21.15.116:0/4042687475 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.518+0000 7fef7519c700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef70160d20 0x7fef700c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7fdaa97fa700 1 -- 172.21.15.116:0/1565174336 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdaa4003a40 con 0x7fdaac06a3e0 2023-05-12T09:07:42.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7f0d6b7fe700 1 -- 172.21.15.116:0/1787250964 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00f040 con 0x7f0d8415cdb0 2023-05-12T09:07:42.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7f0d6b7fe700 1 -- 172.21.15.116:0/1787250964 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c009e90 con 0x7f0d8415cdb0 2023-05-12T09:07:42.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7f0d893ff700 1 -- 172.21.15.116:0/1787250964 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d840c9600 con 0x7f0d8415cdb0 2023-05-12T09:07:42.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.517+0000 7f0d893ff700 1 -- 172.21.15.116:0/1787250964 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8415d210 con 0x7f0d8415cdb0 2023-05-12T09:07:42.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.520+0000 7f0d893ff700 1 -- 172.21.15.116:0/1787250964 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d840c9790 con 0x7f0d8415cdb0 2023-05-12T09:07:42.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7f756ab9c700 1 -- 172.21.15.116:0/1608963541 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640c19c0 msgr2=0x7f75640afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7f756ab9c700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640c19c0 0x7f75640afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7f756ab9c700 1 -- 172.21.15.116:0/1608963541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75640ad690 msgr2=0x7f756415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7f756ab9c700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75640ad690 0x7f756415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7f756ab9c700 1 -- 172.21.15.116:0/1608963541 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7550009500 con 0x7f7564160d20 2023-05-12T09:07:42.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7f756ab9c700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7564160d20 0x7f75640b0700 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f755c00c5c0 tx=0x7f755c00c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3709478202 shutdown_connections 2023-05-12T09:07:42.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7ff3c8bff700 1 --2- 172.21.15.116:0/3709478202 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c4160d20 0x7ff3c406cb90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7ff3c8bff700 1 --2- 172.21.15.116:0/3709478202 >> v2:172.21.15.182:3300/0 conn(0x7ff3c40ad690 0x7ff3c40adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3709478202 >> 172.21.15.116:0/3709478202 conn(0x7ff3c40cf720 msgr2=0x7ff3c40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7fef6ffff700 1 -- 172.21.15.116:0/4042687475 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef70160d20 msgr2=0x7fef700c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7fef6ffff700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef70160d20 0x7fef700c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7fef6ffff700 1 -- 172.21.15.116:0/4042687475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef700ad690 msgr2=0x7fef7015fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7fef6ffff700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef700ad690 0x7fef7015fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7fef6ffff700 1 -- 172.21.15.116:0/4042687475 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60009550 con 0x7fef700c20d0 2023-05-12T09:07:42.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7fef6ffff700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef700c20d0 0x7fef700c46a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef6400c450 tx=0x7fef6400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.520+0000 7fef6d7fa700 1 -- 172.21.15.116:0/4042687475 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef640052d0 con 0x7fef700c20d0 2023-05-12T09:07:42.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.520+0000 7fef6d7fa700 1 -- 172.21.15.116:0/4042687475 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef64005430 con 0x7fef700c20d0 2023-05-12T09:07:42.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.520+0000 7fef6d7fa700 1 -- 172.21.15.116:0/4042687475 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef640038c0 con 0x7fef700c20d0 2023-05-12T09:07:42.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.520+0000 7fc47c7ff700 1 Processor -- start 2023-05-12T09:07:42.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.520+0000 7fc47c7ff700 1 -- start start 2023-05-12T09:07:42.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7f3293dff700 1 -- 172.21.15.116:0/1212131857 wait complete. 2023-05-12T09:07:42.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.518+0000 7fdaa97fa700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda9806adb0 0x7fda9806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.518+0000 7fdaa97fa700 1 -- 172.21.15.116:0/1565174336 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdaa4021070 con 0x7fdaac06a3e0 2023-05-12T09:07:42.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.519+0000 7fdaabfff700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda9806adb0 0x7fda9806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.520+0000 7fdaabfff700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda9806adb0 0x7fda9806d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0c9660 tx=0x7fdaa000d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.520+0000 7f7562ffd700 1 -- 172.21.15.116:0/1608963541 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c004220 con 0x7f7564160d20 2023-05-12T09:07:42.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.520+0000 7f7562ffd700 1 -- 172.21.15.116:0/1608963541 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c004380 con 0x7f7564160d20 2023-05-12T09:07:42.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7f7562ffd700 1 -- 172.21.15.116:0/1608963541 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c0036a0 con 0x7f7564160d20 2023-05-12T09:07:42.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7f756c5ff700 1 -- 172.21.15.116:0/1608963541 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75640ccc30 con 0x7f7564160d20 2023-05-12T09:07:42.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.520+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3709478202 shutdown_connections 2023-05-12T09:07:42.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7f756c5ff700 1 -- 172.21.15.116:0/1608963541 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75640cc950 con 0x7f7564160d20 2023-05-12T09:07:42.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7fef76bff700 1 -- 172.21.15.116:0/4042687475 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef700ccf10 con 0x7fef700c20d0 2023-05-12T09:07:42.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7fef76bff700 1 -- 172.21.15.116:0/4042687475 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef700ccc30 con 0x7fef700c20d0 2023-05-12T09:07:42.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7fdaa97fa700 1 -- 172.21.15.116:0/1565174336 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdaa4056050 con 0x7fdaac06a3e0 2023-05-12T09:07:42.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.522+0000 7f756c5ff700 1 -- 172.21.15.116:0/1608963541 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75640ccf10 con 0x7f7564160d20 2023-05-12T09:07:42.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7fef76bff700 1 -- 172.21.15.116:0/4042687475 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7006d0d0 con 0x7fef700c20d0 2023-05-12T09:07:42.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7fc47c7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4740b87a0 0x7fc4741f7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7fc47c7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4741601e0 0x7fc4741f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7fc47c7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc474160d40 0x7fc47415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7fc47c7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740d3810 con 0x7fc474160d40 2023-05-12T09:07:42.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7fc47c7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741f9fa0 con 0x7fc4741601e0 2023-05-12T09:07:42.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7fc47c7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741fa280 con 0x7fc4740b87a0 2023-05-12T09:07:42.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.522+0000 7fc479d9a700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4741601e0 0x7fc4741f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.522+0000 7fc479d9a700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4741601e0 0x7fc4741f9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58496/0 (socket says 172.21.15.116:58496) 2023-05-12T09:07:42.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.522+0000 7fc479d9a700 1 -- 172.21.15.116:0/420948415 learned_addr learned my addr 172.21.15.116:0/420948415 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.522+0000 7fc47ad9c700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc474160d40 0x7fc47415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7f3293dff700 1 Processor -- start 2023-05-12T09:07:42.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.522+0000 7f3293dff700 1 -- start start 2023-05-12T09:07:42.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.525+0000 7f0d6b7fe700 1 -- 172.21.15.116:0/1787250964 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d7c00c930 con 0x7f0d8415cdb0 2023-05-12T09:07:42.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.521+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3709478202 wait complete. 2023-05-12T09:07:42.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7ff3c8bff700 1 Processor -- start 2023-05-12T09:07:42.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7ff3c8bff700 1 -- start start 2023-05-12T09:07:42.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.525+0000 7ff3c8bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff3c40ad690 0x7ff3c4202bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.525+0000 7ff3c8bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c40c19c0 0x7ff3c406d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.525+0000 7ff3c8bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff3c4160d20 0x7ff3c42015f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.525+0000 7ff3c8bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c41f4ea0 con 0x7ff3c4160d20 2023-05-12T09:07:42.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.525+0000 7ff3c8bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c42030f0 con 0x7ff3c40ad690 2023-05-12T09:07:42.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.525+0000 7ff3c8bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c41f4220 con 0x7ff3c40c19c0 2023-05-12T09:07:42.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7fc47ad9c700 1 -- 172.21.15.116:0/420948415 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4740b87a0 msgr2=0x7fc4741f7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7fc47ad9c700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4740b87a0 0x7fc4741f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7fc47ad9c700 1 -- 172.21.15.116:0/420948415 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4741601e0 msgr2=0x7fc4741f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7fc47ad9c700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4741601e0 0x7fc4741f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7fc47ad9c700 1 -- 172.21.15.116:0/420948415 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc470009550 con 0x7fc474160d40 2023-05-12T09:07:42.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7fc47ad9c700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc474160d40 0x7fc47415c9d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc46c007d40 tx=0x7fc46c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7fc46affd700 1 -- 172.21.15.116:0/420948415 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c00ddd0 con 0x7fc474160d40 2023-05-12T09:07:42.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7fc46affd700 1 -- 172.21.15.116:0/420948415 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c00f040 con 0x7fc474160d40 2023-05-12T09:07:42.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7fc46affd700 1 -- 172.21.15.116:0/420948415 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c003c60 con 0x7fc474160d40 2023-05-12T09:07:42.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.525+0000 7fc47c7ff700 1 -- 172.21.15.116:0/420948415 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4740d1640 con 0x7fc474160d40 2023-05-12T09:07:42.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.525+0000 7fc47c7ff700 1 -- 172.21.15.116:0/420948415 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4740cd980 con 0x7fc474160d40 2023-05-12T09:07:42.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7f3293dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f328c0b17a0 0x7f328c1fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7f3293dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f328c0b69a0 0x7f328c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7f3293dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f328c1f6af0 0x7f328c1f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7f3293dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0c4550 con 0x7f328c0b69a0 2023-05-12T09:07:42.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7f3293dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c1f7640 con 0x7f328c0b17a0 2023-05-12T09:07:42.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.523+0000 7f3293dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c1f7920 con 0x7f328c1f6af0 2023-05-12T09:07:42.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7f3291b9b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f328c0b17a0 0x7f328c1fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7f3291b9b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f328c0b17a0 0x7f328c1fabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58512/0 (socket says 172.21.15.116:58512) 2023-05-12T09:07:42.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7f3291b9b700 1 -- 172.21.15.116:0/2329016836 learned_addr learned my addr 172.21.15.116:0/2329016836 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7f329239c700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f328c1f6af0 0x7f328c1f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7f329139a700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f328c0b69a0 0x7f328c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7f3291b9b700 1 -- 172.21.15.116:0/2329016836 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f328c1f6af0 msgr2=0x7f328c1f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7f3291b9b700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f328c1f6af0 0x7f328c1f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7f3291b9b700 1 -- 172.21.15.116:0/2329016836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f328c0b69a0 msgr2=0x7f328c14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7f3291b9b700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f328c0b69a0 0x7f328c14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.524+0000 7f3291b9b700 1 -- 172.21.15.116:0/2329016836 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c0094a0 con 0x7f328c0b17a0 2023-05-12T09:07:42.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.525+0000 7f3291b9b700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f328c0b17a0 0x7f328c1fabc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f328800c460 tx=0x7f328800c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7ff3c1d9b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c40c19c0 0x7ff3c406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7ff3c1d9b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c40c19c0 0x7ff3c406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49154/0 (socket says 172.21.15.116:49154) 2023-05-12T09:07:42.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7ff3c1d9b700 1 -- 172.21.15.116:0/3572516685 learned_addr learned my addr 172.21.15.116:0/3572516685 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:42.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7ff3c259c700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff3c40ad690 0x7ff3c4202bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7fef6d7fa700 1 -- 172.21.15.116:0/4042687475 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef64003a20 con 0x7fef700c20d0 2023-05-12T09:07:42.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7f0d6b7fe700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d7006adb0 0x7f0d7006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7ff3c1d9b700 1 -- 172.21.15.116:0/3572516685 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff3c40ad690 msgr2=0x7ff3c4202bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7ff3c1d9b700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff3c40ad690 0x7ff3c4202bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7ff3c1d9b700 1 -- 172.21.15.116:0/3572516685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff3c4160d20 msgr2=0x7ff3c42015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7ff3c1d9b700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff3c4160d20 0x7ff3c42015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7ff3c1d9b700 1 -- 172.21.15.116:0/3572516685 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b4009550 con 0x7ff3c40c19c0 2023-05-12T09:07:42.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.526+0000 7fc47c7ff700 1 -- 172.21.15.116:0/420948415 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4740d17d0 con 0x7fc474160d40 2023-05-12T09:07:42.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.527+0000 7f0d6b7fe700 1 -- 172.21.15.116:0/1787250964 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0d7c08a960 con 0x7f0d8415cdb0 2023-05-12T09:07:42.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.527+0000 7ff3c1d9b700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c40c19c0 0x7ff3c406d580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800c7f0 tx=0x7ff3b800cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.527+0000 7fef6d7fa700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef5c06adb0 0x7fef5c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.527+0000 7fef6d7fa700 1 -- 172.21.15.116:0/4042687475 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fef64088da0 con 0x7fef700c20d0 2023-05-12T09:07:42.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.527+0000 7f0d82ffd700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d7006adb0 0x7f0d7006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.528+0000 7f32827fc700 1 -- 172.21.15.116:0/2329016836 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800cea0 con 0x7f328c0b17a0 2023-05-12T09:07:42.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.528+0000 7f32827fc700 1 -- 172.21.15.116:0/2329016836 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288005d70 con 0x7f328c0b17a0 2023-05-12T09:07:42.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.528+0000 7f32827fc700 1 -- 172.21.15.116:0/2329016836 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32880072f0 con 0x7f328c0b17a0 2023-05-12T09:07:42.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.528+0000 7f0d6b7fe700 1 -- 172.21.15.116:0/1787250964 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0d7c055700 con 0x7f0d8415cdb0 2023-05-12T09:07:42.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.528+0000 7f0d82ffd700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d7006adb0 0x7f0d7006d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0d78004f30 tx=0x7f0d78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.529+0000 7fef7499b700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef5c06adb0 0x7fef5c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.528+0000 7f3293dff700 1 -- 172.21.15.116:0/2329016836 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c0b0cc0 con 0x7f328c0b17a0 2023-05-12T09:07:42.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.528+0000 7f3293dff700 1 -- 172.21.15.116:0/2329016836 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c0b09e0 con 0x7f328c0b17a0 2023-05-12T09:07:42.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.529+0000 7f3293dff700 1 -- 172.21.15.116:0/2329016836 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32740052f0 con 0x7f328c0b17a0 2023-05-12T09:07:42.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.529+0000 7fc46affd700 1 -- 172.21.15.116:0/420948415 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc46c004030 con 0x7fc474160d40 2023-05-12T09:07:42.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.530+0000 7fc46affd700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc45806adb0 0x7fc45806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.530+0000 7fc46affd700 1 -- 172.21.15.116:0/420948415 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc46c089860 con 0x7fc474160d40 2023-05-12T09:07:42.582 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.530+0000 7fef7499b700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef5c06adb0 0x7fef5c06d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef60014040 tx=0x7fef60010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.582 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.530+0000 7f7562ffd700 1 -- 172.21.15.116:0/1608963541 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f755c003800 con 0x7f7564160d20 2023-05-12T09:07:42.582 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.530+0000 7fc47a59b700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc45806adb0 0x7fc45806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.583 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.531+0000 7fc47a59b700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc45806adb0 0x7fc45806d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc470009c10 tx=0x7fc470010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.583 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.532+0000 7f7562ffd700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f754806ad30 0x7f754806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.583 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.532+0000 7f7562ffd700 1 -- 172.21.15.116:0/1608963541 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f755c0898d0 con 0x7f7564160d20 2023-05-12T09:07:42.583 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.533+0000 7f756a39b700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f754806ad30 0x7f754806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.584 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.533+0000 7f756a39b700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f754806ad30 0x7f754806d1e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7558001ef0 tx=0x7f7558009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.584 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.536+0000 7ff3b2ffd700 1 -- 172.21.15.116:0/3572516685 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8011800 con 0x7ff3c40c19c0 2023-05-12T09:07:42.584 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.536+0000 7ff3b2ffd700 1 -- 172.21.15.116:0/3572516685 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b8011960 con 0x7ff3c40c19c0 2023-05-12T09:07:42.584 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.536+0000 7ff3b2ffd700 1 -- 172.21.15.116:0/3572516685 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8011cf0 con 0x7ff3c40c19c0 2023-05-12T09:07:42.585 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.536+0000 7fc46affd700 1 -- 172.21.15.116:0/420948415 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc46c054690 con 0x7fc474160d40 2023-05-12T09:07:42.585 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.536+0000 7fef6d7fa700 1 -- 172.21.15.116:0/4042687475 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fef64053bd0 con 0x7fef700c20d0 2023-05-12T09:07:42.585 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.536+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3572516685 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c40ccf10 con 0x7ff3c40c19c0 2023-05-12T09:07:42.585 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.536+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3572516685 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c40ccc30 con 0x7ff3c40c19c0 2023-05-12T09:07:42.586 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.537+0000 7f7562ffd700 1 -- 172.21.15.116:0/1608963541 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f755c058100 con 0x7f7564160d20 2023-05-12T09:07:42.586 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.538+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3572516685 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c406d0d0 con 0x7ff3c40c19c0 2023-05-12T09:07:42.586 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.540+0000 7f32827fc700 1 -- 172.21.15.116:0/2329016836 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3288007450 con 0x7f328c0b17a0 2023-05-12T09:07:42.587 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.541+0000 7f32827fc700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f327006ad30 0x7f327006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.587 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.541+0000 7f32827fc700 1 -- 172.21.15.116:0/2329016836 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3288088fd0 con 0x7f328c0b17a0 2023-05-12T09:07:42.587 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.543+0000 7f32827fc700 1 -- 172.21.15.116:0/2329016836 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3288053d70 con 0x7f328c0b17a0 2023-05-12T09:07:42.587 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.542+0000 7ff3b2ffd700 1 -- 172.21.15.116:0/3572516685 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3b801a450 con 0x7ff3c40c19c0 2023-05-12T09:07:42.588 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.543+0000 7ff3b2ffd700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff3a406adb0 0x7ff3a406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:42.588 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.544+0000 7ff3b2ffd700 1 -- 172.21.15.116:0/3572516685 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff3b80897b0 con 0x7ff3c40c19c0 2023-05-12T09:07:42.588 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.545+0000 7ff3b2ffd700 1 -- 172.21.15.116:0/3572516685 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff3b80545e0 con 0x7ff3c40c19c0 2023-05-12T09:07:42.588 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.545+0000 7ff3c259c700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff3a406adb0 0x7ff3a406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.588 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.546+0000 7ff3c259c700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff3a406adb0 0x7ff3a406d260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4000c00 tx=0x7ff3b4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.589 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.557+0000 7f329139a700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f327006ad30 0x7f327006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:42.589 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.568+0000 7f329139a700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f327006ad30 0x7f327006d1e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f328c0d0d90 tx=0x7f327c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.966+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/3225028746 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1dd80b4a10 con 0x7f1dd806a7b0 2023-05-12T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout:55834574857 2023-05-12T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.967+0000 7f1dcf7fe700 1 -- 172.21.15.116:0/3225028746 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dc0057b70 con 0x7f1dd806a7b0 2023-05-12T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.971+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/3225028746 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1db806adb0 msgr2=0x7f1db806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.971+0000 7f1ddc9ff700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1db806adb0 0x7f1db806d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8000f80 tx=0x7f1dc8009000 comp rx=0 tx=0).stop 2023-05-12T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.971+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/3225028746 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a7b0 msgr2=0x7f1dd80c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.971+0000 7f1ddc9ff700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a7b0 0x7f1dd80c5ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000b550 tx=0x7f1dc000b910 comp rx=0 tx=0).stop 2023-05-12T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.972+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/3225028746 shutdown_connections 2023-05-12T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.972+0000 7f1ddc9ff700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dd80c9050 0x7f1dd815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.972+0000 7f1ddc9ff700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1db806adb0 0x7f1db806d260 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.972+0000 7f1ddc9ff700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1dd806a3e0 0x7f1dd80c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.972+0000 7f1ddc9ff700 1 --2- 172.21.15.116:0/3225028746 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1dd806a7b0 0x7f1dd80c5ad0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.972+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/3225028746 >> 172.21.15.116:0/3225028746 conn(0x7f1dd80cf720 msgr2=0x7f1dd8070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.972+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/3225028746 shutdown_connections 2023-05-12T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.972+0000 7f1ddc9ff700 1 -- 172.21.15.116:0/3225028746 wait complete. 2023-05-12T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.977+0000 7f0d893ff700 1 -- 172.21.15.116:0/1787250964 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d840ccca0 con 0x7f0d8415cdb0 2023-05-12T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.977+0000 7fda92ffd700 1 -- 172.21.15.116:0/1565174336 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fda84005870 con 0x7fdaac06a3e0 2023-05-12T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.977+0000 7f0d6b7fe700 1 -- 172.21.15.116:0/1787250964 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d7c058d20 con 0x7f0d8415cdb0 2023-05-12T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout:55834574857 2023-05-12T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.977+0000 7fdaa97fa700 1 -- 172.21.15.116:0/1565174336 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdaa4015020 con 0x7fdaac06a3e0 2023-05-12T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.979+0000 7fc47c7ff700 1 -- 172.21.15.116:0/420948415 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc474074430 con 0x7fc474160d40 2023-05-12T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.980+0000 7fc46affd700 1 -- 172.21.15.116:0/420948415 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc46c057cb0 con 0x7fc474160d40 2023-05-12T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 -- 172.21.15.116:0/1787250964 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d7006adb0 msgr2=0x7f0d7006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d7006adb0 0x7f0d7006d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0d78004f30 tx=0x7f0d78009040 comp rx=0 tx=0).stop 2023-05-12T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 -- 172.21.15.116:0/1787250964 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d8415cdb0 msgr2=0x7f0d840b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d8415cdb0 0x7f0d840b3450 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00efc0 tx=0x7f0d7c00c3a0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 -- 172.21.15.116:0/1787250964 shutdown_connections 2023-05-12T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d8415cdb0 0x7f0d840b3450 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d840cbc20 0x7f0d840b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d7006adb0 0x7f0d7006d260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 --2- 172.21.15.116:0/1787250964 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d84158aa0 0x7f0d840c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 -- 172.21.15.116:0/1787250964 >> 172.21.15.116:0/1787250964 conn(0x7f0d840cf6e0 msgr2=0x7f0d840b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7fda92ffd700 1 -- 172.21.15.116:0/1565174336 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda9806adb0 msgr2=0x7fda9806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7fda92ffd700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda9806adb0 0x7fda9806d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0c9660 tx=0x7fdaa000d040 comp rx=0 tx=0).stop 2023-05-12T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7fda92ffd700 1 -- 172.21.15.116:0/1565174336 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdaac06a3e0 msgr2=0x7fdaac0c2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7fda92ffd700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdaac06a3e0 0x7fdaac0c2510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4016000 tx=0x7fdaa4004750 comp rx=0 tx=0).stop 2023-05-12T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 -- 172.21.15.116:0/1787250964 shutdown_connections 2023-05-12T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.982+0000 7f0d893ff700 1 -- 172.21.15.116:0/1787250964 wait complete. 2023-05-12T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.983+0000 7fda92ffd700 1 -- 172.21.15.116:0/1565174336 shutdown_connections 2023-05-12T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.983+0000 7fda92ffd700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaac15cdb0 0x7fdaac155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.983+0000 7fda92ffd700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdaac06a3e0 0x7fdaac0c2510 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.983+0000 7fda92ffd700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda9806adb0 0x7fda9806d260 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.983+0000 7fda92ffd700 1 --2- 172.21.15.116:0/1565174336 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdaac0cacf0 0x7fdaac155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.983+0000 7fda92ffd700 1 -- 172.21.15.116:0/1565174336 >> 172.21.15.116:0/1565174336 conn(0x7fdaac0cf6e0 msgr2=0x7fdaac1594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.984+0000 7fda92ffd700 1 -- 172.21.15.116:0/1565174336 shutdown_connections 2023-05-12T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.984+0000 7fda92ffd700 1 -- 172.21.15.116:0/1565174336 wait complete. 2023-05-12T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.986+0000 7fc47c7ff700 1 -- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc45806adb0 msgr2=0x7fc45806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.986+0000 7fc47c7ff700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc45806adb0 0x7fc45806d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc470009c10 tx=0x7fc470010000 comp rx=0 tx=0).stop 2023-05-12T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.986+0000 7fc47c7ff700 1 -- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc474160d40 msgr2=0x7fc47415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.986+0000 7fc47c7ff700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc474160d40 0x7fc47415c9d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc46c007d40 tx=0x7fc46c00d3b0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.987+0000 7fc47c7ff700 1 -- 172.21.15.116:0/420948415 shutdown_connections 2023-05-12T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.987+0000 7fc47c7ff700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc474160d40 0x7fc47415c9d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.987+0000 7fc47c7ff700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc45806adb0 0x7fc45806d260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.987+0000 7fc47c7ff700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4740b87a0 0x7fc4741f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.987+0000 7fc47c7ff700 1 --2- 172.21.15.116:0/420948415 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4741601e0 0x7fc4741f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.987+0000 7fc47c7ff700 1 -- 172.21.15.116:0/420948415 >> 172.21.15.116:0/420948415 conn(0x7fc474071b10 msgr2=0x7fc4740b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.988+0000 7fc47c7ff700 1 -- 172.21.15.116:0/420948415 shutdown_connections 2023-05-12T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.988+0000 7fc47c7ff700 1 -- 172.21.15.116:0/420948415 wait complete. 2023-05-12T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.992+0000 7f756c5ff700 1 -- 172.21.15.116:0/1608963541 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75640af720 con 0x7f7564160d20 2023-05-12T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.992+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3572516685 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff3c4074430 con 0x7ff3c40c19c0 2023-05-12T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.992+0000 7f7562ffd700 1 -- 172.21.15.116:0/1608963541 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75640af720 con 0x7f7564160d20 2023-05-12T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.992+0000 7ff3b2ffd700 1 -- 172.21.15.116:0/3572516685 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3b8057c00 con 0x7ff3c40c19c0 2023-05-12T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout:55834574857 2023-05-12T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3572516685 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff3a406adb0 msgr2=0x7ff3a406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7ff3c8bff700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff3a406adb0 0x7ff3a406d260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4000c00 tx=0x7ff3b4008030 comp rx=0 tx=0).stop 2023-05-12T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3572516685 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c40c19c0 msgr2=0x7ff3c406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7ff3c8bff700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c40c19c0 0x7ff3c406d580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800c7f0 tx=0x7ff3b800cb00 comp rx=0 tx=0).stop 2023-05-12T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7f756c5ff700 1 -- 172.21.15.116:0/1608963541 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f754806ad30 msgr2=0x7f754806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7f756c5ff700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f754806ad30 0x7f754806d1e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7558001ef0 tx=0x7f7558009040 comp rx=0 tx=0).stop 2023-05-12T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7f756c5ff700 1 -- 172.21.15.116:0/1608963541 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7564160d20 msgr2=0x7f75640b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7f756c5ff700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7564160d20 0x7f75640b0700 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f755c00c5c0 tx=0x7f755c00c980 comp rx=0 tx=0).stop 2023-05-12T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7f756c5ff700 1 -- 172.21.15.116:0/1608963541 shutdown_connections 2023-05-12T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7f756c5ff700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7564160d20 0x7f75640b0700 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7f756c5ff700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75640ad690 0x7f756415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7f756c5ff700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f754806ad30 0x7f754806d1e0 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7558001ef0 tx=0x7f7558009040 comp rx=0 tx=0).stop 2023-05-12T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.997+0000 7f756c5ff700 1 --2- 172.21.15.116:0/1608963541 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75640c19c0 0x7f75640afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.998+0000 7f756c5ff700 1 -- 172.21.15.116:0/1608963541 >> 172.21.15.116:0/1608963541 conn(0x7f75640cf720 msgr2=0x7f75641600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.999+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3572516685 shutdown_connections 2023-05-12T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.999+0000 7ff3c8bff700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff3c4160d20 0x7ff3c42015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.999+0000 7ff3c8bff700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff3c40ad690 0x7ff3c4202bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.999+0000 7ff3c8bff700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff3a406adb0 0x7ff3a406d260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.999+0000 7ff3c8bff700 1 --2- 172.21.15.116:0/3572516685 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff3c40c19c0 0x7ff3c406d580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.999+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3572516685 >> 172.21.15.116:0/3572516685 conn(0x7ff3c40cf720 msgr2=0x7ff3c40b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.999+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3572516685 shutdown_connections 2023-05-12T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:42.999+0000 7ff3c8bff700 1 -- 172.21.15.116:0/3572516685 wait complete. 2023-05-12T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.000+0000 7fef76bff700 1 -- 172.21.15.116:0/4042687475 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fef70074430 con 0x7fef700c20d0 2023-05-12T09:07:43.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-05-12T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.004+0000 7f756c5ff700 1 -- 172.21.15.116:0/1608963541 shutdown_connections 2023-05-12T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.004+0000 7f756c5ff700 1 -- 172.21.15.116:0/1608963541 wait complete. 2023-05-12T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.004+0000 7fef6d7fa700 1 -- 172.21.15.116:0/4042687475 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef640571f0 con 0x7fef700c20d0 2023-05-12T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.006+0000 7fef76bff700 1 -- 172.21.15.116:0/4042687475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef5c06adb0 msgr2=0x7fef5c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.006+0000 7fef76bff700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef5c06adb0 0x7fef5c06d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef60014040 tx=0x7fef60010000 comp rx=0 tx=0).stop 2023-05-12T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.006+0000 7fef76bff700 1 -- 172.21.15.116:0/4042687475 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef700c20d0 msgr2=0x7fef700c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.006+0000 7fef76bff700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef700c20d0 0x7fef700c46a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef6400c450 tx=0x7fef6400c760 comp rx=0 tx=0).stop 2023-05-12T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout:55834574857 2023-05-12T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.003+0000 7f3293dff700 1 -- 172.21.15.116:0/2329016836 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3274005870 con 0x7f328c0b17a0 2023-05-12T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.004+0000 7f32827fc700 1 -- 172.21.15.116:0/2329016836 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3288017020 con 0x7f328c0b17a0 2023-05-12T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.007+0000 7fef76bff700 1 -- 172.21.15.116:0/4042687475 shutdown_connections 2023-05-12T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.007+0000 7fef76bff700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef70160d20 0x7fef700c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.007+0000 7fef76bff700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef700ad690 0x7fef7015fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.007+0000 7fef76bff700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef5c06adb0 0x7fef5c06d260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.007+0000 7fef76bff700 1 --2- 172.21.15.116:0/4042687475 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef700c20d0 0x7fef700c46a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.007+0000 7fef76bff700 1 -- 172.21.15.116:0/4042687475 >> 172.21.15.116:0/4042687475 conn(0x7fef700cf720 msgr2=0x7fef70163270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.007+0000 7fef76bff700 1 -- 172.21.15.116:0/4042687475 shutdown_connections 2023-05-12T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.007+0000 7fef76bff700 1 -- 172.21.15.116:0/4042687475 wait complete. 2023-05-12T09:07:43.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.012+0000 7f3293dff700 1 -- 172.21.15.116:0/2329016836 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f327006ad30 msgr2=0x7f327006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:43.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.012+0000 7f3293dff700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f327006ad30 0x7f327006d1e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f328c0d0d90 tx=0x7f327c008030 comp rx=0 tx=0).stop 2023-05-12T09:07:43.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.012+0000 7f3293dff700 1 -- 172.21.15.116:0/2329016836 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f328c0b17a0 msgr2=0x7f328c1fabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:43.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.012+0000 7f3293dff700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f328c0b17a0 0x7f328c1fabc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f328800c460 tx=0x7f328800c770 comp rx=0 tx=0).stop 2023-05-12T09:07:43.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.013+0000 7f3293dff700 1 -- 172.21.15.116:0/2329016836 shutdown_connections 2023-05-12T09:07:43.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.013+0000 7f3293dff700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f327006ad30 0x7f327006d1e0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f328c0d0d90 tx=0x7f327c008030 comp rx=0 tx=0).stop 2023-05-12T09:07:43.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.013+0000 7f3293dff700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f328c1f6af0 0x7f328c1f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.013+0000 7f3293dff700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f328c0b17a0 0x7f328c1fabc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.013+0000 7f3293dff700 1 --2- 172.21.15.116:0/2329016836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f328c0b69a0 0x7f328c14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:43.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.013+0000 7f3293dff700 1 -- 172.21.15.116:0/2329016836 >> 172.21.15.116:0/2329016836 conn(0x7f328c09a090 msgr2=0x7f328c06ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:43.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-05-12T09:07:43.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.016+0000 7f3293dff700 1 -- 172.21.15.116:0/2329016836 shutdown_connections 2023-05-12T09:07:43.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2023-05-12T09:07:43.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:43.018+0000 7f3293dff700 1 -- 172.21.15.116:0/2329016836 wait complete. 2023-05-12T09:07:43.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-05-12T09:07:43.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-05-12T09:07:43.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2023-05-12T09:07:43.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2023-05-12T09:07:43.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-05-12T09:07:44.008 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-12T09:07:44.019 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-12T09:07:44.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-12T09:07:44.023 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-12T09:07:44.036 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-12T09:07:44.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-12T09:07:44.039 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-12T09:07:44.044 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-12T09:07:44.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.319+0000 7f5cb45ff700 1 Processor -- start 2023-05-12T09:07:44.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.319+0000 7f5cb45ff700 1 -- start start 2023-05-12T09:07:44.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.321+0000 7f5cb45ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f5cac0ad690 0x7f5cac0adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.321+0000 7f5cb45ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5cac0c19c0 0x7f5cac0c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.321+0000 7f5cb45ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac0cd1f0 con 0x7f5cac160d20 2023-05-12T09:07:44.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.321+0000 7f5cb45ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac1610f0 con 0x7f5cac0c19c0 2023-05-12T09:07:44.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.321+0000 7f5cb45ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac0c22d0 con 0x7f5cac0ad690 2023-05-12T09:07:44.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.323+0000 7f5cb239b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f5cac160d20 0x7f5cac06cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60496/0 (socket says 172.21.15.116:60496) 2023-05-12T09:07:44.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.323+0000 7f5cb239b700 1 -- 172.21.15.116:0/3595280802 learned_addr learned my addr 172.21.15.116:0/3595280802 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:44.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.323+0000 7f5cb2b9c700 1 --2- 172.21.15.116:0/3595280802 >> v2:172.21.15.116:3300/0 conn(0x7f5cac0c19c0 0x7f5cac0c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.331+0000 7f5cb1b9a700 1 --2- 172.21.15.116:0/3595280802 >> v2:172.21.15.182:3300/0 conn(0x7f5cac0ad690 0x7f5cac0adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.332+0000 7f5cb2b9c700 1 -- 172.21.15.116:0/3595280802 >> v2:172.21.15.182:3300/0 conn(0x7f5cac0ad690 msgr2=0x7f5cac0adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.332+0000 7f5cb2b9c700 1 --2- 172.21.15.116:0/3595280802 >> v2:172.21.15.182:3300/0 conn(0x7f5cac0ad690 0x7f5cac0adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.332+0000 7f5cb2b9c700 1 -- 172.21.15.116:0/3595280802 >> v1:172.21.15.116:6789/0 conn(0x7f5cac160d20 legacy=0x7f5cac06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.332+0000 7f5cb2b9c700 1 -- 172.21.15.116:0/3595280802 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0cc670 con 0x7f5cac0c19c0 2023-05-12T09:07:44.336 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.333+0000 7f5cb2b9c700 1 --2- 172.21.15.116:0/3595280802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cac0c19c0 0x7f5cac0c1d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5cac071b90 tx=0x7f5ca400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fc3c902fe8df67 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.334+0000 7f5cb1399700 1 -- 172.21.15.116:0/3595280802 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca400e070 con 0x7f5cac0c19c0 2023-05-12T09:07:44.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.334+0000 7f5cb1399700 1 -- 172.21.15.116:0/3595280802 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca400bbd0 con 0x7f5cac0c19c0 2023-05-12T09:07:44.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.334+0000 7f5cb1399700 1 -- 172.21.15.116:0/3595280802 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4012430 con 0x7f5cac0c19c0 2023-05-12T09:07:44.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.335+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3595280802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cac0c19c0 msgr2=0x7f5cac0c1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.335+0000 7f5cb45ff700 1 --2- 172.21.15.116:0/3595280802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cac0c19c0 0x7f5cac0c1d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5cac071b90 tx=0x7f5ca400b330 comp rx=0 tx=0).stop 2023-05-12T09:07:44.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.336+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3595280802 shutdown_connections 2023-05-12T09:07:44.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.336+0000 7f5cb45ff700 1 --2- 172.21.15.116:0/3595280802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cac0c19c0 0x7f5cac0c1d90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.336+0000 7f5cb45ff700 1 --2- 172.21.15.116:0/3595280802 >> v2:172.21.15.182:3300/0 conn(0x7f5cac0ad690 0x7f5cac0adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.336+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3595280802 >> 172.21.15.116:0/3595280802 conn(0x7f5cac0cf720 msgr2=0x7f5cac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.337+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3595280802 shutdown_connections 2023-05-12T09:07:44.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.337+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3595280802 wait complete. 2023-05-12T09:07:44.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.340+0000 7f5cb45ff700 1 Processor -- start 2023-05-12T09:07:44.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.340+0000 7f5cb45ff700 1 -- start start 2023-05-12T09:07:44.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.341+0000 7f5cb45ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cac0ad690 0x7f5cac0c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.341+0000 7f5cb45ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5cac0c19c0 0x7f5cac0c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.341+0000 7f5cb45ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5cac160d20 0x7f5cac0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.341+0000 7f5cb45ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac1511e0 con 0x7f5cac0ad690 2023-05-12T09:07:44.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.341+0000 7f5cb45ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac1536c0 con 0x7f5cac0c19c0 2023-05-12T09:07:44.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.341+0000 7f5cb45ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0c3360 con 0x7f5cac160d20 2023-05-12T09:07:44.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.342+0000 7f5cb2b9c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5cac160d20 0x7f5cac0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.342+0000 7f5cb239b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cac0ad690 0x7f5cac0c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.342+0000 7f5cb239b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cac0ad690 0x7f5cac0c2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57272/0 (socket says 172.21.15.116:57272) 2023-05-12T09:07:44.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.342+0000 7f5cb239b700 1 -- 172.21.15.116:0/3194575655 learned_addr learned my addr 172.21.15.116:0/3194575655 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.342+0000 7f5cb1b9a700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5cac0c19c0 0x7f5cac0c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.344+0000 7f5cb1b9a700 1 -- 172.21.15.116:0/3194575655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5cac160d20 msgr2=0x7f5cac0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.344+0000 7f5cb1b9a700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5cac160d20 0x7f5cac0b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.344+0000 7f5cb1b9a700 1 -- 172.21.15.116:0/3194575655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cac0ad690 msgr2=0x7f5cac0c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.344+0000 7f5cb1b9a700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cac0ad690 0x7f5cac0c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.344+0000 7f5cb1b9a700 1 -- 172.21.15.116:0/3194575655 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca4009a70 con 0x7f5cac0c19c0 2023-05-12T09:07:44.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.345+0000 7f5cb1b9a700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5cac0c19c0 0x7f5cac0c37a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800d5f0 tx=0x7f5ca800d900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.345+0000 7f5ca2ffd700 1 -- 172.21.15.116:0/3194575655 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80125f0 con 0x7f5cac0c19c0 2023-05-12T09:07:44.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.345+0000 7f5ca2ffd700 1 -- 172.21.15.116:0/3194575655 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8012750 con 0x7f5cac0c19c0 2023-05-12T09:07:44.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.345+0000 7f5ca2ffd700 1 -- 172.21.15.116:0/3194575655 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8012ae0 con 0x7f5cac0c19c0 2023-05-12T09:07:44.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.345+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3194575655 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac0ccc30 con 0x7f5cac0c19c0 2023-05-12T09:07:44.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.345+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3194575655 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac0cc950 con 0x7f5cac0c19c0 2023-05-12T09:07:44.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.350+0000 7f5ca2ffd700 1 -- 172.21.15.116:0/3194575655 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ca8012c40 con 0x7f5cac0c19c0 2023-05-12T09:07:44.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.351+0000 7f5ca2ffd700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5c9006adb0 0x7f5c9006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.351+0000 7f5ca2ffd700 1 -- 172.21.15.116:0/3194575655 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ca80897b0 con 0x7f5cac0c19c0 2023-05-12T09:07:44.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.352+0000 7f5cb239b700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5c9006adb0 0x7f5c9006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.356 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.353+0000 7f5cb239b700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5c9006adb0 0x7f5c9006d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005910 tx=0x7f5c9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.358 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.355+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3194575655 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c940052f0 con 0x7f5cac0c19c0 2023-05-12T09:07:44.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.362+0000 7f5ca2ffd700 1 -- 172.21.15.116:0/3194575655 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5ca80545e0 con 0x7f5cac0c19c0 2023-05-12T09:07:44.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.382+0000 7f9eb6fff700 1 Processor -- start 2023-05-12T09:07:44.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.382+0000 7f9eb6fff700 1 -- start start 2023-05-12T09:07:44.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.384+0000 7f9eb6fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9eb0089b20 0x7f9eb016d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.384+0000 7f9eb6fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9eb0169770 0x7f9eb0088550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.384+0000 7f9eb6fff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb016a760 con 0x7f9eb006a3e0 2023-05-12T09:07:44.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.384+0000 7f9eb6fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb016a1a0 con 0x7f9eb0169770 2023-05-12T09:07:44.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.384+0000 7f9eb6fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb016a480 con 0x7f9eb0089b20 2023-05-12T09:07:44.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.385+0000 7f9eb559c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9eb0169770 0x7f9eb0088550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.385+0000 7f9eb559c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9eb0169770 0x7f9eb0088550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57274/0 (socket says 172.21.15.116:57274) 2023-05-12T09:07:44.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.385+0000 7f9eb559c700 1 -- 172.21.15.116:0/411100386 learned_addr learned my addr 172.21.15.116:0/411100386 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.387+0000 7f9eb559c700 1 -- 172.21.15.116:0/411100386 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9eb0089b20 msgr2=0x7f9eb016d660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-12T09:07:44.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.387+0000 7f9eb559c700 1 --2- 172.21.15.116:0/411100386 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9eb0089b20 0x7f9eb016d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.387+0000 7f9eb559c700 1 -- 172.21.15.116:0/411100386 >> v1:172.21.15.182:6789/0 conn(0x7f9eb006a3e0 legacy=0x7f9eb006a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-12T09:07:44.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.387+0000 7f9eb559c700 1 -- 172.21.15.116:0/411100386 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb016ce60 con 0x7f9eb0169770 2023-05-12T09:07:44.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.387+0000 7f9eb559c700 1 --2- 172.21.15.116:0/411100386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb0169770 0x7f9eb0088550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8007eb0 tx=0x7f9ea80081c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1f49adc3bfc535 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.388+0000 7f9eaf7fe700 1 -- 172.21.15.116:0/411100386 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8008d40 con 0x7f9eb0169770 2023-05-12T09:07:44.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.388+0000 7f9eaf7fe700 1 -- 172.21.15.116:0/411100386 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea8003a20 con 0x7f9eb0169770 2023-05-12T09:07:44.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.388+0000 7f9eaf7fe700 1 -- 172.21.15.116:0/411100386 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8008ea0 con 0x7f9eb0169770 2023-05-12T09:07:44.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.389+0000 7f9eb6fff700 1 -- 172.21.15.116:0/411100386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb0169770 msgr2=0x7f9eb0088550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.389+0000 7f9eb6fff700 1 --2- 172.21.15.116:0/411100386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb0169770 0x7f9eb0088550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8007eb0 tx=0x7f9ea80081c0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.389+0000 7f9eb6fff700 1 -- 172.21.15.116:0/411100386 shutdown_connections 2023-05-12T09:07:44.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.389+0000 7f9eb6fff700 1 --2- 172.21.15.116:0/411100386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb0169770 0x7f9eb0088550 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.389+0000 7f9eb6fff700 1 --2- 172.21.15.116:0/411100386 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9eb0089b20 0x7f9eb016d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.389+0000 7f9eb6fff700 1 -- 172.21.15.116:0/411100386 >> 172.21.15.116:0/411100386 conn(0x7f9eb00cf6e0 msgr2=0x7f9eb00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.391+0000 7fc9c23ff700 1 Processor -- start 2023-05-12T09:07:44.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.391+0000 7fc9c23ff700 1 -- start start 2023-05-12T09:07:44.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.390+0000 7f9eb6fff700 1 -- 172.21.15.116:0/411100386 shutdown_connections 2023-05-12T09:07:44.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.390+0000 7f9eb6fff700 1 -- 172.21.15.116:0/411100386 wait complete. 2023-05-12T09:07:44.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.392+0000 7fb6f8dff700 1 Processor -- start 2023-05-12T09:07:44.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.392+0000 7fb6f8dff700 1 -- start start 2023-05-12T09:07:44.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.393+0000 7f9eb6fff700 1 Processor -- start 2023-05-12T09:07:44.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.393+0000 7f9eb6fff700 1 -- start start 2023-05-12T09:07:44.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.395+0000 7fb6f8dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6f406a650 0x7fb6f40714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.395+0000 7fb6f8dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fb6f40ccb00 0x7fb6f4088550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.395+0000 7fb6f8dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f40cd270 con 0x7fb6f416da20 2023-05-12T09:07:44.399 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.395+0000 7fb6f8dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f4089dc0 con 0x7fb6f40ccb00 2023-05-12T09:07:44.399 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.395+0000 7fb6f8dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40719e0 con 0x7fb6f406a650 2023-05-12T09:07:44.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.395+0000 7fc9c23ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc9bc160d20 0x7fc9bc06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.395+0000 7fc9c23ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0ad690 0x7fc9bc0adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.395+0000 7fc9c23ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc0cd1f0 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.395+0000 7fc9c23ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc1610f0 con 0x7fc9bc160d20 2023-05-12T09:07:44.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.395+0000 7fc9c23ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0cc670 con 0x7fc9bc0ad690 2023-05-12T09:07:44.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.396+0000 7fb6f2d9d700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb6f416da20 0x7fb6f4088a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60504/0 (socket says 172.21.15.116:60504) 2023-05-12T09:07:44.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.396+0000 7fb6f2d9d700 1 -- 172.21.15.116:0/2518902319 learned_addr learned my addr 172.21.15.116:0/2518902319 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:44.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.396+0000 7f9eb6fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9eb0089b20 0x7f9eb0088f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.396+0000 7f9eb6fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb0169770 0x7f9eb0164550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.396+0000 7f9eb6fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9eb0164a90 0x7f9eb007c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.402 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.396+0000 7f9eb6fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00b2ef0 con 0x7f9eb0169770 2023-05-12T09:07:44.403 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.396+0000 7f9eb6fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb0164f10 con 0x7f9eb0089b20 2023-05-12T09:07:44.403 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.396+0000 7f9eb6fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb007d930 con 0x7f9eb0164a90 2023-05-12T09:07:44.403 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.397+0000 7f9eaffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb0169770 0x7f9eb0164550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.403 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.397+0000 7f9eaffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb0169770 0x7f9eb0164550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57290/0 (socket says 172.21.15.116:57290) 2023-05-12T09:07:44.403 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.397+0000 7f9eaffff700 1 -- 172.21.15.116:0/2232433843 learned_addr learned my addr 172.21.15.116:0/2232433843 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.397+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912519643 0 0) 0x7fb6f40cd270 con 0x7fb6f416da20 2023-05-12T09:07:44.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6dc0035b0 con 0x7fb6f416da20 2023-05-12T09:07:44.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7fb6f259c700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6f406a650 0x7fb6f40714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.397+0000 7fc9bbfff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc9bc160d20 0x7fc9bc06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.397+0000 7fc9bb7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0ad690 0x7fc9bc0adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.397+0000 7fc9bb7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0ad690 0x7fc9bc0adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49194/0 (socket says 172.21.15.116:49194) 2023-05-12T09:07:44.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.397+0000 7fc9bb7fe700 1 -- 172.21.15.116:0/3171469348 learned_addr learned my addr 172.21.15.116:0/3171469348 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7f9eb559c700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9eb0164a90 0x7f9eb007c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7fb6f1d9b700 1 --2- 172.21.15.116:0/2518902319 >> v2:172.21.15.182:3300/0 conn(0x7fb6f40ccb00 0x7fb6f4088550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7f9eb4d9b700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9eb0089b20 0x7f9eb0088f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2681367584 0 0) 0x7fb6dc0035b0 con 0x7fb6f416da20 2023-05-12T09:07:44.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6f406a650 msgr2=0x7fb6f40714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7fb6f159a700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6f406a650 0x7fb6f40714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 >> v2:172.21.15.182:3300/0 conn(0x7fb6f40ccb00 msgr2=0x7fb6f4088550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7fb6f159a700 1 --2- 172.21.15.116:0/2518902319 >> v2:172.21.15.182:3300/0 conn(0x7fb6f40ccb00 0x7fb6f4088550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40ccf90 con 0x7fb6f416da20 2023-05-12T09:07:44.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.398+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7fb6e8004d40 con 0x7fb6f416da20 2023-05-12T09:07:44.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 >> v1:172.21.15.116:6789/0 conn(0x7fb6f416da20 legacy=0x7fb6f4088a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7fb6f159a700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 0x7fb6dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7fb6f159a700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6dc004850 0x7fb6dc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7fb6f159a700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6dc005200 0x7fb6dc00fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4089dc0 con 0x7fb6dc005200 2023-05-12T09:07:44.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40719e0 con 0x7fb6dc003a00 2023-05-12T09:07:44.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc009a00 con 0x7fb6dc004850 2023-05-12T09:07:44.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7f9eb4d9b700 1 -- 172.21.15.116:0/2232433843 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9eb0164a90 msgr2=0x7f9eb007c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7f9eb4d9b700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9eb0164a90 0x7f9eb007c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7f9eb4d9b700 1 -- 172.21.15.116:0/2232433843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb0169770 msgr2=0x7f9eb0164550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7f9eb4d9b700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb0169770 0x7f9eb0164550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7f9eb4d9b700 1 -- 172.21.15.116:0/2232433843 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8007b10 con 0x7f9eb0089b20 2023-05-12T09:07:44.410 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7fc9baffd700 1 -- 172.21.15.116:0/3171469348 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718432570 0 0) 0x7fc9bc0cd1f0 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.410 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.399+0000 7fc9baffd700 1 -- 172.21.15.116:0/3171469348 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a40035b0 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.410 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7f9eb4d9b700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9eb0089b20 0x7f9eb0088f60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00b1680 tx=0x7f9ea000b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.411 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fc9bb7fe700 1 -- 172.21.15.116:0/3171469348 >> v2:172.21.15.182:3300/0 conn(0x7fc9bc160d20 msgr2=0x7fc9bc06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.411 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fc9bb7fe700 1 --2- 172.21.15.116:0/3171469348 >> v2:172.21.15.182:3300/0 conn(0x7fc9bc160d20 0x7fc9bc06cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.411 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fc9bb7fe700 1 -- 172.21.15.116:0/3171469348 >> v1:172.21.15.182:6789/0 conn(0x7fc9bc0c19c0 legacy=0x7fc9bc0c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.411 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fc9bb7fe700 1 -- 172.21.15.116:0/3171469348 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0cc950 con 0x7fc9bc0ad690 2023-05-12T09:07:44.411 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fb6f259c700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 0x7fb6dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fb6f1d9b700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6dc004850 0x7fb6dc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7f9ead7fa700 1 -- 172.21.15.116:0/2232433843 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0011830 con 0x7f9eb0089b20 2023-05-12T09:07:44.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7f9ead7fa700 1 -- 172.21.15.116:0/2232433843 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0011990 con 0x7f9eb0089b20 2023-05-12T09:07:44.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7f9ead7fa700 1 -- 172.21.15.116:0/2232433843 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0011d40 con 0x7f9eb0089b20 2023-05-12T09:07:44.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7f9eb6fff700 1 -- 172.21.15.116:0/2232433843 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb016dba0 con 0x7f9eb0089b20 2023-05-12T09:07:44.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7f9eb6fff700 1 -- 172.21.15.116:0/2232433843 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb016d140 con 0x7f9eb0089b20 2023-05-12T09:07:44.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fb6f2d9d700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6dc005200 0x7fb6dc00fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fb6f259c700 1 -- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6dc004850 msgr2=0x7fb6dc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fb6f259c700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6dc004850 0x7fb6dc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fb6f259c700 1 -- 172.21.15.116:0/2518902319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6dc005200 msgr2=0x7fb6dc00fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fb6f259c700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6dc005200 0x7fb6dc00fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.400+0000 7fb6f259c700 1 -- 172.21.15.116:0/2518902319 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40ccf90 con 0x7fb6dc003a00 2023-05-12T09:07:44.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.401+0000 7fb6f1d9b700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6dc004850 0x7fb6dc004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:44.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.401+0000 7f704bbff700 1 Processor -- start 2023-05-12T09:07:44.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.401+0000 7fb6f259c700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 0x7fb6dc003e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6f406c500 tx=0x7fb6dc005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4049cc4a58e033ee server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.401+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec007dc0 con 0x7fb6dc003a00 2023-05-12T09:07:44.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.401+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec014400 con 0x7fb6dc003a00 2023-05-12T09:07:44.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.401+0000 7fb6f159a700 1 -- 172.21.15.116:0/2518902319 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec014790 con 0x7fb6dc003a00 2023-05-12T09:07:44.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.401+0000 7fc9bb7fe700 1 --2- 172.21.15.116:0/3171469348 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0ad690 0x7fc9bc0adb10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0006fd0 tx=0x7fc9b0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65af46c315e1edea server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.401+0000 7f704bbff700 1 -- start start 2023-05-12T09:07:44.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.402+0000 7f9eb6fff700 1 -- 172.21.15.116:0/2232433843 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb016dd30 con 0x7f9eb0089b20 2023-05-12T09:07:44.417 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7fb6f8dff700 1 -- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 msgr2=0x7fb6dc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.417 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7fb6f8dff700 1 --2- 172.21.15.116:0/2518902319 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 0x7fb6dc003e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6f406c500 tx=0x7fb6dc005880 comp rx=0 tx=0).stop 2023-05-12T09:07:44.417 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7fb6f2d9d700 1 -- 172.21.15.116:0/2518902319 reap_dead start 2023-05-12T09:07:44.417 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7fb6f8dff700 1 -- 172.21.15.116:0/2518902319 shutdown_connections 2023-05-12T09:07:44.417 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7fb6f8dff700 1 -- 172.21.15.116:0/2518902319 >> 172.21.15.116:0/2518902319 conn(0x7fb6f40cf6e0 msgr2=0x7fb6f40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7fc9baffd700 1 -- 172.21.15.116:0/3171469348 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0005e30 con 0x7fc9bc0ad690 2023-05-12T09:07:44.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7fc9baffd700 1 -- 172.21.15.116:0/3171469348 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0004030 con 0x7fc9bc0ad690 2023-05-12T09:07:44.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7fc9baffd700 1 -- 172.21.15.116:0/3171469348 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00043e0 con 0x7fc9bc0ad690 2023-05-12T09:07:44.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.404+0000 7fc9c23ff700 1 -- 172.21.15.116:0/3171469348 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0ad690 msgr2=0x7fc9bc0adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.404+0000 7fc9c23ff700 1 --2- 172.21.15.116:0/3171469348 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0ad690 0x7fc9bc0adb10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0006fd0 tx=0x7fc9b0009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7f704bbff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7044160d20 0x7f704406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7f704bbff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440c20d0 0x7f70440adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7f704bbff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70440cd1f0 con 0x7f70440ad690 2023-05-12T09:07:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7f704bbff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70441610f0 con 0x7f7044160d20 2023-05-12T09:07:44.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.403+0000 7f704bbff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440cc670 con 0x7f70440c20d0 2023-05-12T09:07:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.404+0000 7fb6f8dff700 1 -- 172.21.15.116:0/2518902319 shutdown_connections 2023-05-12T09:07:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.404+0000 7f704999b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7044160d20 0x7f704406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.404+0000 7f704919a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f70440ad690 0x7f70440c19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60514/0 (socket says 172.21.15.116:60514) 2023-05-12T09:07:44.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.404+0000 7f704919a700 1 -- 172.21.15.116:0/926800060 learned_addr learned my addr 172.21.15.116:0/926800060 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.404+0000 7f96079ff700 1 Processor -- start 2023-05-12T09:07:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7fc9c23ff700 1 -- 172.21.15.116:0/3171469348 shutdown_connections 2023-05-12T09:07:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7fc9c23ff700 1 --2- 172.21.15.116:0/3171469348 >> v2:172.21.15.182:3300/0 conn(0x7fc9bc160d20 0x7fc9bc06cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7fc9c23ff700 1 --2- 172.21.15.116:0/3171469348 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0ad690 0x7fc9bc0adb10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7fc9c23ff700 1 -- 172.21.15.116:0/3171469348 >> 172.21.15.116:0/3171469348 conn(0x7fc9bc0cf720 msgr2=0x7fc9bc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7f7048999700 1 -- 172.21.15.116:0/926800060 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784993205 0 0) 0x7f70440cd1f0 con 0x7f70440ad690 2023-05-12T09:07:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7f7048999700 1 -- 172.21.15.116:0/926800060 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70300035b0 con 0x7f70440ad690 2023-05-12T09:07:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7f704999b700 1 -- 172.21.15.116:0/926800060 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440c20d0 msgr2=0x7f70440adb10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-12T09:07:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7f704999b700 1 --2- 172.21.15.116:0/926800060 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440c20d0 0x7f70440adb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7f704999b700 1 -- 172.21.15.116:0/926800060 >> v1:172.21.15.116:6789/0 conn(0x7f70440ad690 legacy=0x7f70440c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7f704999b700 1 -- 172.21.15.116:0/926800060 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70440cc950 con 0x7f7044160d20 2023-05-12T09:07:44.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7f96c8dff700 1 Processor -- start 2023-05-12T09:07:44.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.406+0000 7f96c8dff700 1 -- start start 2023-05-12T09:07:44.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.406+0000 7f704999b700 1 --2- 172.21.15.116:0/926800060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7044160d20 0x7f704406cb90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f703c009d90 tx=0x7f703c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef9a348d2ba4ec6 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7f9ead7fa700 1 -- 172.21.15.116:0/2232433843 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ea001a400 con 0x7f9eb0089b20 2023-05-12T09:07:44.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.406+0000 7f9ead7fa700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f9e9806adb0 0x7f9e9806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.406+0000 7f9ead7fa700 1 -- 172.21.15.116:0/2232433843 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ea0089440 con 0x7f9eb0089b20 2023-05-12T09:07:44.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.406+0000 7f7048999700 1 -- 172.21.15.116:0/926800060 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00e070 con 0x7f7044160d20 2023-05-12T09:07:44.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.406+0000 7f7048999700 1 -- 172.21.15.116:0/926800060 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c00bae0 con 0x7f7044160d20 2023-05-12T09:07:44.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.406+0000 7f7048999700 1 -- 172.21.15.116:0/926800060 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00be90 con 0x7f7044160d20 2023-05-12T09:07:44.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.404+0000 7fb6f8dff700 1 -- 172.21.15.116:0/2518902319 wait complete. 2023-05-12T09:07:44.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7fb6f8dff700 1 Processor -- start 2023-05-12T09:07:44.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7fc9c23ff700 1 -- 172.21.15.116:0/3171469348 shutdown_connections 2023-05-12T09:07:44.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7f9eaffff700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f9e9806adb0 0x7f9e9806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.405+0000 7f96079ff700 1 -- start start 2023-05-12T09:07:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7f96079ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9600160d20 0x7f960006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7f96079ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f96000c20d0 0x7f96000adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7f96079ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000cd1f0 con 0x7f96000ad690 2023-05-12T09:07:44.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7f96079ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96001610f0 con 0x7f96000c20d0 2023-05-12T09:07:44.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7f96079ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96000cc670 con 0x7f9600160d20 2023-05-12T09:07:44.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7fb6f8dff700 1 -- start start 2023-05-12T09:07:44.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7fb6f8dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 0x7fb6f41691f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7fb6f8dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6f4088a60 0x7fb6f415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7fb6f8dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6f406d550 0x7fb6f406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7fb6f8dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f406df00 con 0x7fb6f4088a60 2023-05-12T09:07:44.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7fb6f8dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4089200 con 0x7fb6dc003a00 2023-05-12T09:07:44.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7fb6f8dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f415f240 con 0x7fb6f406d550 2023-05-12T09:07:44.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7fc9c23ff700 1 -- 172.21.15.116:0/3171469348 wait complete. 2023-05-12T09:07:44.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f9605f9c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f96000c20d0 0x7f96000adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f9605f9c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f96000c20d0 0x7f96000adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58564/0 (socket says 172.21.15.116:58564) 2023-05-12T09:07:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f9605f9c700 1 -- 172.21.15.116:0/3442461608 learned_addr learned my addr 172.21.15.116:0/3442461608 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f960579b700 1 --2- 172.21.15.116:0/3442461608 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9600160d20 0x7f960006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7f9605f9c700 1 -- 172.21.15.116:0/3442461608 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9600160d20 msgr2=0x7f960006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7f9605f9c700 1 --2- 172.21.15.116:0/3442461608 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9600160d20 0x7f960006cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7f9605f9c700 1 -- 172.21.15.116:0/3442461608 >> v1:172.21.15.116:6789/0 conn(0x7f96000ad690 legacy=0x7f96000c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7f9605f9c700 1 -- 172.21.15.116:0/3442461608 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000cc950 con 0x7f96000c20d0 2023-05-12T09:07:44.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7f704bbff700 1 -- 172.21.15.116:0/926800060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7044160d20 msgr2=0x7f704406cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.407+0000 7f704bbff700 1 --2- 172.21.15.116:0/926800060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7044160d20 0x7f704406cb90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f703c009d90 tx=0x7f703c00b330 comp rx=0 tx=0).stop 2023-05-12T09:07:44.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f704bbff700 1 -- 172.21.15.116:0/926800060 shutdown_connections 2023-05-12T09:07:44.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f704bbff700 1 --2- 172.21.15.116:0/926800060 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440c20d0 0x7f70440adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f704bbff700 1 --2- 172.21.15.116:0/926800060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7044160d20 0x7f704406cb90 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f703c009d90 tx=0x7f703c00b330 comp rx=0 tx=0).stop 2023-05-12T09:07:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f704bbff700 1 -- 172.21.15.116:0/926800060 >> 172.21.15.116:0/926800060 conn(0x7f70440cf720 msgr2=0x7f70440cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f704bbff700 1 -- 172.21.15.116:0/926800060 shutdown_connections 2023-05-12T09:07:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f96c8dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96c40adf70 0x7f96c40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f96c8dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40cc9e0 con 0x7f96c415cf10 2023-05-12T09:07:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f96c8dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c415de20 con 0x7f96c40cd760 2023-05-12T09:07:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.408+0000 7f96c8dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c415d860 con 0x7f96c40adf70 2023-05-12T09:07:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7f96c1d9b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96c40adf70 0x7f96c40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7f96c259c700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f96c40cd760 0x7f96c40cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:46316/0 (socket says 172.21.15.116:46316) 2023-05-12T09:07:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7f96c259c700 1 -- 172.21.15.116:0/2840487552 learned_addr learned my addr 172.21.15.116:0/2840487552 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:44.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7f9eaffff700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f9e9806adb0 0x7f9e9806d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9eb016c420 tx=0x7f9e9c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7fb6f259c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 0x7fb6f41691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7fb6f259c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 0x7fb6f41691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58568/0 (socket says 172.21.15.116:58568) 2023-05-12T09:07:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.409+0000 7fb6f259c700 1 -- 172.21.15.116:0/3848676040 learned_addr learned my addr 172.21.15.116:0/3848676040 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7fb6f2d9d700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6f406d550 0x7fb6f406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7fb6f1d9b700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6f4088a60 0x7fb6f415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7fb6f259c700 1 -- 172.21.15.116:0/3848676040 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6f406d550 msgr2=0x7fb6f406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7fb6f259c700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6f406d550 0x7fb6f406d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7fb6f259c700 1 -- 172.21.15.116:0/3848676040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6f4088a60 msgr2=0x7fb6f415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7fb6f259c700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6f4088a60 0x7fb6f415ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7fb6f259c700 1 -- 172.21.15.116:0/3848676040 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f416d240 con 0x7fb6dc003a00 2023-05-12T09:07:44.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7fb6f259c700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 0x7fb6f41691f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec003ea0 tx=0x7fb6ec004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7fc9c23ff700 1 Processor -- start 2023-05-12T09:07:44.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7f704bbff700 1 -- 172.21.15.116:0/926800060 wait complete. 2023-05-12T09:07:44.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631620673 0 0) 0x7f96c40cc9e0 con 0x7f96c415cf10 2023-05-12T09:07:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96ac0035b0 con 0x7f96c415cf10 2023-05-12T09:07:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567837333 0 0) 0x7f96ac0035b0 con 0x7f96c415cf10 2023-05-12T09:07:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96c40adf70 msgr2=0x7f96c40cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7f96c159a700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96c40adf70 0x7f96c40cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 >> v1:172.21.15.182:6789/0 conn(0x7f96c40cd760 legacy=0x7f96c40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c415db40 con 0x7f96c415cf10 2023-05-12T09:07:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f96b8001670 con 0x7f96c415cf10 2023-05-12T09:07:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 >> v1:172.21.15.116:6789/0 conn(0x7f96c415cf10 legacy=0x7f96c406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c159a700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96ac003a30 0x7f96ac003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c159a700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96ac004850 0x7f96ac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c159a700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96ac005270 0x7f96ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c415d860 con 0x7f96ac005270 2023-05-12T09:07:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac00c190 con 0x7f96ac003a30 2023-05-12T09:07:44.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac00c350 con 0x7f96ac004850 2023-05-12T09:07:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c1d9b700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96c40adf70 0x7f96c40cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c259c700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96ac003a30 0x7f96ac003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7fb6e2ffd700 1 -- 172.21.15.116:0/3848676040 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec015810 con 0x7fb6dc003a00 2023-05-12T09:07:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7fb6e2ffd700 1 -- 172.21.15.116:0/3848676040 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec015970 con 0x7fb6dc003a00 2023-05-12T09:07:44.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7fb6e2ffd700 1 -- 172.21.15.116:0/3848676040 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec015ce0 con 0x7fb6dc003a00 2023-05-12T09:07:44.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7fb6f8dff700 1 -- 172.21.15.116:0/3848676040 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f416cf60 con 0x7fb6dc003a00 2023-05-12T09:07:44.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c1d9b700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96ac004850 0x7f96ac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7f96c2d9d700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96ac005270 0x7f96ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.410+0000 7f9605f9c700 1 --2- 172.21.15.116:0/3442461608 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96000c20d0 0x7f96000adb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009e50 tx=0x7f95f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d2b36fc0ba280a8 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.411+0000 7fb6f8dff700 1 -- 172.21.15.116:0/3848676040 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f416d520 con 0x7fb6dc003a00 2023-05-12T09:07:44.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.412+0000 7f704bbff700 1 Processor -- start 2023-05-12T09:07:44.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.412+0000 7f96c259c700 1 -- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96ac004850 msgr2=0x7f96ac004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.412+0000 7f96c259c700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96ac004850 0x7f96ac004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.412+0000 7f96c259c700 1 -- 172.21.15.116:0/2840487552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96ac005270 msgr2=0x7f96ac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.412+0000 7f96c259c700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96ac005270 0x7f96ac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.412+0000 7f96c259c700 1 -- 172.21.15.116:0/2840487552 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c415db40 con 0x7f96ac003a30 2023-05-12T09:07:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7f96c259c700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96ac003a30 0x7f96ac003e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f96bc00c190 tx=0x7f96ac005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5ac245dfa625ae5 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.412+0000 7f95f7fff700 1 -- 172.21.15.116:0/3442461608 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800e070 con 0x7f96000c20d0 2023-05-12T09:07:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.412+0000 7f95f7fff700 1 -- 172.21.15.116:0/3442461608 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f800b910 con 0x7f96000c20d0 2023-05-12T09:07:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.412+0000 7f95f7fff700 1 -- 172.21.15.116:0/3442461608 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800bcc0 con 0x7f96000c20d0 2023-05-12T09:07:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7f96079ff700 1 -- 172.21.15.116:0/3442461608 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96000c20d0 msgr2=0x7f96000adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7f96079ff700 1 --2- 172.21.15.116:0/3442461608 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96000c20d0 0x7f96000adb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009e50 tx=0x7f95f800b330 comp rx=0 tx=0).stop 2023-05-12T09:07:44.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7f9ead7fa700 1 -- 172.21.15.116:0/2232433843 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9ea0054270 con 0x7f9eb0089b20 2023-05-12T09:07:44.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7f96079ff700 1 -- 172.21.15.116:0/3442461608 shutdown_connections 2023-05-12T09:07:44.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7f96079ff700 1 --2- 172.21.15.116:0/3442461608 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96000c20d0 0x7f96000adb30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7f96079ff700 1 --2- 172.21.15.116:0/3442461608 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9600160d20 0x7f960006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7f96079ff700 1 -- 172.21.15.116:0/3442461608 >> 172.21.15.116:0/3442461608 conn(0x7f96000cf720 msgr2=0x7f96000cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7f96079ff700 1 -- 172.21.15.116:0/3442461608 shutdown_connections 2023-05-12T09:07:44.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7f96079ff700 1 -- 172.21.15.116:0/3442461608 wait complete. 2023-05-12T09:07:44.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.414+0000 7fb6f8dff700 1 -- 172.21.15.116:0/3848676040 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d80052f0 con 0x7fb6dc003a00 2023-05-12T09:07:44.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7fc9c23ff700 1 -- start start 2023-05-12T09:07:44.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.414+0000 7fc9c23ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9bc0ad690 0x7fc9bc15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.414+0000 7fc9c23ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0c19c0 0x7fc9bc0c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.414+0000 7fc9c23ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9bc160d20 0x7fc9bc0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.412+0000 7f704bbff700 1 -- start start 2023-05-12T09:07:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.414+0000 7f704bbff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440ad690 0x7f70440afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.414+0000 7f704bbff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70440c20d0 0x7f70441f9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.414+0000 7f704bbff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70440c1670 0x7f704415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.414+0000 7f704bbff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70440c24c0 con 0x7f70440c1670 2023-05-12T09:07:44.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.414+0000 7f704bbff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70440c2710 con 0x7f70440c20d0 2023-05-12T09:07:44.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.414+0000 7f704bbff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440c29f0 con 0x7f70440ad690 2023-05-12T09:07:44.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.415+0000 7f704999b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440ad690 0x7f70440afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.415+0000 7f704999b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440ad690 0x7f70440afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49284/0 (socket says 172.21.15.116:49284) 2023-05-12T09:07:44.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.415+0000 7f704999b700 1 -- 172.21.15.116:0/410321429 learned_addr learned my addr 172.21.15.116:0/410321429 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.415+0000 7fc9c23ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b1520 con 0x7fc9bc160d20 2023-05-12T09:07:44.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.415+0000 7fc9c23ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0c43c0 con 0x7fc9bc0ad690 2023-05-12T09:07:44.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.415+0000 7fc9c23ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0c4e90 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.415+0000 7fc9bb7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0c19c0 0x7fc9bc0c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.415+0000 7fc9bb7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0c19c0 0x7fc9bc0c3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49296/0 (socket says 172.21.15.116:49296) 2023-05-12T09:07:44.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.415+0000 7fc9bb7fe700 1 -- 172.21.15.116:0/511046792 learned_addr learned my addr 172.21.15.116:0/511046792 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7fc9bb7fe700 1 -- 172.21.15.116:0/511046792 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9bc0ad690 msgr2=0x7fc9bc15c2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-12T09:07:44.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc001d80 con 0x7f96ac003a30 2023-05-12T09:07:44.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc00cc70 con 0x7f96ac003a30 2023-05-12T09:07:44.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7f96c159a700 1 -- 172.21.15.116:0/2840487552 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc012400 con 0x7f96ac003a30 2023-05-12T09:07:44.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7ffb47bff700 1 Processor -- start 2023-05-12T09:07:44.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.413+0000 7ffb47bff700 1 -- start start 2023-05-12T09:07:44.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7fc9bb7fe700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9bc0ad690 0x7fc9bc15c2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7fc9bb7fe700 1 -- 172.21.15.116:0/511046792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9bc160d20 msgr2=0x7fc9bc0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7fc9bb7fe700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9bc160d20 0x7fc9bc0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7fc9bb7fe700 1 -- 172.21.15.116:0/511046792 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0009500 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7ffb47bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb400ad930 0x7ffb400add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7fb6e2ffd700 1 -- 172.21.15.116:0/3848676040 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6ec004040 con 0x7fb6dc003a00 2023-05-12T09:07:44.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7fc9bb7fe700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0c19c0 0x7fc9bc0c3e80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0004000 tx=0x7fc9b0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7fc9b8ff9700 1 -- 172.21.15.116:0/511046792 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0003d20 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7fc9b8ff9700 1 -- 172.21.15.116:0/511046792 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0011420 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7fc9b8ff9700 1 -- 172.21.15.116:0/511046792 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0003ea0 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7f96079ff700 1 Processor -- start 2023-05-12T09:07:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7f96079ff700 1 -- start start 2023-05-12T09:07:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7f96079ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96000ad690 0x7f96000b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7f96079ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96000c20d0 0x7f96000ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7f96079ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9600160d20 0x7f96000cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7f96079ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960014d940 con 0x7f96000c20d0 2023-05-12T09:07:44.456 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7f96079ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000b3eb0 con 0x7f9600160d20 2023-05-12T09:07:44.456 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7f96079ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960014d2f0 con 0x7f96000ad690 2023-05-12T09:07:44.456 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7f704999b700 1 -- 172.21.15.116:0/410321429 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70440c20d0 msgr2=0x7f70441f9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.457 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7f704999b700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70440c20d0 0x7f70441f9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.457 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7f704999b700 1 -- 172.21.15.116:0/410321429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70440c1670 msgr2=0x7f704415dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.457 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7f704999b700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70440c1670 0x7f704415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.457 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7f704999b700 1 -- 172.21.15.116:0/410321429 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c009a70 con 0x7f70440ad690 2023-05-12T09:07:44.457 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7f704999b700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440ad690 0x7f70440afee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f703c00b370 tx=0x7f703c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.458 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7f96c8dff700 1 -- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96ac003a30 msgr2=0x7f96ac003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.458 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7f96c8dff700 1 --2- 172.21.15.116:0/2840487552 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96ac003a30 0x7f96ac003e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f96bc00c190 tx=0x7f96ac005880 comp rx=0 tx=0).stop 2023-05-12T09:07:44.458 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7f96c2d9d700 1 -- 172.21.15.116:0/2840487552 reap_dead start 2023-05-12T09:07:44.458 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7f96c8dff700 1 -- 172.21.15.116:0/2840487552 shutdown_connections 2023-05-12T09:07:44.458 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7f96c8dff700 1 -- 172.21.15.116:0/2840487552 >> 172.21.15.116:0/2840487552 conn(0x7f96c40cf720 msgr2=0x7f96c40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7f96c8dff700 1 -- 172.21.15.116:0/2840487552 shutdown_connections 2023-05-12T09:07:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7f96c8dff700 1 -- 172.21.15.116:0/2840487552 wait complete. 2023-05-12T09:07:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7ffb47bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7ffb40160fd0 0x7ffb4006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7ffb47bff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ffb4006c6c0 0x7ffb40070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7ffb47bff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb40070af0 con 0x7ffb4006c6c0 2023-05-12T09:07:44.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7ffb47bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb400ae240 con 0x7ffb40160fd0 2023-05-12T09:07:44.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.416+0000 7ffb47bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb40161530 con 0x7ffb400ad930 2023-05-12T09:07:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7ffb4519a700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7ffb40160fd0 0x7ffb4006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7ffb4599b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb400ad930 0x7ffb400add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7ffb4599b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb400ad930 0x7ffb400add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49312/0 (socket says 172.21.15.116:49312) 2023-05-12T09:07:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7ffb4599b700 1 -- 172.21.15.116:0/3695182421 learned_addr learned my addr 172.21.15.116:0/3695182421 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.417+0000 7ffb4619c700 1 --2- 172.21.15.116:0/3695182421 >> v2:172.21.15.116:3300/0 conn(0x7ffb4006c6c0 0x7ffb40070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7ffb4619c700 1 -- 172.21.15.116:0/3695182421 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb400ad930 msgr2=0x7ffb400add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7ffb4619c700 1 --2- 172.21.15.116:0/3695182421 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb400ad930 0x7ffb400add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7ffb4619c700 1 -- 172.21.15.116:0/3695182421 >> v2:172.21.15.182:3300/0 conn(0x7ffb40160fd0 msgr2=0x7ffb4006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:44.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7ffb4619c700 1 --2- 172.21.15.116:0/3695182421 >> v2:172.21.15.182:3300/0 conn(0x7ffb40160fd0 0x7ffb4006a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.418+0000 7ffb4619c700 1 -- 172.21.15.116:0/3695182421 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb40161810 con 0x7ffb4006c6c0 2023-05-12T09:07:44.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.419+0000 7ffb4619c700 1 --2- 172.21.15.116:0/3695182421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb4006c6c0 0x7ffb40070ff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb4006b800 tx=0x7ffb3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e88872bb0e1cb9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.419+0000 7ffb44999700 1 -- 172.21.15.116:0/3695182421 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3800e070 con 0x7ffb4006c6c0 2023-05-12T09:07:44.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.419+0000 7ffb44999700 1 -- 172.21.15.116:0/3695182421 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3800bb20 con 0x7ffb4006c6c0 2023-05-12T09:07:44.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.419+0000 7ffb44999700 1 -- 172.21.15.116:0/3695182421 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38012430 con 0x7ffb4006c6c0 2023-05-12T09:07:44.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.419+0000 7fb6e2ffd700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb6d406ade0 0x7fb6d406d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.419+0000 7fb6e2ffd700 1 -- 172.21.15.116:0/3848676040 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb6ec08b2f0 con 0x7fb6dc003a00 2023-05-12T09:07:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f703a7fc700 1 -- 172.21.15.116:0/410321429 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c004740 con 0x7f70440ad690 2023-05-12T09:07:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f703a7fc700 1 -- 172.21.15.116:0/410321429 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c0048a0 con 0x7f70440ad690 2023-05-12T09:07:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f703a7fc700 1 -- 172.21.15.116:0/410321429 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c012650 con 0x7f70440ad690 2023-05-12T09:07:44.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7fb6f1d9b700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb6d406ade0 0x7fb6d406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7fb6e2ffd700 1 -- 172.21.15.116:0/3848676040 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb6ec059bb0 con 0x7fb6dc003a00 2023-05-12T09:07:44.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.421+0000 7fb6f1d9b700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb6d406ade0 0x7fb6d406d290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40c8310 tx=0x7fb6e4006d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7fc9c23ff700 1 -- 172.21.15.116:0/511046792 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc0ccf10 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7fc9c23ff700 1 -- 172.21.15.116:0/511046792 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc0ccc30 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.419+0000 7f960579b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96000ad690 0x7f96000b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.419+0000 7f9605f9c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9600160d20 0x7f96000cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.419+0000 7f960579b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96000ad690 0x7f96000b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49328/0 (socket says 172.21.15.116:49328) 2023-05-12T09:07:44.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f960579b700 1 -- 172.21.15.116:0/3032310479 learned_addr learned my addr 172.21.15.116:0/3032310479 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f9604f9a700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96000c20d0 0x7f96000ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f960579b700 1 -- 172.21.15.116:0/3032310479 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9600160d20 msgr2=0x7f96000cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f960579b700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9600160d20 0x7f96000cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f960579b700 1 -- 172.21.15.116:0/3032310479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96000c20d0 msgr2=0x7f96000ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f960579b700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96000c20d0 0x7f96000ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f960579b700 1 -- 172.21.15.116:0/3032310479 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f8009b30 con 0x7f96000ad690 2023-05-12T09:07:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f96c8dff700 1 Processor -- start 2023-05-12T09:07:44.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.421+0000 7f704bbff700 1 -- 172.21.15.116:0/410321429 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70440ccf10 con 0x7f70440ad690 2023-05-12T09:07:44.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.421+0000 7f704bbff700 1 -- 172.21.15.116:0/410321429 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70440ccc30 con 0x7f70440ad690 2023-05-12T09:07:44.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.421+0000 7f960579b700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96000ad690 0x7f96000b33f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00e9b0 tx=0x7f95fc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.421+0000 7fc9c23ff700 1 -- 172.21.15.116:0/511046792 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc06d0d0 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.420+0000 7f96c8dff700 1 -- start start 2023-05-12T09:07:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f96c8dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96c4159850 0x7f96c414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f96c8dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c406ce90 0x7f96c414bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f96c8dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96c415b020 0x7f96c40af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f96c8dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c414c530 con 0x7f96c406ce90 2023-05-12T09:07:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f96c8dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c416c330 con 0x7f96c415b020 2023-05-12T09:07:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f96c8dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c416c610 con 0x7f96c4159850 2023-05-12T09:07:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f96c2d9d700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96c415b020 0x7f96c40af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f96c2d9d700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96c415b020 0x7f96c40af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:58632/0 (socket says 172.21.15.116:58632) 2023-05-12T09:07:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f96c2d9d700 1 -- 172.21.15.116:0/1306277066 learned_addr learned my addr 172.21.15.116:0/1306277066 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7ffb47bff700 1 -- 172.21.15.116:0/3695182421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb4006c6c0 msgr2=0x7ffb40070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7ffb47bff700 1 --2- 172.21.15.116:0/3695182421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb4006c6c0 0x7ffb40070ff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb4006b800 tx=0x7ffb3800b330 comp rx=0 tx=0).stop 2023-05-12T09:07:44.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f95f5ffb700 1 -- 172.21.15.116:0/3032310479 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc009710 con 0x7f96000ad690 2023-05-12T09:07:44.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f95f5ffb700 1 -- 172.21.15.116:0/3032310479 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc00c850 con 0x7f96000ad690 2023-05-12T09:07:44.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f95f5ffb700 1 -- 172.21.15.116:0/3032310479 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00cbc0 con 0x7f96000ad690 2023-05-12T09:07:44.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f96079ff700 1 -- 172.21.15.116:0/3032310479 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96000ccf10 con 0x7f96000ad690 2023-05-12T09:07:44.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.422+0000 7f704bbff700 1 -- 172.21.15.116:0/410321429 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704406d070 con 0x7f70440ad690 2023-05-12T09:07:44.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.423+0000 7f96c259c700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96c4159850 0x7f96c414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.423+0000 7f96079ff700 1 -- 172.21.15.116:0/3032310479 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96000ccc30 con 0x7f96000ad690 2023-05-12T09:07:44.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.423+0000 7f96c1d9b700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c406ce90 0x7f96c414bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.423+0000 7f96c2d9d700 1 -- 172.21.15.116:0/1306277066 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96c4159850 msgr2=0x7f96c414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.423+0000 7f96c2d9d700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96c4159850 0x7f96c414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.423+0000 7f96c2d9d700 1 -- 172.21.15.116:0/1306277066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c406ce90 msgr2=0x7f96c414bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.423+0000 7f96c2d9d700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c406ce90 0x7f96c414bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.423+0000 7f96c2d9d700 1 -- 172.21.15.116:0/1306277066 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4071600 con 0x7f96c415b020 2023-05-12T09:07:44.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.423+0000 7f96c2d9d700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96c415b020 0x7f96c40af170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f96b8000fb0 tx=0x7f96b800ea90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.425+0000 7f96079ff700 1 -- 172.21.15.116:0/3032310479 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e00052f0 con 0x7f96000ad690 2023-05-12T09:07:44.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.425+0000 7f96b2ffd700 1 -- 172.21.15.116:0/1306277066 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b80052e0 con 0x7f96c415b020 2023-05-12T09:07:44.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.425+0000 7f96b2ffd700 1 -- 172.21.15.116:0/1306277066 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b8005440 con 0x7f96c415b020 2023-05-12T09:07:44.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.425+0000 7f96b2ffd700 1 -- 172.21.15.116:0/1306277066 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b80038c0 con 0x7f96c415b020 2023-05-12T09:07:44.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.426+0000 7f96c8dff700 1 -- 172.21.15.116:0/1306277066 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c40cc670 con 0x7f96c415b020 2023-05-12T09:07:44.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.426+0000 7f96c8dff700 1 -- 172.21.15.116:0/1306277066 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c415d390 con 0x7f96c415b020 2023-05-12T09:07:44.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.426+0000 7f703a7fc700 1 -- 172.21.15.116:0/410321429 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f703c0127b0 con 0x7f70440ad690 2023-05-12T09:07:44.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.427+0000 7f96c8dff700 1 -- 172.21.15.116:0/1306277066 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c4071b50 con 0x7f96c415b020 2023-05-12T09:07:44.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.427+0000 7ffb47bff700 1 -- 172.21.15.116:0/3695182421 shutdown_connections 2023-05-12T09:07:44.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.427+0000 7ffb47bff700 1 --2- 172.21.15.116:0/3695182421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb4006c6c0 0x7ffb40070ff0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.427+0000 7ffb47bff700 1 --2- 172.21.15.116:0/3695182421 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb400ad930 0x7ffb400add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.427+0000 7ffb47bff700 1 --2- 172.21.15.116:0/3695182421 >> v2:172.21.15.182:3300/0 conn(0x7ffb40160fd0 0x7ffb4006a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.427+0000 7ffb47bff700 1 -- 172.21.15.116:0/3695182421 >> 172.21.15.116:0/3695182421 conn(0x7ffb400cf6e0 msgr2=0x7ffb400cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.427+0000 7fc9b8ff9700 1 -- 172.21.15.116:0/511046792 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9b0018030 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.427+0000 7f95f5ffb700 1 -- 172.21.15.116:0/3032310479 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95fc00cd20 con 0x7f96000ad690 2023-05-12T09:07:44.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.429+0000 7f95f5ffb700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f95e406ad30 0x7f95e406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.428+0000 7f703a7fc700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f702806adb0 0x7f702806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.428+0000 7f703a7fc700 1 -- 172.21.15.116:0/410321429 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f703c08b920 con 0x7f70440ad690 2023-05-12T09:07:44.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.428+0000 7ffb47bff700 1 -- 172.21.15.116:0/3695182421 shutdown_connections 2023-05-12T09:07:44.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.428+0000 7ffb47bff700 1 -- 172.21.15.116:0/3695182421 wait complete. 2023-05-12T09:07:44.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.429+0000 7fc9b8ff9700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc9a806adb0 0x7fc9a806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.429+0000 7fc9b8ff9700 1 -- 172.21.15.116:0/511046792 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc9b008ad20 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.430+0000 7f9604f9a700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f95e406ad30 0x7f95e406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.430+0000 7f704919a700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f702806adb0 0x7f702806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.430+0000 7fc9b8ff9700 1 -- 172.21.15.116:0/511046792 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc9b0055b50 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.431+0000 7f704919a700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f702806adb0 0x7f702806d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7040000fb0 tx=0x7f7040007a30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.431+0000 7f95f5ffb700 1 -- 172.21.15.116:0/3032310479 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95fc05c290 con 0x7f96000ad690 2023-05-12T09:07:44.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.431+0000 7f9604f9a700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f95e406ad30 0x7f95e406d1e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f960014ac00 tx=0x7f95f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.431+0000 7fc9bbfff700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc9a806adb0 0x7fc9a806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.432+0000 7fc9bbfff700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc9a806adb0 0x7fc9a806d260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0afef0 tx=0x7fc9ac009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.431+0000 7ffb47bff700 1 Processor -- start 2023-05-12T09:07:44.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.431+0000 7ffb47bff700 1 -- start start 2023-05-12T09:07:44.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7ffb47bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb4006c6c0 0x7ffb4015d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7ffb47bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb400ad930 0x7ffb400ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7ffb47bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ffb40160fd0 0x7ffb400b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7ffb47bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb401eb0b0 con 0x7ffb400ad930 2023-05-12T09:07:44.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7ffb47bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb401eaeb0 con 0x7ffb40160fd0 2023-05-12T09:07:44.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7ffb47bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400aee20 con 0x7ffb4006c6c0 2023-05-12T09:07:44.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7ffb4519a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb400ad930 0x7ffb400ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7ffb4599b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb4006c6c0 0x7ffb4015d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7ffb4519a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb400ad930 0x7ffb400ae440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57378/0 (socket says 172.21.15.116:57378) 2023-05-12T09:07:44.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7ffb4519a700 1 -- 172.21.15.116:0/3745824245 learned_addr learned my addr 172.21.15.116:0/3745824245 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:44.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.432+0000 7f96b2ffd700 1 -- 172.21.15.116:0/1306277066 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f96b8003a20 con 0x7f96c415b020 2023-05-12T09:07:44.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.433+0000 7f96b2ffd700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f96a406adb0 0x7f96a406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.434+0000 7f96b2ffd700 1 -- 172.21.15.116:0/1306277066 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f96b8089330 con 0x7f96c415b020 2023-05-12T09:07:44.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.434+0000 7ffb4519a700 1 -- 172.21.15.116:0/3745824245 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb4006c6c0 msgr2=0x7ffb4015d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.434+0000 7ffb4519a700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb4006c6c0 0x7ffb4015d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.434+0000 7ffb4519a700 1 -- 172.21.15.116:0/3745824245 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ffb40160fd0 msgr2=0x7ffb400b3640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-12T09:07:44.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.434+0000 7ffb4519a700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ffb40160fd0 0x7ffb400b3640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.434+0000 7ffb4519a700 1 -- 172.21.15.116:0/3745824245 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb38009a70 con 0x7ffb400ad930 2023-05-12T09:07:44.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.435+0000 7ffb4519a700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb400ad930 0x7ffb400ae440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00e810 tx=0x7ffb3c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.435+0000 7f96c259c700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f96a406adb0 0x7f96a406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.435+0000 7f96b2ffd700 1 -- 172.21.15.116:0/1306277066 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f96b8054160 con 0x7f96c415b020 2023-05-12T09:07:44.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.435+0000 7f703a7fc700 1 -- 172.21.15.116:0/410321429 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f703c056750 con 0x7f70440ad690 2023-05-12T09:07:44.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.436+0000 7ffb367fc700 1 -- 172.21.15.116:0/3745824245 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c013610 con 0x7ffb400ad930 2023-05-12T09:07:44.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.436+0000 7ffb367fc700 1 -- 172.21.15.116:0/3745824245 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c013770 con 0x7ffb400ad930 2023-05-12T09:07:44.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.436+0000 7ffb367fc700 1 -- 172.21.15.116:0/3745824245 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c013b00 con 0x7ffb400ad930 2023-05-12T09:07:44.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.437+0000 7ffb47bff700 1 -- 172.21.15.116:0/3745824245 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb40161dd0 con 0x7ffb400ad930 2023-05-12T09:07:44.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.437+0000 7ffb47bff700 1 -- 172.21.15.116:0/3745824245 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb40161af0 con 0x7ffb400ad930 2023-05-12T09:07:44.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.439+0000 7ffb47bff700 1 -- 172.21.15.116:0/3745824245 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4006ace0 con 0x7ffb400ad930 2023-05-12T09:07:44.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.439+0000 7f95f5ffb700 1 -- 172.21.15.116:0/3032310479 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f95fc054610 con 0x7f96000ad690 2023-05-12T09:07:44.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.442+0000 7ffb367fc700 1 -- 172.21.15.116:0/3745824245 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb3c013c60 con 0x7ffb400ad930 2023-05-12T09:07:44.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.454+0000 7ffb367fc700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb2406adb0 0x7ffb2406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:44.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.454+0000 7ffb367fc700 1 -- 172.21.15.116:0/3745824245 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb3c0892d0 con 0x7ffb400ad930 2023-05-12T09:07:44.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.454+0000 7ffb367fc700 1 -- 172.21.15.116:0/3745824245 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ffb3c08b840 con 0x7ffb400ad930 2023-05-12T09:07:44.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.456+0000 7ffb4599b700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb2406adb0 0x7ffb2406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:44.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.457+0000 7ffb4599b700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb2406adb0 0x7ffb2406d260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009bd0 tx=0x7ffb300092c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.460+0000 7f96c259c700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f96a406adb0 0x7f96a406d260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f96c4071b20 tx=0x7f96bc00a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:44.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.803+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3194575655 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5c940055a0 con 0x7f5cac0c19c0 2023-05-12T09:07:44.810 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:44.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.804+0000 7f5ca2ffd700 1 -- 172.21.15.116:0/3194575655 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ca8057c00 con 0x7f5cac0c19c0 2023-05-12T09:07:44.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.808+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3194575655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5c9006adb0 msgr2=0x7f5c9006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.808+0000 7f5cb45ff700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5c9006adb0 0x7f5c9006d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005910 tx=0x7f5c9c009040 comp rx=0 tx=0).stop 2023-05-12T09:07:44.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.808+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3194575655 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5cac0c19c0 msgr2=0x7f5cac0c37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.808+0000 7f5cb45ff700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5cac0c19c0 0x7f5cac0c37a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800d5f0 tx=0x7f5ca800d900 comp rx=0 tx=0).stop 2023-05-12T09:07:44.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.808+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3194575655 shutdown_connections 2023-05-12T09:07:44.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.808+0000 7f5cb45ff700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5c9006adb0 0x7f5c9006d260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.808+0000 7f5cb45ff700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5cac160d20 0x7f5cac0b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.808+0000 7f5cb45ff700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cac0ad690 0x7f5cac0c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.808+0000 7f5cb45ff700 1 --2- 172.21.15.116:0/3194575655 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5cac0c19c0 0x7f5cac0c37a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.808+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3194575655 >> 172.21.15.116:0/3194575655 conn(0x7f5cac0cf720 msgr2=0x7f5cac1636d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.809+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3194575655 shutdown_connections 2023-05-12T09:07:44.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.809+0000 7f5cb45ff700 1 -- 172.21.15.116:0/3194575655 wait complete. 2023-05-12T09:07:44.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-05-12T09:07:44.841 DEBUG:teuthology.parallel:result is None 2023-05-12T09:07:44.862 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.859+0000 7f704bbff700 1 -- 172.21.15.116:0/410321429 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f70440c2b30 con 0x7f70440ad690 2023-05-12T09:07:44.862 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.859+0000 7f703a7fc700 1 -- 172.21.15.116:0/410321429 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f703c02b020 con 0x7f70440ad690 2023-05-12T09:07:44.863 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.860+0000 7f9eb6fff700 1 -- 172.21.15.116:0/2232433843 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9eb00cdad0 con 0x7f9eb0089b20 2023-05-12T09:07:44.863 INFO:teuthology.orchestra.run.smithi116.stdout:55834574859 2023-05-12T09:07:44.864 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.860+0000 7f9ead7fa700 1 -- 172.21.15.116:0/2232433843 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ea0057890 con 0x7f9eb0089b20 2023-05-12T09:07:44.864 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:44.866 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.862+0000 7f704bbff700 1 -- 172.21.15.116:0/410321429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f702806adb0 msgr2=0x7f702806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.866 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.862+0000 7f704bbff700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f702806adb0 0x7f702806d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7040000fb0 tx=0x7f7040007a30 comp rx=0 tx=0).stop 2023-05-12T09:07:44.867 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.862+0000 7f704bbff700 1 -- 172.21.15.116:0/410321429 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440ad690 msgr2=0x7f70440afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.867 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.862+0000 7f704bbff700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440ad690 0x7f70440afee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f703c00b370 tx=0x7f703c004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.863+0000 7f704bbff700 1 -- 172.21.15.116:0/410321429 shutdown_connections 2023-05-12T09:07:44.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.863+0000 7f704bbff700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70440c1670 0x7f704415dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.863+0000 7f704bbff700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f702806adb0 0x7f702806d260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.863+0000 7f704bbff700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f70440ad690 0x7f70440afee0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.863+0000 7f704bbff700 1 --2- 172.21.15.116:0/410321429 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70440c20d0 0x7f70441f9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.863+0000 7f704bbff700 1 -- 172.21.15.116:0/410321429 >> 172.21.15.116:0/410321429 conn(0x7f70440cf720 msgr2=0x7f704406d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.863+0000 7f704bbff700 1 -- 172.21.15.116:0/410321429 shutdown_connections 2023-05-12T09:07:44.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.863+0000 7f704bbff700 1 -- 172.21.15.116:0/410321429 wait complete. 2023-05-12T09:07:44.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.864+0000 7f9eb6fff700 1 -- 172.21.15.116:0/2232433843 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f9e9806adb0 msgr2=0x7f9e9806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.864+0000 7f9eb6fff700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f9e9806adb0 0x7f9e9806d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9eb016c420 tx=0x7f9e9c008040 comp rx=0 tx=0).stop 2023-05-12T09:07:44.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.864+0000 7f9eb6fff700 1 -- 172.21.15.116:0/2232433843 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9eb0089b20 msgr2=0x7f9eb0088f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.864+0000 7f9eb6fff700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9eb0089b20 0x7f9eb0088f60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00b1680 tx=0x7f9ea000b800 comp rx=0 tx=0).stop 2023-05-12T09:07:44.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.864+0000 7f9eb6fff700 1 -- 172.21.15.116:0/2232433843 shutdown_connections 2023-05-12T09:07:44.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.864+0000 7f9eb6fff700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f9e9806adb0 0x7f9e9806d260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.864+0000 7f9eb6fff700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f9eb0164a90 0x7f9eb007c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.864+0000 7f9eb6fff700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9eb0089b20 0x7f9eb0088f60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.864+0000 7f9eb6fff700 1 --2- 172.21.15.116:0/2232433843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb0169770 0x7f9eb0164550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.864+0000 7f9eb6fff700 1 -- 172.21.15.116:0/2232433843 >> 172.21.15.116:0/2232433843 conn(0x7f9eb00cf6e0 msgr2=0x7f9eb00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.865+0000 7f9eb6fff700 1 -- 172.21.15.116:0/2232433843 shutdown_connections 2023-05-12T09:07:44.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.865+0000 7f9eb6fff700 1 -- 172.21.15.116:0/2232433843 wait complete. 2023-05-12T09:07:44.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.869+0000 7fb6f8dff700 1 -- 172.21.15.116:0/3848676040 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb6d8005870 con 0x7fb6dc003a00 2023-05-12T09:07:44.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.869+0000 7fb6e2ffd700 1 -- 172.21.15.116:0/3848676040 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6ec023030 con 0x7fb6dc003a00 2023-05-12T09:07:44.875 INFO:teuthology.orchestra.run.smithi116.stdout:55834574859 2023-05-12T09:07:44.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.874+0000 7fb6f8dff700 1 -- 172.21.15.116:0/3848676040 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb6d406ade0 msgr2=0x7fb6d406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.874+0000 7fb6f8dff700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb6d406ade0 0x7fb6d406d290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40c8310 tx=0x7fb6e4006d10 comp rx=0 tx=0).stop 2023-05-12T09:07:44.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.874+0000 7fb6f8dff700 1 -- 172.21.15.116:0/3848676040 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 msgr2=0x7fb6f41691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.874+0000 7fb6f8dff700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 0x7fb6f41691f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec003ea0 tx=0x7fb6ec004b40 comp rx=0 tx=0).stop 2023-05-12T09:07:44.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.874+0000 7fb6f8dff700 1 -- 172.21.15.116:0/3848676040 shutdown_connections 2023-05-12T09:07:44.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.874+0000 7fb6f8dff700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb6d406ade0 0x7fb6d406d290 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.874+0000 7fb6f8dff700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6f406d550 0x7fb6f406d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.874+0000 7fb6f8dff700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6dc003a00 0x7fb6f41691f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.874+0000 7fb6f8dff700 1 --2- 172.21.15.116:0/3848676040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6f4088a60 0x7fb6f415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.874+0000 7fb6f8dff700 1 -- 172.21.15.116:0/3848676040 >> 172.21.15.116:0/3848676040 conn(0x7fb6f40cf6e0 msgr2=0x7fb6f4169de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.875+0000 7fb6f8dff700 1 -- 172.21.15.116:0/3848676040 shutdown_connections 2023-05-12T09:07:44.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.875+0000 7fb6f8dff700 1 -- 172.21.15.116:0/3848676040 wait complete. 2023-05-12T09:07:44.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.879+0000 7fc9c23ff700 1 -- 172.21.15.116:0/511046792 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc9bc074430 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.880+0000 7fc9b8ff9700 1 -- 172.21.15.116:0/511046792 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc9b0059170 con 0x7fc9bc0c19c0 2023-05-12T09:07:44.884 INFO:teuthology.orchestra.run.smithi116.stdout:55834574859 2023-05-12T09:07:44.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 -- 172.21.15.116:0/511046792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc9a806adb0 msgr2=0x7fc9a806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc9a806adb0 0x7fc9a806d260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0afef0 tx=0x7fc9ac009210 comp rx=0 tx=0).stop 2023-05-12T09:07:44.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 -- 172.21.15.116:0/511046792 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0c19c0 msgr2=0x7fc9bc0c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0c19c0 0x7fc9bc0c3e80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0004000 tx=0x7fc9b0004750 comp rx=0 tx=0).stop 2023-05-12T09:07:44.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 -- 172.21.15.116:0/511046792 shutdown_connections 2023-05-12T09:07:44.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9bc160d20 0x7fc9bc0b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc9bc0ad690 0x7fc9bc15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc9a806adb0 0x7fc9a806d260 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0afef0 tx=0x7fc9ac009210 comp rx=0 tx=0).stop 2023-05-12T09:07:44.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 --2- 172.21.15.116:0/511046792 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc9bc0c19c0 0x7fc9bc0c3e80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 -- 172.21.15.116:0/511046792 >> 172.21.15.116:0/511046792 conn(0x7fc9bc0cf720 msgr2=0x7fc9bc161230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 -- 172.21.15.116:0/511046792 shutdown_connections 2023-05-12T09:07:44.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-05-12T09:07:44.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.884+0000 7fc9c23ff700 1 -- 172.21.15.116:0/511046792 wait complete. 2023-05-12T09:07:44.891 DEBUG:teuthology.parallel:result is None 2023-05-12T09:07:44.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.885+0000 7f96079ff700 1 -- 172.21.15.116:0/3032310479 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f95e00055a0 con 0x7f96000ad690 2023-05-12T09:07:44.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.885+0000 7f95f5ffb700 1 -- 172.21.15.116:0/3032310479 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95fc017090 con 0x7f96000ad690 2023-05-12T09:07:44.892 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:44.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 -- 172.21.15.116:0/3032310479 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f95e406ad30 msgr2=0x7f95e406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f95e406ad30 0x7f95e406d1e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f960014ac00 tx=0x7f95f0009040 comp rx=0 tx=0).stop 2023-05-12T09:07:44.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 -- 172.21.15.116:0/3032310479 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96000ad690 msgr2=0x7f96000b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96000ad690 0x7f96000b33f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00e9b0 tx=0x7f95fc00ecc0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 -- 172.21.15.116:0/3032310479 shutdown_connections 2023-05-12T09:07:44.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f9600160d20 0x7f96000cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f95e406ad30 0x7f95e406d1e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96000ad690 0x7f96000b33f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 --2- 172.21.15.116:0/3032310479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96000c20d0 0x7f96000ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 -- 172.21.15.116:0/3032310479 >> 172.21.15.116:0/3032310479 conn(0x7f96000cf720 msgr2=0x7f96000b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 -- 172.21.15.116:0/3032310479 shutdown_connections 2023-05-12T09:07:44.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.889+0000 7f96079ff700 1 -- 172.21.15.116:0/3032310479 wait complete. 2023-05-12T09:07:44.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-05-12T09:07:44.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.894+0000 7f96c8dff700 1 -- 172.21.15.116:0/1306277066 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f96c40b4a10 con 0x7f96c415b020 2023-05-12T09:07:44.898 DEBUG:teuthology.parallel:result is None 2023-05-12T09:07:44.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.895+0000 7f96b2ffd700 1 -- 172.21.15.116:0/1306277066 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f96b8019090 con 0x7f96c415b020 2023-05-12T09:07:44.899 INFO:teuthology.orchestra.run.smithi116.stdout:55834574859 2023-05-12T09:07:44.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 -- 172.21.15.116:0/1306277066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f96a406adb0 msgr2=0x7f96a406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f96a406adb0 0x7f96a406d260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f96c4071b20 tx=0x7f96bc00a000 comp rx=0 tx=0).stop 2023-05-12T09:07:44.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 -- 172.21.15.116:0/1306277066 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96c415b020 msgr2=0x7f96c40af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96c415b020 0x7f96c40af170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f96b8000fb0 tx=0x7f96b800ea90 comp rx=0 tx=0).stop 2023-05-12T09:07:44.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 -- 172.21.15.116:0/1306277066 shutdown_connections 2023-05-12T09:07:44.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96c415b020 0x7f96c40af170 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f96a406adb0 0x7f96a406d260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96c4159850 0x7f96c414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 --2- 172.21.15.116:0/1306277066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c406ce90 0x7f96c414bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 -- 172.21.15.116:0/1306277066 >> 172.21.15.116:0/1306277066 conn(0x7f96c40cf720 msgr2=0x7f96c414c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 -- 172.21.15.116:0/1306277066 shutdown_connections 2023-05-12T09:07:44.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.898+0000 7f96c8dff700 1 -- 172.21.15.116:0/1306277066 wait complete. 2023-05-12T09:07:44.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.904+0000 7ffb47bff700 1 -- 172.21.15.116:0/3745824245 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ffb40074430 con 0x7ffb400ad930 2023-05-12T09:07:44.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.904+0000 7ffb367fc700 1 -- 172.21.15.116:0/3745824245 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb3c054080 con 0x7ffb400ad930 2023-05-12T09:07:44.907 INFO:teuthology.orchestra.run.smithi116.stdout:55834574858 2023-05-12T09:07:44.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2023-05-12T09:07:44.908 DEBUG:teuthology.parallel:result is None 2023-05-12T09:07:44.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 -- 172.21.15.116:0/3745824245 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb2406adb0 msgr2=0x7ffb2406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb2406adb0 0x7ffb2406d260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009bd0 tx=0x7ffb300092c0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 -- 172.21.15.116:0/3745824245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb400ad930 msgr2=0x7ffb400ae440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:44.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb400ad930 0x7ffb400ae440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00e810 tx=0x7ffb3c00eb20 comp rx=0 tx=0).stop 2023-05-12T09:07:44.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 -- 172.21.15.116:0/3745824245 shutdown_connections 2023-05-12T09:07:44.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ffb40160fd0 0x7ffb400b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb2406adb0 0x7ffb2406d260 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb4006c6c0 0x7ffb4015d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 --2- 172.21.15.116:0/3745824245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb400ad930 0x7ffb400ae440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:44.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 -- 172.21.15.116:0/3745824245 >> 172.21.15.116:0/3745824245 conn(0x7ffb400cf6e0 msgr2=0x7ffb400b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:44.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 -- 172.21.15.116:0/3745824245 shutdown_connections 2023-05-12T09:07:44.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:44.908+0000 7ffb47bff700 1 -- 172.21.15.116:0/3745824245 wait complete. 2023-05-12T09:07:44.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-05-12T09:07:44.915 DEBUG:teuthology.parallel:result is None 2023-05-12T09:07:44.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-05-12T09:07:44.917 DEBUG:teuthology.parallel:result is None 2023-05-12T09:07:44.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2023-05-12T09:07:44.924 DEBUG:teuthology.parallel:result is None 2023-05-12T09:07:44.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-05-12T09:07:44.929 DEBUG:teuthology.parallel:result is None 2023-05-12T09:07:44.930 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-12T09:07:44.930 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-12T09:07:45.153 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.149+0000 7f00dd9ff700 1 Processor -- start 2023-05-12T09:07:45.153 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.150+0000 7f00dd9ff700 1 -- start start 2023-05-12T09:07:45.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00dd9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00d80b87a0 0x7f00d80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00dd9ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f00d81601e0 0x7f00d8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00dd9ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f00d8160b70 0x7f00d80d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00dd9ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d80d02d0 con 0x7f00d81601e0 2023-05-12T09:07:45.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00dd9ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d80d0cb0 con 0x7f00d8160b70 2023-05-12T09:07:45.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00dd9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80b2730 con 0x7f00d80b87a0 2023-05-12T09:07:45.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00cffff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f00d81601e0 0x7f00d8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00cffff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f00d81601e0 0x7f00d8160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57384/0 (socket says 172.21.15.116:57384) 2023-05-12T09:07:45.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00cffff700 1 -- 172.21.15.116:0/1854970220 learned_addr learned my addr 172.21.15.116:0/1854970220 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:45.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00d6ffd700 1 --2- 172.21.15.116:0/1854970220 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00d80b87a0 0x7f00d80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00d77fe700 1 --2- 172.21.15.116:0/1854970220 >> v2:172.21.15.182:3300/0 conn(0x7f00d8160b70 0x7f00d80d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00cffff700 1 -- 172.21.15.116:0/1854970220 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00d80b87a0 msgr2=0x7f00d80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:45.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00cffff700 1 --2- 172.21.15.116:0/1854970220 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00d80b87a0 0x7f00d80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00cffff700 1 -- 172.21.15.116:0/1854970220 >> v2:172.21.15.182:3300/0 conn(0x7f00d8160b70 msgr2=0x7f00d80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:45.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00cffff700 1 --2- 172.21.15.116:0/1854970220 >> v2:172.21.15.182:3300/0 conn(0x7f00d8160b70 0x7f00d80d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00cffff700 1 -- 172.21.15.116:0/1854970220 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d8160ff0 con 0x7f00d81601e0 2023-05-12T09:07:45.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.151+0000 7f00d77fe700 1 --2- 172.21.15.116:0/1854970220 >> v2:172.21.15.182:3300/0 conn(0x7f00d8160b70 0x7f00d80d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:45.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.152+0000 7f00cffff700 1 --2- 172.21.15.116:0/1854970220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d81601e0 0x7f00d8160630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00d808be30 tx=0x7f00c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2206beadc9868cda server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:45.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.152+0000 7f00d67fc700 1 -- 172.21.15.116:0/1854970220 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c000b870 con 0x7f00d81601e0 2023-05-12T09:07:45.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.152+0000 7f00d67fc700 1 -- 172.21.15.116:0/1854970220 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c000b9d0 con 0x7f00d81601e0 2023-05-12T09:07:45.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.152+0000 7f00d67fc700 1 -- 172.21.15.116:0/1854970220 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c000bd60 con 0x7f00d81601e0 2023-05-12T09:07:45.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.152+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1854970220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d81601e0 msgr2=0x7f00d8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.152+0000 7f00dd9ff700 1 --2- 172.21.15.116:0/1854970220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d81601e0 0x7f00d8160630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00d808be30 tx=0x7f00c0009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.152+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1854970220 shutdown_connections 2023-05-12T09:07:45.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.152+0000 7f00dd9ff700 1 --2- 172.21.15.116:0/1854970220 >> v2:172.21.15.182:3300/0 conn(0x7f00d8160b70 0x7f00d80d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.152+0000 7f00dd9ff700 1 --2- 172.21.15.116:0/1854970220 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00d80b87a0 0x7f00d80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.152+0000 7f00dd9ff700 1 --2- 172.21.15.116:0/1854970220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d81601e0 0x7f00d8160630 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.153+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1854970220 >> 172.21.15.116:0/1854970220 conn(0x7f00d8071b10 msgr2=0x7f00d8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:45.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.153+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1854970220 shutdown_connections 2023-05-12T09:07:45.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.153+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1854970220 wait complete. 2023-05-12T09:07:45.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.154+0000 7f00dd9ff700 1 Processor -- start 2023-05-12T09:07:45.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.154+0000 7f00dd9ff700 1 -- start start 2023-05-12T09:07:45.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.155+0000 7f00dd9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d80b87a0 0x7f00d81f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.155+0000 7f00dd9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00d81601e0 0x7f00d80d2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.155+0000 7f00dd9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00d8160b70 0x7f00d80d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.155+0000 7f00dd9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d81f2f40 con 0x7f00d80b87a0 2023-05-12T09:07:45.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.155+0000 7f00dd9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8142c00 con 0x7f00d8160b70 2023-05-12T09:07:45.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.155+0000 7f00dd9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8153090 con 0x7f00d81601e0 2023-05-12T09:07:45.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d6ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d80b87a0 0x7f00d81f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d6ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d80b87a0 0x7f00d81f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57392/0 (socket says 172.21.15.116:57392) 2023-05-12T09:07:45.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d6ffd700 1 -- 172.21.15.116:0/1287921567 learned_addr learned my addr 172.21.15.116:0/1287921567 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:45.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d77fe700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00d8160b70 0x7f00d80d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00cffff700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00d81601e0 0x7f00d80d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d6ffd700 1 -- 172.21.15.116:0/1287921567 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00d81601e0 msgr2=0x7f00d80d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d6ffd700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00d81601e0 0x7f00d80d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d6ffd700 1 -- 172.21.15.116:0/1287921567 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00d8160b70 msgr2=0x7f00d80d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d6ffd700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00d8160b70 0x7f00d80d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d6ffd700 1 -- 172.21.15.116:0/1287921567 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c0009550 con 0x7f00d80b87a0 2023-05-12T09:07:45.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d77fe700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00d8160b70 0x7f00d80d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:45.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d6ffd700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d80b87a0 0x7f00d81f2a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00c800e810 tx=0x7f00c800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:45.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d4ff9700 1 -- 172.21.15.116:0/1287921567 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8013610 con 0x7f00d80b87a0 2023-05-12T09:07:45.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d4ff9700 1 -- 172.21.15.116:0/1287921567 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c8013790 con 0x7f00d80b87a0 2023-05-12T09:07:45.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1287921567 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d80cd6a0 con 0x7f00d80b87a0 2023-05-12T09:07:45.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.156+0000 7f00d4ff9700 1 -- 172.21.15.116:0/1287921567 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8013b40 con 0x7f00d80b87a0 2023-05-12T09:07:45.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.157+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1287921567 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d80cdc60 con 0x7f00d80b87a0 2023-05-12T09:07:45.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.158+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1287921567 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d80cd980 con 0x7f00d80b87a0 2023-05-12T09:07:45.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.159+0000 7f00d4ff9700 1 -- 172.21.15.116:0/1287921567 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00c8013ca0 con 0x7f00d80b87a0 2023-05-12T09:07:45.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.159+0000 7f00d4ff9700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00b806ace0 0x7f00b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.159+0000 7f00d4ff9700 1 -- 172.21.15.116:0/1287921567 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00c8089410 con 0x7f00d80b87a0 2023-05-12T09:07:45.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.160+0000 7f00cffff700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00b806ace0 0x7f00b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.160+0000 7f00cffff700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00b806ace0 0x7f00b806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f00c0000c00 tx=0x7f00c0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:45.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.164+0000 7f00d4ff9700 1 -- 172.21.15.116:0/1287921567 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f00c8057bc0 con 0x7f00d80b87a0 2023-05-12T09:07:45.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.351+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1287921567 --> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00d8074430 con 0x7f00b806ace0 2023-05-12T09:07:45.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.362+0000 7f00d4ff9700 1 -- 172.21.15.116:0/1287921567 <== mgr.4106 v2:172.21.15.116:6832/3989593778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367485 (secure 0 0 0) 0x7f00d8074430 con 0x7f00b806ace0 2023-05-12T09:07:45.369 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:45.371 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1287921567 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00b806ace0 msgr2=0x7f00b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00b806ace0 0x7f00b806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f00c0000c00 tx=0x7f00c0008030 comp rx=0 tx=0).stop 2023-05-12T09:07:45.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1287921567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d80b87a0 msgr2=0x7f00d81f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d80b87a0 0x7f00d81f2a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00c800e810 tx=0x7f00c800eb20 comp rx=0 tx=0).stop 2023-05-12T09:07:45.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1287921567 shutdown_connections 2023-05-12T09:07:45.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f00d8160b70 0x7f00d80d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00d80b87a0 0x7f00d81f2a00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f00b806ace0 0x7f00b806d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 --2- 172.21.15.116:0/1287921567 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f00d81601e0 0x7f00d80d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1287921567 >> 172.21.15.116:0/1287921567 conn(0x7f00d8071b10 msgr2=0x7f00d80b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:45.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1287921567 shutdown_connections 2023-05-12T09:07:45.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.367+0000 7f00dd9ff700 1 -- 172.21.15.116:0/1287921567 wait complete. 2023-05-12T09:07:45.373 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2023-05-12T09:07:45.387 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-05-12T09:07:43.575148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67068,"kb_used_data":3196,"kb_used_omap":0,"kb_used_meta":63808,"kb_avail":754907652,"statfs":{"total":773094113280,"available":773025435648,"internally_reserved":0,"allocated":3272704,"data_stored":2023677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65339392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002752"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056869+0000","last_change":"2023-05-12T09:07:10.552182+0000","last_active":"2023-05-12T09:07:15.056869+0000","last_peered":"2023-05-12T09:07:15.056869+0000","last_clean":"2023-05-12T09:07:15.056869+0000","last_became_active":"2023-05-12T09:07:10.551926+0000","last_became_peered":"2023-05-12T09:07:10.551926+0000","last_unstale":"2023-05-12T09:07:15.056869+0000","last_undegraded":"2023-05-12T09:07:15.056869+0000","last_fullsized":"2023-05-12T09:07:15.056869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:06:10.158751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098056+0000","last_change":"2023-05-12T09:07:10.565186+0000","last_active":"2023-05-12T09:07:15.098056+0000","last_peered":"2023-05-12T09:07:15.098056+0000","last_clean":"2023-05-12T09:07:15.098056+0000","last_became_active":"2023-05-12T09:07:10.564909+0000","last_became_peered":"2023-05-12T09:07:10.564909+0000","last_unstale":"2023-05-12T09:07:15.098056+0000","last_undegraded":"2023-05-12T09:07:15.098056+0000","last_fullsized":"2023-05-12T09:07:15.098056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:58:56.835652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099010+0000","last_change":"2023-05-12T09:07:10.573666+0000","last_active":"2023-05-12T09:07:15.099010+0000","last_peered":"2023-05-12T09:07:15.099010+0000","last_clean":"2023-05-12T09:07:15.099010+0000","last_became_active":"2023-05-12T09:07:10.573426+0000","last_became_peered":"2023-05-12T09:07:10.573426+0000","last_unstale":"2023-05-12T09:07:15.099010+0000","last_undegraded":"2023-05-12T09:07:15.099010+0000","last_fullsized":"2023-05-12T09:07:15.099010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:31:46.429695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058452+0000","last_change":"2023-05-12T09:07:10.549143+0000","last_active":"2023-05-12T09:07:15.058452+0000","last_peered":"2023-05-12T09:07:15.058452+0000","last_clean":"2023-05-12T09:07:15.058452+0000","last_became_active":"2023-05-12T09:07:10.548812+0000","last_became_peered":"2023-05-12T09:07:10.548812+0000","last_unstale":"2023-05-12T09:07:15.058452+0000","last_undegraded":"2023-05-12T09:07:15.058452+0000","last_fullsized":"2023-05-12T09:07:15.058452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:58:25.521877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097939+0000","last_change":"2023-05-12T09:07:10.553470+0000","last_active":"2023-05-12T09:07:15.097939+0000","last_peered":"2023-05-12T09:07:15.097939+0000","last_clean":"2023-05-12T09:07:15.097939+0000","last_became_active":"2023-05-12T09:07:10.552853+0000","last_became_peered":"2023-05-12T09:07:10.552853+0000","last_unstale":"2023-05-12T09:07:15.097939+0000","last_undegraded":"2023-05-12T09:07:15.097939+0000","last_fullsized":"2023-05-12T09:07:15.097939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:46:06.379380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099031+0000","last_change":"2023-05-12T09:07:10.572964+0000","last_active":"2023-05-12T09:07:15.099031+0000","last_peered":"2023-05-12T09:07:15.099031+0000","last_clean":"2023-05-12T09:07:15.099031+0000","last_became_active":"2023-05-12T09:07:10.572655+0000","last_became_peered":"2023-05-12T09:07:10.572655+0000","last_unstale":"2023-05-12T09:07:15.099031+0000","last_undegraded":"2023-05-12T09:07:15.099031+0000","last_fullsized":"2023-05-12T09:07:15.099031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:54.558448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098226+0000","last_change":"2023-05-12T09:07:10.568411+0000","last_active":"2023-05-12T09:07:15.098226+0000","last_peered":"2023-05-12T09:07:15.098226+0000","last_clean":"2023-05-12T09:07:15.098226+0000","last_became_active":"2023-05-12T09:07:10.567921+0000","last_became_peered":"2023-05-12T09:07:10.567921+0000","last_unstale":"2023-05-12T09:07:15.098226+0000","last_undegraded":"2023-05-12T09:07:15.098226+0000","last_fullsized":"2023-05-12T09:07:15.098226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098049+0000","last_change":"2023-05-12T09:07:10.567670+0000","last_active":"2023-05-12T09:07:15.098049+0000","last_peered":"2023-05-12T09:07:15.098049+0000","last_clean":"2023-05-12T09:07:15.098049+0000","last_became_active":"2023-05-12T09:07:10.567354+0000","last_became_peered":"2023-05-12T09:07:10.567354+0000","last_unstale":"2023-05-12T09:07:15.098049+0000","last_undegraded":"2023-05-12T09:07:15.098049+0000","last_fullsized":"2023-05-12T09:07:15.098049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:24:11.877400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097017+0000","last_change":"2023-05-12T09:07:10.559800+0000","last_active":"2023-05-12T09:07:15.097017+0000","last_peered":"2023-05-12T09:07:15.097017+0000","last_clean":"2023-05-12T09:07:15.097017+0000","last_became_active":"2023-05-12T09:07:10.559373+0000","last_became_peered":"2023-05-12T09:07:10.559373+0000","last_unstale":"2023-05-12T09:07:15.097017+0000","last_undegraded":"2023-05-12T09:07:15.097017+0000","last_fullsized":"2023-05-12T09:07:15.097017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098405+0000","last_change":"2023-05-12T09:07:10.557392+0000","last_active":"2023-05-12T09:07:15.098405+0000","last_peered":"2023-05-12T09:07:15.098405+0000","last_clean":"2023-05-12T09:07:15.098405+0000","last_became_active":"2023-05-12T09:07:10.557036+0000","last_became_peered":"2023-05-12T09:07:10.557036+0000","last_unstale":"2023-05-12T09:07:15.098405+0000","last_undegraded":"2023-05-12T09:07:15.098405+0000","last_fullsized":"2023-05-12T09:07:15.098405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:01.116544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099397+0000","last_change":"2023-05-12T09:07:10.569606+0000","last_active":"2023-05-12T09:07:15.099397+0000","last_peered":"2023-05-12T09:07:15.099397+0000","last_clean":"2023-05-12T09:07:15.099397+0000","last_became_active":"2023-05-12T09:07:10.569341+0000","last_became_peered":"2023-05-12T09:07:10.569341+0000","last_unstale":"2023-05-12T09:07:15.099397+0000","last_undegraded":"2023-05-12T09:07:15.099397+0000","last_fullsized":"2023-05-12T09:07:15.099397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:10.845175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056685+0000","last_change":"2023-05-12T09:07:10.572853+0000","last_active":"2023-05-12T09:07:15.056685+0000","last_peered":"2023-05-12T09:07:15.056685+0000","last_clean":"2023-05-12T09:07:15.056685+0000","last_became_active":"2023-05-12T09:07:10.572602+0000","last_became_peered":"2023-05-12T09:07:10.572602+0000","last_unstale":"2023-05-12T09:07:15.056685+0000","last_undegraded":"2023-05-12T09:07:15.056685+0000","last_fullsized":"2023-05-12T09:07:15.056685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:27:20.881878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056707+0000","last_change":"2023-05-12T09:07:10.556787+0000","last_active":"2023-05-12T09:07:15.056707+0000","last_peered":"2023-05-12T09:07:15.056707+0000","last_clean":"2023-05-12T09:07:15.056707+0000","last_became_active":"2023-05-12T09:07:10.556536+0000","last_became_peered":"2023-05-12T09:07:10.556536+0000","last_unstale":"2023-05-12T09:07:15.056707+0000","last_undegraded":"2023-05-12T09:07:15.056707+0000","last_fullsized":"2023-05-12T09:07:15.056707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:49.471362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098243+0000","last_change":"2023-05-12T09:07:10.552674+0000","last_active":"2023-05-12T09:07:15.098243+0000","last_peered":"2023-05-12T09:07:15.098243+0000","last_clean":"2023-05-12T09:07:15.098243+0000","last_became_active":"2023-05-12T09:07:10.552398+0000","last_became_peered":"2023-05-12T09:07:10.552398+0000","last_unstale":"2023-05-12T09:07:15.098243+0000","last_undegraded":"2023-05-12T09:07:15.098243+0000","last_fullsized":"2023-05-12T09:07:15.098243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:11.449230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097981+0000","last_change":"2023-05-12T09:07:10.568235+0000","last_active":"2023-05-12T09:07:15.097981+0000","last_peered":"2023-05-12T09:07:15.097981+0000","last_clean":"2023-05-12T09:07:15.097981+0000","last_became_active":"2023-05-12T09:07:10.567553+0000","last_became_peered":"2023-05-12T09:07:10.567553+0000","last_unstale":"2023-05-12T09:07:15.097981+0000","last_undegraded":"2023-05-12T09:07:15.097981+0000","last_fullsized":"2023-05-12T09:07:15.097981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099513+0000","last_change":"2023-05-12T09:07:10.572841+0000","last_active":"2023-05-12T09:07:15.099513+0000","last_peered":"2023-05-12T09:07:15.099513+0000","last_clean":"2023-05-12T09:07:15.099513+0000","last_became_active":"2023-05-12T09:07:10.572568+0000","last_became_peered":"2023-05-12T09:07:10.572568+0000","last_unstale":"2023-05-12T09:07:15.099513+0000","last_undegraded":"2023-05-12T09:07:15.099513+0000","last_fullsized":"2023-05-12T09:07:15.099513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:58.012080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097155+0000","last_change":"2023-05-12T09:07:10.547094+0000","last_active":"2023-05-12T09:07:15.097155+0000","last_peered":"2023-05-12T09:07:15.097155+0000","last_clean":"2023-05-12T09:07:15.097155+0000","last_became_active":"2023-05-12T09:07:10.546792+0000","last_became_peered":"2023-05-12T09:07:10.546792+0000","last_unstale":"2023-05-12T09:07:15.097155+0000","last_undegraded":"2023-05-12T09:07:15.097155+0000","last_fullsized":"2023-05-12T09:07:15.097155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099265+0000","last_change":"2023-05-12T09:07:10.565515+0000","last_active":"2023-05-12T09:07:15.099265+0000","last_peered":"2023-05-12T09:07:15.099265+0000","last_clean":"2023-05-12T09:07:15.099265+0000","last_became_active":"2023-05-12T09:07:10.565207+0000","last_became_peered":"2023-05-12T09:07:10.565207+0000","last_unstale":"2023-05-12T09:07:15.099265+0000","last_undegraded":"2023-05-12T09:07:15.099265+0000","last_fullsized":"2023-05-12T09:07:15.099265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:49.560027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057002+0000","last_change":"2023-05-12T09:07:10.544063+0000","last_active":"2023-05-12T09:07:15.057002+0000","last_peered":"2023-05-12T09:07:15.057002+0000","last_clean":"2023-05-12T09:07:15.057002+0000","last_became_active":"2023-05-12T09:07:10.543808+0000","last_became_peered":"2023-05-12T09:07:10.543808+0000","last_unstale":"2023-05-12T09:07:15.057002+0000","last_undegraded":"2023-05-12T09:07:15.057002+0000","last_fullsized":"2023-05-12T09:07:15.057002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:31:21.496742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099598+0000","last_change":"2023-05-12T09:07:10.572909+0000","last_active":"2023-05-12T09:07:15.099598+0000","last_peered":"2023-05-12T09:07:15.099598+0000","last_clean":"2023-05-12T09:07:15.099598+0000","last_became_active":"2023-05-12T09:07:10.572159+0000","last_became_peered":"2023-05-12T09:07:10.572159+0000","last_unstale":"2023-05-12T09:07:15.099598+0000","last_undegraded":"2023-05-12T09:07:15.099598+0000","last_fullsized":"2023-05-12T09:07:15.099598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:08.244006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097642+0000","last_change":"2023-05-12T09:07:10.561695+0000","last_active":"2023-05-12T09:07:15.097642+0000","last_peered":"2023-05-12T09:07:15.097642+0000","last_clean":"2023-05-12T09:07:15.097642+0000","last_became_active":"2023-05-12T09:07:10.561421+0000","last_became_peered":"2023-05-12T09:07:10.561421+0000","last_unstale":"2023-05-12T09:07:15.097642+0000","last_undegraded":"2023-05-12T09:07:15.097642+0000","last_fullsized":"2023-05-12T09:07:15.097642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097054+0000","last_change":"2023-05-12T09:07:10.556885+0000","last_active":"2023-05-12T09:07:15.097054+0000","last_peered":"2023-05-12T09:07:15.097054+0000","last_clean":"2023-05-12T09:07:15.097054+0000","last_became_active":"2023-05-12T09:07:10.556648+0000","last_became_peered":"2023-05-12T09:07:10.556648+0000","last_unstale":"2023-05-12T09:07:15.097054+0000","last_undegraded":"2023-05-12T09:07:15.097054+0000","last_fullsized":"2023-05-12T09:07:15.097054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:29.216512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058586+0000","last_change":"2023-05-12T09:07:10.552009+0000","last_active":"2023-05-12T09:07:15.058586+0000","last_peered":"2023-05-12T09:07:15.058586+0000","last_clean":"2023-05-12T09:07:15.058586+0000","last_became_active":"2023-05-12T09:07:10.551526+0000","last_became_peered":"2023-05-12T09:07:10.551526+0000","last_unstale":"2023-05-12T09:07:15.058586+0000","last_undegraded":"2023-05-12T09:07:15.058586+0000","last_fullsized":"2023-05-12T09:07:15.058586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:29:40.632493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097137+0000","last_change":"2023-05-12T09:07:10.565180+0000","last_active":"2023-05-12T09:07:15.097137+0000","last_peered":"2023-05-12T09:07:15.097137+0000","last_clean":"2023-05-12T09:07:15.097137+0000","last_became_active":"2023-05-12T09:07:10.564257+0000","last_became_peered":"2023-05-12T09:07:10.564257+0000","last_unstale":"2023-05-12T09:07:15.097137+0000","last_undegraded":"2023-05-12T09:07:15.097137+0000","last_fullsized":"2023-05-12T09:07:15.097137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:01.116544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097918+0000","last_change":"2023-05-12T09:07:10.566527+0000","last_active":"2023-05-12T09:07:15.097918+0000","last_peered":"2023-05-12T09:07:15.097918+0000","last_clean":"2023-05-12T09:07:15.097918+0000","last_became_active":"2023-05-12T09:07:10.566257+0000","last_became_peered":"2023-05-12T09:07:10.566257+0000","last_unstale":"2023-05-12T09:07:15.097918+0000","last_undegraded":"2023-05-12T09:07:15.097918+0000","last_fullsized":"2023-05-12T09:07:15.097918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097456+0000","last_change":"2023-05-12T09:07:10.569619+0000","last_active":"2023-05-12T09:07:15.097456+0000","last_peered":"2023-05-12T09:07:15.097456+0000","last_clean":"2023-05-12T09:07:15.097456+0000","last_became_active":"2023-05-12T09:07:10.569336+0000","last_became_peered":"2023-05-12T09:07:10.569336+0000","last_unstale":"2023-05-12T09:07:15.097456+0000","last_undegraded":"2023-05-12T09:07:15.097456+0000","last_fullsized":"2023-05-12T09:07:15.097456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099394+0000","last_change":"2023-05-12T09:07:10.560495+0000","last_active":"2023-05-12T09:07:15.099394+0000","last_peered":"2023-05-12T09:07:15.099394+0000","last_clean":"2023-05-12T09:07:15.099394+0000","last_became_active":"2023-05-12T09:07:10.560049+0000","last_became_peered":"2023-05-12T09:07:10.560049+0000","last_unstale":"2023-05-12T09:07:15.099394+0000","last_undegraded":"2023-05-12T09:07:15.099394+0000","last_fullsized":"2023-05-12T09:07:15.099394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:27:05.047259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099295+0000","last_change":"2023-05-12T09:07:14.597955+0000","last_active":"2023-05-12T09:07:15.099295+0000","last_peered":"2023-05-12T09:07:15.099295+0000","last_clean":"2023-05-12T09:07:15.099295+0000","last_became_active":"2023-05-12T09:07:14.597429+0000","last_became_peered":"2023-05-12T09:07:14.597429+0000","last_unstale":"2023-05-12T09:07:15.099295+0000","last_undegraded":"2023-05-12T09:07:15.099295+0000","last_fullsized":"2023-05-12T09:07:15.099295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:42.341874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098315+0000","last_change":"2023-05-12T09:07:10.075419+0000","last_active":"2023-05-12T09:07:15.098315+0000","last_peered":"2023-05-12T09:07:15.098315+0000","last_clean":"2023-05-12T09:07:15.098315+0000","last_became_active":"2023-05-12T09:07:10.075045+0000","last_became_peered":"2023-05-12T09:07:10.075045+0000","last_unstale":"2023-05-12T09:07:15.098315+0000","last_undegraded":"2023-05-12T09:07:15.098315+0000","last_fullsized":"2023-05-12T09:07:15.098315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:46:05.372940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059049+0000","last_change":"2023-05-12T09:07:10.556737+0000","last_active":"2023-05-12T09:07:15.059049+0000","last_peered":"2023-05-12T09:07:15.059049+0000","last_clean":"2023-05-12T09:07:15.059049+0000","last_became_active":"2023-05-12T09:07:10.556495+0000","last_became_peered":"2023-05-12T09:07:10.556495+0000","last_unstale":"2023-05-12T09:07:15.059049+0000","last_undegraded":"2023-05-12T09:07:15.059049+0000","last_fullsized":"2023-05-12T09:07:15.059049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:49.560027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058830+0000","last_change":"2023-05-12T09:07:14.581307+0000","last_active":"2023-05-12T09:07:15.058830+0000","last_peered":"2023-05-12T09:07:15.058830+0000","last_clean":"2023-05-12T09:07:15.058830+0000","last_became_active":"2023-05-12T09:07:14.580877+0000","last_became_peered":"2023-05-12T09:07:14.580877+0000","last_unstale":"2023-05-12T09:07:15.058830+0000","last_undegraded":"2023-05-12T09:07:15.058830+0000","last_fullsized":"2023-05-12T09:07:15.058830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:19:01.287710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096438+0000","last_change":"2023-05-12T09:07:10.072878+0000","last_active":"2023-05-12T09:07:15.096438+0000","last_peered":"2023-05-12T09:07:15.096438+0000","last_clean":"2023-05-12T09:07:15.096438+0000","last_became_active":"2023-05-12T09:07:10.072354+0000","last_became_peered":"2023-05-12T09:07:10.072354+0000","last_unstale":"2023-05-12T09:07:15.096438+0000","last_undegraded":"2023-05-12T09:07:15.096438+0000","last_fullsized":"2023-05-12T09:07:15.096438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:58:55.829212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097423+0000","last_change":"2023-05-12T09:07:10.560312+0000","last_active":"2023-05-12T09:07:15.097423+0000","last_peered":"2023-05-12T09:07:15.097423+0000","last_clean":"2023-05-12T09:07:15.097423+0000","last_became_active":"2023-05-12T09:07:10.560026+0000","last_became_peered":"2023-05-12T09:07:10.560026+0000","last_unstale":"2023-05-12T09:07:15.097423+0000","last_undegraded":"2023-05-12T09:07:15.097423+0000","last_fullsized":"2023-05-12T09:07:15.097423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:51.153107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097572+0000","last_change":"2023-05-12T09:07:14.588155+0000","last_active":"2023-05-12T09:07:15.097572+0000","last_peered":"2023-05-12T09:07:15.097572+0000","last_clean":"2023-05-12T09:07:15.097572+0000","last_became_active":"2023-05-12T09:07:14.587745+0000","last_became_peered":"2023-05-12T09:07:14.587745+0000","last_unstale":"2023-05-12T09:07:15.097572+0000","last_undegraded":"2023-05-12T09:07:15.097572+0000","last_fullsized":"2023-05-12T09:07:15.097572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:42:22.571545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058871+0000","last_change":"2023-05-12T09:07:10.080957+0000","last_active":"2023-05-12T09:07:15.058871+0000","last_peered":"2023-05-12T09:07:15.058871+0000","last_clean":"2023-05-12T09:07:15.058871+0000","last_became_active":"2023-05-12T09:07:10.080662+0000","last_became_peered":"2023-05-12T09:07:10.080662+0000","last_unstale":"2023-05-12T09:07:15.058871+0000","last_undegraded":"2023-05-12T09:07:15.058871+0000","last_fullsized":"2023-05-12T09:07:15.058871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:52:11.295716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059156+0000","last_change":"2023-05-12T09:07:10.563118+0000","last_active":"2023-05-12T09:07:15.059156+0000","last_peered":"2023-05-12T09:07:15.059156+0000","last_clean":"2023-05-12T09:07:15.059156+0000","last_became_active":"2023-05-12T09:07:10.562749+0000","last_became_peered":"2023-05-12T09:07:10.562749+0000","last_unstale":"2023-05-12T09:07:15.059156+0000","last_undegraded":"2023-05-12T09:07:15.059156+0000","last_fullsized":"2023-05-12T09:07:15.059156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:13:26.432067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058101+0000","last_change":"2023-05-12T09:07:14.581060+0000","last_active":"2023-05-12T09:07:15.058101+0000","last_peered":"2023-05-12T09:07:15.058101+0000","last_clean":"2023-05-12T09:07:15.058101+0000","last_became_active":"2023-05-12T09:07:14.580610+0000","last_became_peered":"2023-05-12T09:07:14.580610+0000","last_unstale":"2023-05-12T09:07:15.058101+0000","last_undegraded":"2023-05-12T09:07:15.058101+0000","last_fullsized":"2023-05-12T09:07:15.058101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T21:04:50.690412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097268+0000","last_change":"2023-05-12T09:07:10.068667+0000","last_active":"2023-05-12T09:07:15.097268+0000","last_peered":"2023-05-12T09:07:15.097268+0000","last_clean":"2023-05-12T09:07:15.097268+0000","last_became_active":"2023-05-12T09:07:10.068386+0000","last_became_peered":"2023-05-12T09:07:10.068386+0000","last_unstale":"2023-05-12T09:07:15.097268+0000","last_undegraded":"2023-05-12T09:07:15.097268+0000","last_fullsized":"2023-05-12T09:07:15.097268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:34:33.760261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058741+0000","last_change":"2023-05-12T09:07:10.565793+0000","last_active":"2023-05-12T09:07:15.058741+0000","last_peered":"2023-05-12T09:07:15.058741+0000","last_clean":"2023-05-12T09:07:15.058741+0000","last_became_active":"2023-05-12T09:07:10.565550+0000","last_became_peered":"2023-05-12T09:07:10.565550+0000","last_unstale":"2023-05-12T09:07:15.058741+0000","last_undegraded":"2023-05-12T09:07:15.058741+0000","last_fullsized":"2023-05-12T09:07:15.058741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:14:42.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096926+0000","last_change":"2023-05-12T09:07:14.595717+0000","last_active":"2023-05-12T09:07:15.096926+0000","last_peered":"2023-05-12T09:07:15.096926+0000","last_clean":"2023-05-12T09:07:15.096926+0000","last_became_active":"2023-05-12T09:07:14.595257+0000","last_became_peered":"2023-05-12T09:07:14.595257+0000","last_unstale":"2023-05-12T09:07:15.096926+0000","last_undegraded":"2023-05-12T09:07:15.096926+0000","last_fullsized":"2023-05-12T09:07:15.096926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:14.949895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098244+0000","last_change":"2023-05-12T09:07:10.070218+0000","last_active":"2023-05-12T09:07:15.098244+0000","last_peered":"2023-05-12T09:07:15.098244+0000","last_clean":"2023-05-12T09:07:15.098244+0000","last_became_active":"2023-05-12T09:07:10.069889+0000","last_became_peered":"2023-05-12T09:07:10.069889+0000","last_unstale":"2023-05-12T09:07:15.098244+0000","last_undegraded":"2023-05-12T09:07:15.098244+0000","last_fullsized":"2023-05-12T09:07:15.098244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:42.081422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058443+0000","last_change":"2023-05-12T09:07:10.560559+0000","last_active":"2023-05-12T09:07:15.058443+0000","last_peered":"2023-05-12T09:07:15.058443+0000","last_clean":"2023-05-12T09:07:15.058443+0000","last_became_active":"2023-05-12T09:07:10.560373+0000","last_became_peered":"2023-05-12T09:07:10.560373+0000","last_unstale":"2023-05-12T09:07:15.058443+0000","last_undegraded":"2023-05-12T09:07:15.058443+0000","last_fullsized":"2023-05-12T09:07:15.058443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:39.228924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059243+0000","last_change":"2023-05-12T09:07:14.598817+0000","last_active":"2023-05-12T09:07:15.059243+0000","last_peered":"2023-05-12T09:07:15.059243+0000","last_clean":"2023-05-12T09:07:15.059243+0000","last_became_active":"2023-05-12T09:07:14.598424+0000","last_became_peered":"2023-05-12T09:07:14.598424+0000","last_unstale":"2023-05-12T09:07:15.059243+0000","last_undegraded":"2023-05-12T09:07:15.059243+0000","last_fullsized":"2023-05-12T09:07:15.059243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:14.345840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097760+0000","last_change":"2023-05-12T09:07:10.079800+0000","last_active":"2023-05-12T09:07:15.097760+0000","last_peered":"2023-05-12T09:07:15.097760+0000","last_clean":"2023-05-12T09:07:15.097760+0000","last_became_active":"2023-05-12T09:07:10.079511+0000","last_became_peered":"2023-05-12T09:07:10.079511+0000","last_unstale":"2023-05-12T09:07:15.097760+0000","last_undegraded":"2023-05-12T09:07:15.097760+0000","last_fullsized":"2023-05-12T09:07:15.097760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:12.733875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097492+0000","last_change":"2023-05-12T09:07:10.567328+0000","last_active":"2023-05-12T09:07:15.097492+0000","last_peered":"2023-05-12T09:07:15.097492+0000","last_clean":"2023-05-12T09:07:15.097492+0000","last_became_active":"2023-05-12T09:07:10.566882+0000","last_became_peered":"2023-05-12T09:07:10.566882+0000","last_unstale":"2023-05-12T09:07:15.097492+0000","last_undegraded":"2023-05-12T09:07:15.097492+0000","last_fullsized":"2023-05-12T09:07:15.097492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:27:05.047259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097631+0000","last_change":"2023-05-12T09:07:14.585280+0000","last_active":"2023-05-12T09:07:15.097631+0000","last_peered":"2023-05-12T09:07:15.097631+0000","last_clean":"2023-05-12T09:07:15.097631+0000","last_became_active":"2023-05-12T09:07:14.584873+0000","last_became_peered":"2023-05-12T09:07:14.584873+0000","last_unstale":"2023-05-12T09:07:15.097631+0000","last_undegraded":"2023-05-12T09:07:15.097631+0000","last_fullsized":"2023-05-12T09:07:15.097631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:17.240980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:29.211417+0000","last_change":"2023-05-12T09:07:10.069756+0000","last_active":"2023-05-12T09:07:29.211417+0000","last_peered":"2023-05-12T09:07:29.211417+0000","last_clean":"2023-05-12T09:07:29.211417+0000","last_became_active":"2023-05-12T09:07:10.069451+0000","last_became_peered":"2023-05-12T09:07:10.069451+0000","last_unstale":"2023-05-12T09:07:29.211417+0000","last_undegraded":"2023-05-12T09:07:29.211417+0000","last_fullsized":"2023-05-12T09:07:29.211417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:09:04.714440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098689+0000","last_change":"2023-05-12T09:07:10.565252+0000","last_active":"2023-05-12T09:07:15.098689+0000","last_peered":"2023-05-12T09:07:15.098689+0000","last_clean":"2023-05-12T09:07:15.098689+0000","last_became_active":"2023-05-12T09:07:10.564960+0000","last_became_peered":"2023-05-12T09:07:10.564960+0000","last_unstale":"2023-05-12T09:07:15.098689+0000","last_undegraded":"2023-05-12T09:07:15.098689+0000","last_fullsized":"2023-05-12T09:07:15.098689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:08:57.701341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099521+0000","last_change":"2023-05-12T09:07:14.595988+0000","last_active":"2023-05-12T09:07:15.099521+0000","last_peered":"2023-05-12T09:07:15.099521+0000","last_clean":"2023-05-12T09:07:15.099521+0000","last_became_active":"2023-05-12T09:07:14.595488+0000","last_became_peered":"2023-05-12T09:07:14.595488+0000","last_unstale":"2023-05-12T09:07:15.099521+0000","last_undegraded":"2023-05-12T09:07:15.099521+0000","last_fullsized":"2023-05-12T09:07:15.099521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:17.240980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097496+0000","last_change":"2023-05-12T09:07:10.079093+0000","last_active":"2023-05-12T09:07:15.097496+0000","last_peered":"2023-05-12T09:07:15.097496+0000","last_clean":"2023-05-12T09:07:15.097496+0000","last_became_active":"2023-05-12T09:07:10.078795+0000","last_became_peered":"2023-05-12T09:07:10.078795+0000","last_unstale":"2023-05-12T09:07:15.097496+0000","last_undegraded":"2023-05-12T09:07:15.097496+0000","last_fullsized":"2023-05-12T09:07:15.097496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:21.054528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058869+0000","last_change":"2023-05-12T09:07:10.565215+0000","last_active":"2023-05-12T09:07:15.058869+0000","last_peered":"2023-05-12T09:07:15.058869+0000","last_clean":"2023-05-12T09:07:15.058869+0000","last_became_active":"2023-05-12T09:07:10.564963+0000","last_became_peered":"2023-05-12T09:07:10.564963+0000","last_unstale":"2023-05-12T09:07:15.058869+0000","last_undegraded":"2023-05-12T09:07:15.058869+0000","last_fullsized":"2023-05-12T09:07:15.058869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:35.146554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059099+0000","last_change":"2023-05-12T09:07:14.584072+0000","last_active":"2023-05-12T09:07:15.059099+0000","last_peered":"2023-05-12T09:07:15.059099+0000","last_clean":"2023-05-12T09:07:15.059099+0000","last_became_active":"2023-05-12T09:07:14.583584+0000","last_became_peered":"2023-05-12T09:07:14.583584+0000","last_unstale":"2023-05-12T09:07:15.059099+0000","last_undegraded":"2023-05-12T09:07:15.059099+0000","last_fullsized":"2023-05-12T09:07:15.059099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:42.341874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097258+0000","last_change":"2023-05-12T09:07:10.066744+0000","last_active":"2023-05-12T09:07:15.097258+0000","last_peered":"2023-05-12T09:07:15.097258+0000","last_clean":"2023-05-12T09:07:15.097258+0000","last_became_active":"2023-05-12T09:07:10.066464+0000","last_became_peered":"2023-05-12T09:07:10.066464+0000","last_unstale":"2023-05-12T09:07:15.097258+0000","last_undegraded":"2023-05-12T09:07:15.097258+0000","last_fullsized":"2023-05-12T09:07:15.097258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:38:11.562367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099293+0000","last_change":"2023-05-12T09:07:10.560309+0000","last_active":"2023-05-12T09:07:15.099293+0000","last_peered":"2023-05-12T09:07:15.099293+0000","last_clean":"2023-05-12T09:07:15.099293+0000","last_became_active":"2023-05-12T09:07:10.559669+0000","last_became_peered":"2023-05-12T09:07:10.559669+0000","last_unstale":"2023-05-12T09:07:15.099293+0000","last_undegraded":"2023-05-12T09:07:15.099293+0000","last_fullsized":"2023-05-12T09:07:15.099293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059044+0000","last_change":"2023-05-12T09:07:14.583910+0000","last_active":"2023-05-12T09:07:15.059044+0000","last_peered":"2023-05-12T09:07:15.059044+0000","last_clean":"2023-05-12T09:07:15.059044+0000","last_became_active":"2023-05-12T09:07:14.583260+0000","last_became_peered":"2023-05-12T09:07:14.583260+0000","last_unstale":"2023-05-12T09:07:15.059044+0000","last_undegraded":"2023-05-12T09:07:15.059044+0000","last_fullsized":"2023-05-12T09:07:15.059044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:11.744671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098106+0000","last_change":"2023-05-12T09:07:10.078179+0000","last_active":"2023-05-12T09:07:15.098106+0000","last_peered":"2023-05-12T09:07:15.098106+0000","last_clean":"2023-05-12T09:07:15.098106+0000","last_became_active":"2023-05-12T09:07:10.077837+0000","last_became_peered":"2023-05-12T09:07:10.077837+0000","last_unstale":"2023-05-12T09:07:15.098106+0000","last_undegraded":"2023-05-12T09:07:15.098106+0000","last_fullsized":"2023-05-12T09:07:15.098106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:28.210072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097897+0000","last_change":"2023-05-12T09:07:10.560712+0000","last_active":"2023-05-12T09:07:15.097897+0000","last_peered":"2023-05-12T09:07:15.097897+0000","last_clean":"2023-05-12T09:07:15.097897+0000","last_became_active":"2023-05-12T09:07:10.560481+0000","last_became_peered":"2023-05-12T09:07:10.560481+0000","last_unstale":"2023-05-12T09:07:15.097897+0000","last_undegraded":"2023-05-12T09:07:15.097897+0000","last_fullsized":"2023-05-12T09:07:15.097897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:37:03.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097898+0000","last_change":"2023-05-12T09:07:14.590864+0000","last_active":"2023-05-12T09:07:15.097898+0000","last_peered":"2023-05-12T09:07:15.097898+0000","last_clean":"2023-05-12T09:07:15.097898+0000","last_became_active":"2023-05-12T09:07:14.590469+0000","last_became_peered":"2023-05-12T09:07:14.590469+0000","last_unstale":"2023-05-12T09:07:15.097898+0000","last_undegraded":"2023-05-12T09:07:15.097898+0000","last_fullsized":"2023-05-12T09:07:15.097898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:28:30.258916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058132+0000","last_change":"2023-05-12T09:07:10.076195+0000","last_active":"2023-05-12T09:07:15.058132+0000","last_peered":"2023-05-12T09:07:15.058132+0000","last_clean":"2023-05-12T09:07:15.058132+0000","last_became_active":"2023-05-12T09:07:10.075812+0000","last_became_peered":"2023-05-12T09:07:10.075812+0000","last_unstale":"2023-05-12T09:07:15.058132+0000","last_undegraded":"2023-05-12T09:07:15.058132+0000","last_fullsized":"2023-05-12T09:07:15.058132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:18:52.025513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059357+0000","last_change":"2023-05-12T09:07:10.563115+0000","last_active":"2023-05-12T09:07:15.059357+0000","last_peered":"2023-05-12T09:07:15.059357+0000","last_clean":"2023-05-12T09:07:15.059357+0000","last_became_active":"2023-05-12T09:07:10.562845+0000","last_became_peered":"2023-05-12T09:07:10.562845+0000","last_unstale":"2023-05-12T09:07:15.059357+0000","last_undegraded":"2023-05-12T09:07:15.059357+0000","last_fullsized":"2023-05-12T09:07:15.059357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:20:22.733100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098372+0000","last_change":"2023-05-12T09:07:14.591597+0000","last_active":"2023-05-12T09:07:15.098372+0000","last_peered":"2023-05-12T09:07:15.098372+0000","last_clean":"2023-05-12T09:07:15.098372+0000","last_became_active":"2023-05-12T09:07:14.591185+0000","last_became_peered":"2023-05-12T09:07:14.591185+0000","last_unstale":"2023-05-12T09:07:15.098372+0000","last_undegraded":"2023-05-12T09:07:15.098372+0000","last_fullsized":"2023-05-12T09:07:15.098372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:38:16.069472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097483+0000","last_change":"2023-05-12T09:07:10.079275+0000","last_active":"2023-05-12T09:07:15.097483+0000","last_peered":"2023-05-12T09:07:15.097483+0000","last_clean":"2023-05-12T09:07:15.097483+0000","last_became_active":"2023-05-12T09:07:10.078985+0000","last_became_peered":"2023-05-12T09:07:10.078985+0000","last_unstale":"2023-05-12T09:07:15.097483+0000","last_undegraded":"2023-05-12T09:07:15.097483+0000","last_fullsized":"2023-05-12T09:07:15.097483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:29:57.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097914+0000","last_change":"2023-05-12T09:07:10.558991+0000","last_active":"2023-05-12T09:07:15.097914+0000","last_peered":"2023-05-12T09:07:15.097914+0000","last_clean":"2023-05-12T09:07:15.097914+0000","last_became_active":"2023-05-12T09:07:10.558695+0000","last_became_peered":"2023-05-12T09:07:10.558695+0000","last_unstale":"2023-05-12T09:07:15.097914+0000","last_undegraded":"2023-05-12T09:07:15.097914+0000","last_fullsized":"2023-05-12T09:07:15.097914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:00:26.351184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056464+0000","last_change":"2023-05-12T09:07:14.586265+0000","last_active":"2023-05-12T09:07:15.056464+0000","last_peered":"2023-05-12T09:07:15.056464+0000","last_clean":"2023-05-12T09:07:15.056464+0000","last_became_active":"2023-05-12T09:07:14.585710+0000","last_became_peered":"2023-05-12T09:07:14.585710+0000","last_unstale":"2023-05-12T09:07:15.056464+0000","last_undegraded":"2023-05-12T09:07:15.056464+0000","last_fullsized":"2023-05-12T09:07:15.056464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:05:38.749407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097889+0000","last_change":"2023-05-12T09:07:10.079611+0000","last_active":"2023-05-12T09:07:15.097889+0000","last_peered":"2023-05-12T09:07:15.097889+0000","last_clean":"2023-05-12T09:07:15.097889+0000","last_became_active":"2023-05-12T09:07:10.079324+0000","last_became_peered":"2023-05-12T09:07:10.079324+0000","last_unstale":"2023-05-12T09:07:15.097889+0000","last_undegraded":"2023-05-12T09:07:15.097889+0000","last_fullsized":"2023-05-12T09:07:15.097889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:34.152879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098310+0000","last_change":"2023-05-12T09:07:10.569420+0000","last_active":"2023-05-12T09:07:15.098310+0000","last_peered":"2023-05-12T09:07:15.098310+0000","last_clean":"2023-05-12T09:07:15.098310+0000","last_became_active":"2023-05-12T09:07:10.569160+0000","last_became_peered":"2023-05-12T09:07:10.569160+0000","last_unstale":"2023-05-12T09:07:15.098310+0000","last_undegraded":"2023-05-12T09:07:15.098310+0000","last_fullsized":"2023-05-12T09:07:15.098310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:01:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056628+0000","last_change":"2023-05-12T09:07:14.585639+0000","last_active":"2023-05-12T09:07:15.056628+0000","last_peered":"2023-05-12T09:07:15.056628+0000","last_clean":"2023-05-12T09:07:15.056628+0000","last_became_active":"2023-05-12T09:07:14.585153+0000","last_became_peered":"2023-05-12T09:07:14.585153+0000","last_unstale":"2023-05-12T09:07:15.056628+0000","last_undegraded":"2023-05-12T09:07:15.056628+0000","last_fullsized":"2023-05-12T09:07:15.056628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:02:03.620298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097546+0000","last_change":"2023-05-12T09:07:10.073391+0000","last_active":"2023-05-12T09:07:15.097546+0000","last_peered":"2023-05-12T09:07:15.097546+0000","last_clean":"2023-05-12T09:07:15.097546+0000","last_became_active":"2023-05-12T09:07:10.073069+0000","last_became_peered":"2023-05-12T09:07:10.073069+0000","last_unstale":"2023-05-12T09:07:15.097546+0000","last_undegraded":"2023-05-12T09:07:15.097546+0000","last_fullsized":"2023-05-12T09:07:15.097546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:24.289481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058350+0000","last_change":"2023-05-12T09:07:10.567111+0000","last_active":"2023-05-12T09:07:15.058350+0000","last_peered":"2023-05-12T09:07:15.058350+0000","last_clean":"2023-05-12T09:07:15.058350+0000","last_became_active":"2023-05-12T09:07:10.566663+0000","last_became_peered":"2023-05-12T09:07:10.566663+0000","last_unstale":"2023-05-12T09:07:15.058350+0000","last_undegraded":"2023-05-12T09:07:15.058350+0000","last_fullsized":"2023-05-12T09:07:15.058350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:32:58.490075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056879+0000","last_change":"2023-05-12T09:07:14.591606+0000","last_active":"2023-05-12T09:07:15.056879+0000","last_peered":"2023-05-12T09:07:15.056879+0000","last_clean":"2023-05-12T09:07:15.056879+0000","last_became_active":"2023-05-12T09:07:14.591207+0000","last_became_peered":"2023-05-12T09:07:14.591207+0000","last_unstale":"2023-05-12T09:07:15.056879+0000","last_undegraded":"2023-05-12T09:07:15.056879+0000","last_fullsized":"2023-05-12T09:07:15.056879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:47:06.214488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097650+0000","last_change":"2023-05-12T09:07:10.072631+0000","last_active":"2023-05-12T09:07:15.097650+0000","last_peered":"2023-05-12T09:07:15.097650+0000","last_clean":"2023-05-12T09:07:15.097650+0000","last_became_active":"2023-05-12T09:07:10.072337+0000","last_became_peered":"2023-05-12T09:07:10.072337+0000","last_unstale":"2023-05-12T09:07:15.097650+0000","last_undegraded":"2023-05-12T09:07:15.097650+0000","last_fullsized":"2023-05-12T09:07:15.097650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:57:12.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098158+0000","last_change":"2023-05-12T09:07:10.565145+0000","last_active":"2023-05-12T09:07:15.098158+0000","last_peered":"2023-05-12T09:07:15.098158+0000","last_clean":"2023-05-12T09:07:15.098158+0000","last_became_active":"2023-05-12T09:07:10.564875+0000","last_became_peered":"2023-05-12T09:07:10.564875+0000","last_unstale":"2023-05-12T09:07:15.098158+0000","last_undegraded":"2023-05-12T09:07:15.098158+0000","last_fullsized":"2023-05-12T09:07:15.098158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:19.840466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056750+0000","last_change":"2023-05-12T09:07:14.587809+0000","last_active":"2023-05-12T09:07:15.056750+0000","last_peered":"2023-05-12T09:07:15.056750+0000","last_clean":"2023-05-12T09:07:15.056750+0000","last_became_active":"2023-05-12T09:07:14.587214+0000","last_became_peered":"2023-05-12T09:07:14.587214+0000","last_unstale":"2023-05-12T09:07:15.056750+0000","last_undegraded":"2023-05-12T09:07:15.056750+0000","last_fullsized":"2023-05-12T09:07:15.056750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:13:57.325469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059145+0000","last_change":"2023-05-12T09:07:10.080418+0000","last_active":"2023-05-12T09:07:15.059145+0000","last_peered":"2023-05-12T09:07:15.059145+0000","last_clean":"2023-05-12T09:07:15.059145+0000","last_became_active":"2023-05-12T09:07:10.080097+0000","last_became_peered":"2023-05-12T09:07:10.080097+0000","last_unstale":"2023-05-12T09:07:15.059145+0000","last_undegraded":"2023-05-12T09:07:15.059145+0000","last_fullsized":"2023-05-12T09:07:15.059145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:36.409374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098730+0000","last_change":"2023-05-12T09:07:10.572418+0000","last_active":"2023-05-12T09:07:15.098730+0000","last_peered":"2023-05-12T09:07:15.098730+0000","last_clean":"2023-05-12T09:07:15.098730+0000","last_became_active":"2023-05-12T09:07:10.571808+0000","last_became_peered":"2023-05-12T09:07:10.571808+0000","last_unstale":"2023-05-12T09:07:15.098730+0000","last_undegraded":"2023-05-12T09:07:15.098730+0000","last_fullsized":"2023-05-12T09:07:15.098730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:41.253320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097248+0000","last_change":"2023-05-12T09:07:14.590970+0000","last_active":"2023-05-12T09:07:15.097248+0000","last_peered":"2023-05-12T09:07:15.097248+0000","last_clean":"2023-05-12T09:07:15.097248+0000","last_became_active":"2023-05-12T09:07:14.590573+0000","last_became_peered":"2023-05-12T09:07:14.590573+0000","last_unstale":"2023-05-12T09:07:15.097248+0000","last_undegraded":"2023-05-12T09:07:15.097248+0000","last_fullsized":"2023-05-12T09:07:15.097248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:28.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058408+0000","last_change":"2023-05-12T09:07:10.071121+0000","last_active":"2023-05-12T09:07:15.058408+0000","last_peered":"2023-05-12T09:07:15.058408+0000","last_clean":"2023-05-12T09:07:15.058408+0000","last_became_active":"2023-05-12T09:07:10.070840+0000","last_became_peered":"2023-05-12T09:07:10.070840+0000","last_unstale":"2023-05-12T09:07:15.058408+0000","last_undegraded":"2023-05-12T09:07:15.058408+0000","last_fullsized":"2023-05-12T09:07:15.058408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:30.198454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098441+0000","last_change":"2023-05-12T09:07:10.566231+0000","last_active":"2023-05-12T09:07:15.098441+0000","last_peered":"2023-05-12T09:07:15.098441+0000","last_clean":"2023-05-12T09:07:15.098441+0000","last_became_active":"2023-05-12T09:07:10.565893+0000","last_became_peered":"2023-05-12T09:07:10.565893+0000","last_unstale":"2023-05-12T09:07:15.098441+0000","last_undegraded":"2023-05-12T09:07:15.098441+0000","last_fullsized":"2023-05-12T09:07:15.098441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:39.228924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098881+0000","last_change":"2023-05-12T09:07:14.593678+0000","last_active":"2023-05-12T09:07:15.098881+0000","last_peered":"2023-05-12T09:07:15.098881+0000","last_clean":"2023-05-12T09:07:15.098881+0000","last_became_active":"2023-05-12T09:07:14.593316+0000","last_became_peered":"2023-05-12T09:07:14.593316+0000","last_unstale":"2023-05-12T09:07:15.098881+0000","last_undegraded":"2023-05-12T09:07:15.098881+0000","last_fullsized":"2023-05-12T09:07:15.098881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:30:02.274700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097913+0000","last_change":"2023-05-12T09:07:10.063181+0000","last_active":"2023-05-12T09:07:15.097913+0000","last_peered":"2023-05-12T09:07:15.097913+0000","last_clean":"2023-05-12T09:07:15.097913+0000","last_became_active":"2023-05-12T09:07:10.062780+0000","last_became_peered":"2023-05-12T09:07:10.062780+0000","last_unstale":"2023-05-12T09:07:15.097913+0000","last_undegraded":"2023-05-12T09:07:15.097913+0000","last_fullsized":"2023-05-12T09:07:15.097913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:17.984136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099317+0000","last_change":"2023-05-12T09:07:10.565492+0000","last_active":"2023-05-12T09:07:15.099317+0000","last_peered":"2023-05-12T09:07:15.099317+0000","last_clean":"2023-05-12T09:07:15.099317+0000","last_became_active":"2023-05-12T09:07:10.565230+0000","last_became_peered":"2023-05-12T09:07:10.565230+0000","last_unstale":"2023-05-12T09:07:15.099317+0000","last_undegraded":"2023-05-12T09:07:15.099317+0000","last_fullsized":"2023-05-12T09:07:15.099317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:37.415814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098778+0000","last_change":"2023-05-12T09:07:14.598561+0000","last_active":"2023-05-12T09:07:15.098778+0000","last_peered":"2023-05-12T09:07:15.098778+0000","last_clean":"2023-05-12T09:07:15.098778+0000","last_became_active":"2023-05-12T09:07:14.598166+0000","last_became_peered":"2023-05-12T09:07:14.598166+0000","last_unstale":"2023-05-12T09:07:15.098778+0000","last_undegraded":"2023-05-12T09:07:15.098778+0000","last_fullsized":"2023-05-12T09:07:15.098778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:57:23.396980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058526+0000","last_change":"2023-05-12T09:07:10.073569+0000","last_active":"2023-05-12T09:07:15.058526+0000","last_peered":"2023-05-12T09:07:15.058526+0000","last_clean":"2023-05-12T09:07:15.058526+0000","last_became_active":"2023-05-12T09:07:10.073359+0000","last_became_peered":"2023-05-12T09:07:10.073359+0000","last_unstale":"2023-05-12T09:07:15.058526+0000","last_undegraded":"2023-05-12T09:07:15.058526+0000","last_fullsized":"2023-05-12T09:07:15.058526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:03:07.204680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098024+0000","last_change":"2023-05-12T09:07:10.564749+0000","last_active":"2023-05-12T09:07:15.098024+0000","last_peered":"2023-05-12T09:07:15.098024+0000","last_clean":"2023-05-12T09:07:15.098024+0000","last_became_active":"2023-05-12T09:07:10.564200+0000","last_became_peered":"2023-05-12T09:07:10.564200+0000","last_unstale":"2023-05-12T09:07:15.098024+0000","last_undegraded":"2023-05-12T09:07:15.098024+0000","last_fullsized":"2023-05-12T09:07:15.098024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:29.216512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099214+0000","last_change":"2023-05-12T09:07:14.598427+0000","last_active":"2023-05-12T09:07:15.099214+0000","last_peered":"2023-05-12T09:07:15.099214+0000","last_clean":"2023-05-12T09:07:15.099214+0000","last_became_active":"2023-05-12T09:07:14.598011+0000","last_became_peered":"2023-05-12T09:07:14.598011+0000","last_unstale":"2023-05-12T09:07:15.099214+0000","last_undegraded":"2023-05-12T09:07:15.099214+0000","last_fullsized":"2023-05-12T09:07:15.099214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:52:15.802821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059169+0000","last_change":"2023-05-12T09:07:10.073900+0000","last_active":"2023-05-12T09:07:15.059169+0000","last_peered":"2023-05-12T09:07:15.059169+0000","last_clean":"2023-05-12T09:07:15.059169+0000","last_became_active":"2023-05-12T09:07:10.073595+0000","last_became_peered":"2023-05-12T09:07:10.073595+0000","last_unstale":"2023-05-12T09:07:15.059169+0000","last_undegraded":"2023-05-12T09:07:15.059169+0000","last_fullsized":"2023-05-12T09:07:15.059169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:09:04.714440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098675+0000","last_change":"2023-05-12T09:07:04.835422+0000","last_active":"2023-05-12T09:07:15.098675+0000","last_peered":"2023-05-12T09:07:15.098675+0000","last_clean":"2023-05-12T09:07:15.098675+0000","last_became_active":"2023-05-12T09:07:04.834944+0000","last_became_peered":"2023-05-12T09:07:04.834944+0000","last_unstale":"2023-05-12T09:07:15.098675+0000","last_undegraded":"2023-05-12T09:07:15.098675+0000","last_fullsized":"2023-05-12T09:07:15.098675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:29:34.402135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058443+0000","last_change":"2023-05-12T09:07:10.557866+0000","last_active":"2023-05-12T09:07:15.058443+0000","last_peered":"2023-05-12T09:07:15.058443+0000","last_clean":"2023-05-12T09:07:15.058443+0000","last_became_active":"2023-05-12T09:07:10.557613+0000","last_became_peered":"2023-05-12T09:07:10.557613+0000","last_unstale":"2023-05-12T09:07:15.058443+0000","last_undegraded":"2023-05-12T09:07:15.058443+0000","last_fullsized":"2023-05-12T09:07:15.058443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:41.253320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058370+0000","last_change":"2023-05-12T09:07:14.596466+0000","last_active":"2023-05-12T09:07:15.058370+0000","last_peered":"2023-05-12T09:07:15.058370+0000","last_clean":"2023-05-12T09:07:15.058370+0000","last_became_active":"2023-05-12T09:07:14.595765+0000","last_became_peered":"2023-05-12T09:07:14.595765+0000","last_unstale":"2023-05-12T09:07:15.058370+0000","last_undegraded":"2023-05-12T09:07:15.058370+0000","last_fullsized":"2023-05-12T09:07:15.058370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:23.341131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058733+0000","last_change":"2023-05-12T09:07:04.828759+0000","last_active":"2023-05-12T09:07:15.058733+0000","last_peered":"2023-05-12T09:07:15.058733+0000","last_clean":"2023-05-12T09:07:15.058733+0000","last_became_active":"2023-05-12T09:07:04.828460+0000","last_became_peered":"2023-05-12T09:07:04.828460+0000","last_unstale":"2023-05-12T09:07:15.058733+0000","last_undegraded":"2023-05-12T09:07:15.058733+0000","last_fullsized":"2023-05-12T09:07:15.058733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:08:51.470983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097285+0000","last_change":"2023-05-12T09:07:10.074451+0000","last_active":"2023-05-12T09:07:15.097285+0000","last_peered":"2023-05-12T09:07:15.097285+0000","last_clean":"2023-05-12T09:07:15.097285+0000","last_became_active":"2023-05-12T09:07:10.074189+0000","last_became_peered":"2023-05-12T09:07:10.074189+0000","last_unstale":"2023-05-12T09:07:15.097285+0000","last_undegraded":"2023-05-12T09:07:15.097285+0000","last_fullsized":"2023-05-12T09:07:15.097285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:31:30.209986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098050+0000","last_change":"2023-05-12T09:07:10.574648+0000","last_active":"2023-05-12T09:07:15.098050+0000","last_peered":"2023-05-12T09:07:15.098050+0000","last_clean":"2023-05-12T09:07:15.098050+0000","last_became_active":"2023-05-12T09:07:10.573975+0000","last_became_peered":"2023-05-12T09:07:10.573975+0000","last_unstale":"2023-05-12T09:07:15.098050+0000","last_undegraded":"2023-05-12T09:07:15.098050+0000","last_fullsized":"2023-05-12T09:07:15.098050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:11:46.901235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098514+0000","last_change":"2023-05-12T09:07:14.596807+0000","last_active":"2023-05-12T09:07:15.098514+0000","last_peered":"2023-05-12T09:07:15.098514+0000","last_clean":"2023-05-12T09:07:15.098514+0000","last_became_active":"2023-05-12T09:07:14.596455+0000","last_became_peered":"2023-05-12T09:07:14.596455+0000","last_unstale":"2023-05-12T09:07:15.098514+0000","last_undegraded":"2023-05-12T09:07:15.098514+0000","last_fullsized":"2023-05-12T09:07:15.098514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:15.456994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096671+0000","last_change":"2023-05-12T09:07:04.830658+0000","last_active":"2023-05-12T09:07:15.096671+0000","last_peered":"2023-05-12T09:07:15.096671+0000","last_clean":"2023-05-12T09:07:15.096671+0000","last_became_active":"2023-05-12T09:07:04.830354+0000","last_became_peered":"2023-05-12T09:07:04.830354+0000","last_unstale":"2023-05-12T09:07:15.096671+0000","last_undegraded":"2023-05-12T09:07:15.096671+0000","last_fullsized":"2023-05-12T09:07:15.096671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:25:54.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097236+0000","last_change":"2023-05-12T09:07:04.830850+0000","last_active":"2023-05-12T09:07:15.097236+0000","last_peered":"2023-05-12T09:07:15.097236+0000","last_clean":"2023-05-12T09:07:15.097236+0000","last_became_active":"2023-05-12T09:07:04.829577+0000","last_became_peered":"2023-05-12T09:07:04.829577+0000","last_unstale":"2023-05-12T09:07:15.097236+0000","last_undegraded":"2023-05-12T09:07:15.097236+0000","last_fullsized":"2023-05-12T09:07:15.097236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:42.458296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096795+0000","last_change":"2023-05-12T09:07:10.078248+0000","last_active":"2023-05-12T09:07:15.096795+0000","last_peered":"2023-05-12T09:07:15.096795+0000","last_clean":"2023-05-12T09:07:15.096795+0000","last_became_active":"2023-05-12T09:07:10.077994+0000","last_became_peered":"2023-05-12T09:07:10.077994+0000","last_unstale":"2023-05-12T09:07:15.096795+0000","last_undegraded":"2023-05-12T09:07:15.096795+0000","last_fullsized":"2023-05-12T09:07:15.096795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:34.152879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097764+0000","last_change":"2023-05-12T09:07:10.557403+0000","last_active":"2023-05-12T09:07:15.097764+0000","last_peered":"2023-05-12T09:07:15.097764+0000","last_clean":"2023-05-12T09:07:15.097764+0000","last_became_active":"2023-05-12T09:07:10.557170+0000","last_became_peered":"2023-05-12T09:07:10.557170+0000","last_unstale":"2023-05-12T09:07:15.097764+0000","last_undegraded":"2023-05-12T09:07:15.097764+0000","last_fullsized":"2023-05-12T09:07:15.097764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:41:05.519844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057360+0000","last_change":"2023-05-12T09:07:14.588875+0000","last_active":"2023-05-12T09:07:15.057360+0000","last_peered":"2023-05-12T09:07:15.057360+0000","last_clean":"2023-05-12T09:07:15.057360+0000","last_became_active":"2023-05-12T09:07:14.587235+0000","last_became_peered":"2023-05-12T09:07:14.587235+0000","last_unstale":"2023-05-12T09:07:15.057360+0000","last_undegraded":"2023-05-12T09:07:15.057360+0000","last_fullsized":"2023-05-12T09:07:15.057360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:48.344758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097643+0000","last_change":"2023-05-12T09:07:05.258677+0000","last_active":"2023-05-12T09:07:15.097643+0000","last_peered":"2023-05-12T09:07:15.097643+0000","last_clean":"2023-05-12T09:07:15.097643+0000","last_became_active":"2023-05-12T09:07:05.258372+0000","last_became_peered":"2023-05-12T09:07:05.258372+0000","last_unstale":"2023-05-12T09:07:15.097643+0000","last_undegraded":"2023-05-12T09:07:15.097643+0000","last_fullsized":"2023-05-12T09:07:15.097643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:26:58.816901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096485+0000","last_change":"2023-05-12T09:07:10.071185+0000","last_active":"2023-05-12T09:07:15.096485+0000","last_peered":"2023-05-12T09:07:15.096485+0000","last_clean":"2023-05-12T09:07:15.096485+0000","last_became_active":"2023-05-12T09:07:10.070930+0000","last_became_peered":"2023-05-12T09:07:10.070930+0000","last_unstale":"2023-05-12T09:07:15.096485+0000","last_undegraded":"2023-05-12T09:07:15.096485+0000","last_fullsized":"2023-05-12T09:07:15.096485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:10.442791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098132+0000","last_change":"2023-05-12T09:07:10.565103+0000","last_active":"2023-05-12T09:07:15.098132+0000","last_peered":"2023-05-12T09:07:15.098132+0000","last_clean":"2023-05-12T09:07:15.098132+0000","last_became_active":"2023-05-12T09:07:10.564782+0000","last_became_peered":"2023-05-12T09:07:10.564782+0000","last_unstale":"2023-05-12T09:07:15.098132+0000","last_undegraded":"2023-05-12T09:07:15.098132+0000","last_fullsized":"2023-05-12T09:07:15.098132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098635+0000","last_change":"2023-05-12T09:07:14.585727+0000","last_active":"2023-05-12T09:07:15.098635+0000","last_peered":"2023-05-12T09:07:15.098635+0000","last_clean":"2023-05-12T09:07:15.098635+0000","last_became_active":"2023-05-12T09:07:14.585342+0000","last_became_peered":"2023-05-12T09:07:14.585342+0000","last_unstale":"2023-05-12T09:07:15.098635+0000","last_undegraded":"2023-05-12T09:07:15.098635+0000","last_fullsized":"2023-05-12T09:07:15.098635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:34:38.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097101+0000","last_change":"2023-05-12T09:07:05.258599+0000","last_active":"2023-05-12T09:07:15.097101+0000","last_peered":"2023-05-12T09:07:15.097101+0000","last_clean":"2023-05-12T09:07:15.097101+0000","last_became_active":"2023-05-12T09:07:05.258301+0000","last_became_peered":"2023-05-12T09:07:05.258301+0000","last_unstale":"2023-05-12T09:07:15.097101+0000","last_undegraded":"2023-05-12T09:07:15.097101+0000","last_fullsized":"2023-05-12T09:07:15.097101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:36.857503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058798+0000","last_change":"2023-05-12T09:07:10.077809+0000","last_active":"2023-05-12T09:07:15.058798+0000","last_peered":"2023-05-12T09:07:15.058798+0000","last_clean":"2023-05-12T09:07:15.058798+0000","last_became_active":"2023-05-12T09:07:10.077502+0000","last_became_peered":"2023-05-12T09:07:10.077502+0000","last_unstale":"2023-05-12T09:07:15.058798+0000","last_undegraded":"2023-05-12T09:07:15.058798+0000","last_fullsized":"2023-05-12T09:07:15.058798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:31:45.423256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058539+0000","last_change":"2023-05-12T09:07:10.569701+0000","last_active":"2023-05-12T09:07:15.058539+0000","last_peered":"2023-05-12T09:07:15.058539+0000","last_clean":"2023-05-12T09:07:15.058539+0000","last_became_active":"2023-05-12T09:07:10.569342+0000","last_became_peered":"2023-05-12T09:07:10.569342+0000","last_unstale":"2023-05-12T09:07:15.058539+0000","last_undegraded":"2023-05-12T09:07:15.058539+0000","last_fullsized":"2023-05-12T09:07:15.058539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:59:18.361363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098305+0000","last_change":"2023-05-12T09:07:14.589783+0000","last_active":"2023-05-12T09:07:15.098305+0000","last_peered":"2023-05-12T09:07:15.098305+0000","last_clean":"2023-05-12T09:07:15.098305+0000","last_became_active":"2023-05-12T09:07:14.589383+0000","last_became_peered":"2023-05-12T09:07:14.589383+0000","last_unstale":"2023-05-12T09:07:15.098305+0000","last_undegraded":"2023-05-12T09:07:15.098305+0000","last_fullsized":"2023-05-12T09:07:15.098305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:42.729589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097652+0000","last_change":"2023-05-12T09:07:05.258734+0000","last_active":"2023-05-12T09:07:15.097652+0000","last_peered":"2023-05-12T09:07:15.097652+0000","last_clean":"2023-05-12T09:07:15.097652+0000","last_became_active":"2023-05-12T09:07:05.258376+0000","last_became_peered":"2023-05-12T09:07:05.258376+0000","last_unstale":"2023-05-12T09:07:15.097652+0000","last_undegraded":"2023-05-12T09:07:15.097652+0000","last_fullsized":"2023-05-12T09:07:15.097652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:41:23.293447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098911+0000","last_change":"2023-05-12T09:07:10.073268+0000","last_active":"2023-05-12T09:07:15.098911+0000","last_peered":"2023-05-12T09:07:15.098911+0000","last_clean":"2023-05-12T09:07:15.098911+0000","last_became_active":"2023-05-12T09:07:10.072997+0000","last_became_peered":"2023-05-12T09:07:10.072997+0000","last_unstale":"2023-05-12T09:07:15.098911+0000","last_undegraded":"2023-05-12T09:07:15.098911+0000","last_fullsized":"2023-05-12T09:07:15.098911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:14:41.536722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096597+0000","last_change":"2023-05-12T09:07:10.561961+0000","last_active":"2023-05-12T09:07:15.096597+0000","last_peered":"2023-05-12T09:07:15.096597+0000","last_clean":"2023-05-12T09:07:15.096597+0000","last_became_active":"2023-05-12T09:07:10.561690+0000","last_became_peered":"2023-05-12T09:07:10.561690+0000","last_unstale":"2023-05-12T09:07:15.096597+0000","last_undegraded":"2023-05-12T09:07:15.096597+0000","last_fullsized":"2023-05-12T09:07:15.096597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:43.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058733+0000","last_change":"2023-05-12T09:07:14.585070+0000","last_active":"2023-05-12T09:07:15.058733+0000","last_peered":"2023-05-12T09:07:15.058733+0000","last_clean":"2023-05-12T09:07:15.058733+0000","last_became_active":"2023-05-12T09:07:14.584656+0000","last_became_peered":"2023-05-12T09:07:14.584656+0000","last_unstale":"2023-05-12T09:07:15.058733+0000","last_undegraded":"2023-05-12T09:07:15.058733+0000","last_fullsized":"2023-05-12T09:07:15.058733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:53:19.096515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058688+0000","last_change":"2023-05-12T09:07:05.258598+0000","last_active":"2023-05-12T09:07:15.058688+0000","last_peered":"2023-05-12T09:07:15.058688+0000","last_clean":"2023-05-12T09:07:15.058688+0000","last_became_active":"2023-05-12T09:07:05.258280+0000","last_became_peered":"2023-05-12T09:07:05.258280+0000","last_unstale":"2023-05-12T09:07:15.058688+0000","last_undegraded":"2023-05-12T09:07:15.058688+0000","last_fullsized":"2023-05-12T09:07:15.058688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:50.177616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096736+0000","last_change":"2023-05-12T09:07:10.072051+0000","last_active":"2023-05-12T09:07:15.096736+0000","last_peered":"2023-05-12T09:07:15.096736+0000","last_clean":"2023-05-12T09:07:15.096736+0000","last_became_active":"2023-05-12T09:07:10.071775+0000","last_became_peered":"2023-05-12T09:07:10.071775+0000","last_unstale":"2023-05-12T09:07:15.096736+0000","last_undegraded":"2023-05-12T09:07:15.096736+0000","last_fullsized":"2023-05-12T09:07:15.096736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:10.949889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097922+0000","last_change":"2023-05-12T09:07:10.558361+0000","last_active":"2023-05-12T09:07:15.097922+0000","last_peered":"2023-05-12T09:07:15.097922+0000","last_clean":"2023-05-12T09:07:15.097922+0000","last_became_active":"2023-05-12T09:07:10.557975+0000","last_became_peered":"2023-05-12T09:07:10.557975+0000","last_unstale":"2023-05-12T09:07:15.097922+0000","last_undegraded":"2023-05-12T09:07:15.097922+0000","last_fullsized":"2023-05-12T09:07:15.097922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:01:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097799+0000","last_change":"2023-05-12T09:07:14.587172+0000","last_active":"2023-05-12T09:07:15.097799+0000","last_peered":"2023-05-12T09:07:15.097799+0000","last_clean":"2023-05-12T09:07:15.097799+0000","last_became_active":"2023-05-12T09:07:14.586671+0000","last_became_peered":"2023-05-12T09:07:14.586671+0000","last_unstale":"2023-05-12T09:07:15.097799+0000","last_undegraded":"2023-05-12T09:07:15.097799+0000","last_fullsized":"2023-05-12T09:07:15.097799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:11:50.401900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059054+0000","last_change":"2023-05-12T09:07:04.830787+0000","last_active":"2023-05-12T09:07:15.059054+0000","last_peered":"2023-05-12T09:07:15.059054+0000","last_clean":"2023-05-12T09:07:15.059054+0000","last_became_active":"2023-05-12T09:07:04.830492+0000","last_became_peered":"2023-05-12T09:07:04.830492+0000","last_unstale":"2023-05-12T09:07:15.059054+0000","last_undegraded":"2023-05-12T09:07:15.059054+0000","last_fullsized":"2023-05-12T09:07:15.059054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:18:33.956760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099144+0000","last_change":"2023-05-12T09:07:10.072970+0000","last_active":"2023-05-12T09:07:15.099144+0000","last_peered":"2023-05-12T09:07:15.099144+0000","last_clean":"2023-05-12T09:07:15.099144+0000","last_became_active":"2023-05-12T09:07:10.072670+0000","last_became_peered":"2023-05-12T09:07:10.072670+0000","last_unstale":"2023-05-12T09:07:15.099144+0000","last_undegraded":"2023-05-12T09:07:15.099144+0000","last_fullsized":"2023-05-12T09:07:15.099144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:21.054528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097023+0000","last_change":"2023-05-12T09:07:10.565493+0000","last_active":"2023-05-12T09:07:15.097023+0000","last_peered":"2023-05-12T09:07:15.097023+0000","last_clean":"2023-05-12T09:07:15.097023+0000","last_became_active":"2023-05-12T09:07:10.565202+0000","last_became_peered":"2023-05-12T09:07:10.565202+0000","last_unstale":"2023-05-12T09:07:15.097023+0000","last_undegraded":"2023-05-12T09:07:15.097023+0000","last_fullsized":"2023-05-12T09:07:15.097023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:22.060968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096821+0000","last_change":"2023-05-12T09:07:14.595394+0000","last_active":"2023-05-12T09:07:15.096821+0000","last_peered":"2023-05-12T09:07:15.096821+0000","last_clean":"2023-05-12T09:07:15.096821+0000","last_became_active":"2023-05-12T09:07:14.594978+0000","last_became_peered":"2023-05-12T09:07:14.594978+0000","last_unstale":"2023-05-12T09:07:15.096821+0000","last_undegraded":"2023-05-12T09:07:15.096821+0000","last_fullsized":"2023-05-12T09:07:15.096821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:52.189320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097791+0000","last_change":"2023-05-12T09:07:10.078522+0000","last_active":"2023-05-12T09:07:15.097791+0000","last_peered":"2023-05-12T09:07:15.097791+0000","last_clean":"2023-05-12T09:07:15.097791+0000","last_became_active":"2023-05-12T09:07:10.078295+0000","last_became_peered":"2023-05-12T09:07:10.078295+0000","last_unstale":"2023-05-12T09:07:15.097791+0000","last_undegraded":"2023-05-12T09:07:15.097791+0000","last_fullsized":"2023-05-12T09:07:15.097791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:17.984136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057055+0000","last_change":"2023-05-12T09:07:10.560192+0000","last_active":"2023-05-12T09:07:15.057055+0000","last_peered":"2023-05-12T09:07:15.057055+0000","last_clean":"2023-05-12T09:07:15.057055+0000","last_became_active":"2023-05-12T09:07:10.559897+0000","last_became_peered":"2023-05-12T09:07:10.559897+0000","last_unstale":"2023-05-12T09:07:15.057055+0000","last_undegraded":"2023-05-12T09:07:15.057055+0000","last_fullsized":"2023-05-12T09:07:15.057055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:25:50.021542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097222+0000","last_change":"2023-05-12T09:07:14.590573+0000","last_active":"2023-05-12T09:07:15.097222+0000","last_peered":"2023-05-12T09:07:15.097222+0000","last_clean":"2023-05-12T09:07:15.097222+0000","last_became_active":"2023-05-12T09:07:14.590176+0000","last_became_peered":"2023-05-12T09:07:14.590176+0000","last_unstale":"2023-05-12T09:07:15.097222+0000","last_undegraded":"2023-05-12T09:07:15.097222+0000","last_fullsized":"2023-05-12T09:07:15.097222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:15.456994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097418+0000","last_change":"2023-05-12T09:07:10.080277+0000","last_active":"2023-05-12T09:07:15.097418+0000","last_peered":"2023-05-12T09:07:15.097418+0000","last_clean":"2023-05-12T09:07:15.097418+0000","last_became_active":"2023-05-12T09:07:10.079936+0000","last_became_peered":"2023-05-12T09:07:10.079936+0000","last_unstale":"2023-05-12T09:07:15.097418+0000","last_undegraded":"2023-05-12T09:07:15.097418+0000","last_fullsized":"2023-05-12T09:07:15.097418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:03:06.647253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098333+0000","last_change":"2023-05-12T09:07:10.569555+0000","last_active":"2023-05-12T09:07:15.098333+0000","last_peered":"2023-05-12T09:07:15.098333+0000","last_clean":"2023-05-12T09:07:15.098333+0000","last_became_active":"2023-05-12T09:07:10.569253+0000","last_became_peered":"2023-05-12T09:07:10.569253+0000","last_unstale":"2023-05-12T09:07:15.098333+0000","last_undegraded":"2023-05-12T09:07:15.098333+0000","last_fullsized":"2023-05-12T09:07:15.098333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:19.840466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098745+0000","last_change":"2023-05-12T09:07:14.588834+0000","last_active":"2023-05-12T09:07:15.098745+0000","last_peered":"2023-05-12T09:07:15.098745+0000","last_clean":"2023-05-12T09:07:15.098745+0000","last_became_active":"2023-05-12T09:07:14.588451+0000","last_became_peered":"2023-05-12T09:07:14.588451+0000","last_unstale":"2023-05-12T09:07:15.098745+0000","last_undegraded":"2023-05-12T09:07:15.098745+0000","last_fullsized":"2023-05-12T09:07:15.098745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:52.189320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099255+0000","last_change":"2023-05-12T09:07:10.078506+0000","last_active":"2023-05-12T09:07:15.099255+0000","last_peered":"2023-05-12T09:07:15.099255+0000","last_clean":"2023-05-12T09:07:15.099255+0000","last_became_active":"2023-05-12T09:07:10.078243+0000","last_became_peered":"2023-05-12T09:07:10.078243+0000","last_unstale":"2023-05-12T09:07:15.099255+0000","last_undegraded":"2023-05-12T09:07:15.099255+0000","last_fullsized":"2023-05-12T09:07:15.099255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:24.289481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098134+0000","last_change":"2023-05-12T09:07:10.570203+0000","last_active":"2023-05-12T09:07:15.098134+0000","last_peered":"2023-05-12T09:07:15.098134+0000","last_clean":"2023-05-12T09:07:15.098134+0000","last_became_active":"2023-05-12T09:07:10.569917+0000","last_became_peered":"2023-05-12T09:07:10.569917+0000","last_unstale":"2023-05-12T09:07:15.098134+0000","last_undegraded":"2023-05-12T09:07:15.098134+0000","last_fullsized":"2023-05-12T09:07:15.098134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:37:03.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098605+0000","last_change":"2023-05-12T09:07:14.591389+0000","last_active":"2023-05-12T09:07:15.098605+0000","last_peered":"2023-05-12T09:07:15.098605+0000","last_clean":"2023-05-12T09:07:15.098605+0000","last_became_active":"2023-05-12T09:07:14.591029+0000","last_became_peered":"2023-05-12T09:07:14.591029+0000","last_unstale":"2023-05-12T09:07:15.098605+0000","last_undegraded":"2023-05-12T09:07:15.098605+0000","last_fullsized":"2023-05-12T09:07:15.098605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:50:10.131123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059215+0000","last_change":"2023-05-12T09:07:10.066391+0000","last_active":"2023-05-12T09:07:15.059215+0000","last_peered":"2023-05-12T09:07:15.059215+0000","last_clean":"2023-05-12T09:07:15.059215+0000","last_became_active":"2023-05-12T09:07:10.066135+0000","last_became_peered":"2023-05-12T09:07:10.066135+0000","last_unstale":"2023-05-12T09:07:15.059215+0000","last_undegraded":"2023-05-12T09:07:15.059215+0000","last_fullsized":"2023-05-12T09:07:15.059215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:57.005641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058832+0000","last_change":"2023-05-12T09:07:10.552090+0000","last_active":"2023-05-12T09:07:15.058832+0000","last_peered":"2023-05-12T09:07:15.058832+0000","last_clean":"2023-05-12T09:07:15.058832+0000","last_became_active":"2023-05-12T09:07:10.551802+0000","last_became_peered":"2023-05-12T09:07:10.551802+0000","last_unstale":"2023-05-12T09:07:15.058832+0000","last_undegraded":"2023-05-12T09:07:15.058832+0000","last_fullsized":"2023-05-12T09:07:15.058832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:54.558448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096851+0000","last_change":"2023-05-12T09:07:14.585407+0000","last_active":"2023-05-12T09:07:15.096851+0000","last_peered":"2023-05-12T09:07:15.096851+0000","last_clean":"2023-05-12T09:07:15.096851+0000","last_became_active":"2023-05-12T09:07:14.585059+0000","last_became_peered":"2023-05-12T09:07:14.585059+0000","last_unstale":"2023-05-12T09:07:15.096851+0000","last_undegraded":"2023-05-12T09:07:15.096851+0000","last_fullsized":"2023-05-12T09:07:15.096851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:30:02.274700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097402+0000","last_change":"2023-05-12T09:07:10.068737+0000","last_active":"2023-05-12T09:07:15.097402+0000","last_peered":"2023-05-12T09:07:15.097402+0000","last_clean":"2023-05-12T09:07:15.097402+0000","last_became_active":"2023-05-12T09:07:10.068427+0000","last_became_peered":"2023-05-12T09:07:10.068427+0000","last_unstale":"2023-05-12T09:07:15.097402+0000","last_undegraded":"2023-05-12T09:07:15.097402+0000","last_fullsized":"2023-05-12T09:07:15.097402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:49:41.703805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098946+0000","last_change":"2023-05-12T09:07:10.565243+0000","last_active":"2023-05-12T09:07:15.098946+0000","last_peered":"2023-05-12T09:07:15.098946+0000","last_clean":"2023-05-12T09:07:15.098946+0000","last_became_active":"2023-05-12T09:07:10.564923+0000","last_became_peered":"2023-05-12T09:07:10.564923+0000","last_unstale":"2023-05-12T09:07:15.098946+0000","last_undegraded":"2023-05-12T09:07:15.098946+0000","last_fullsized":"2023-05-12T09:07:15.098946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:35.146554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058306+0000","last_change":"2023-05-12T09:07:10.554737+0000","last_active":"2023-05-12T09:07:15.058306+0000","last_peered":"2023-05-12T09:07:15.058306+0000","last_clean":"2023-05-12T09:07:15.058306+0000","last_became_active":"2023-05-12T09:07:10.554481+0000","last_became_peered":"2023-05-12T09:07:10.554481+0000","last_unstale":"2023-05-12T09:07:15.058306+0000","last_undegraded":"2023-05-12T09:07:15.058306+0000","last_fullsized":"2023-05-12T09:07:15.058306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:07:09.286879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058533+0000","last_change":"2023-05-12T09:07:10.551816+0000","last_active":"2023-05-12T09:07:15.058533+0000","last_peered":"2023-05-12T09:07:15.058533+0000","last_clean":"2023-05-12T09:07:15.058533+0000","last_became_active":"2023-05-12T09:07:10.551522+0000","last_became_peered":"2023-05-12T09:07:10.551522+0000","last_unstale":"2023-05-12T09:07:15.058533+0000","last_undegraded":"2023-05-12T09:07:15.058533+0000","last_fullsized":"2023-05-12T09:07:15.058533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:50:06.630457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098592+0000","last_change":"2023-05-12T09:07:10.565765+0000","last_active":"2023-05-12T09:07:15.098592+0000","last_peered":"2023-05-12T09:07:15.098592+0000","last_clean":"2023-05-12T09:07:15.098592+0000","last_became_active":"2023-05-12T09:07:10.565493+0000","last_became_peered":"2023-05-12T09:07:10.565493+0000","last_unstale":"2023-05-12T09:07:15.098592+0000","last_undegraded":"2023-05-12T09:07:15.098592+0000","last_fullsized":"2023-05-12T09:07:15.098592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:03:08.211119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058766+0000","last_change":"2023-05-12T09:07:10.558789+0000","last_active":"2023-05-12T09:07:15.058766+0000","last_peered":"2023-05-12T09:07:15.058766+0000","last_clean":"2023-05-12T09:07:15.058766+0000","last_became_active":"2023-05-12T09:07:10.557767+0000","last_became_peered":"2023-05-12T09:07:10.557767+0000","last_unstale":"2023-05-12T09:07:15.058766+0000","last_undegraded":"2023-05-12T09:07:15.058766+0000","last_fullsized":"2023-05-12T09:07:15.058766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:57:19.896315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097817+0000","last_change":"2023-05-12T09:07:10.566888+0000","last_active":"2023-05-12T09:07:15.097817+0000","last_peered":"2023-05-12T09:07:15.097817+0000","last_clean":"2023-05-12T09:07:15.097817+0000","last_became_active":"2023-05-12T09:07:10.566580+0000","last_became_peered":"2023-05-12T09:07:10.566580+0000","last_unstale":"2023-05-12T09:07:15.097817+0000","last_undegraded":"2023-05-12T09:07:15.097817+0000","last_fullsized":"2023-05-12T09:07:15.097817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:35.159319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9248,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362592,"statfs":{"total":96636764160,"available":96627294208,"internally_reserved":0,"allocated":876544,"data_stored":699108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9220,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362620,"statfs":{"total":96636764160,"available":96627322880,"internally_reserved":0,"allocated":847872,"data_stored":695098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8132,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363708,"statfs":{"total":96636764160,"available":96628436992,"internally_reserved":0,"allocated":258048,"data_stored":105312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8132,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363708,"statfs":{"total":96636764160,"available":96628436992,"internally_reserved":0,"allocated":258048,"data_stored":104820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8212,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363628,"statfs":{"total":96636764160,"available":96628355072,"internally_reserved":0,"allocated":274432,"data_stored":108580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":104021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-12T09:07:45.395 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-12T09:07:45.613 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.609+0000 7fb2a71ff700 1 Processor -- start 2023-05-12T09:07:45.613 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.610+0000 7fb2a71ff700 1 -- start start 2023-05-12T09:07:45.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.611+0000 7fb2a71ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2a00b87a0 0x7fb2a00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.611+0000 7fb2a71ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fb2a0160d40 0x7fb2a00d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.611+0000 7fb2a71ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a00cdc60 con 0x7fb2a01601e0 2023-05-12T09:07:45.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.611+0000 7fb2a71ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00d02d0 con 0x7fb2a00b87a0 2023-05-12T09:07:45.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.611+0000 7fb2a71ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00d0cb0 con 0x7fb2a0160d40 2023-05-12T09:07:45.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.611+0000 7fb2a4f9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2a00b87a0 0x7fb2a00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.612+0000 7fb2a4f9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2a00b87a0 0x7fb2a00cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57400/0 (socket says 172.21.15.116:57400) 2023-05-12T09:07:45.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.612+0000 7fb2a4f9b700 1 -- 172.21.15.116:0/569649080 learned_addr learned my addr 172.21.15.116:0/569649080 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:45.616 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.612+0000 7fb2a579c700 1 --2- 172.21.15.116:0/569649080 >> v2:172.21.15.182:3300/0 conn(0x7fb2a0160d40 0x7fb2a00d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.617 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.612+0000 7fb2a4f9b700 1 -- 172.21.15.116:0/569649080 >> v2:172.21.15.182:3300/0 conn(0x7fb2a0160d40 msgr2=0x7fb2a00d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:45.617 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.612+0000 7fb2a4f9b700 1 --2- 172.21.15.116:0/569649080 >> v2:172.21.15.182:3300/0 conn(0x7fb2a0160d40 0x7fb2a00d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.617 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.612+0000 7fb2a4f9b700 1 -- 172.21.15.116:0/569649080 >> v1:172.21.15.182:6789/0 conn(0x7fb2a01601e0 legacy=0x7fb2a0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.617 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.612+0000 7fb2a4f9b700 1 -- 172.21.15.116:0/569649080 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a00cd6a0 con 0x7fb2a00b87a0 2023-05-12T09:07:45.617 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.612+0000 7fb2a4f9b700 1 --2- 172.21.15.116:0/569649080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a00b87a0 0x7fb2a00cfbf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00d0820 tx=0x7fb294009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286d97fbc476199 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:45.618 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.612+0000 7fb29f7fe700 1 -- 172.21.15.116:0/569649080 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294011830 con 0x7fb2a00b87a0 2023-05-12T09:07:45.618 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.613+0000 7fb29f7fe700 1 -- 172.21.15.116:0/569649080 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294011990 con 0x7fb2a00b87a0 2023-05-12T09:07:45.618 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.613+0000 7fb29f7fe700 1 -- 172.21.15.116:0/569649080 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294011d20 con 0x7fb2a00b87a0 2023-05-12T09:07:45.618 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.613+0000 7fb2a71ff700 1 -- 172.21.15.116:0/569649080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a00b87a0 msgr2=0x7fb2a00cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.618 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.613+0000 7fb2a71ff700 1 --2- 172.21.15.116:0/569649080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a00b87a0 0x7fb2a00cfbf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00d0820 tx=0x7fb294009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:45.618 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.613+0000 7fb2a71ff700 1 -- 172.21.15.116:0/569649080 shutdown_connections 2023-05-12T09:07:45.618 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.613+0000 7fb2a71ff700 1 --2- 172.21.15.116:0/569649080 >> v2:172.21.15.182:3300/0 conn(0x7fb2a0160d40 0x7fb2a00d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.613+0000 7fb2a71ff700 1 --2- 172.21.15.116:0/569649080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a00b87a0 0x7fb2a00cfbf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.613+0000 7fb2a71ff700 1 -- 172.21.15.116:0/569649080 >> 172.21.15.116:0/569649080 conn(0x7fb2a0071b10 msgr2=0x7fb2a0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:45.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.613+0000 7fb2a71ff700 1 -- 172.21.15.116:0/569649080 shutdown_connections 2023-05-12T09:07:45.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.613+0000 7fb2a71ff700 1 -- 172.21.15.116:0/569649080 wait complete. 2023-05-12T09:07:45.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.615+0000 7fb2a71ff700 1 Processor -- start 2023-05-12T09:07:45.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.615+0000 7fb2a71ff700 1 -- start start 2023-05-12T09:07:45.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb2a71ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb2a00b87a0 0x7fb2a0151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb2a71ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2a01601e0 0x7fb2a00c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb2a71ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a0160d40 0x7fb2a00d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb2a71ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a01517c0 con 0x7fb2a0160d40 2023-05-12T09:07:45.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb2a71ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00c8670 con 0x7fb2a00b87a0 2023-05-12T09:07:45.622 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb2a71ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00c8950 con 0x7fb2a01601e0 2023-05-12T09:07:45.622 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb2a579c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a0160d40 0x7fb2a00d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.622 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb2a579c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a0160d40 0x7fb2a00d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57412/0 (socket says 172.21.15.116:57412) 2023-05-12T09:07:45.622 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb2a579c700 1 -- 172.21.15.116:0/2390614322 learned_addr learned my addr 172.21.15.116:0/2390614322 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:45.622 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb2a4f9b700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb2a00b87a0 0x7fb2a0151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.622 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.616+0000 7fb29ffff700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2a01601e0 0x7fb2a00c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.622 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb2a579c700 1 -- 172.21.15.116:0/2390614322 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2a01601e0 msgr2=0x7fb2a00c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb2a579c700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2a01601e0 0x7fb2a00c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb2a579c700 1 -- 172.21.15.116:0/2390614322 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb2a00b87a0 msgr2=0x7fb2a0151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb2a579c700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb2a00b87a0 0x7fb2a0151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb2a579c700 1 -- 172.21.15.116:0/2390614322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb294009550 con 0x7fb2a0160d40 2023-05-12T09:07:45.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb29ffff700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2a01601e0 0x7fb2a00c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:45.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb2a579c700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a0160d40 0x7fb2a00d1b70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb29800efc0 tx=0x7fb29800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:45.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb29d7fa700 1 -- 172.21.15.116:0/2390614322 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29800cb80 con 0x7fb2a0160d40 2023-05-12T09:07:45.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb29d7fa700 1 -- 172.21.15.116:0/2390614322 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29800f040 con 0x7fb2a0160d40 2023-05-12T09:07:45.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb2a71ff700 1 -- 172.21.15.116:0/2390614322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a00d1640 con 0x7fb2a0160d40 2023-05-12T09:07:45.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb29d7fa700 1 -- 172.21.15.116:0/2390614322 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298014480 con 0x7fb2a0160d40 2023-05-12T09:07:45.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.617+0000 7fb2a71ff700 1 -- 172.21.15.116:0/2390614322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a00cd980 con 0x7fb2a0160d40 2023-05-12T09:07:45.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.618+0000 7fb2a71ff700 1 -- 172.21.15.116:0/2390614322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a00d17d0 con 0x7fb2a0160d40 2023-05-12T09:07:45.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.619+0000 7fb29d7fa700 1 -- 172.21.15.116:0/2390614322 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb2980145e0 con 0x7fb2a0160d40 2023-05-12T09:07:45.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.620+0000 7fb29d7fa700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb28406ace0 0x7fb28406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:45.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.620+0000 7fb29d7fa700 1 -- 172.21.15.116:0/2390614322 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb298089ff0 con 0x7fb2a0160d40 2023-05-12T09:07:45.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.621+0000 7fb2a4f9b700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb28406ace0 0x7fb28406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:45.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.621+0000 7fb2a4f9b700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb28406ace0 0x7fb28406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb294009870 tx=0x7fb294008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:45.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.625+0000 7fb29d7fa700 1 -- 172.21.15.116:0/2390614322 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb2980bc2d0 con 0x7fb2a0160d40 2023-05-12T09:07:45.818 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.815+0000 7fb2a71ff700 1 -- 172.21.15.116:0/2390614322 --> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2a00c8ac0 con 0x7fb28406ace0 2023-05-12T09:07:45.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.825+0000 7fb29d7fa700 1 -- 172.21.15.116:0/2390614322 <== mgr.4106 v2:172.21.15.116:6832/3989593778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367468 (secure 0 0 0) 0x7fb2a00c8ac0 con 0x7fb28406ace0 2023-05-12T09:07:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:45.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 -- 172.21.15.116:0/2390614322 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb28406ace0 msgr2=0x7fb28406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb28406ace0 0x7fb28406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb294009870 tx=0x7fb294008030 comp rx=0 tx=0).stop 2023-05-12T09:07:45.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 -- 172.21.15.116:0/2390614322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a0160d40 msgr2=0x7fb2a00d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:45.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a0160d40 0x7fb2a00d1b70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb29800efc0 tx=0x7fb29800c0c0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 -- 172.21.15.116:0/2390614322 shutdown_connections 2023-05-12T09:07:45.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2a0160d40 0x7fb2a00d1b70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb2a00b87a0 0x7fb2a0151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb28406ace0 0x7fb28406d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 --2- 172.21.15.116:0/2390614322 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2a01601e0 0x7fb2a00c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:45.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 -- 172.21.15.116:0/2390614322 >> 172.21.15.116:0/2390614322 conn(0x7fb2a0071b10 msgr2=0x7fb2a0071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:45.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 -- 172.21.15.116:0/2390614322 shutdown_connections 2023-05-12T09:07:45.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:45.830+0000 7fb2a71ff700 1 -- 172.21.15.116:0/2390614322 wait complete. 2023-05-12T09:07:45.837 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2023-05-12T09:07:45.851 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-05-12T09:07:45.575805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67068,"kb_used_data":3196,"kb_used_omap":0,"kb_used_meta":63808,"kb_avail":754907652,"statfs":{"total":773094113280,"available":773025435648,"internally_reserved":0,"allocated":3272704,"data_stored":2023677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65339392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003038"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056869+0000","last_change":"2023-05-12T09:07:10.552182+0000","last_active":"2023-05-12T09:07:15.056869+0000","last_peered":"2023-05-12T09:07:15.056869+0000","last_clean":"2023-05-12T09:07:15.056869+0000","last_became_active":"2023-05-12T09:07:10.551926+0000","last_became_peered":"2023-05-12T09:07:10.551926+0000","last_unstale":"2023-05-12T09:07:15.056869+0000","last_undegraded":"2023-05-12T09:07:15.056869+0000","last_fullsized":"2023-05-12T09:07:15.056869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:06:10.158751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098056+0000","last_change":"2023-05-12T09:07:10.565186+0000","last_active":"2023-05-12T09:07:15.098056+0000","last_peered":"2023-05-12T09:07:15.098056+0000","last_clean":"2023-05-12T09:07:15.098056+0000","last_became_active":"2023-05-12T09:07:10.564909+0000","last_became_peered":"2023-05-12T09:07:10.564909+0000","last_unstale":"2023-05-12T09:07:15.098056+0000","last_undegraded":"2023-05-12T09:07:15.098056+0000","last_fullsized":"2023-05-12T09:07:15.098056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:58:56.835652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099010+0000","last_change":"2023-05-12T09:07:10.573666+0000","last_active":"2023-05-12T09:07:15.099010+0000","last_peered":"2023-05-12T09:07:15.099010+0000","last_clean":"2023-05-12T09:07:15.099010+0000","last_became_active":"2023-05-12T09:07:10.573426+0000","last_became_peered":"2023-05-12T09:07:10.573426+0000","last_unstale":"2023-05-12T09:07:15.099010+0000","last_undegraded":"2023-05-12T09:07:15.099010+0000","last_fullsized":"2023-05-12T09:07:15.099010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:31:46.429695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058452+0000","last_change":"2023-05-12T09:07:10.549143+0000","last_active":"2023-05-12T09:07:15.058452+0000","last_peered":"2023-05-12T09:07:15.058452+0000","last_clean":"2023-05-12T09:07:15.058452+0000","last_became_active":"2023-05-12T09:07:10.548812+0000","last_became_peered":"2023-05-12T09:07:10.548812+0000","last_unstale":"2023-05-12T09:07:15.058452+0000","last_undegraded":"2023-05-12T09:07:15.058452+0000","last_fullsized":"2023-05-12T09:07:15.058452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:58:25.521877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097939+0000","last_change":"2023-05-12T09:07:10.553470+0000","last_active":"2023-05-12T09:07:15.097939+0000","last_peered":"2023-05-12T09:07:15.097939+0000","last_clean":"2023-05-12T09:07:15.097939+0000","last_became_active":"2023-05-12T09:07:10.552853+0000","last_became_peered":"2023-05-12T09:07:10.552853+0000","last_unstale":"2023-05-12T09:07:15.097939+0000","last_undegraded":"2023-05-12T09:07:15.097939+0000","last_fullsized":"2023-05-12T09:07:15.097939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:46:06.379380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099031+0000","last_change":"2023-05-12T09:07:10.572964+0000","last_active":"2023-05-12T09:07:15.099031+0000","last_peered":"2023-05-12T09:07:15.099031+0000","last_clean":"2023-05-12T09:07:15.099031+0000","last_became_active":"2023-05-12T09:07:10.572655+0000","last_became_peered":"2023-05-12T09:07:10.572655+0000","last_unstale":"2023-05-12T09:07:15.099031+0000","last_undegraded":"2023-05-12T09:07:15.099031+0000","last_fullsized":"2023-05-12T09:07:15.099031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:54.558448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098226+0000","last_change":"2023-05-12T09:07:10.568411+0000","last_active":"2023-05-12T09:07:15.098226+0000","last_peered":"2023-05-12T09:07:15.098226+0000","last_clean":"2023-05-12T09:07:15.098226+0000","last_became_active":"2023-05-12T09:07:10.567921+0000","last_became_peered":"2023-05-12T09:07:10.567921+0000","last_unstale":"2023-05-12T09:07:15.098226+0000","last_undegraded":"2023-05-12T09:07:15.098226+0000","last_fullsized":"2023-05-12T09:07:15.098226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098049+0000","last_change":"2023-05-12T09:07:10.567670+0000","last_active":"2023-05-12T09:07:15.098049+0000","last_peered":"2023-05-12T09:07:15.098049+0000","last_clean":"2023-05-12T09:07:15.098049+0000","last_became_active":"2023-05-12T09:07:10.567354+0000","last_became_peered":"2023-05-12T09:07:10.567354+0000","last_unstale":"2023-05-12T09:07:15.098049+0000","last_undegraded":"2023-05-12T09:07:15.098049+0000","last_fullsized":"2023-05-12T09:07:15.098049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:24:11.877400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097017+0000","last_change":"2023-05-12T09:07:10.559800+0000","last_active":"2023-05-12T09:07:15.097017+0000","last_peered":"2023-05-12T09:07:15.097017+0000","last_clean":"2023-05-12T09:07:15.097017+0000","last_became_active":"2023-05-12T09:07:10.559373+0000","last_became_peered":"2023-05-12T09:07:10.559373+0000","last_unstale":"2023-05-12T09:07:15.097017+0000","last_undegraded":"2023-05-12T09:07:15.097017+0000","last_fullsized":"2023-05-12T09:07:15.097017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098405+0000","last_change":"2023-05-12T09:07:10.557392+0000","last_active":"2023-05-12T09:07:15.098405+0000","last_peered":"2023-05-12T09:07:15.098405+0000","last_clean":"2023-05-12T09:07:15.098405+0000","last_became_active":"2023-05-12T09:07:10.557036+0000","last_became_peered":"2023-05-12T09:07:10.557036+0000","last_unstale":"2023-05-12T09:07:15.098405+0000","last_undegraded":"2023-05-12T09:07:15.098405+0000","last_fullsized":"2023-05-12T09:07:15.098405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:01.116544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099397+0000","last_change":"2023-05-12T09:07:10.569606+0000","last_active":"2023-05-12T09:07:15.099397+0000","last_peered":"2023-05-12T09:07:15.099397+0000","last_clean":"2023-05-12T09:07:15.099397+0000","last_became_active":"2023-05-12T09:07:10.569341+0000","last_became_peered":"2023-05-12T09:07:10.569341+0000","last_unstale":"2023-05-12T09:07:15.099397+0000","last_undegraded":"2023-05-12T09:07:15.099397+0000","last_fullsized":"2023-05-12T09:07:15.099397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:10.845175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056685+0000","last_change":"2023-05-12T09:07:10.572853+0000","last_active":"2023-05-12T09:07:15.056685+0000","last_peered":"2023-05-12T09:07:15.056685+0000","last_clean":"2023-05-12T09:07:15.056685+0000","last_became_active":"2023-05-12T09:07:10.572602+0000","last_became_peered":"2023-05-12T09:07:10.572602+0000","last_unstale":"2023-05-12T09:07:15.056685+0000","last_undegraded":"2023-05-12T09:07:15.056685+0000","last_fullsized":"2023-05-12T09:07:15.056685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:27:20.881878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056707+0000","last_change":"2023-05-12T09:07:10.556787+0000","last_active":"2023-05-12T09:07:15.056707+0000","last_peered":"2023-05-12T09:07:15.056707+0000","last_clean":"2023-05-12T09:07:15.056707+0000","last_became_active":"2023-05-12T09:07:10.556536+0000","last_became_peered":"2023-05-12T09:07:10.556536+0000","last_unstale":"2023-05-12T09:07:15.056707+0000","last_undegraded":"2023-05-12T09:07:15.056707+0000","last_fullsized":"2023-05-12T09:07:15.056707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:49.471362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098243+0000","last_change":"2023-05-12T09:07:10.552674+0000","last_active":"2023-05-12T09:07:15.098243+0000","last_peered":"2023-05-12T09:07:15.098243+0000","last_clean":"2023-05-12T09:07:15.098243+0000","last_became_active":"2023-05-12T09:07:10.552398+0000","last_became_peered":"2023-05-12T09:07:10.552398+0000","last_unstale":"2023-05-12T09:07:15.098243+0000","last_undegraded":"2023-05-12T09:07:15.098243+0000","last_fullsized":"2023-05-12T09:07:15.098243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:11.449230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097981+0000","last_change":"2023-05-12T09:07:10.568235+0000","last_active":"2023-05-12T09:07:15.097981+0000","last_peered":"2023-05-12T09:07:15.097981+0000","last_clean":"2023-05-12T09:07:15.097981+0000","last_became_active":"2023-05-12T09:07:10.567553+0000","last_became_peered":"2023-05-12T09:07:10.567553+0000","last_unstale":"2023-05-12T09:07:15.097981+0000","last_undegraded":"2023-05-12T09:07:15.097981+0000","last_fullsized":"2023-05-12T09:07:15.097981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099513+0000","last_change":"2023-05-12T09:07:10.572841+0000","last_active":"2023-05-12T09:07:15.099513+0000","last_peered":"2023-05-12T09:07:15.099513+0000","last_clean":"2023-05-12T09:07:15.099513+0000","last_became_active":"2023-05-12T09:07:10.572568+0000","last_became_peered":"2023-05-12T09:07:10.572568+0000","last_unstale":"2023-05-12T09:07:15.099513+0000","last_undegraded":"2023-05-12T09:07:15.099513+0000","last_fullsized":"2023-05-12T09:07:15.099513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:58.012080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097155+0000","last_change":"2023-05-12T09:07:10.547094+0000","last_active":"2023-05-12T09:07:15.097155+0000","last_peered":"2023-05-12T09:07:15.097155+0000","last_clean":"2023-05-12T09:07:15.097155+0000","last_became_active":"2023-05-12T09:07:10.546792+0000","last_became_peered":"2023-05-12T09:07:10.546792+0000","last_unstale":"2023-05-12T09:07:15.097155+0000","last_undegraded":"2023-05-12T09:07:15.097155+0000","last_fullsized":"2023-05-12T09:07:15.097155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099265+0000","last_change":"2023-05-12T09:07:10.565515+0000","last_active":"2023-05-12T09:07:15.099265+0000","last_peered":"2023-05-12T09:07:15.099265+0000","last_clean":"2023-05-12T09:07:15.099265+0000","last_became_active":"2023-05-12T09:07:10.565207+0000","last_became_peered":"2023-05-12T09:07:10.565207+0000","last_unstale":"2023-05-12T09:07:15.099265+0000","last_undegraded":"2023-05-12T09:07:15.099265+0000","last_fullsized":"2023-05-12T09:07:15.099265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:49.560027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057002+0000","last_change":"2023-05-12T09:07:10.544063+0000","last_active":"2023-05-12T09:07:15.057002+0000","last_peered":"2023-05-12T09:07:15.057002+0000","last_clean":"2023-05-12T09:07:15.057002+0000","last_became_active":"2023-05-12T09:07:10.543808+0000","last_became_peered":"2023-05-12T09:07:10.543808+0000","last_unstale":"2023-05-12T09:07:15.057002+0000","last_undegraded":"2023-05-12T09:07:15.057002+0000","last_fullsized":"2023-05-12T09:07:15.057002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:31:21.496742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099598+0000","last_change":"2023-05-12T09:07:10.572909+0000","last_active":"2023-05-12T09:07:15.099598+0000","last_peered":"2023-05-12T09:07:15.099598+0000","last_clean":"2023-05-12T09:07:15.099598+0000","last_became_active":"2023-05-12T09:07:10.572159+0000","last_became_peered":"2023-05-12T09:07:10.572159+0000","last_unstale":"2023-05-12T09:07:15.099598+0000","last_undegraded":"2023-05-12T09:07:15.099598+0000","last_fullsized":"2023-05-12T09:07:15.099598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:08.244006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097642+0000","last_change":"2023-05-12T09:07:10.561695+0000","last_active":"2023-05-12T09:07:15.097642+0000","last_peered":"2023-05-12T09:07:15.097642+0000","last_clean":"2023-05-12T09:07:15.097642+0000","last_became_active":"2023-05-12T09:07:10.561421+0000","last_became_peered":"2023-05-12T09:07:10.561421+0000","last_unstale":"2023-05-12T09:07:15.097642+0000","last_undegraded":"2023-05-12T09:07:15.097642+0000","last_fullsized":"2023-05-12T09:07:15.097642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097054+0000","last_change":"2023-05-12T09:07:10.556885+0000","last_active":"2023-05-12T09:07:15.097054+0000","last_peered":"2023-05-12T09:07:15.097054+0000","last_clean":"2023-05-12T09:07:15.097054+0000","last_became_active":"2023-05-12T09:07:10.556648+0000","last_became_peered":"2023-05-12T09:07:10.556648+0000","last_unstale":"2023-05-12T09:07:15.097054+0000","last_undegraded":"2023-05-12T09:07:15.097054+0000","last_fullsized":"2023-05-12T09:07:15.097054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:29.216512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058586+0000","last_change":"2023-05-12T09:07:10.552009+0000","last_active":"2023-05-12T09:07:15.058586+0000","last_peered":"2023-05-12T09:07:15.058586+0000","last_clean":"2023-05-12T09:07:15.058586+0000","last_became_active":"2023-05-12T09:07:10.551526+0000","last_became_peered":"2023-05-12T09:07:10.551526+0000","last_unstale":"2023-05-12T09:07:15.058586+0000","last_undegraded":"2023-05-12T09:07:15.058586+0000","last_fullsized":"2023-05-12T09:07:15.058586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:29:40.632493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097137+0000","last_change":"2023-05-12T09:07:10.565180+0000","last_active":"2023-05-12T09:07:15.097137+0000","last_peered":"2023-05-12T09:07:15.097137+0000","last_clean":"2023-05-12T09:07:15.097137+0000","last_became_active":"2023-05-12T09:07:10.564257+0000","last_became_peered":"2023-05-12T09:07:10.564257+0000","last_unstale":"2023-05-12T09:07:15.097137+0000","last_undegraded":"2023-05-12T09:07:15.097137+0000","last_fullsized":"2023-05-12T09:07:15.097137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:26:01.116544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097918+0000","last_change":"2023-05-12T09:07:10.566527+0000","last_active":"2023-05-12T09:07:15.097918+0000","last_peered":"2023-05-12T09:07:15.097918+0000","last_clean":"2023-05-12T09:07:15.097918+0000","last_became_active":"2023-05-12T09:07:10.566257+0000","last_became_peered":"2023-05-12T09:07:10.566257+0000","last_unstale":"2023-05-12T09:07:15.097918+0000","last_undegraded":"2023-05-12T09:07:15.097918+0000","last_fullsized":"2023-05-12T09:07:15.097918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:33:26.206493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097456+0000","last_change":"2023-05-12T09:07:10.569619+0000","last_active":"2023-05-12T09:07:15.097456+0000","last_peered":"2023-05-12T09:07:15.097456+0000","last_clean":"2023-05-12T09:07:15.097456+0000","last_became_active":"2023-05-12T09:07:10.569336+0000","last_became_peered":"2023-05-12T09:07:10.569336+0000","last_unstale":"2023-05-12T09:07:15.097456+0000","last_undegraded":"2023-05-12T09:07:15.097456+0000","last_fullsized":"2023-05-12T09:07:15.097456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099394+0000","last_change":"2023-05-12T09:07:10.560495+0000","last_active":"2023-05-12T09:07:15.099394+0000","last_peered":"2023-05-12T09:07:15.099394+0000","last_clean":"2023-05-12T09:07:15.099394+0000","last_became_active":"2023-05-12T09:07:10.560049+0000","last_became_peered":"2023-05-12T09:07:10.560049+0000","last_unstale":"2023-05-12T09:07:15.099394+0000","last_undegraded":"2023-05-12T09:07:15.099394+0000","last_fullsized":"2023-05-12T09:07:15.099394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:27:05.047259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099295+0000","last_change":"2023-05-12T09:07:14.597955+0000","last_active":"2023-05-12T09:07:15.099295+0000","last_peered":"2023-05-12T09:07:15.099295+0000","last_clean":"2023-05-12T09:07:15.099295+0000","last_became_active":"2023-05-12T09:07:14.597429+0000","last_became_peered":"2023-05-12T09:07:14.597429+0000","last_unstale":"2023-05-12T09:07:15.099295+0000","last_undegraded":"2023-05-12T09:07:15.099295+0000","last_fullsized":"2023-05-12T09:07:15.099295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:42.341874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098315+0000","last_change":"2023-05-12T09:07:10.075419+0000","last_active":"2023-05-12T09:07:15.098315+0000","last_peered":"2023-05-12T09:07:15.098315+0000","last_clean":"2023-05-12T09:07:15.098315+0000","last_became_active":"2023-05-12T09:07:10.075045+0000","last_became_peered":"2023-05-12T09:07:10.075045+0000","last_unstale":"2023-05-12T09:07:15.098315+0000","last_undegraded":"2023-05-12T09:07:15.098315+0000","last_fullsized":"2023-05-12T09:07:15.098315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:46:05.372940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059049+0000","last_change":"2023-05-12T09:07:10.556737+0000","last_active":"2023-05-12T09:07:15.059049+0000","last_peered":"2023-05-12T09:07:15.059049+0000","last_clean":"2023-05-12T09:07:15.059049+0000","last_became_active":"2023-05-12T09:07:10.556495+0000","last_became_peered":"2023-05-12T09:07:10.556495+0000","last_unstale":"2023-05-12T09:07:15.059049+0000","last_undegraded":"2023-05-12T09:07:15.059049+0000","last_fullsized":"2023-05-12T09:07:15.059049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:49.560027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058830+0000","last_change":"2023-05-12T09:07:14.581307+0000","last_active":"2023-05-12T09:07:15.058830+0000","last_peered":"2023-05-12T09:07:15.058830+0000","last_clean":"2023-05-12T09:07:15.058830+0000","last_became_active":"2023-05-12T09:07:14.580877+0000","last_became_peered":"2023-05-12T09:07:14.580877+0000","last_unstale":"2023-05-12T09:07:15.058830+0000","last_undegraded":"2023-05-12T09:07:15.058830+0000","last_fullsized":"2023-05-12T09:07:15.058830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:19:01.287710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096438+0000","last_change":"2023-05-12T09:07:10.072878+0000","last_active":"2023-05-12T09:07:15.096438+0000","last_peered":"2023-05-12T09:07:15.096438+0000","last_clean":"2023-05-12T09:07:15.096438+0000","last_became_active":"2023-05-12T09:07:10.072354+0000","last_became_peered":"2023-05-12T09:07:10.072354+0000","last_unstale":"2023-05-12T09:07:15.096438+0000","last_undegraded":"2023-05-12T09:07:15.096438+0000","last_fullsized":"2023-05-12T09:07:15.096438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:58:55.829212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097423+0000","last_change":"2023-05-12T09:07:10.560312+0000","last_active":"2023-05-12T09:07:15.097423+0000","last_peered":"2023-05-12T09:07:15.097423+0000","last_clean":"2023-05-12T09:07:15.097423+0000","last_became_active":"2023-05-12T09:07:10.560026+0000","last_became_peered":"2023-05-12T09:07:10.560026+0000","last_unstale":"2023-05-12T09:07:15.097423+0000","last_undegraded":"2023-05-12T09:07:15.097423+0000","last_fullsized":"2023-05-12T09:07:15.097423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:51.153107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097572+0000","last_change":"2023-05-12T09:07:14.588155+0000","last_active":"2023-05-12T09:07:15.097572+0000","last_peered":"2023-05-12T09:07:15.097572+0000","last_clean":"2023-05-12T09:07:15.097572+0000","last_became_active":"2023-05-12T09:07:14.587745+0000","last_became_peered":"2023-05-12T09:07:14.587745+0000","last_unstale":"2023-05-12T09:07:15.097572+0000","last_undegraded":"2023-05-12T09:07:15.097572+0000","last_fullsized":"2023-05-12T09:07:15.097572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:42:22.571545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058871+0000","last_change":"2023-05-12T09:07:10.080957+0000","last_active":"2023-05-12T09:07:15.058871+0000","last_peered":"2023-05-12T09:07:15.058871+0000","last_clean":"2023-05-12T09:07:15.058871+0000","last_became_active":"2023-05-12T09:07:10.080662+0000","last_became_peered":"2023-05-12T09:07:10.080662+0000","last_unstale":"2023-05-12T09:07:15.058871+0000","last_undegraded":"2023-05-12T09:07:15.058871+0000","last_fullsized":"2023-05-12T09:07:15.058871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:52:11.295716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059156+0000","last_change":"2023-05-12T09:07:10.563118+0000","last_active":"2023-05-12T09:07:15.059156+0000","last_peered":"2023-05-12T09:07:15.059156+0000","last_clean":"2023-05-12T09:07:15.059156+0000","last_became_active":"2023-05-12T09:07:10.562749+0000","last_became_peered":"2023-05-12T09:07:10.562749+0000","last_unstale":"2023-05-12T09:07:15.059156+0000","last_undegraded":"2023-05-12T09:07:15.059156+0000","last_fullsized":"2023-05-12T09:07:15.059156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:13:26.432067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058101+0000","last_change":"2023-05-12T09:07:14.581060+0000","last_active":"2023-05-12T09:07:15.058101+0000","last_peered":"2023-05-12T09:07:15.058101+0000","last_clean":"2023-05-12T09:07:15.058101+0000","last_became_active":"2023-05-12T09:07:14.580610+0000","last_became_peered":"2023-05-12T09:07:14.580610+0000","last_unstale":"2023-05-12T09:07:15.058101+0000","last_undegraded":"2023-05-12T09:07:15.058101+0000","last_fullsized":"2023-05-12T09:07:15.058101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T21:04:50.690412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097268+0000","last_change":"2023-05-12T09:07:10.068667+0000","last_active":"2023-05-12T09:07:15.097268+0000","last_peered":"2023-05-12T09:07:15.097268+0000","last_clean":"2023-05-12T09:07:15.097268+0000","last_became_active":"2023-05-12T09:07:10.068386+0000","last_became_peered":"2023-05-12T09:07:10.068386+0000","last_unstale":"2023-05-12T09:07:15.097268+0000","last_undegraded":"2023-05-12T09:07:15.097268+0000","last_fullsized":"2023-05-12T09:07:15.097268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:34:33.760261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058741+0000","last_change":"2023-05-12T09:07:10.565793+0000","last_active":"2023-05-12T09:07:15.058741+0000","last_peered":"2023-05-12T09:07:15.058741+0000","last_clean":"2023-05-12T09:07:15.058741+0000","last_became_active":"2023-05-12T09:07:10.565550+0000","last_became_peered":"2023-05-12T09:07:10.565550+0000","last_unstale":"2023-05-12T09:07:15.058741+0000","last_undegraded":"2023-05-12T09:07:15.058741+0000","last_fullsized":"2023-05-12T09:07:15.058741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:14:42.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096926+0000","last_change":"2023-05-12T09:07:14.595717+0000","last_active":"2023-05-12T09:07:15.096926+0000","last_peered":"2023-05-12T09:07:15.096926+0000","last_clean":"2023-05-12T09:07:15.096926+0000","last_became_active":"2023-05-12T09:07:14.595257+0000","last_became_peered":"2023-05-12T09:07:14.595257+0000","last_unstale":"2023-05-12T09:07:15.096926+0000","last_undegraded":"2023-05-12T09:07:15.096926+0000","last_fullsized":"2023-05-12T09:07:15.096926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:14.949895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098244+0000","last_change":"2023-05-12T09:07:10.070218+0000","last_active":"2023-05-12T09:07:15.098244+0000","last_peered":"2023-05-12T09:07:15.098244+0000","last_clean":"2023-05-12T09:07:15.098244+0000","last_became_active":"2023-05-12T09:07:10.069889+0000","last_became_peered":"2023-05-12T09:07:10.069889+0000","last_unstale":"2023-05-12T09:07:15.098244+0000","last_undegraded":"2023-05-12T09:07:15.098244+0000","last_fullsized":"2023-05-12T09:07:15.098244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:42.081422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058443+0000","last_change":"2023-05-12T09:07:10.560559+0000","last_active":"2023-05-12T09:07:15.058443+0000","last_peered":"2023-05-12T09:07:15.058443+0000","last_clean":"2023-05-12T09:07:15.058443+0000","last_became_active":"2023-05-12T09:07:10.560373+0000","last_became_peered":"2023-05-12T09:07:10.560373+0000","last_unstale":"2023-05-12T09:07:15.058443+0000","last_undegraded":"2023-05-12T09:07:15.058443+0000","last_fullsized":"2023-05-12T09:07:15.058443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:39.228924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059243+0000","last_change":"2023-05-12T09:07:14.598817+0000","last_active":"2023-05-12T09:07:15.059243+0000","last_peered":"2023-05-12T09:07:15.059243+0000","last_clean":"2023-05-12T09:07:15.059243+0000","last_became_active":"2023-05-12T09:07:14.598424+0000","last_became_peered":"2023-05-12T09:07:14.598424+0000","last_unstale":"2023-05-12T09:07:15.059243+0000","last_undegraded":"2023-05-12T09:07:15.059243+0000","last_fullsized":"2023-05-12T09:07:15.059243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:14.345840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097760+0000","last_change":"2023-05-12T09:07:10.079800+0000","last_active":"2023-05-12T09:07:15.097760+0000","last_peered":"2023-05-12T09:07:15.097760+0000","last_clean":"2023-05-12T09:07:15.097760+0000","last_became_active":"2023-05-12T09:07:10.079511+0000","last_became_peered":"2023-05-12T09:07:10.079511+0000","last_unstale":"2023-05-12T09:07:15.097760+0000","last_undegraded":"2023-05-12T09:07:15.097760+0000","last_fullsized":"2023-05-12T09:07:15.097760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:12.733875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097492+0000","last_change":"2023-05-12T09:07:10.567328+0000","last_active":"2023-05-12T09:07:15.097492+0000","last_peered":"2023-05-12T09:07:15.097492+0000","last_clean":"2023-05-12T09:07:15.097492+0000","last_became_active":"2023-05-12T09:07:10.566882+0000","last_became_peered":"2023-05-12T09:07:10.566882+0000","last_unstale":"2023-05-12T09:07:15.097492+0000","last_undegraded":"2023-05-12T09:07:15.097492+0000","last_fullsized":"2023-05-12T09:07:15.097492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:27:05.047259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097631+0000","last_change":"2023-05-12T09:07:14.585280+0000","last_active":"2023-05-12T09:07:15.097631+0000","last_peered":"2023-05-12T09:07:15.097631+0000","last_clean":"2023-05-12T09:07:15.097631+0000","last_became_active":"2023-05-12T09:07:14.584873+0000","last_became_peered":"2023-05-12T09:07:14.584873+0000","last_unstale":"2023-05-12T09:07:15.097631+0000","last_undegraded":"2023-05-12T09:07:15.097631+0000","last_fullsized":"2023-05-12T09:07:15.097631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:17.240980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:29.211417+0000","last_change":"2023-05-12T09:07:10.069756+0000","last_active":"2023-05-12T09:07:29.211417+0000","last_peered":"2023-05-12T09:07:29.211417+0000","last_clean":"2023-05-12T09:07:29.211417+0000","last_became_active":"2023-05-12T09:07:10.069451+0000","last_became_peered":"2023-05-12T09:07:10.069451+0000","last_unstale":"2023-05-12T09:07:29.211417+0000","last_undegraded":"2023-05-12T09:07:29.211417+0000","last_fullsized":"2023-05-12T09:07:29.211417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:09:04.714440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098689+0000","last_change":"2023-05-12T09:07:10.565252+0000","last_active":"2023-05-12T09:07:15.098689+0000","last_peered":"2023-05-12T09:07:15.098689+0000","last_clean":"2023-05-12T09:07:15.098689+0000","last_became_active":"2023-05-12T09:07:10.564960+0000","last_became_peered":"2023-05-12T09:07:10.564960+0000","last_unstale":"2023-05-12T09:07:15.098689+0000","last_undegraded":"2023-05-12T09:07:15.098689+0000","last_fullsized":"2023-05-12T09:07:15.098689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:08:57.701341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099521+0000","last_change":"2023-05-12T09:07:14.595988+0000","last_active":"2023-05-12T09:07:15.099521+0000","last_peered":"2023-05-12T09:07:15.099521+0000","last_clean":"2023-05-12T09:07:15.099521+0000","last_became_active":"2023-05-12T09:07:14.595488+0000","last_became_peered":"2023-05-12T09:07:14.595488+0000","last_unstale":"2023-05-12T09:07:15.099521+0000","last_undegraded":"2023-05-12T09:07:15.099521+0000","last_fullsized":"2023-05-12T09:07:15.099521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:57:17.240980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097496+0000","last_change":"2023-05-12T09:07:10.079093+0000","last_active":"2023-05-12T09:07:15.097496+0000","last_peered":"2023-05-12T09:07:15.097496+0000","last_clean":"2023-05-12T09:07:15.097496+0000","last_became_active":"2023-05-12T09:07:10.078795+0000","last_became_peered":"2023-05-12T09:07:10.078795+0000","last_unstale":"2023-05-12T09:07:15.097496+0000","last_undegraded":"2023-05-12T09:07:15.097496+0000","last_fullsized":"2023-05-12T09:07:15.097496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:21.054528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058869+0000","last_change":"2023-05-12T09:07:10.565215+0000","last_active":"2023-05-12T09:07:15.058869+0000","last_peered":"2023-05-12T09:07:15.058869+0000","last_clean":"2023-05-12T09:07:15.058869+0000","last_became_active":"2023-05-12T09:07:10.564963+0000","last_became_peered":"2023-05-12T09:07:10.564963+0000","last_unstale":"2023-05-12T09:07:15.058869+0000","last_undegraded":"2023-05-12T09:07:15.058869+0000","last_fullsized":"2023-05-12T09:07:15.058869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:35.146554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059099+0000","last_change":"2023-05-12T09:07:14.584072+0000","last_active":"2023-05-12T09:07:15.059099+0000","last_peered":"2023-05-12T09:07:15.059099+0000","last_clean":"2023-05-12T09:07:15.059099+0000","last_became_active":"2023-05-12T09:07:14.583584+0000","last_became_peered":"2023-05-12T09:07:14.583584+0000","last_unstale":"2023-05-12T09:07:15.059099+0000","last_undegraded":"2023-05-12T09:07:15.059099+0000","last_fullsized":"2023-05-12T09:07:15.059099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:42.341874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097258+0000","last_change":"2023-05-12T09:07:10.066744+0000","last_active":"2023-05-12T09:07:15.097258+0000","last_peered":"2023-05-12T09:07:15.097258+0000","last_clean":"2023-05-12T09:07:15.097258+0000","last_became_active":"2023-05-12T09:07:10.066464+0000","last_became_peered":"2023-05-12T09:07:10.066464+0000","last_unstale":"2023-05-12T09:07:15.097258+0000","last_undegraded":"2023-05-12T09:07:15.097258+0000","last_fullsized":"2023-05-12T09:07:15.097258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:38:11.562367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099293+0000","last_change":"2023-05-12T09:07:10.560309+0000","last_active":"2023-05-12T09:07:15.099293+0000","last_peered":"2023-05-12T09:07:15.099293+0000","last_clean":"2023-05-12T09:07:15.099293+0000","last_became_active":"2023-05-12T09:07:10.559669+0000","last_became_peered":"2023-05-12T09:07:10.559669+0000","last_unstale":"2023-05-12T09:07:15.099293+0000","last_undegraded":"2023-05-12T09:07:15.099293+0000","last_fullsized":"2023-05-12T09:07:15.099293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:27:35.918121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059044+0000","last_change":"2023-05-12T09:07:14.583910+0000","last_active":"2023-05-12T09:07:15.059044+0000","last_peered":"2023-05-12T09:07:15.059044+0000","last_clean":"2023-05-12T09:07:15.059044+0000","last_became_active":"2023-05-12T09:07:14.583260+0000","last_became_peered":"2023-05-12T09:07:14.583260+0000","last_unstale":"2023-05-12T09:07:15.059044+0000","last_undegraded":"2023-05-12T09:07:15.059044+0000","last_fullsized":"2023-05-12T09:07:15.059044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:11.744671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098106+0000","last_change":"2023-05-12T09:07:10.078179+0000","last_active":"2023-05-12T09:07:15.098106+0000","last_peered":"2023-05-12T09:07:15.098106+0000","last_clean":"2023-05-12T09:07:15.098106+0000","last_became_active":"2023-05-12T09:07:10.077837+0000","last_became_peered":"2023-05-12T09:07:10.077837+0000","last_unstale":"2023-05-12T09:07:15.098106+0000","last_undegraded":"2023-05-12T09:07:15.098106+0000","last_fullsized":"2023-05-12T09:07:15.098106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:28.210072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097897+0000","last_change":"2023-05-12T09:07:10.560712+0000","last_active":"2023-05-12T09:07:15.097897+0000","last_peered":"2023-05-12T09:07:15.097897+0000","last_clean":"2023-05-12T09:07:15.097897+0000","last_became_active":"2023-05-12T09:07:10.560481+0000","last_became_peered":"2023-05-12T09:07:10.560481+0000","last_unstale":"2023-05-12T09:07:15.097897+0000","last_undegraded":"2023-05-12T09:07:15.097897+0000","last_fullsized":"2023-05-12T09:07:15.097897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:37:03.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097898+0000","last_change":"2023-05-12T09:07:14.590864+0000","last_active":"2023-05-12T09:07:15.097898+0000","last_peered":"2023-05-12T09:07:15.097898+0000","last_clean":"2023-05-12T09:07:15.097898+0000","last_became_active":"2023-05-12T09:07:14.590469+0000","last_became_peered":"2023-05-12T09:07:14.590469+0000","last_unstale":"2023-05-12T09:07:15.097898+0000","last_undegraded":"2023-05-12T09:07:15.097898+0000","last_fullsized":"2023-05-12T09:07:15.097898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:28:30.258916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058132+0000","last_change":"2023-05-12T09:07:10.076195+0000","last_active":"2023-05-12T09:07:15.058132+0000","last_peered":"2023-05-12T09:07:15.058132+0000","last_clean":"2023-05-12T09:07:15.058132+0000","last_became_active":"2023-05-12T09:07:10.075812+0000","last_became_peered":"2023-05-12T09:07:10.075812+0000","last_unstale":"2023-05-12T09:07:15.058132+0000","last_undegraded":"2023-05-12T09:07:15.058132+0000","last_fullsized":"2023-05-12T09:07:15.058132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:18:52.025513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059357+0000","last_change":"2023-05-12T09:07:10.563115+0000","last_active":"2023-05-12T09:07:15.059357+0000","last_peered":"2023-05-12T09:07:15.059357+0000","last_clean":"2023-05-12T09:07:15.059357+0000","last_became_active":"2023-05-12T09:07:10.562845+0000","last_became_peered":"2023-05-12T09:07:10.562845+0000","last_unstale":"2023-05-12T09:07:15.059357+0000","last_undegraded":"2023-05-12T09:07:15.059357+0000","last_fullsized":"2023-05-12T09:07:15.059357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:20:22.733100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098372+0000","last_change":"2023-05-12T09:07:14.591597+0000","last_active":"2023-05-12T09:07:15.098372+0000","last_peered":"2023-05-12T09:07:15.098372+0000","last_clean":"2023-05-12T09:07:15.098372+0000","last_became_active":"2023-05-12T09:07:14.591185+0000","last_became_peered":"2023-05-12T09:07:14.591185+0000","last_unstale":"2023-05-12T09:07:15.098372+0000","last_undegraded":"2023-05-12T09:07:15.098372+0000","last_fullsized":"2023-05-12T09:07:15.098372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:38:16.069472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097483+0000","last_change":"2023-05-12T09:07:10.079275+0000","last_active":"2023-05-12T09:07:15.097483+0000","last_peered":"2023-05-12T09:07:15.097483+0000","last_clean":"2023-05-12T09:07:15.097483+0000","last_became_active":"2023-05-12T09:07:10.078985+0000","last_became_peered":"2023-05-12T09:07:10.078985+0000","last_unstale":"2023-05-12T09:07:15.097483+0000","last_undegraded":"2023-05-12T09:07:15.097483+0000","last_fullsized":"2023-05-12T09:07:15.097483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:29:57.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097914+0000","last_change":"2023-05-12T09:07:10.558991+0000","last_active":"2023-05-12T09:07:15.097914+0000","last_peered":"2023-05-12T09:07:15.097914+0000","last_clean":"2023-05-12T09:07:15.097914+0000","last_became_active":"2023-05-12T09:07:10.558695+0000","last_became_peered":"2023-05-12T09:07:10.558695+0000","last_unstale":"2023-05-12T09:07:15.097914+0000","last_undegraded":"2023-05-12T09:07:15.097914+0000","last_fullsized":"2023-05-12T09:07:15.097914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:00:26.351184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056464+0000","last_change":"2023-05-12T09:07:14.586265+0000","last_active":"2023-05-12T09:07:15.056464+0000","last_peered":"2023-05-12T09:07:15.056464+0000","last_clean":"2023-05-12T09:07:15.056464+0000","last_became_active":"2023-05-12T09:07:14.585710+0000","last_became_peered":"2023-05-12T09:07:14.585710+0000","last_unstale":"2023-05-12T09:07:15.056464+0000","last_undegraded":"2023-05-12T09:07:15.056464+0000","last_fullsized":"2023-05-12T09:07:15.056464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:05:38.749407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097889+0000","last_change":"2023-05-12T09:07:10.079611+0000","last_active":"2023-05-12T09:07:15.097889+0000","last_peered":"2023-05-12T09:07:15.097889+0000","last_clean":"2023-05-12T09:07:15.097889+0000","last_became_active":"2023-05-12T09:07:10.079324+0000","last_became_peered":"2023-05-12T09:07:10.079324+0000","last_unstale":"2023-05-12T09:07:15.097889+0000","last_undegraded":"2023-05-12T09:07:15.097889+0000","last_fullsized":"2023-05-12T09:07:15.097889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:34.152879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098310+0000","last_change":"2023-05-12T09:07:10.569420+0000","last_active":"2023-05-12T09:07:15.098310+0000","last_peered":"2023-05-12T09:07:15.098310+0000","last_clean":"2023-05-12T09:07:15.098310+0000","last_became_active":"2023-05-12T09:07:10.569160+0000","last_became_peered":"2023-05-12T09:07:10.569160+0000","last_unstale":"2023-05-12T09:07:15.098310+0000","last_undegraded":"2023-05-12T09:07:15.098310+0000","last_fullsized":"2023-05-12T09:07:15.098310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:01:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056628+0000","last_change":"2023-05-12T09:07:14.585639+0000","last_active":"2023-05-12T09:07:15.056628+0000","last_peered":"2023-05-12T09:07:15.056628+0000","last_clean":"2023-05-12T09:07:15.056628+0000","last_became_active":"2023-05-12T09:07:14.585153+0000","last_became_peered":"2023-05-12T09:07:14.585153+0000","last_unstale":"2023-05-12T09:07:15.056628+0000","last_undegraded":"2023-05-12T09:07:15.056628+0000","last_fullsized":"2023-05-12T09:07:15.056628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:02:03.620298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097546+0000","last_change":"2023-05-12T09:07:10.073391+0000","last_active":"2023-05-12T09:07:15.097546+0000","last_peered":"2023-05-12T09:07:15.097546+0000","last_clean":"2023-05-12T09:07:15.097546+0000","last_became_active":"2023-05-12T09:07:10.073069+0000","last_became_peered":"2023-05-12T09:07:10.073069+0000","last_unstale":"2023-05-12T09:07:15.097546+0000","last_undegraded":"2023-05-12T09:07:15.097546+0000","last_fullsized":"2023-05-12T09:07:15.097546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:24.289481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058350+0000","last_change":"2023-05-12T09:07:10.567111+0000","last_active":"2023-05-12T09:07:15.058350+0000","last_peered":"2023-05-12T09:07:15.058350+0000","last_clean":"2023-05-12T09:07:15.058350+0000","last_became_active":"2023-05-12T09:07:10.566663+0000","last_became_peered":"2023-05-12T09:07:10.566663+0000","last_unstale":"2023-05-12T09:07:15.058350+0000","last_undegraded":"2023-05-12T09:07:15.058350+0000","last_fullsized":"2023-05-12T09:07:15.058350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:32:58.490075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056879+0000","last_change":"2023-05-12T09:07:14.591606+0000","last_active":"2023-05-12T09:07:15.056879+0000","last_peered":"2023-05-12T09:07:15.056879+0000","last_clean":"2023-05-12T09:07:15.056879+0000","last_became_active":"2023-05-12T09:07:14.591207+0000","last_became_peered":"2023-05-12T09:07:14.591207+0000","last_unstale":"2023-05-12T09:07:15.056879+0000","last_undegraded":"2023-05-12T09:07:15.056879+0000","last_fullsized":"2023-05-12T09:07:15.056879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:47:06.214488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097650+0000","last_change":"2023-05-12T09:07:10.072631+0000","last_active":"2023-05-12T09:07:15.097650+0000","last_peered":"2023-05-12T09:07:15.097650+0000","last_clean":"2023-05-12T09:07:15.097650+0000","last_became_active":"2023-05-12T09:07:10.072337+0000","last_became_peered":"2023-05-12T09:07:10.072337+0000","last_unstale":"2023-05-12T09:07:15.097650+0000","last_undegraded":"2023-05-12T09:07:15.097650+0000","last_fullsized":"2023-05-12T09:07:15.097650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:57:12.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098158+0000","last_change":"2023-05-12T09:07:10.565145+0000","last_active":"2023-05-12T09:07:15.098158+0000","last_peered":"2023-05-12T09:07:15.098158+0000","last_clean":"2023-05-12T09:07:15.098158+0000","last_became_active":"2023-05-12T09:07:10.564875+0000","last_became_peered":"2023-05-12T09:07:10.564875+0000","last_unstale":"2023-05-12T09:07:15.098158+0000","last_undegraded":"2023-05-12T09:07:15.098158+0000","last_fullsized":"2023-05-12T09:07:15.098158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:19.840466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.056750+0000","last_change":"2023-05-12T09:07:14.587809+0000","last_active":"2023-05-12T09:07:15.056750+0000","last_peered":"2023-05-12T09:07:15.056750+0000","last_clean":"2023-05-12T09:07:15.056750+0000","last_became_active":"2023-05-12T09:07:14.587214+0000","last_became_peered":"2023-05-12T09:07:14.587214+0000","last_unstale":"2023-05-12T09:07:15.056750+0000","last_undegraded":"2023-05-12T09:07:15.056750+0000","last_fullsized":"2023-05-12T09:07:15.056750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:13:57.325469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059145+0000","last_change":"2023-05-12T09:07:10.080418+0000","last_active":"2023-05-12T09:07:15.059145+0000","last_peered":"2023-05-12T09:07:15.059145+0000","last_clean":"2023-05-12T09:07:15.059145+0000","last_became_active":"2023-05-12T09:07:10.080097+0000","last_became_peered":"2023-05-12T09:07:10.080097+0000","last_unstale":"2023-05-12T09:07:15.059145+0000","last_undegraded":"2023-05-12T09:07:15.059145+0000","last_fullsized":"2023-05-12T09:07:15.059145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:36.409374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098730+0000","last_change":"2023-05-12T09:07:10.572418+0000","last_active":"2023-05-12T09:07:15.098730+0000","last_peered":"2023-05-12T09:07:15.098730+0000","last_clean":"2023-05-12T09:07:15.098730+0000","last_became_active":"2023-05-12T09:07:10.571808+0000","last_became_peered":"2023-05-12T09:07:10.571808+0000","last_unstale":"2023-05-12T09:07:15.098730+0000","last_undegraded":"2023-05-12T09:07:15.098730+0000","last_fullsized":"2023-05-12T09:07:15.098730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:41.253320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097248+0000","last_change":"2023-05-12T09:07:14.590970+0000","last_active":"2023-05-12T09:07:15.097248+0000","last_peered":"2023-05-12T09:07:15.097248+0000","last_clean":"2023-05-12T09:07:15.097248+0000","last_became_active":"2023-05-12T09:07:14.590573+0000","last_became_peered":"2023-05-12T09:07:14.590573+0000","last_unstale":"2023-05-12T09:07:15.097248+0000","last_undegraded":"2023-05-12T09:07:15.097248+0000","last_fullsized":"2023-05-12T09:07:15.097248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:28.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058408+0000","last_change":"2023-05-12T09:07:10.071121+0000","last_active":"2023-05-12T09:07:15.058408+0000","last_peered":"2023-05-12T09:07:15.058408+0000","last_clean":"2023-05-12T09:07:15.058408+0000","last_became_active":"2023-05-12T09:07:10.070840+0000","last_became_peered":"2023-05-12T09:07:10.070840+0000","last_unstale":"2023-05-12T09:07:15.058408+0000","last_undegraded":"2023-05-12T09:07:15.058408+0000","last_fullsized":"2023-05-12T09:07:15.058408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:30.198454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098441+0000","last_change":"2023-05-12T09:07:10.566231+0000","last_active":"2023-05-12T09:07:15.098441+0000","last_peered":"2023-05-12T09:07:15.098441+0000","last_clean":"2023-05-12T09:07:15.098441+0000","last_became_active":"2023-05-12T09:07:10.565893+0000","last_became_peered":"2023-05-12T09:07:10.565893+0000","last_unstale":"2023-05-12T09:07:15.098441+0000","last_undegraded":"2023-05-12T09:07:15.098441+0000","last_fullsized":"2023-05-12T09:07:15.098441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:39.228924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098881+0000","last_change":"2023-05-12T09:07:14.593678+0000","last_active":"2023-05-12T09:07:15.098881+0000","last_peered":"2023-05-12T09:07:15.098881+0000","last_clean":"2023-05-12T09:07:15.098881+0000","last_became_active":"2023-05-12T09:07:14.593316+0000","last_became_peered":"2023-05-12T09:07:14.593316+0000","last_unstale":"2023-05-12T09:07:15.098881+0000","last_undegraded":"2023-05-12T09:07:15.098881+0000","last_fullsized":"2023-05-12T09:07:15.098881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:30:02.274700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097913+0000","last_change":"2023-05-12T09:07:10.063181+0000","last_active":"2023-05-12T09:07:15.097913+0000","last_peered":"2023-05-12T09:07:15.097913+0000","last_clean":"2023-05-12T09:07:15.097913+0000","last_became_active":"2023-05-12T09:07:10.062780+0000","last_became_peered":"2023-05-12T09:07:10.062780+0000","last_unstale":"2023-05-12T09:07:15.097913+0000","last_undegraded":"2023-05-12T09:07:15.097913+0000","last_fullsized":"2023-05-12T09:07:15.097913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:17.984136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099317+0000","last_change":"2023-05-12T09:07:10.565492+0000","last_active":"2023-05-12T09:07:15.099317+0000","last_peered":"2023-05-12T09:07:15.099317+0000","last_clean":"2023-05-12T09:07:15.099317+0000","last_became_active":"2023-05-12T09:07:10.565230+0000","last_became_peered":"2023-05-12T09:07:10.565230+0000","last_unstale":"2023-05-12T09:07:15.099317+0000","last_undegraded":"2023-05-12T09:07:15.099317+0000","last_fullsized":"2023-05-12T09:07:15.099317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:37.415814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098778+0000","last_change":"2023-05-12T09:07:14.598561+0000","last_active":"2023-05-12T09:07:15.098778+0000","last_peered":"2023-05-12T09:07:15.098778+0000","last_clean":"2023-05-12T09:07:15.098778+0000","last_became_active":"2023-05-12T09:07:14.598166+0000","last_became_peered":"2023-05-12T09:07:14.598166+0000","last_unstale":"2023-05-12T09:07:15.098778+0000","last_undegraded":"2023-05-12T09:07:15.098778+0000","last_fullsized":"2023-05-12T09:07:15.098778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:57:23.396980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058526+0000","last_change":"2023-05-12T09:07:10.073569+0000","last_active":"2023-05-12T09:07:15.058526+0000","last_peered":"2023-05-12T09:07:15.058526+0000","last_clean":"2023-05-12T09:07:15.058526+0000","last_became_active":"2023-05-12T09:07:10.073359+0000","last_became_peered":"2023-05-12T09:07:10.073359+0000","last_unstale":"2023-05-12T09:07:15.058526+0000","last_undegraded":"2023-05-12T09:07:15.058526+0000","last_fullsized":"2023-05-12T09:07:15.058526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:03:07.204680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098024+0000","last_change":"2023-05-12T09:07:10.564749+0000","last_active":"2023-05-12T09:07:15.098024+0000","last_peered":"2023-05-12T09:07:15.098024+0000","last_clean":"2023-05-12T09:07:15.098024+0000","last_became_active":"2023-05-12T09:07:10.564200+0000","last_became_peered":"2023-05-12T09:07:10.564200+0000","last_unstale":"2023-05-12T09:07:15.098024+0000","last_undegraded":"2023-05-12T09:07:15.098024+0000","last_fullsized":"2023-05-12T09:07:15.098024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:48:29.216512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099214+0000","last_change":"2023-05-12T09:07:14.598427+0000","last_active":"2023-05-12T09:07:15.099214+0000","last_peered":"2023-05-12T09:07:15.099214+0000","last_clean":"2023-05-12T09:07:15.099214+0000","last_became_active":"2023-05-12T09:07:14.598011+0000","last_became_peered":"2023-05-12T09:07:14.598011+0000","last_unstale":"2023-05-12T09:07:15.099214+0000","last_undegraded":"2023-05-12T09:07:15.099214+0000","last_fullsized":"2023-05-12T09:07:15.099214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:52:15.802821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059169+0000","last_change":"2023-05-12T09:07:10.073900+0000","last_active":"2023-05-12T09:07:15.059169+0000","last_peered":"2023-05-12T09:07:15.059169+0000","last_clean":"2023-05-12T09:07:15.059169+0000","last_became_active":"2023-05-12T09:07:10.073595+0000","last_became_peered":"2023-05-12T09:07:10.073595+0000","last_unstale":"2023-05-12T09:07:15.059169+0000","last_undegraded":"2023-05-12T09:07:15.059169+0000","last_fullsized":"2023-05-12T09:07:15.059169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:09:04.714440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098675+0000","last_change":"2023-05-12T09:07:04.835422+0000","last_active":"2023-05-12T09:07:15.098675+0000","last_peered":"2023-05-12T09:07:15.098675+0000","last_clean":"2023-05-12T09:07:15.098675+0000","last_became_active":"2023-05-12T09:07:04.834944+0000","last_became_peered":"2023-05-12T09:07:04.834944+0000","last_unstale":"2023-05-12T09:07:15.098675+0000","last_undegraded":"2023-05-12T09:07:15.098675+0000","last_fullsized":"2023-05-12T09:07:15.098675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:29:34.402135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058443+0000","last_change":"2023-05-12T09:07:10.557866+0000","last_active":"2023-05-12T09:07:15.058443+0000","last_peered":"2023-05-12T09:07:15.058443+0000","last_clean":"2023-05-12T09:07:15.058443+0000","last_became_active":"2023-05-12T09:07:10.557613+0000","last_became_peered":"2023-05-12T09:07:10.557613+0000","last_unstale":"2023-05-12T09:07:15.058443+0000","last_undegraded":"2023-05-12T09:07:15.058443+0000","last_fullsized":"2023-05-12T09:07:15.058443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:13:41.253320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058370+0000","last_change":"2023-05-12T09:07:14.596466+0000","last_active":"2023-05-12T09:07:15.058370+0000","last_peered":"2023-05-12T09:07:15.058370+0000","last_clean":"2023-05-12T09:07:15.058370+0000","last_became_active":"2023-05-12T09:07:14.595765+0000","last_became_peered":"2023-05-12T09:07:14.595765+0000","last_unstale":"2023-05-12T09:07:15.058370+0000","last_undegraded":"2023-05-12T09:07:15.058370+0000","last_fullsized":"2023-05-12T09:07:15.058370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:23.341131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058733+0000","last_change":"2023-05-12T09:07:04.828759+0000","last_active":"2023-05-12T09:07:15.058733+0000","last_peered":"2023-05-12T09:07:15.058733+0000","last_clean":"2023-05-12T09:07:15.058733+0000","last_became_active":"2023-05-12T09:07:04.828460+0000","last_became_peered":"2023-05-12T09:07:04.828460+0000","last_unstale":"2023-05-12T09:07:15.058733+0000","last_undegraded":"2023-05-12T09:07:15.058733+0000","last_fullsized":"2023-05-12T09:07:15.058733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:08:51.470983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097285+0000","last_change":"2023-05-12T09:07:10.074451+0000","last_active":"2023-05-12T09:07:15.097285+0000","last_peered":"2023-05-12T09:07:15.097285+0000","last_clean":"2023-05-12T09:07:15.097285+0000","last_became_active":"2023-05-12T09:07:10.074189+0000","last_became_peered":"2023-05-12T09:07:10.074189+0000","last_unstale":"2023-05-12T09:07:15.097285+0000","last_undegraded":"2023-05-12T09:07:15.097285+0000","last_fullsized":"2023-05-12T09:07:15.097285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:31:30.209986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098050+0000","last_change":"2023-05-12T09:07:10.574648+0000","last_active":"2023-05-12T09:07:15.098050+0000","last_peered":"2023-05-12T09:07:15.098050+0000","last_clean":"2023-05-12T09:07:15.098050+0000","last_became_active":"2023-05-12T09:07:10.573975+0000","last_became_peered":"2023-05-12T09:07:10.573975+0000","last_unstale":"2023-05-12T09:07:15.098050+0000","last_undegraded":"2023-05-12T09:07:15.098050+0000","last_fullsized":"2023-05-12T09:07:15.098050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:11:46.901235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098514+0000","last_change":"2023-05-12T09:07:14.596807+0000","last_active":"2023-05-12T09:07:15.098514+0000","last_peered":"2023-05-12T09:07:15.098514+0000","last_clean":"2023-05-12T09:07:15.098514+0000","last_became_active":"2023-05-12T09:07:14.596455+0000","last_became_peered":"2023-05-12T09:07:14.596455+0000","last_unstale":"2023-05-12T09:07:15.098514+0000","last_undegraded":"2023-05-12T09:07:15.098514+0000","last_fullsized":"2023-05-12T09:07:15.098514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:15.456994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096671+0000","last_change":"2023-05-12T09:07:04.830658+0000","last_active":"2023-05-12T09:07:15.096671+0000","last_peered":"2023-05-12T09:07:15.096671+0000","last_clean":"2023-05-12T09:07:15.096671+0000","last_became_active":"2023-05-12T09:07:04.830354+0000","last_became_peered":"2023-05-12T09:07:04.830354+0000","last_unstale":"2023-05-12T09:07:15.096671+0000","last_undegraded":"2023-05-12T09:07:15.096671+0000","last_fullsized":"2023-05-12T09:07:15.096671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:25:54.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097236+0000","last_change":"2023-05-12T09:07:04.830850+0000","last_active":"2023-05-12T09:07:15.097236+0000","last_peered":"2023-05-12T09:07:15.097236+0000","last_clean":"2023-05-12T09:07:15.097236+0000","last_became_active":"2023-05-12T09:07:04.829577+0000","last_became_peered":"2023-05-12T09:07:04.829577+0000","last_unstale":"2023-05-12T09:07:15.097236+0000","last_undegraded":"2023-05-12T09:07:15.097236+0000","last_fullsized":"2023-05-12T09:07:15.097236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:42.458296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096795+0000","last_change":"2023-05-12T09:07:10.078248+0000","last_active":"2023-05-12T09:07:15.096795+0000","last_peered":"2023-05-12T09:07:15.096795+0000","last_clean":"2023-05-12T09:07:15.096795+0000","last_became_active":"2023-05-12T09:07:10.077994+0000","last_became_peered":"2023-05-12T09:07:10.077994+0000","last_unstale":"2023-05-12T09:07:15.096795+0000","last_undegraded":"2023-05-12T09:07:15.096795+0000","last_fullsized":"2023-05-12T09:07:15.096795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:34.152879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097764+0000","last_change":"2023-05-12T09:07:10.557403+0000","last_active":"2023-05-12T09:07:15.097764+0000","last_peered":"2023-05-12T09:07:15.097764+0000","last_clean":"2023-05-12T09:07:15.097764+0000","last_became_active":"2023-05-12T09:07:10.557170+0000","last_became_peered":"2023-05-12T09:07:10.557170+0000","last_unstale":"2023-05-12T09:07:15.097764+0000","last_undegraded":"2023-05-12T09:07:15.097764+0000","last_fullsized":"2023-05-12T09:07:15.097764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:41:05.519844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057360+0000","last_change":"2023-05-12T09:07:14.588875+0000","last_active":"2023-05-12T09:07:15.057360+0000","last_peered":"2023-05-12T09:07:15.057360+0000","last_clean":"2023-05-12T09:07:15.057360+0000","last_became_active":"2023-05-12T09:07:14.587235+0000","last_became_peered":"2023-05-12T09:07:14.587235+0000","last_unstale":"2023-05-12T09:07:15.057360+0000","last_undegraded":"2023-05-12T09:07:15.057360+0000","last_fullsized":"2023-05-12T09:07:15.057360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:11:48.344758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097643+0000","last_change":"2023-05-12T09:07:05.258677+0000","last_active":"2023-05-12T09:07:15.097643+0000","last_peered":"2023-05-12T09:07:15.097643+0000","last_clean":"2023-05-12T09:07:15.097643+0000","last_became_active":"2023-05-12T09:07:05.258372+0000","last_became_peered":"2023-05-12T09:07:05.258372+0000","last_unstale":"2023-05-12T09:07:15.097643+0000","last_undegraded":"2023-05-12T09:07:15.097643+0000","last_fullsized":"2023-05-12T09:07:15.097643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:26:58.816901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096485+0000","last_change":"2023-05-12T09:07:10.071185+0000","last_active":"2023-05-12T09:07:15.096485+0000","last_peered":"2023-05-12T09:07:15.096485+0000","last_clean":"2023-05-12T09:07:15.096485+0000","last_became_active":"2023-05-12T09:07:10.070930+0000","last_became_peered":"2023-05-12T09:07:10.070930+0000","last_unstale":"2023-05-12T09:07:15.096485+0000","last_undegraded":"2023-05-12T09:07:15.096485+0000","last_fullsized":"2023-05-12T09:07:15.096485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:42:10.442791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098132+0000","last_change":"2023-05-12T09:07:10.565103+0000","last_active":"2023-05-12T09:07:15.098132+0000","last_peered":"2023-05-12T09:07:15.098132+0000","last_clean":"2023-05-12T09:07:15.098132+0000","last_became_active":"2023-05-12T09:07:10.564782+0000","last_became_peered":"2023-05-12T09:07:10.564782+0000","last_unstale":"2023-05-12T09:07:15.098132+0000","last_undegraded":"2023-05-12T09:07:15.098132+0000","last_fullsized":"2023-05-12T09:07:15.098132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:19:43.475022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098635+0000","last_change":"2023-05-12T09:07:14.585727+0000","last_active":"2023-05-12T09:07:15.098635+0000","last_peered":"2023-05-12T09:07:15.098635+0000","last_clean":"2023-05-12T09:07:15.098635+0000","last_became_active":"2023-05-12T09:07:14.585342+0000","last_became_peered":"2023-05-12T09:07:14.585342+0000","last_unstale":"2023-05-12T09:07:15.098635+0000","last_undegraded":"2023-05-12T09:07:15.098635+0000","last_fullsized":"2023-05-12T09:07:15.098635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:34:38.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097101+0000","last_change":"2023-05-12T09:07:05.258599+0000","last_active":"2023-05-12T09:07:15.097101+0000","last_peered":"2023-05-12T09:07:15.097101+0000","last_clean":"2023-05-12T09:07:15.097101+0000","last_became_active":"2023-05-12T09:07:05.258301+0000","last_became_peered":"2023-05-12T09:07:05.258301+0000","last_unstale":"2023-05-12T09:07:15.097101+0000","last_undegraded":"2023-05-12T09:07:15.097101+0000","last_fullsized":"2023-05-12T09:07:15.097101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:36.857503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058798+0000","last_change":"2023-05-12T09:07:10.077809+0000","last_active":"2023-05-12T09:07:15.058798+0000","last_peered":"2023-05-12T09:07:15.058798+0000","last_clean":"2023-05-12T09:07:15.058798+0000","last_became_active":"2023-05-12T09:07:10.077502+0000","last_became_peered":"2023-05-12T09:07:10.077502+0000","last_unstale":"2023-05-12T09:07:15.058798+0000","last_undegraded":"2023-05-12T09:07:15.058798+0000","last_fullsized":"2023-05-12T09:07:15.058798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:31:45.423256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058539+0000","last_change":"2023-05-12T09:07:10.569701+0000","last_active":"2023-05-12T09:07:15.058539+0000","last_peered":"2023-05-12T09:07:15.058539+0000","last_clean":"2023-05-12T09:07:15.058539+0000","last_became_active":"2023-05-12T09:07:10.569342+0000","last_became_peered":"2023-05-12T09:07:10.569342+0000","last_unstale":"2023-05-12T09:07:15.058539+0000","last_undegraded":"2023-05-12T09:07:15.058539+0000","last_fullsized":"2023-05-12T09:07:15.058539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:59:18.361363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098305+0000","last_change":"2023-05-12T09:07:14.589783+0000","last_active":"2023-05-12T09:07:15.098305+0000","last_peered":"2023-05-12T09:07:15.098305+0000","last_clean":"2023-05-12T09:07:15.098305+0000","last_became_active":"2023-05-12T09:07:14.589383+0000","last_became_peered":"2023-05-12T09:07:14.589383+0000","last_unstale":"2023-05-12T09:07:15.098305+0000","last_undegraded":"2023-05-12T09:07:15.098305+0000","last_fullsized":"2023-05-12T09:07:15.098305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:42.729589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097652+0000","last_change":"2023-05-12T09:07:05.258734+0000","last_active":"2023-05-12T09:07:15.097652+0000","last_peered":"2023-05-12T09:07:15.097652+0000","last_clean":"2023-05-12T09:07:15.097652+0000","last_became_active":"2023-05-12T09:07:05.258376+0000","last_became_peered":"2023-05-12T09:07:05.258376+0000","last_unstale":"2023-05-12T09:07:15.097652+0000","last_undegraded":"2023-05-12T09:07:15.097652+0000","last_fullsized":"2023-05-12T09:07:15.097652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:41:23.293447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098911+0000","last_change":"2023-05-12T09:07:10.073268+0000","last_active":"2023-05-12T09:07:15.098911+0000","last_peered":"2023-05-12T09:07:15.098911+0000","last_clean":"2023-05-12T09:07:15.098911+0000","last_became_active":"2023-05-12T09:07:10.072997+0000","last_became_peered":"2023-05-12T09:07:10.072997+0000","last_unstale":"2023-05-12T09:07:15.098911+0000","last_undegraded":"2023-05-12T09:07:15.098911+0000","last_fullsized":"2023-05-12T09:07:15.098911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:14:41.536722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096597+0000","last_change":"2023-05-12T09:07:10.561961+0000","last_active":"2023-05-12T09:07:15.096597+0000","last_peered":"2023-05-12T09:07:15.096597+0000","last_clean":"2023-05-12T09:07:15.096597+0000","last_became_active":"2023-05-12T09:07:10.561690+0000","last_became_peered":"2023-05-12T09:07:10.561690+0000","last_unstale":"2023-05-12T09:07:15.096597+0000","last_undegraded":"2023-05-12T09:07:15.096597+0000","last_fullsized":"2023-05-12T09:07:15.096597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:17:43.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058733+0000","last_change":"2023-05-12T09:07:14.585070+0000","last_active":"2023-05-12T09:07:15.058733+0000","last_peered":"2023-05-12T09:07:15.058733+0000","last_clean":"2023-05-12T09:07:15.058733+0000","last_became_active":"2023-05-12T09:07:14.584656+0000","last_became_peered":"2023-05-12T09:07:14.584656+0000","last_unstale":"2023-05-12T09:07:15.058733+0000","last_undegraded":"2023-05-12T09:07:15.058733+0000","last_fullsized":"2023-05-12T09:07:15.058733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:53:19.096515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058688+0000","last_change":"2023-05-12T09:07:05.258598+0000","last_active":"2023-05-12T09:07:15.058688+0000","last_peered":"2023-05-12T09:07:15.058688+0000","last_clean":"2023-05-12T09:07:15.058688+0000","last_became_active":"2023-05-12T09:07:05.258280+0000","last_became_peered":"2023-05-12T09:07:05.258280+0000","last_unstale":"2023-05-12T09:07:15.058688+0000","last_undegraded":"2023-05-12T09:07:15.058688+0000","last_fullsized":"2023-05-12T09:07:15.058688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:50.177616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096736+0000","last_change":"2023-05-12T09:07:10.072051+0000","last_active":"2023-05-12T09:07:15.096736+0000","last_peered":"2023-05-12T09:07:15.096736+0000","last_clean":"2023-05-12T09:07:15.096736+0000","last_became_active":"2023-05-12T09:07:10.071775+0000","last_became_peered":"2023-05-12T09:07:10.071775+0000","last_unstale":"2023-05-12T09:07:15.096736+0000","last_undegraded":"2023-05-12T09:07:15.096736+0000","last_fullsized":"2023-05-12T09:07:15.096736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:10.949889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097922+0000","last_change":"2023-05-12T09:07:10.558361+0000","last_active":"2023-05-12T09:07:15.097922+0000","last_peered":"2023-05-12T09:07:15.097922+0000","last_clean":"2023-05-12T09:07:15.097922+0000","last_became_active":"2023-05-12T09:07:10.557975+0000","last_became_peered":"2023-05-12T09:07:10.557975+0000","last_unstale":"2023-05-12T09:07:15.097922+0000","last_undegraded":"2023-05-12T09:07:15.097922+0000","last_fullsized":"2023-05-12T09:07:15.097922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:01:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097799+0000","last_change":"2023-05-12T09:07:14.587172+0000","last_active":"2023-05-12T09:07:15.097799+0000","last_peered":"2023-05-12T09:07:15.097799+0000","last_clean":"2023-05-12T09:07:15.097799+0000","last_became_active":"2023-05-12T09:07:14.586671+0000","last_became_peered":"2023-05-12T09:07:14.586671+0000","last_unstale":"2023-05-12T09:07:15.097799+0000","last_undegraded":"2023-05-12T09:07:15.097799+0000","last_fullsized":"2023-05-12T09:07:15.097799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:11:50.401900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059054+0000","last_change":"2023-05-12T09:07:04.830787+0000","last_active":"2023-05-12T09:07:15.059054+0000","last_peered":"2023-05-12T09:07:15.059054+0000","last_clean":"2023-05-12T09:07:15.059054+0000","last_became_active":"2023-05-12T09:07:04.830492+0000","last_became_peered":"2023-05-12T09:07:04.830492+0000","last_unstale":"2023-05-12T09:07:15.059054+0000","last_undegraded":"2023-05-12T09:07:15.059054+0000","last_fullsized":"2023-05-12T09:07:15.059054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:18:33.956760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099144+0000","last_change":"2023-05-12T09:07:10.072970+0000","last_active":"2023-05-12T09:07:15.099144+0000","last_peered":"2023-05-12T09:07:15.099144+0000","last_clean":"2023-05-12T09:07:15.099144+0000","last_became_active":"2023-05-12T09:07:10.072670+0000","last_became_peered":"2023-05-12T09:07:10.072670+0000","last_unstale":"2023-05-12T09:07:15.099144+0000","last_undegraded":"2023-05-12T09:07:15.099144+0000","last_fullsized":"2023-05-12T09:07:15.099144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:21.054528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097023+0000","last_change":"2023-05-12T09:07:10.565493+0000","last_active":"2023-05-12T09:07:15.097023+0000","last_peered":"2023-05-12T09:07:15.097023+0000","last_clean":"2023-05-12T09:07:15.097023+0000","last_became_active":"2023-05-12T09:07:10.565202+0000","last_became_peered":"2023-05-12T09:07:10.565202+0000","last_unstale":"2023-05-12T09:07:15.097023+0000","last_undegraded":"2023-05-12T09:07:15.097023+0000","last_fullsized":"2023-05-12T09:07:15.097023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:22.060968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096821+0000","last_change":"2023-05-12T09:07:14.595394+0000","last_active":"2023-05-12T09:07:15.096821+0000","last_peered":"2023-05-12T09:07:15.096821+0000","last_clean":"2023-05-12T09:07:15.096821+0000","last_became_active":"2023-05-12T09:07:14.594978+0000","last_became_peered":"2023-05-12T09:07:14.594978+0000","last_unstale":"2023-05-12T09:07:15.096821+0000","last_undegraded":"2023-05-12T09:07:15.096821+0000","last_fullsized":"2023-05-12T09:07:15.096821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:52.189320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097791+0000","last_change":"2023-05-12T09:07:10.078522+0000","last_active":"2023-05-12T09:07:15.097791+0000","last_peered":"2023-05-12T09:07:15.097791+0000","last_clean":"2023-05-12T09:07:15.097791+0000","last_became_active":"2023-05-12T09:07:10.078295+0000","last_became_peered":"2023-05-12T09:07:10.078295+0000","last_unstale":"2023-05-12T09:07:15.097791+0000","last_undegraded":"2023-05-12T09:07:15.097791+0000","last_fullsized":"2023-05-12T09:07:15.097791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:11:17.984136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.057055+0000","last_change":"2023-05-12T09:07:10.560192+0000","last_active":"2023-05-12T09:07:15.057055+0000","last_peered":"2023-05-12T09:07:15.057055+0000","last_clean":"2023-05-12T09:07:15.057055+0000","last_became_active":"2023-05-12T09:07:10.559897+0000","last_became_peered":"2023-05-12T09:07:10.559897+0000","last_unstale":"2023-05-12T09:07:15.057055+0000","last_undegraded":"2023-05-12T09:07:15.057055+0000","last_fullsized":"2023-05-12T09:07:15.057055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:25:50.021542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097222+0000","last_change":"2023-05-12T09:07:14.590573+0000","last_active":"2023-05-12T09:07:15.097222+0000","last_peered":"2023-05-12T09:07:15.097222+0000","last_clean":"2023-05-12T09:07:15.097222+0000","last_became_active":"2023-05-12T09:07:14.590176+0000","last_became_peered":"2023-05-12T09:07:14.590176+0000","last_unstale":"2023-05-12T09:07:15.097222+0000","last_undegraded":"2023-05-12T09:07:15.097222+0000","last_fullsized":"2023-05-12T09:07:15.097222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:52:15.456994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097418+0000","last_change":"2023-05-12T09:07:10.080277+0000","last_active":"2023-05-12T09:07:15.097418+0000","last_peered":"2023-05-12T09:07:15.097418+0000","last_clean":"2023-05-12T09:07:15.097418+0000","last_became_active":"2023-05-12T09:07:10.079936+0000","last_became_peered":"2023-05-12T09:07:10.079936+0000","last_unstale":"2023-05-12T09:07:15.097418+0000","last_undegraded":"2023-05-12T09:07:15.097418+0000","last_fullsized":"2023-05-12T09:07:15.097418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:03:06.647253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098333+0000","last_change":"2023-05-12T09:07:10.569555+0000","last_active":"2023-05-12T09:07:15.098333+0000","last_peered":"2023-05-12T09:07:15.098333+0000","last_clean":"2023-05-12T09:07:15.098333+0000","last_became_active":"2023-05-12T09:07:10.569253+0000","last_became_peered":"2023-05-12T09:07:10.569253+0000","last_unstale":"2023-05-12T09:07:15.098333+0000","last_undegraded":"2023-05-12T09:07:15.098333+0000","last_fullsized":"2023-05-12T09:07:15.098333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:58:19.840466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098745+0000","last_change":"2023-05-12T09:07:14.588834+0000","last_active":"2023-05-12T09:07:15.098745+0000","last_peered":"2023-05-12T09:07:15.098745+0000","last_clean":"2023-05-12T09:07:15.098745+0000","last_became_active":"2023-05-12T09:07:14.588451+0000","last_became_peered":"2023-05-12T09:07:14.588451+0000","last_unstale":"2023-05-12T09:07:15.098745+0000","last_undegraded":"2023-05-12T09:07:15.098745+0000","last_fullsized":"2023-05-12T09:07:15.098745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:50:52.189320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.099255+0000","last_change":"2023-05-12T09:07:10.078506+0000","last_active":"2023-05-12T09:07:15.099255+0000","last_peered":"2023-05-12T09:07:15.099255+0000","last_clean":"2023-05-12T09:07:15.099255+0000","last_became_active":"2023-05-12T09:07:10.078243+0000","last_became_peered":"2023-05-12T09:07:10.078243+0000","last_unstale":"2023-05-12T09:07:15.099255+0000","last_undegraded":"2023-05-12T09:07:15.099255+0000","last_fullsized":"2023-05-12T09:07:15.099255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:31:24.289481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098134+0000","last_change":"2023-05-12T09:07:10.570203+0000","last_active":"2023-05-12T09:07:15.098134+0000","last_peered":"2023-05-12T09:07:15.098134+0000","last_clean":"2023-05-12T09:07:15.098134+0000","last_became_active":"2023-05-12T09:07:10.569917+0000","last_became_peered":"2023-05-12T09:07:10.569917+0000","last_unstale":"2023-05-12T09:07:15.098134+0000","last_undegraded":"2023-05-12T09:07:15.098134+0000","last_fullsized":"2023-05-12T09:07:15.098134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:37:03.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098605+0000","last_change":"2023-05-12T09:07:14.591389+0000","last_active":"2023-05-12T09:07:15.098605+0000","last_peered":"2023-05-12T09:07:15.098605+0000","last_clean":"2023-05-12T09:07:15.098605+0000","last_became_active":"2023-05-12T09:07:14.591029+0000","last_became_peered":"2023-05-12T09:07:14.591029+0000","last_unstale":"2023-05-12T09:07:15.098605+0000","last_undegraded":"2023-05-12T09:07:15.098605+0000","last_fullsized":"2023-05-12T09:07:15.098605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:50:10.131123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.059215+0000","last_change":"2023-05-12T09:07:10.066391+0000","last_active":"2023-05-12T09:07:15.059215+0000","last_peered":"2023-05-12T09:07:15.059215+0000","last_clean":"2023-05-12T09:07:15.059215+0000","last_became_active":"2023-05-12T09:07:10.066135+0000","last_became_peered":"2023-05-12T09:07:10.066135+0000","last_unstale":"2023-05-12T09:07:15.059215+0000","last_undegraded":"2023-05-12T09:07:15.059215+0000","last_fullsized":"2023-05-12T09:07:15.059215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:57.005641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058832+0000","last_change":"2023-05-12T09:07:10.552090+0000","last_active":"2023-05-12T09:07:15.058832+0000","last_peered":"2023-05-12T09:07:15.058832+0000","last_clean":"2023-05-12T09:07:15.058832+0000","last_became_active":"2023-05-12T09:07:10.551802+0000","last_became_peered":"2023-05-12T09:07:10.551802+0000","last_unstale":"2023-05-12T09:07:15.058832+0000","last_undegraded":"2023-05-12T09:07:15.058832+0000","last_fullsized":"2023-05-12T09:07:15.058832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:54.558448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.096851+0000","last_change":"2023-05-12T09:07:14.585407+0000","last_active":"2023-05-12T09:07:15.096851+0000","last_peered":"2023-05-12T09:07:15.096851+0000","last_clean":"2023-05-12T09:07:15.096851+0000","last_became_active":"2023-05-12T09:07:14.585059+0000","last_became_peered":"2023-05-12T09:07:14.585059+0000","last_unstale":"2023-05-12T09:07:15.096851+0000","last_undegraded":"2023-05-12T09:07:15.096851+0000","last_fullsized":"2023-05-12T09:07:15.096851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:13.546326+0000","last_clean_scrub_stamp":"2023-05-12T09:07:13.546326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:30:02.274700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097402+0000","last_change":"2023-05-12T09:07:10.068737+0000","last_active":"2023-05-12T09:07:15.097402+0000","last_peered":"2023-05-12T09:07:15.097402+0000","last_clean":"2023-05-12T09:07:15.097402+0000","last_became_active":"2023-05-12T09:07:10.068427+0000","last_became_peered":"2023-05-12T09:07:10.068427+0000","last_unstale":"2023-05-12T09:07:15.097402+0000","last_undegraded":"2023-05-12T09:07:15.097402+0000","last_fullsized":"2023-05-12T09:07:15.097402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:09.039221+0000","last_clean_scrub_stamp":"2023-05-12T09:07:09.039221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:49:41.703805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098946+0000","last_change":"2023-05-12T09:07:10.565243+0000","last_active":"2023-05-12T09:07:15.098946+0000","last_peered":"2023-05-12T09:07:15.098946+0000","last_clean":"2023-05-12T09:07:15.098946+0000","last_became_active":"2023-05-12T09:07:10.564923+0000","last_became_peered":"2023-05-12T09:07:10.564923+0000","last_unstale":"2023-05-12T09:07:15.098946+0000","last_undegraded":"2023-05-12T09:07:15.098946+0000","last_fullsized":"2023-05-12T09:07:15.098946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:35.146554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058306+0000","last_change":"2023-05-12T09:07:10.554737+0000","last_active":"2023-05-12T09:07:15.058306+0000","last_peered":"2023-05-12T09:07:15.058306+0000","last_clean":"2023-05-12T09:07:15.058306+0000","last_became_active":"2023-05-12T09:07:10.554481+0000","last_became_peered":"2023-05-12T09:07:10.554481+0000","last_unstale":"2023-05-12T09:07:15.058306+0000","last_undegraded":"2023-05-12T09:07:15.058306+0000","last_fullsized":"2023-05-12T09:07:15.058306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:07:09.286879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058533+0000","last_change":"2023-05-12T09:07:10.551816+0000","last_active":"2023-05-12T09:07:15.058533+0000","last_peered":"2023-05-12T09:07:15.058533+0000","last_clean":"2023-05-12T09:07:15.058533+0000","last_became_active":"2023-05-12T09:07:10.551522+0000","last_became_peered":"2023-05-12T09:07:10.551522+0000","last_unstale":"2023-05-12T09:07:15.058533+0000","last_undegraded":"2023-05-12T09:07:15.058533+0000","last_fullsized":"2023-05-12T09:07:15.058533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:50:06.630457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.098592+0000","last_change":"2023-05-12T09:07:10.565765+0000","last_active":"2023-05-12T09:07:15.098592+0000","last_peered":"2023-05-12T09:07:15.098592+0000","last_clean":"2023-05-12T09:07:15.098592+0000","last_became_active":"2023-05-12T09:07:10.565493+0000","last_became_peered":"2023-05-12T09:07:10.565493+0000","last_unstale":"2023-05-12T09:07:15.098592+0000","last_undegraded":"2023-05-12T09:07:15.098592+0000","last_fullsized":"2023-05-12T09:07:15.098592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:03:08.211119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.058766+0000","last_change":"2023-05-12T09:07:10.558789+0000","last_active":"2023-05-12T09:07:15.058766+0000","last_peered":"2023-05-12T09:07:15.058766+0000","last_clean":"2023-05-12T09:07:15.058766+0000","last_became_active":"2023-05-12T09:07:10.557767+0000","last_became_peered":"2023-05-12T09:07:10.557767+0000","last_unstale":"2023-05-12T09:07:15.058766+0000","last_undegraded":"2023-05-12T09:07:15.058766+0000","last_fullsized":"2023-05-12T09:07:15.058766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:57:19.896315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-12T09:07:15.097817+0000","last_change":"2023-05-12T09:07:10.566888+0000","last_active":"2023-05-12T09:07:15.097817+0000","last_peered":"2023-05-12T09:07:15.097817+0000","last_clean":"2023-05-12T09:07:15.097817+0000","last_became_active":"2023-05-12T09:07:10.566580+0000","last_became_peered":"2023-05-12T09:07:10.566580+0000","last_unstale":"2023-05-12T09:07:15.097817+0000","last_undegraded":"2023-05-12T09:07:15.097817+0000","last_fullsized":"2023-05-12T09:07:15.097817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:10.045660+0000","last_clean_scrub_stamp":"2023-05-12T09:07:10.045660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:27:35.159319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9248,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362592,"statfs":{"total":96636764160,"available":96627294208,"internally_reserved":0,"allocated":876544,"data_stored":699108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8259999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9220,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362620,"statfs":{"total":96636764160,"available":96627322880,"internally_reserved":0,"allocated":847872,"data_stored":695098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8132,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363708,"statfs":{"total":96636764160,"available":96628436992,"internally_reserved":0,"allocated":258048,"data_stored":105312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.8220000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.8470000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.064}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7910000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.968}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8132,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363708,"statfs":{"total":96636764160,"available":96628436992,"internally_reserved":0,"allocated":258048,"data_stored":104820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8212,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363628,"statfs":{"total":96636764160,"available":96628355072,"internally_reserved":0,"allocated":274432,"data_stored":108580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":104021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-12T09:07:45.859 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-12T09:07:45.859 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-12T09:07:45.860 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-12T09:07:45.860 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-12T09:07:46.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.071+0000 7fda68bff700 1 Processor -- start 2023-05-12T09:07:46.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.071+0000 7fda68bff700 1 -- start start 2023-05-12T09:07:46.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.072+0000 7fda68bff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fda6415c590 0x7fda64160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.072+0000 7fda68bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fda640cff50 0x7fda640d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.072+0000 7fda68bff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda640cd520 con 0x7fda640cf010 2023-05-12T09:07:46.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.072+0000 7fda68bff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda640d2640 con 0x7fda6415c590 2023-05-12T09:07:46.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.072+0000 7fda68bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda641610d0 con 0x7fda640cff50 2023-05-12T09:07:46.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.072+0000 7fda6259c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fda6415c590 0x7fda64160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.072+0000 7fda6259c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fda6415c590 0x7fda64160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57420/0 (socket says 172.21.15.116:57420) 2023-05-12T09:07:46.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.072+0000 7fda6259c700 1 -- 172.21.15.116:0/2923662163 learned_addr learned my addr 172.21.15.116:0/2923662163 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:46.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.072+0000 7fda62d9d700 1 --2- 172.21.15.116:0/2923662163 >> v2:172.21.15.182:3300/0 conn(0x7fda640cff50 0x7fda640d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.073+0000 7fda6259c700 1 -- 172.21.15.116:0/2923662163 >> v2:172.21.15.182:3300/0 conn(0x7fda640cff50 msgr2=0x7fda640d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:46.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.073+0000 7fda6259c700 1 --2- 172.21.15.116:0/2923662163 >> v2:172.21.15.182:3300/0 conn(0x7fda640cff50 0x7fda640d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.073+0000 7fda6259c700 1 -- 172.21.15.116:0/2923662163 >> v1:172.21.15.182:6789/0 conn(0x7fda640cf010 legacy=0x7fda640cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.073+0000 7fda6259c700 1 -- 172.21.15.116:0/2923662163 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640b23c0 con 0x7fda6415c590 2023-05-12T09:07:46.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.073+0000 7fda6259c700 1 --2- 172.21.15.116:0/2923662163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda6415c590 0x7fda64160b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fda640b20b0 tx=0x7fda54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acdad6f5f391b3 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:46.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.073+0000 7fda6159a700 1 -- 172.21.15.116:0/2923662163 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54011830 con 0x7fda6415c590 2023-05-12T09:07:46.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.073+0000 7fda6159a700 1 -- 172.21.15.116:0/2923662163 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda54011990 con 0x7fda6415c590 2023-05-12T09:07:46.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.073+0000 7fda6159a700 1 -- 172.21.15.116:0/2923662163 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54011d20 con 0x7fda6415c590 2023-05-12T09:07:46.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.074+0000 7fda68bff700 1 -- 172.21.15.116:0/2923662163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda6415c590 msgr2=0x7fda64160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.074+0000 7fda68bff700 1 --2- 172.21.15.116:0/2923662163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda6415c590 0x7fda64160b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fda640b20b0 tx=0x7fda54009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.074+0000 7fda68bff700 1 -- 172.21.15.116:0/2923662163 shutdown_connections 2023-05-12T09:07:46.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.074+0000 7fda68bff700 1 --2- 172.21.15.116:0/2923662163 >> v2:172.21.15.182:3300/0 conn(0x7fda640cff50 0x7fda640d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.074+0000 7fda68bff700 1 --2- 172.21.15.116:0/2923662163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda6415c590 0x7fda64160b90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.074+0000 7fda68bff700 1 -- 172.21.15.116:0/2923662163 >> 172.21.15.116:0/2923662163 conn(0x7fda64071b10 msgr2=0x7fda64071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:46.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.074+0000 7fda68bff700 1 -- 172.21.15.116:0/2923662163 shutdown_connections 2023-05-12T09:07:46.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.074+0000 7fda68bff700 1 -- 172.21.15.116:0/2923662163 wait complete. 2023-05-12T09:07:46.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.076+0000 7fda68bff700 1 Processor -- start 2023-05-12T09:07:46.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.076+0000 7fda68bff700 1 -- start start 2023-05-12T09:07:46.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda68bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda640cf010 0x7fda64157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda68bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fda640cff50 0x7fda640b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda68bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fda6415c590 0x7fda640b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda68bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640b7170 con 0x7fda640cf010 2023-05-12T09:07:46.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda68bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6415f250 con 0x7fda640cff50 2023-05-12T09:07:46.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda68bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda640b6e30 con 0x7fda6415c590 2023-05-12T09:07:46.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda6259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda640cf010 0x7fda64157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda6259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda640cf010 0x7fda64157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57432/0 (socket says 172.21.15.116:57432) 2023-05-12T09:07:46.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda6259c700 1 -- 172.21.15.116:0/706442497 learned_addr learned my addr 172.21.15.116:0/706442497 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:46.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda61d9b700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fda640cff50 0x7fda640b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda62d9d700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fda6415c590 0x7fda640b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda6259c700 1 -- 172.21.15.116:0/706442497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fda6415c590 msgr2=0x7fda640b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda6259c700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fda6415c590 0x7fda640b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda6259c700 1 -- 172.21.15.116:0/706442497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fda640cff50 msgr2=0x7fda640b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda6259c700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fda640cff50 0x7fda640b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.077+0000 7fda6259c700 1 -- 172.21.15.116:0/706442497 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda54009550 con 0x7fda640cf010 2023-05-12T09:07:46.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.078+0000 7fda6259c700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda640cf010 0x7fda64157390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fda54000c00 tx=0x7fda54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:46.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.078+0000 7fda52ffd700 1 -- 172.21.15.116:0/706442497 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54004300 con 0x7fda640cf010 2023-05-12T09:07:46.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.078+0000 7fda52ffd700 1 -- 172.21.15.116:0/706442497 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5401f070 con 0x7fda640cf010 2023-05-12T09:07:46.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.078+0000 7fda52ffd700 1 -- 172.21.15.116:0/706442497 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540036a0 con 0x7fda640cf010 2023-05-12T09:07:46.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.078+0000 7fda68bff700 1 -- 172.21.15.116:0/706442497 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda640cd770 con 0x7fda640cf010 2023-05-12T09:07:46.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.078+0000 7fda68bff700 1 -- 172.21.15.116:0/706442497 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda640cf560 con 0x7fda640cf010 2023-05-12T09:07:46.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.079+0000 7fda68bff700 1 -- 172.21.15.116:0/706442497 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6415c960 con 0x7fda640cf010 2023-05-12T09:07:46.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.080+0000 7fda52ffd700 1 -- 172.21.15.116:0/706442497 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda54021030 con 0x7fda640cf010 2023-05-12T09:07:46.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.081+0000 7fda52ffd700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda4406ace0 0x7fda4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.081+0000 7fda52ffd700 1 -- 172.21.15.116:0/706442497 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fda5408ab00 con 0x7fda640cf010 2023-05-12T09:07:46.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.081+0000 7fda61d9b700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda4406ace0 0x7fda4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.081+0000 7fda61d9b700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda4406ace0 0x7fda4406d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fda641f56f0 tx=0x7fda58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:46.088 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.085+0000 7fda52ffd700 1 -- 172.21.15.116:0/706442497 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fda5408ce60 con 0x7fda640cf010 2023-05-12T09:07:46.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.317+0000 7fda68bff700 1 -- 172.21.15.116:0/706442497 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fda640b51f0 con 0x7fda640cf010 2023-05-12T09:07:46.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.318+0000 7fda52ffd700 1 -- 172.21.15.116:0/706442497 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fda54055830 con 0x7fda640cf010 2023-05-12T09:07:46.321 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:46.322 INFO:teuthology.orchestra.run.smithi116.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-12T09:07:46.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 -- 172.21.15.116:0/706442497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda4406ace0 msgr2=0x7fda4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda4406ace0 0x7fda4406d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fda641f56f0 tx=0x7fda58009040 comp rx=0 tx=0).stop 2023-05-12T09:07:46.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 -- 172.21.15.116:0/706442497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda640cf010 msgr2=0x7fda64157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda640cf010 0x7fda64157390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fda54000c00 tx=0x7fda54004750 comp rx=0 tx=0).stop 2023-05-12T09:07:46.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 -- 172.21.15.116:0/706442497 shutdown_connections 2023-05-12T09:07:46.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fda4406ace0 0x7fda4406d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fda6415c590 0x7fda640b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda640cf010 0x7fda64157390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 --2- 172.21.15.116:0/706442497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fda640cff50 0x7fda640b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 -- 172.21.15.116:0/706442497 >> 172.21.15.116:0/706442497 conn(0x7fda64071b10 msgr2=0x7fda6415b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:46.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 -- 172.21.15.116:0/706442497 shutdown_connections 2023-05-12T09:07:46.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.320+0000 7fda68bff700 1 -- 172.21.15.116:0/706442497 wait complete. 2023-05-12T09:07:46.340 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-12T09:07:46.341 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.522+0000 7fa5533ff700 1 Processor -- start 2023-05-12T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.522+0000 7fa5533ff700 1 -- start start 2023-05-12T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.523+0000 7fa5533ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fa54c0cfbf0 0x7fa54c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.523+0000 7fa5533ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa54c0d1100 0x7fa54c0d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.523+0000 7fa5533ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c0d0020 con 0x7fa54c0b87a0 2023-05-12T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.523+0000 7fa5533ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54c0d02d0 con 0x7fa54c0d1100 2023-05-12T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.523+0000 7fa5533ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54c0d0cb0 con 0x7fa54c0cfbf0 2023-05-12T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.523+0000 7fa55119b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa54c0b87a0 0x7fa54c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60556/0 (socket says 172.21.15.116:60556) 2023-05-12T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.524+0000 7fa55119b700 1 -- 172.21.15.116:0/1469453971 learned_addr learned my addr 172.21.15.116:0/1469453971 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.524+0000 7fa55199c700 1 --2- 172.21.15.116:0/1469453971 >> v2:172.21.15.116:3300/0 conn(0x7fa54c0d1100 0x7fa54c0d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.524+0000 7fa55099a700 1 --2- 172.21.15.116:0/1469453971 >> v2:172.21.15.182:3300/0 conn(0x7fa54c0cfbf0 0x7fa54c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.524+0000 7fa543fff700 1 -- 172.21.15.116:0/1469453971 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928582346 0 0) 0x7fa54c0d0020 con 0x7fa54c0b87a0 2023-05-12T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.524+0000 7fa543fff700 1 -- 172.21.15.116:0/1469453971 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5380035b0 con 0x7fa54c0b87a0 2023-05-12T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.524+0000 7fa55099a700 1 -- 172.21.15.116:0/1469453971 >> v2:172.21.15.116:3300/0 conn(0x7fa54c0d1100 msgr2=0x7fa54c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.524+0000 7fa55099a700 1 --2- 172.21.15.116:0/1469453971 >> v2:172.21.15.116:3300/0 conn(0x7fa54c0d1100 0x7fa54c0d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.524+0000 7fa55099a700 1 -- 172.21.15.116:0/1469453971 >> v1:172.21.15.116:6789/0 conn(0x7fa54c0b87a0 legacy=0x7fa54c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.524+0000 7fa55099a700 1 -- 172.21.15.116:0/1469453971 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0cdc60 con 0x7fa54c0cfbf0 2023-05-12T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.524+0000 7fa55099a700 1 --2- 172.21.15.116:0/1469453971 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa54c0cfbf0 0x7fa54c1608f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0b8f60 tx=0x7fa53c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c03eb57ba901fde2 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa543fff700 1 -- 172.21.15.116:0/1469453971 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c011830 con 0x7fa54c0cfbf0 2023-05-12T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa543fff700 1 -- 172.21.15.116:0/1469453971 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c011990 con 0x7fa54c0cfbf0 2023-05-12T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa543fff700 1 -- 172.21.15.116:0/1469453971 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c011d20 con 0x7fa54c0cfbf0 2023-05-12T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa5533ff700 1 -- 172.21.15.116:0/1469453971 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa54c0cfbf0 msgr2=0x7fa54c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa5533ff700 1 --2- 172.21.15.116:0/1469453971 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa54c0cfbf0 0x7fa54c1608f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0b8f60 tx=0x7fa53c009b20 comp rx=0 tx=0).stop 2023-05-12T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa5533ff700 1 -- 172.21.15.116:0/1469453971 shutdown_connections 2023-05-12T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa5533ff700 1 --2- 172.21.15.116:0/1469453971 >> v2:172.21.15.116:3300/0 conn(0x7fa54c0d1100 0x7fa54c0d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa5533ff700 1 --2- 172.21.15.116:0/1469453971 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa54c0cfbf0 0x7fa54c1608f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa5533ff700 1 -- 172.21.15.116:0/1469453971 >> 172.21.15.116:0/1469453971 conn(0x7fa54c071b10 msgr2=0x7fa54c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa5533ff700 1 -- 172.21.15.116:0/1469453971 shutdown_connections 2023-05-12T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.525+0000 7fa5533ff700 1 -- 172.21.15.116:0/1469453971 wait complete. 2023-05-12T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.527+0000 7fa5533ff700 1 Processor -- start 2023-05-12T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.527+0000 7fa5533ff700 1 -- start start 2023-05-12T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.528+0000 7fa5533ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa54c0b87a0 0x7fa54c0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.528+0000 7fa5533ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa54c0cfbf0 0x7fa54c14ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.528+0000 7fa5533ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa54c0d1100 0x7fa54c0c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.528+0000 7fa5533ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c15e660 con 0x7fa54c0b87a0 2023-05-12T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.528+0000 7fa5533ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c14f1d0 con 0x7fa54c0d1100 2023-05-12T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.528+0000 7fa5533ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0ca480 con 0x7fa54c0cfbf0 2023-05-12T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.528+0000 7fa55119b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa54c0b87a0 0x7fa54c0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.528+0000 7fa55119b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa54c0b87a0 0x7fa54c0c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57454/0 (socket says 172.21.15.116:57454) 2023-05-12T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.528+0000 7fa55119b700 1 -- 172.21.15.116:0/3119479180 learned_addr learned my addr 172.21.15.116:0/3119479180 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa55199c700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa54c0d1100 0x7fa54c0c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa55119b700 1 -- 172.21.15.116:0/3119479180 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa54c0cfbf0 msgr2=0x7fa54c14ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa55099a700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa54c0cfbf0 0x7fa54c14ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa55119b700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa54c0cfbf0 0x7fa54c14ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa55119b700 1 -- 172.21.15.116:0/3119479180 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa54c0d1100 msgr2=0x7fa54c0c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa55119b700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa54c0d1100 0x7fa54c0c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa55119b700 1 -- 172.21.15.116:0/3119479180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0094a0 con 0x7fa54c0b87a0 2023-05-12T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa55199c700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa54c0d1100 0x7fa54c0c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa55099a700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa54c0cfbf0 0x7fa54c14ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa55119b700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa54c0b87a0 0x7fa54c0c9680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa548001eb0 tx=0x7fa54800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa541ffb700 1 -- 172.21.15.116:0/3119479180 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548005d70 con 0x7fa54c0b87a0 2023-05-12T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa541ffb700 1 -- 172.21.15.116:0/3119479180 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5480070d0 con 0x7fa54c0b87a0 2023-05-12T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa5533ff700 1 -- 172.21.15.116:0/3119479180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c0cd980 con 0x7fa54c0b87a0 2023-05-12T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa541ffb700 1 -- 172.21.15.116:0/3119479180 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548007460 con 0x7fa54c0b87a0 2023-05-12T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.529+0000 7fa5533ff700 1 -- 172.21.15.116:0/3119479180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c0cd6a0 con 0x7fa54c0b87a0 2023-05-12T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.530+0000 7fa5533ff700 1 -- 172.21.15.116:0/3119479180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c160e30 con 0x7fa54c0b87a0 2023-05-12T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.531+0000 7fa541ffb700 1 -- 172.21.15.116:0/3119479180 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa5480075c0 con 0x7fa54c0b87a0 2023-05-12T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.532+0000 7fa541ffb700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa53006ace0 0x7fa53006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.532+0000 7fa541ffb700 1 -- 172.21.15.116:0/3119479180 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa548088dd0 con 0x7fa54c0b87a0 2023-05-12T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.532+0000 7fa55099a700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa53006ace0 0x7fa53006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.533+0000 7fa55099a700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa53006ace0 0x7fa53006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa54c1f5280 tx=0x7fa53c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.536+0000 7fa541ffb700 1 -- 172.21.15.116:0/3119479180 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa548053af0 con 0x7fa54c0b87a0 2023-05-12T09:07:46.745 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.742+0000 7fa5533ff700 1 -- 172.21.15.116:0/3119479180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa54c074430 con 0x7fa54c0b87a0 2023-05-12T09:07:46.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.743+0000 7fa541ffb700 1 -- 172.21.15.116:0/3119479180 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7fa548057110 con 0x7fa54c0b87a0 2023-05-12T09:07:46.747 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:46.747 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:46.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 -- 172.21.15.116:0/3119479180 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa53006ace0 msgr2=0x7fa53006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa53006ace0 0x7fa53006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa54c1f5280 tx=0x7fa53c008030 comp rx=0 tx=0).stop 2023-05-12T09:07:46.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 -- 172.21.15.116:0/3119479180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa54c0b87a0 msgr2=0x7fa54c0c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa54c0b87a0 0x7fa54c0c9680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa548001eb0 tx=0x7fa54800c860 comp rx=0 tx=0).stop 2023-05-12T09:07:46.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 -- 172.21.15.116:0/3119479180 shutdown_connections 2023-05-12T09:07:46.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa54c0d1100 0x7fa54c0c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa54c0b87a0 0x7fa54c0c9680 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa53006ace0 0x7fa53006d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 --2- 172.21.15.116:0/3119479180 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa54c0cfbf0 0x7fa54c14ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 -- 172.21.15.116:0/3119479180 >> 172.21.15.116:0/3119479180 conn(0x7fa54c071b10 msgr2=0x7fa54c0d3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:46.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 -- 172.21.15.116:0/3119479180 shutdown_connections 2023-05-12T09:07:46.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.746+0000 7fa5533ff700 1 -- 172.21.15.116:0/3119479180 wait complete. 2023-05-12T09:07:46.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:07:46.767 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:07:46.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.950+0000 7f56e97ff700 1 Processor -- start 2023-05-12T09:07:46.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.951+0000 7f56e97ff700 1 -- start start 2023-05-12T09:07:46.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56e97ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f56e406aaf0 0x7f56e4070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56e97ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56e4071030 0x7f56e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56e97ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e40cb280 con 0x7f56e415a5a0 2023-05-12T09:07:46.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56e97ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e415a970 con 0x7f56e406aaf0 2023-05-12T09:07:46.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56e97ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4071470 con 0x7f56e4071030 2023-05-12T09:07:46.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56dbfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f56e406aaf0 0x7f56e4070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56dbfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f56e406aaf0 0x7f56e4070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57466/0 (socket says 172.21.15.116:57466) 2023-05-12T09:07:46.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56dbfff700 1 -- 172.21.15.116:0/1946409495 learned_addr learned my addr 172.21.15.116:0/1946409495 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:46.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56e37fe700 1 --2- 172.21.15.116:0/1946409495 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56e4071030 0x7f56e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56dbfff700 1 -- 172.21.15.116:0/1946409495 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56e4071030 msgr2=0x7f56e406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:46.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56dbfff700 1 --2- 172.21.15.116:0/1946409495 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56e4071030 0x7f56e406d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56dbfff700 1 -- 172.21.15.116:0/1946409495 >> v1:172.21.15.182:6789/0 conn(0x7f56e415a5a0 legacy=0x7f56e406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:46.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.952+0000 7f56dbfff700 1 -- 172.21.15.116:0/1946409495 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4071700 con 0x7f56e406aaf0 2023-05-12T09:07:46.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.953+0000 7f56dbfff700 1 --2- 172.21.15.116:0/1946409495 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e406aaf0 0x7f56e4070af0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56cc006fd0 tx=0x7f56cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fa72cc45243a25 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:46.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.953+0000 7f56e27fc700 1 -- 172.21.15.116:0/1946409495 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc005e30 con 0x7f56e406aaf0 2023-05-12T09:07:46.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.953+0000 7f56e27fc700 1 -- 172.21.15.116:0/1946409495 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc006030 con 0x7f56e406aaf0 2023-05-12T09:07:46.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.953+0000 7f56e27fc700 1 -- 172.21.15.116:0/1946409495 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0063c0 con 0x7f56e406aaf0 2023-05-12T09:07:46.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.953+0000 7f56e97ff700 1 -- 172.21.15.116:0/1946409495 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e406aaf0 msgr2=0x7f56e4070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.953+0000 7f56e97ff700 1 --2- 172.21.15.116:0/1946409495 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e406aaf0 0x7f56e4070af0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56cc006fd0 tx=0x7f56cc009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.954+0000 7f56e97ff700 1 -- 172.21.15.116:0/1946409495 shutdown_connections 2023-05-12T09:07:46.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.954+0000 7f56e97ff700 1 --2- 172.21.15.116:0/1946409495 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56e4071030 0x7f56e406d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.954+0000 7f56e97ff700 1 --2- 172.21.15.116:0/1946409495 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e406aaf0 0x7f56e4070af0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.954+0000 7f56e97ff700 1 -- 172.21.15.116:0/1946409495 >> 172.21.15.116:0/1946409495 conn(0x7f56e40cf720 msgr2=0x7f56e40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:46.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.954+0000 7f56e97ff700 1 -- 172.21.15.116:0/1946409495 shutdown_connections 2023-05-12T09:07:46.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.954+0000 7f56e97ff700 1 -- 172.21.15.116:0/1946409495 wait complete. 2023-05-12T09:07:46.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.955+0000 7f56e97ff700 1 Processor -- start 2023-05-12T09:07:46.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.955+0000 7f56e97ff700 1 -- start start 2023-05-12T09:07:46.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.956+0000 7f56e97ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56e406aaf0 0x7f56e4150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.956+0000 7f56e97ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e4071030 0x7f56e4150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.956+0000 7f56e97ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56e415a5a0 0x7f56e4154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.956+0000 7f56e97ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415bcd0 con 0x7f56e4071030 2023-05-12T09:07:46.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.956+0000 7f56e97ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415d990 con 0x7f56e415a5a0 2023-05-12T09:07:46.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.956+0000 7f56e97ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415b9f0 con 0x7f56e406aaf0 2023-05-12T09:07:46.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56dbfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e4071030 0x7f56e4150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56dbfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e4071030 0x7f56e4150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57474/0 (socket says 172.21.15.116:57474) 2023-05-12T09:07:46.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56dbfff700 1 -- 172.21.15.116:0/771364193 learned_addr learned my addr 172.21.15.116:0/771364193 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:46.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56e2ffd700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56e406aaf0 0x7f56e4150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56e37fe700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56e415a5a0 0x7f56e4154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.964 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56dbfff700 1 -- 172.21.15.116:0/771364193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56e406aaf0 msgr2=0x7f56e4150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.964 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56dbfff700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56e406aaf0 0x7f56e4150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.964 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56dbfff700 1 -- 172.21.15.116:0/771364193 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56e415a5a0 msgr2=0x7f56e4154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:46.964 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56dbfff700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56e415a5a0 0x7f56e4154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:46.964 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56dbfff700 1 -- 172.21.15.116:0/771364193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc009500 con 0x7f56e4071030 2023-05-12T09:07:46.964 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.957+0000 7f56dbfff700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e4071030 0x7f56e4150590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f56cc000c00 tx=0x7f56cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:46.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.958+0000 7f56db7fe700 1 -- 172.21.15.116:0/771364193 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0067d0 con 0x7f56e4071030 2023-05-12T09:07:46.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.958+0000 7f56db7fe700 1 -- 172.21.15.116:0/771364193 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc020070 con 0x7f56e4071030 2023-05-12T09:07:46.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.958+0000 7f56db7fe700 1 -- 172.21.15.116:0/771364193 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc006950 con 0x7f56e4071030 2023-05-12T09:07:46.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.958+0000 7f56e97ff700 1 -- 172.21.15.116:0/771364193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e406c6c0 con 0x7f56e4071030 2023-05-12T09:07:46.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.958+0000 7f56e97ff700 1 -- 172.21.15.116:0/771364193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e40719e0 con 0x7f56e4071030 2023-05-12T09:07:46.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.959+0000 7f56e97ff700 1 -- 172.21.15.116:0/771364193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e406c9a0 con 0x7f56e4071030 2023-05-12T09:07:46.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.960+0000 7f56db7fe700 1 -- 172.21.15.116:0/771364193 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56cc022030 con 0x7f56e4071030 2023-05-12T09:07:46.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.960+0000 7f56db7fe700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c406ace0 0x7f56c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:46.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.961+0000 7f56db7fe700 1 -- 172.21.15.116:0/771364193 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f56cc08aa10 con 0x7f56e4071030 2023-05-12T09:07:46.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.961+0000 7f56e2ffd700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c406ace0 0x7f56c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:46.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.961+0000 7f56e2ffd700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c406ace0 0x7f56c406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f56e4151920 tx=0x7f56d40090e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:46.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:46.965+0000 7f56db7fe700 1 -- 172.21.15.116:0/771364193 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f56cc055840 con 0x7f56e4071030 2023-05-12T09:07:47.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.157+0000 7f56e97ff700 1 -- 172.21.15.116:0/771364193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f56e40ccfc0 con 0x7f56e4071030 2023-05-12T09:07:47.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.157+0000 7f56db7fe700 1 -- 172.21.15.116:0/771364193 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56cc058e60 con 0x7f56e4071030 2023-05-12T09:07:47.161 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:07:47.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 -- 172.21.15.116:0/771364193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c406ace0 msgr2=0x7f56c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c406ace0 0x7f56c406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f56e4151920 tx=0x7f56d40090e0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 -- 172.21.15.116:0/771364193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e4071030 msgr2=0x7f56e4150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e4071030 0x7f56e4150590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f56cc000c00 tx=0x7f56cc004750 comp rx=0 tx=0).stop 2023-05-12T09:07:47.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 -- 172.21.15.116:0/771364193 shutdown_connections 2023-05-12T09:07:47.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56e415a5a0 0x7f56e4154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c406ace0 0x7f56c406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56e406aaf0 0x7f56e4150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 --2- 172.21.15.116:0/771364193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56e4071030 0x7f56e4150590 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 -- 172.21.15.116:0/771364193 >> 172.21.15.116:0/771364193 conn(0x7f56e40cf720 msgr2=0x7f56e4072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:47.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 -- 172.21.15.116:0/771364193 shutdown_connections 2023-05-12T09:07:47.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.160+0000 7f56e97ff700 1 -- 172.21.15.116:0/771364193 wait complete. 2023-05-12T09:07:47.180 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:07:47.366 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.363+0000 7f8cf6bff700 1 Processor -- start 2023-05-12T09:07:47.367 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.364+0000 7f8cf6bff700 1 -- start start 2023-05-12T09:07:47.368 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8cf6bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f8cf00b87a0 0x7f8cf00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8cf6bff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8cf01601e0 0x7f8cf0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8cf6bff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf00cdc60 con 0x7f8cf0160b70 2023-05-12T09:07:47.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8cf6bff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00d02d0 con 0x7f8cf01601e0 2023-05-12T09:07:47.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8cf6bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00d0cb0 con 0x7f8cf00b87a0 2023-05-12T09:07:47.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8ceffff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8cf01601e0 0x7f8cf0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8cf519c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8cf0160b70 0x7f8cf00d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60558/0 (socket says 172.21.15.116:60558) 2023-05-12T09:07:47.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8cf519c700 1 -- 172.21.15.116:0/1775902396 learned_addr learned my addr 172.21.15.116:0/1775902396 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:47.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8cf499b700 1 --2- 172.21.15.116:0/1775902396 >> v2:172.21.15.182:3300/0 conn(0x7f8cf00b87a0 0x7f8cf00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8cef7fe700 1 -- 172.21.15.116:0/1775902396 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809752959 0 0) 0x7f8cf00cdc60 con 0x7f8cf0160b70 2023-05-12T09:07:47.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8cef7fe700 1 -- 172.21.15.116:0/1775902396 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce00035b0 con 0x7f8cf0160b70 2023-05-12T09:07:47.371 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8ceffff700 1 -- 172.21.15.116:0/1775902396 >> v2:172.21.15.182:3300/0 conn(0x7f8cf00b87a0 msgr2=0x7f8cf00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:47.371 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8ceffff700 1 --2- 172.21.15.116:0/1775902396 >> v2:172.21.15.182:3300/0 conn(0x7f8cf00b87a0 0x7f8cf00cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.371 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8ceffff700 1 -- 172.21.15.116:0/1775902396 >> v1:172.21.15.116:6789/0 conn(0x7f8cf0160b70 legacy=0x7f8cf00d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.371 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.365+0000 7f8ceffff700 1 -- 172.21.15.116:0/1775902396 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00cd6a0 con 0x7f8cf01601e0 2023-05-12T09:07:47.371 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.366+0000 7f8ceffff700 1 --2- 172.21.15.116:0/1775902396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 0x7f8cf0160630 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00b4ac0 tx=0x7f8cdc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb14648e039220b server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:47.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.366+0000 7f8cef7fe700 1 -- 172.21.15.116:0/1775902396 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc011830 con 0x7f8cf01601e0 2023-05-12T09:07:47.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.366+0000 7f8cef7fe700 1 -- 172.21.15.116:0/1775902396 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc011990 con 0x7f8cf01601e0 2023-05-12T09:07:47.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.366+0000 7f8cef7fe700 1 -- 172.21.15.116:0/1775902396 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc011d20 con 0x7f8cf01601e0 2023-05-12T09:07:47.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.366+0000 7f8cf6bff700 1 -- 172.21.15.116:0/1775902396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 msgr2=0x7f8cf0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.366+0000 7f8cf6bff700 1 --2- 172.21.15.116:0/1775902396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 0x7f8cf0160630 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00b4ac0 tx=0x7f8cdc009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:47.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.367+0000 7f8cf6bff700 1 -- 172.21.15.116:0/1775902396 shutdown_connections 2023-05-12T09:07:47.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.367+0000 7f8cf6bff700 1 --2- 172.21.15.116:0/1775902396 >> v2:172.21.15.182:3300/0 conn(0x7f8cf00b87a0 0x7f8cf00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.367+0000 7f8cf6bff700 1 --2- 172.21.15.116:0/1775902396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 0x7f8cf0160630 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.367+0000 7f8cf6bff700 1 -- 172.21.15.116:0/1775902396 >> 172.21.15.116:0/1775902396 conn(0x7f8cf0071b10 msgr2=0x7f8cf0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:47.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.367+0000 7f8cf6bff700 1 -- 172.21.15.116:0/1775902396 shutdown_connections 2023-05-12T09:07:47.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.367+0000 7f8cf6bff700 1 -- 172.21.15.116:0/1775902396 wait complete. 2023-05-12T09:07:47.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.368+0000 7f8cf6bff700 1 Processor -- start 2023-05-12T09:07:47.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.368+0000 7f8cf6bff700 1 -- start start 2023-05-12T09:07:47.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.369+0000 7f8cf6bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cf00b87a0 0x7f8cf01f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.369+0000 7f8cf6bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 0x7f8cf0151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.369+0000 7f8cf6bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8cf0160b70 0x7f8cf00b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.369+0000 7f8cf6bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00b4620 con 0x7f8cf01601e0 2023-05-12T09:07:47.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.369+0000 7f8cf6bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00cbdd0 con 0x7f8cf0160b70 2023-05-12T09:07:47.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.369+0000 7f8cf6bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00cb7c0 con 0x7f8cf00b87a0 2023-05-12T09:07:47.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8ceffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 0x7f8cf0151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8ceffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 0x7f8cf0151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57486/0 (socket says 172.21.15.116:57486) 2023-05-12T09:07:47.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8ceffff700 1 -- 172.21.15.116:0/3447357316 learned_addr learned my addr 172.21.15.116:0/3447357316 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:47.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8cf519c700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8cf0160b70 0x7f8cf00b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8cf499b700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cf00b87a0 0x7f8cf01f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8ceffff700 1 -- 172.21.15.116:0/3447357316 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cf00b87a0 msgr2=0x7f8cf01f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8ceffff700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cf00b87a0 0x7f8cf01f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8ceffff700 1 -- 172.21.15.116:0/3447357316 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8cf0160b70 msgr2=0x7f8cf00b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8ceffff700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8cf0160b70 0x7f8cf00b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8ceffff700 1 -- 172.21.15.116:0/3447357316 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0094a0 con 0x7f8cf01601e0 2023-05-12T09:07:47.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.370+0000 7f8ceffff700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 0x7f8cf0151090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0097c0 tx=0x7f8cdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:47.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.371+0000 7f8ced7fa700 1 -- 172.21.15.116:0/3447357316 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc004510 con 0x7f8cf01601e0 2023-05-12T09:07:47.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.371+0000 7f8ced7fa700 1 -- 172.21.15.116:0/3447357316 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc01e070 con 0x7f8cf01601e0 2023-05-12T09:07:47.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.371+0000 7f8cf6bff700 1 -- 172.21.15.116:0/3447357316 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf0160f90 con 0x7f8cf01601e0 2023-05-12T09:07:47.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.371+0000 7f8ced7fa700 1 -- 172.21.15.116:0/3447357316 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0038e0 con 0x7f8cf01601e0 2023-05-12T09:07:47.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.371+0000 7f8cf6bff700 1 -- 172.21.15.116:0/3447357316 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf00cd980 con 0x7f8cf01601e0 2023-05-12T09:07:47.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.372+0000 7f8cf6bff700 1 -- 172.21.15.116:0/3447357316 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf00d2110 con 0x7f8cf01601e0 2023-05-12T09:07:47.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.372+0000 7f8ced7fa700 1 -- 172.21.15.116:0/3447357316 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cdc003a40 con 0x7f8cf01601e0 2023-05-12T09:07:47.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.374+0000 7f8ced7fa700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cd406ace0 0x7f8cd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.374+0000 7f8ced7fa700 1 -- 172.21.15.116:0/3447357316 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8cdc08a4d0 con 0x7f8cf01601e0 2023-05-12T09:07:47.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.374+0000 7f8cf499b700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cd406ace0 0x7f8cd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.374+0000 7f8cf499b700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cd406ace0 0x7f8cd406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009be0 tx=0x7f8ce4009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:47.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.378+0000 7f8ced7fa700 1 -- 172.21.15.116:0/3447357316 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8cdc055280 con 0x7f8cf01601e0 2023-05-12T09:07:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.572+0000 7f8cf6bff700 1 -- 172.21.15.116:0/3447357316 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8cf00cb620 con 0x7f8cf01601e0 2023-05-12T09:07:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.573+0000 7f8ced7fa700 1 -- 172.21.15.116:0/3447357316 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8cf00cb620 con 0x7f8cf01601e0 2023-05-12T09:07:47.576 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:07:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 -- 172.21.15.116:0/3447357316 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cd406ace0 msgr2=0x7f8cd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cd406ace0 0x7f8cd406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009be0 tx=0x7f8ce4009210 comp rx=0 tx=0).stop 2023-05-12T09:07:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 -- 172.21.15.116:0/3447357316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 msgr2=0x7f8cf0151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 0x7f8cf0151090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0097c0 tx=0x7f8cdc004750 comp rx=0 tx=0).stop 2023-05-12T09:07:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 -- 172.21.15.116:0/3447357316 shutdown_connections 2023-05-12T09:07:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8cf0160b70 0x7f8cf00b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8cd406ace0 0x7f8cd406d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8cf00b87a0 0x7f8cf01f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 --2- 172.21.15.116:0/3447357316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cf01601e0 0x7f8cf0151090 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 -- 172.21.15.116:0/3447357316 >> 172.21.15.116:0/3447357316 conn(0x7f8cf0071b10 msgr2=0x7f8cf00b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 -- 172.21.15.116:0/3447357316 shutdown_connections 2023-05-12T09:07:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.575+0000 7f8cf6bff700 1 -- 172.21.15.116:0/3447357316 wait complete. 2023-05-12T09:07:47.595 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:07:47.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.780+0000 7ffba27ff700 1 Processor -- start 2023-05-12T09:07:47.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.780+0000 7ffba27ff700 1 -- start start 2023-05-12T09:07:47.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.781+0000 7ffba27ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb9c0cfbf0 0x7ffb9c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.781+0000 7ffba27ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ffb9c0d1100 0x7ffb9c0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.781+0000 7ffba27ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9c0d0020 con 0x7ffb9c0b87a0 2023-05-12T09:07:47.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.781+0000 7ffba27ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9c0d02d0 con 0x7ffb9c0d1100 2023-05-12T09:07:47.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.781+0000 7ffba27ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0d0cb0 con 0x7ffb9c0cfbf0 2023-05-12T09:07:47.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.781+0000 7ffb9bfff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ffb9c0b87a0 0x7ffb9c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60568/0 (socket says 172.21.15.116:60568) 2023-05-12T09:07:47.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.781+0000 7ffb9bfff700 1 -- 172.21.15.116:0/3854911628 learned_addr learned my addr 172.21.15.116:0/3854911628 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:47.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.781+0000 7ffba0d9c700 1 --2- 172.21.15.116:0/3854911628 >> v2:172.21.15.116:3300/0 conn(0x7ffb9c0d1100 0x7ffb9c0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.781+0000 7ffb9b7fe700 1 --2- 172.21.15.116:0/3854911628 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb9c0cfbf0 0x7ffb9c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.781+0000 7ffb9affd700 1 -- 172.21.15.116:0/3854911628 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038805700 0 0) 0x7ffb9c0d0020 con 0x7ffb9c0b87a0 2023-05-12T09:07:47.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.782+0000 7ffb9affd700 1 -- 172.21.15.116:0/3854911628 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb840035b0 con 0x7ffb9c0b87a0 2023-05-12T09:07:47.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.782+0000 7ffba0d9c700 1 -- 172.21.15.116:0/3854911628 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb9c0cfbf0 msgr2=0x7ffb9c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:47.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.782+0000 7ffba0d9c700 1 --2- 172.21.15.116:0/3854911628 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb9c0cfbf0 0x7ffb9c1608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.782+0000 7ffba0d9c700 1 -- 172.21.15.116:0/3854911628 >> v1:172.21.15.116:6789/0 conn(0x7ffb9c0b87a0 legacy=0x7ffb9c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.782+0000 7ffba0d9c700 1 -- 172.21.15.116:0/3854911628 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c0cdc60 con 0x7ffb9c0d1100 2023-05-12T09:07:47.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.782+0000 7ffba0d9c700 1 --2- 172.21.15.116:0/3854911628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 0x7ffb9c0d1580 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009d90 tx=0x7ffb9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf1caf10ebebd73 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:47.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.782+0000 7ffb9affd700 1 -- 172.21.15.116:0/3854911628 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9400e070 con 0x7ffb9c0d1100 2023-05-12T09:07:47.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.782+0000 7ffb9affd700 1 -- 172.21.15.116:0/3854911628 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9400bb20 con 0x7ffb9c0d1100 2023-05-12T09:07:47.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.782+0000 7ffb9affd700 1 -- 172.21.15.116:0/3854911628 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94012430 con 0x7ffb9c0d1100 2023-05-12T09:07:47.789 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.783+0000 7ffba27ff700 1 -- 172.21.15.116:0/3854911628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 msgr2=0x7ffb9c0d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.790 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.783+0000 7ffba27ff700 1 --2- 172.21.15.116:0/3854911628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 0x7ffb9c0d1580 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009d90 tx=0x7ffb9400b330 comp rx=0 tx=0).stop 2023-05-12T09:07:47.790 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.783+0000 7ffba27ff700 1 -- 172.21.15.116:0/3854911628 shutdown_connections 2023-05-12T09:07:47.790 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.783+0000 7ffba27ff700 1 --2- 172.21.15.116:0/3854911628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 0x7ffb9c0d1580 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.790 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.783+0000 7ffba27ff700 1 --2- 172.21.15.116:0/3854911628 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb9c0cfbf0 0x7ffb9c1608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.790 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.783+0000 7ffba27ff700 1 -- 172.21.15.116:0/3854911628 >> 172.21.15.116:0/3854911628 conn(0x7ffb9c071b10 msgr2=0x7ffb9c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:47.790 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.783+0000 7ffba27ff700 1 -- 172.21.15.116:0/3854911628 shutdown_connections 2023-05-12T09:07:47.790 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.783+0000 7ffba27ff700 1 -- 172.21.15.116:0/3854911628 wait complete. 2023-05-12T09:07:47.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.784+0000 7ffba27ff700 1 Processor -- start 2023-05-12T09:07:47.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.785+0000 7ffba27ff700 1 -- start start 2023-05-12T09:07:47.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.785+0000 7ffba27ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ffb9c0b87a0 0x7ffb9c0cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.785+0000 7ffba27ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb9c0cfbf0 0x7ffb9c15f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.785+0000 7ffba27ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 0x7ffb9c0d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.785+0000 7ffba27ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c15de70 con 0x7ffb9c0d1100 2023-05-12T09:07:47.791 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.785+0000 7ffba27ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0cc030 con 0x7ffb9c0b87a0 2023-05-12T09:07:47.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.785+0000 7ffba27ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c15cdd0 con 0x7ffb9c0cfbf0 2023-05-12T09:07:47.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffba0d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 0x7ffb9c0d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffba0d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 0x7ffb9c0d28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57504/0 (socket says 172.21.15.116:57504) 2023-05-12T09:07:47.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffba0d9c700 1 -- 172.21.15.116:0/278841232 learned_addr learned my addr 172.21.15.116:0/278841232 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:47.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffb9b7fe700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb9c0cfbf0 0x7ffb9c15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffb9bfff700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ffb9c0b87a0 0x7ffb9c0cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffba0d9c700 1 -- 172.21.15.116:0/278841232 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb9c0cfbf0 msgr2=0x7ffb9c15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffba0d9c700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb9c0cfbf0 0x7ffb9c15f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffba0d9c700 1 -- 172.21.15.116:0/278841232 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ffb9c0b87a0 msgr2=0x7ffb9c0cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffba0d9c700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ffb9c0b87a0 0x7ffb9c0cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffba0d9c700 1 -- 172.21.15.116:0/278841232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb94009a70 con 0x7ffb9c0d1100 2023-05-12T09:07:47.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.786+0000 7ffba0d9c700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 0x7ffb9c0d28c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffb94014040 tx=0x7ffb94004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:47.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.787+0000 7ffb98ff9700 1 -- 172.21.15.116:0/278841232 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb940129f0 con 0x7ffb9c0d1100 2023-05-12T09:07:47.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.787+0000 7ffb98ff9700 1 -- 172.21.15.116:0/278841232 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb94020070 con 0x7ffb9c0d1100 2023-05-12T09:07:47.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.787+0000 7ffb98ff9700 1 -- 172.21.15.116:0/278841232 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94012db0 con 0x7ffb9c0d1100 2023-05-12T09:07:47.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.787+0000 7ffba27ff700 1 -- 172.21.15.116:0/278841232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9c0cd980 con 0x7ffb9c0d1100 2023-05-12T09:07:47.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.787+0000 7ffba27ff700 1 -- 172.21.15.116:0/278841232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9c0cd6a0 con 0x7ffb9c0d1100 2023-05-12T09:07:47.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.788+0000 7ffba27ff700 1 -- 172.21.15.116:0/278841232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9c160e30 con 0x7ffb9c0d1100 2023-05-12T09:07:47.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.789+0000 7ffb98ff9700 1 -- 172.21.15.116:0/278841232 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb94004040 con 0x7ffb9c0d1100 2023-05-12T09:07:47.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.790+0000 7ffb98ff9700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb8806ace0 0x7ffb8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:47.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.790+0000 7ffb98ff9700 1 -- 172.21.15.116:0/278841232 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb94022070 con 0x7ffb9c0d1100 2023-05-12T09:07:47.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.790+0000 7ffb9bfff700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb8806ace0 0x7ffb8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:47.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.790+0000 7ffb9bfff700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb8806ace0 0x7ffb8806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c007fd0 tx=0x7ffb8c007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:47.797 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.794+0000 7ffb98ff9700 1 -- 172.21.15.116:0/278841232 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ffb940560b0 con 0x7ffb9c0d1100 2023-05-12T09:07:47.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.987+0000 7ffba27ff700 1 -- 172.21.15.116:0/278841232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb9c074430 con 0x7ffb9c0d1100 2023-05-12T09:07:47.990 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.987+0000 7ffb98ff9700 1 -- 172.21.15.116:0/278841232 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb940596d0 con 0x7ffb9c0d1100 2023-05-12T09:07:47.991 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:07:47.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.989+0000 7ffba27ff700 1 -- 172.21.15.116:0/278841232 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb8806ace0 msgr2=0x7ffb8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.989+0000 7ffba27ff700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb8806ace0 0x7ffb8806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c007fd0 tx=0x7ffb8c007dc0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.989+0000 7ffba27ff700 1 -- 172.21.15.116:0/278841232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 msgr2=0x7ffb9c0d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:47.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.989+0000 7ffba27ff700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 0x7ffb9c0d28c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffb94014040 tx=0x7ffb94004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.993 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.990+0000 7ffba27ff700 1 -- 172.21.15.116:0/278841232 shutdown_connections 2023-05-12T09:07:47.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.990+0000 7ffba27ff700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb9c0d1100 0x7ffb9c0d28c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.990+0000 7ffba27ff700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ffb9c0b87a0 0x7ffb9c0cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.990+0000 7ffba27ff700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ffb8806ace0 0x7ffb8806d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.990+0000 7ffba27ff700 1 --2- 172.21.15.116:0/278841232 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ffb9c0cfbf0 0x7ffb9c15f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:47.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.990+0000 7ffba27ff700 1 -- 172.21.15.116:0/278841232 >> 172.21.15.116:0/278841232 conn(0x7ffb9c071b10 msgr2=0x7ffb9c0b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:47.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.990+0000 7ffba27ff700 1 -- 172.21.15.116:0/278841232 shutdown_connections 2023-05-12T09:07:47.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:47.990+0000 7ffba27ff700 1 -- 172.21.15.116:0/278841232 wait complete. 2023-05-12T09:07:48.010 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:07:48.199 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.197+0000 7fd8f97ff700 1 Processor -- start 2023-05-12T09:07:48.199 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.197+0000 7fd8f97ff700 1 -- start start 2023-05-12T09:07:48.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.197+0000 7fd8f97ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fd8f40cfbf0 0x7fd8f41608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.197+0000 7fd8f97ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40d0020 con 0x7fd8f40d1100 2023-05-12T09:07:48.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.197+0000 7fd8f97ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40cdc60 con 0x7fd8f40b87a0 2023-05-12T09:07:48.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.197+0000 7fd8f97ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40d02d0 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.197+0000 7fd8f37fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd8f40d1100 0x7fd8f40d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60578/0 (socket says 172.21.15.116:60578) 2023-05-12T09:07:48.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.197+0000 7fd8f37fe700 1 -- 172.21.15.116:0/3584724516 learned_addr learned my addr 172.21.15.116:0/3584724516 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:48.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.198+0000 7fd8f27fc700 1 --2- 172.21.15.116:0/3584724516 >> v2:172.21.15.182:3300/0 conn(0x7fd8f40cfbf0 0x7fd8f41608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.202 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.198+0000 7fd8f1ffb700 1 -- 172.21.15.116:0/3584724516 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262244204 0 0) 0x7fd8f40d0020 con 0x7fd8f40d1100 2023-05-12T09:07:48.203 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.198+0000 7fd8f1ffb700 1 -- 172.21.15.116:0/3584724516 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8dc0035b0 con 0x7fd8f40d1100 2023-05-12T09:07:48.203 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.198+0000 7fd8f27fc700 1 -- 172.21.15.116:0/3584724516 >> v1:172.21.15.182:6789/0 conn(0x7fd8f40b87a0 legacy=0x7fd8f41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.203 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.198+0000 7fd8f27fc700 1 -- 172.21.15.116:0/3584724516 >> v1:172.21.15.116:6789/0 conn(0x7fd8f40d1100 legacy=0x7fd8f40d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.203 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.198+0000 7fd8f27fc700 1 -- 172.21.15.116:0/3584724516 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40cd6a0 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.203 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.198+0000 7fd8f27fc700 1 --2- 172.21.15.116:0/3584724516 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8f40cfbf0 0x7fd8f41608f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009840 tx=0x7fd8e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7697a0a9df0d3108 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:48.203 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.199+0000 7fd8f1ffb700 1 -- 172.21.15.116:0/3584724516 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8011830 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.204 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.199+0000 7fd8f1ffb700 1 -- 172.21.15.116:0/3584724516 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e8011990 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.204 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.199+0000 7fd8f1ffb700 1 -- 172.21.15.116:0/3584724516 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8011d00 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.199+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3584724516 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8f40cfbf0 msgr2=0x7fd8f41608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.199+0000 7fd8f97ff700 1 --2- 172.21.15.116:0/3584724516 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8f40cfbf0 0x7fd8f41608f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009840 tx=0x7fd8e8009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:48.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.199+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3584724516 shutdown_connections 2023-05-12T09:07:48.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.199+0000 7fd8f97ff700 1 --2- 172.21.15.116:0/3584724516 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8f40cfbf0 0x7fd8f41608f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.199+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3584724516 >> 172.21.15.116:0/3584724516 conn(0x7fd8f4071b10 msgr2=0x7fd8f4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:48.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.199+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3584724516 shutdown_connections 2023-05-12T09:07:48.206 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.199+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3584724516 wait complete. 2023-05-12T09:07:48.208 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.201+0000 7fd8f97ff700 1 Processor -- start 2023-05-12T09:07:48.208 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.201+0000 7fd8f97ff700 1 -- start start 2023-05-12T09:07:48.208 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f97ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8f40b87a0 0x7fd8f4150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.208 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f97ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8f40cfbf0 0x7fd8f415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f97ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd8f40d1100 0x7fd8f40d2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f97ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4150860 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f97ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f415cc40 con 0x7fd8f40b87a0 2023-05-12T09:07:48.210 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f97ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f415cf20 con 0x7fd8f40d1100 2023-05-12T09:07:48.210 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f27fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8f40cfbf0 0x7fd8f415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.210 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f27fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8f40cfbf0 0x7fd8f415c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57518/0 (socket says 172.21.15.116:57518) 2023-05-12T09:07:48.210 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f27fc700 1 -- 172.21.15.116:0/3491375867 learned_addr learned my addr 172.21.15.116:0/3491375867 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f37fe700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd8f40d1100 0x7fd8f40d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.202+0000 7fd8f2ffd700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8f40b87a0 0x7fd8f4150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8f27fc700 1 -- 172.21.15.116:0/3491375867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd8f40d1100 msgr2=0x7fd8f40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8f27fc700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd8f40d1100 0x7fd8f40d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8f27fc700 1 -- 172.21.15.116:0/3491375867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8f40b87a0 msgr2=0x7fd8f4150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8f27fc700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8f40b87a0 0x7fd8f4150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8f27fc700 1 -- 172.21.15.116:0/3491375867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80094a0 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8f2ffd700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8f40b87a0 0x7fd8f4150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:48.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8f27fc700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8f40cfbf0 0x7fd8f415c360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009fd0 tx=0x7fd8e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:48.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8db7fe700 1 -- 172.21.15.116:0/3491375867 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80045d0 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8db7fe700 1 -- 172.21.15.116:0/3491375867 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e801f070 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3491375867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f4160e30 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8db7fe700 1 -- 172.21.15.116:0/3491375867 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80038a0 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.203+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3491375867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f40cd980 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.204+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3491375867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f4160fc0 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.205+0000 7fd8db7fe700 1 -- 172.21.15.116:0/3491375867 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd8e8003a00 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.206+0000 7fd8db7fe700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd8e006ace0 0x7fd8e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.206+0000 7fd8db7fe700 1 -- 172.21.15.116:0/3491375867 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd8e8021070 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.206+0000 7fd8f2ffd700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd8e006ace0 0x7fd8e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.207+0000 7fd8f2ffd700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd8e006ace0 0x7fd8e006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4001780 tx=0x7fd8e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:48.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.210+0000 7fd8db7fe700 1 -- 172.21.15.116:0/3491375867 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd8e8055dd0 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.403+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3491375867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8f40b52f0 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.403+0000 7fd8db7fe700 1 -- 172.21.15.116:0/3491375867 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8e80150a0 con 0x7fd8f40cfbf0 2023-05-12T09:07:48.407 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:07:48.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3491375867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd8e006ace0 msgr2=0x7fd8e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd8e006ace0 0x7fd8e006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4001780 tx=0x7fd8e4009040 comp rx=0 tx=0).stop 2023-05-12T09:07:48.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3491375867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8f40cfbf0 msgr2=0x7fd8f415c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8f40cfbf0 0x7fd8f415c360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009fd0 tx=0x7fd8e8004750 comp rx=0 tx=0).stop 2023-05-12T09:07:48.409 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3491375867 shutdown_connections 2023-05-12T09:07:48.410 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd8e006ace0 0x7fd8e006d190 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4001780 tx=0x7fd8e4009040 comp rx=0 tx=0).stop 2023-05-12T09:07:48.410 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd8f40d1100 0x7fd8f40d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.410 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8f40b87a0 0x7fd8f4150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.410 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 --2- 172.21.15.116:0/3491375867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8f40cfbf0 0x7fd8f415c360 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.410 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3491375867 >> 172.21.15.116:0/3491375867 conn(0x7fd8f4071b10 msgr2=0x7fd8f40b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:48.410 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3491375867 shutdown_connections 2023-05-12T09:07:48.410 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.407+0000 7fd8f97ff700 1 -- 172.21.15.116:0/3491375867 wait complete. 2023-05-12T09:07:48.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:07:48.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.612+0000 7fbec05ff700 1 Processor -- start 2023-05-12T09:07:48.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.613+0000 7fbec05ff700 1 -- start start 2023-05-12T09:07:48.616 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbec05ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fbeb80b87a0 0x7fbeb80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.616 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbec05ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 0x7fbeb8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.616 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbec05ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb8160ff0 con 0x7fbeb8160b70 2023-05-12T09:07:48.616 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbec05ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb80d02d0 con 0x7fbeb80b87a0 2023-05-12T09:07:48.616 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbec05ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb80d0cb0 con 0x7fbeb81601e0 2023-05-12T09:07:48.616 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbebeb9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fbeb8160b70 0x7fbeb80d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60594/0 (socket says 172.21.15.116:60594) 2023-05-12T09:07:48.617 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbebeb9c700 1 -- 172.21.15.116:0/3654687324 learned_addr learned my addr 172.21.15.116:0/3654687324 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:48.617 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbebdb9a700 1 --2- 172.21.15.116:0/3654687324 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 0x7fbeb8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.617 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbebe39b700 1 --2- 172.21.15.116:0/3654687324 >> v2:172.21.15.182:3300/0 conn(0x7fbeb80b87a0 0x7fbeb80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.618 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbebd399700 1 -- 172.21.15.116:0/3654687324 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508419704 0 0) 0x7fbeb8160ff0 con 0x7fbeb8160b70 2023-05-12T09:07:48.618 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.614+0000 7fbebd399700 1 -- 172.21.15.116:0/3654687324 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbea40035b0 con 0x7fbeb8160b70 2023-05-12T09:07:48.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.615+0000 7fbebdb9a700 1 -- 172.21.15.116:0/3654687324 >> v2:172.21.15.182:3300/0 conn(0x7fbeb80b87a0 msgr2=0x7fbeb80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:48.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.615+0000 7fbebdb9a700 1 --2- 172.21.15.116:0/3654687324 >> v2:172.21.15.182:3300/0 conn(0x7fbeb80b87a0 0x7fbeb80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.615+0000 7fbebdb9a700 1 -- 172.21.15.116:0/3654687324 >> v1:172.21.15.116:6789/0 conn(0x7fbeb8160b70 legacy=0x7fbeb80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.615+0000 7fbebdb9a700 1 -- 172.21.15.116:0/3654687324 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb80cdc60 con 0x7fbeb81601e0 2023-05-12T09:07:48.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.615+0000 7fbebe39b700 1 --2- 172.21.15.116:0/3654687324 >> v2:172.21.15.182:3300/0 conn(0x7fbeb80b87a0 0x7fbeb80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:48.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.615+0000 7fbebdb9a700 1 --2- 172.21.15.116:0/3654687324 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 0x7fbeb8160630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009840 tx=0x7fbea8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb291a222245093d server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:48.619 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.615+0000 7fbebd399700 1 -- 172.21.15.116:0/3654687324 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea8011830 con 0x7fbeb81601e0 2023-05-12T09:07:48.620 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.615+0000 7fbebd399700 1 -- 172.21.15.116:0/3654687324 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea8011990 con 0x7fbeb81601e0 2023-05-12T09:07:48.620 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.615+0000 7fbebd399700 1 -- 172.21.15.116:0/3654687324 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea8011d20 con 0x7fbeb81601e0 2023-05-12T09:07:48.620 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.616+0000 7fbec05ff700 1 -- 172.21.15.116:0/3654687324 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 msgr2=0x7fbeb8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.620 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.616+0000 7fbec05ff700 1 --2- 172.21.15.116:0/3654687324 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 0x7fbeb8160630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009840 tx=0x7fbea8009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:48.620 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.616+0000 7fbec05ff700 1 -- 172.21.15.116:0/3654687324 shutdown_connections 2023-05-12T09:07:48.620 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.616+0000 7fbec05ff700 1 --2- 172.21.15.116:0/3654687324 >> v2:172.21.15.182:3300/0 conn(0x7fbeb80b87a0 0x7fbeb80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.620 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.616+0000 7fbec05ff700 1 --2- 172.21.15.116:0/3654687324 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 0x7fbeb8160630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.616+0000 7fbec05ff700 1 -- 172.21.15.116:0/3654687324 >> 172.21.15.116:0/3654687324 conn(0x7fbeb8071b10 msgr2=0x7fbeb8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:48.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.616+0000 7fbec05ff700 1 -- 172.21.15.116:0/3654687324 shutdown_connections 2023-05-12T09:07:48.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.616+0000 7fbec05ff700 1 -- 172.21.15.116:0/3654687324 wait complete. 2023-05-12T09:07:48.622 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.617+0000 7fbec05ff700 1 Processor -- start 2023-05-12T09:07:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.618+0000 7fbec05ff700 1 -- start start 2023-05-12T09:07:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.618+0000 7fbec05ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbeb80b87a0 0x7fbeb80cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.618+0000 7fbec05ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 0x7fbeb815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.618+0000 7fbec05ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbeb8160b70 0x7fbeb81543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.618+0000 7fbec05ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb815de40 con 0x7fbeb80b87a0 2023-05-12T09:07:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.618+0000 7fbec05ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb815d4f0 con 0x7fbeb8160b70 2023-05-12T09:07:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.618+0000 7fbec05ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb815d7d0 con 0x7fbeb81601e0 2023-05-12T09:07:48.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebe39b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbeb80b87a0 0x7fbeb80cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebe39b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbeb80b87a0 0x7fbeb80cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57534/0 (socket says 172.21.15.116:57534) 2023-05-12T09:07:48.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebdb9a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 0x7fbeb815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebe39b700 1 -- 172.21.15.116:0/3519820105 learned_addr learned my addr 172.21.15.116:0/3519820105 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:48.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebeb9c700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbeb8160b70 0x7fbeb81543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebdb9a700 1 -- 172.21.15.116:0/3519820105 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbeb8160b70 msgr2=0x7fbeb81543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebdb9a700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbeb8160b70 0x7fbeb81543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebdb9a700 1 -- 172.21.15.116:0/3519820105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbeb80b87a0 msgr2=0x7fbeb80cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebdb9a700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbeb80b87a0 0x7fbeb80cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebdb9a700 1 -- 172.21.15.116:0/3519820105 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40094a0 con 0x7fbeb81601e0 2023-05-12T09:07:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebe39b700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbeb80b87a0 0x7fbeb80cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.619+0000 7fbebdb9a700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 0x7fbeb815cca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbea8016000 tx=0x7fbea8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.620+0000 7fbeaeffd700 1 -- 172.21.15.116:0/3519820105 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea8004590 con 0x7fbeb81601e0 2023-05-12T09:07:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.620+0000 7fbeaeffd700 1 -- 172.21.15.116:0/3519820105 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea801f070 con 0x7fbeb81601e0 2023-05-12T09:07:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.620+0000 7fbeaeffd700 1 -- 172.21.15.116:0/3519820105 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea80038e0 con 0x7fbeb81601e0 2023-05-12T09:07:48.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.620+0000 7fbec05ff700 1 -- 172.21.15.116:0/3519820105 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea80094a0 con 0x7fbeb81601e0 2023-05-12T09:07:48.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.620+0000 7fbec05ff700 1 -- 172.21.15.116:0/3519820105 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb80cd980 con 0x7fbeb81601e0 2023-05-12T09:07:48.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.621+0000 7fbec05ff700 1 -- 172.21.15.116:0/3519820105 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb80cd6a0 con 0x7fbeb81601e0 2023-05-12T09:07:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.622+0000 7fbeaeffd700 1 -- 172.21.15.116:0/3519820105 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbea8003a40 con 0x7fbeb81601e0 2023-05-12T09:07:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.623+0000 7fbeaeffd700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe9c06ace0 0x7fbe9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.623+0000 7fbeaeffd700 1 -- 172.21.15.116:0/3519820105 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbea8021070 con 0x7fbeb81601e0 2023-05-12T09:07:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.623+0000 7fbebe39b700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe9c06ace0 0x7fbe9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.624+0000 7fbebe39b700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe9c06ace0 0x7fbe9c06d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4011530 tx=0x7fbeb4009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:48.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.628+0000 7fbeaeffd700 1 -- 172.21.15.116:0/3519820105 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbea8055bf0 con 0x7fbeb81601e0 2023-05-12T09:07:48.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.823+0000 7fbec05ff700 1 -- 172.21.15.116:0/3519820105 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbeb80d2110 con 0x7fbeb81601e0 2023-05-12T09:07:48.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.823+0000 7fbeaeffd700 1 -- 172.21.15.116:0/3519820105 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbea8015020 con 0x7fbeb81601e0 2023-05-12T09:07:48.826 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:07:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 -- 172.21.15.116:0/3519820105 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe9c06ace0 msgr2=0x7fbe9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe9c06ace0 0x7fbe9c06d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4011530 tx=0x7fbeb4009210 comp rx=0 tx=0).stop 2023-05-12T09:07:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 -- 172.21.15.116:0/3519820105 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 msgr2=0x7fbeb815cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 0x7fbeb815cca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbea8016000 tx=0x7fbea8004750 comp rx=0 tx=0).stop 2023-05-12T09:07:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 -- 172.21.15.116:0/3519820105 shutdown_connections 2023-05-12T09:07:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbeb8160b70 0x7fbeb81543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbeb80b87a0 0x7fbeb80cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe9c06ace0 0x7fbe9c06d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 --2- 172.21.15.116:0/3519820105 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbeb81601e0 0x7fbeb815cca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 -- 172.21.15.116:0/3519820105 >> 172.21.15.116:0/3519820105 conn(0x7fbeb8071b10 msgr2=0x7fbeb8071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:48.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 -- 172.21.15.116:0/3519820105 shutdown_connections 2023-05-12T09:07:48.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:48.826+0000 7fbec05ff700 1 -- 172.21.15.116:0/3519820105 wait complete. 2023-05-12T09:07:48.845 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:07:49.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.027+0000 7f1209fff700 1 Processor -- start 2023-05-12T09:07:49.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.028+0000 7f1209fff700 1 -- start start 2023-05-12T09:07:49.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.029+0000 7f1209fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f12040d0b50 0x7f12040d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.029+0000 7f1209fff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120415d480 con 0x7f120415a280 2023-05-12T09:07:49.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.029+0000 7f1209fff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120415d6e0 con 0x7f12040cd640 2023-05-12T09:07:49.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.029+0000 7f1209fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120415d9c0 con 0x7f12040d0b50 2023-05-12T09:07:49.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.029+0000 7f1203fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f12040d0b50 0x7f12040d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.029+0000 7f12037fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f120415a280 0x7f120415cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60610/0 (socket says 172.21.15.116:60610) 2023-05-12T09:07:49.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.029+0000 7f12037fe700 1 -- 172.21.15.116:0/1373581348 learned_addr learned my addr 172.21.15.116:0/1373581348 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:49.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.029+0000 7f1203fff700 1 -- 172.21.15.116:0/1373581348 >> v1:172.21.15.182:6789/0 conn(0x7f12040cd640 legacy=0x7f12040cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.029+0000 7f1203fff700 1 -- 172.21.15.116:0/1373581348 >> v1:172.21.15.116:6789/0 conn(0x7f120415a280 legacy=0x7f120415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.029+0000 7f1203fff700 1 -- 172.21.15.116:0/1373581348 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120415dca0 con 0x7f12040d0b50 2023-05-12T09:07:49.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.030+0000 7f1203fff700 1 --2- 172.21.15.116:0/1373581348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040d0b50 0x7f12040d0f90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009d90 tx=0x7f11fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193e264e999199bc server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:49.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.030+0000 7f1202ffd700 1 -- 172.21.15.116:0/1373581348 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00e070 con 0x7f12040d0b50 2023-05-12T09:07:49.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.030+0000 7f1202ffd700 1 -- 172.21.15.116:0/1373581348 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc00bbd0 con 0x7f12040d0b50 2023-05-12T09:07:49.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.030+0000 7f1202ffd700 1 -- 172.21.15.116:0/1373581348 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc012430 con 0x7f12040d0b50 2023-05-12T09:07:49.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.030+0000 7f1209fff700 1 -- 172.21.15.116:0/1373581348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040d0b50 msgr2=0x7f12040d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.030+0000 7f1209fff700 1 --2- 172.21.15.116:0/1373581348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040d0b50 0x7f12040d0f90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009d90 tx=0x7f11fc00b330 comp rx=0 tx=0).stop 2023-05-12T09:07:49.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.030+0000 7f1209fff700 1 -- 172.21.15.116:0/1373581348 shutdown_connections 2023-05-12T09:07:49.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.030+0000 7f1209fff700 1 --2- 172.21.15.116:0/1373581348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040d0b50 0x7f12040d0f90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.030+0000 7f1209fff700 1 -- 172.21.15.116:0/1373581348 >> 172.21.15.116:0/1373581348 conn(0x7f1204066260 msgr2=0x7f1204071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:49.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.031+0000 7f1209fff700 1 -- 172.21.15.116:0/1373581348 shutdown_connections 2023-05-12T09:07:49.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.031+0000 7f1209fff700 1 -- 172.21.15.116:0/1373581348 wait complete. 2023-05-12T09:07:49.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.032+0000 7f1209fff700 1 Processor -- start 2023-05-12T09:07:49.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.032+0000 7f1209fff700 1 -- start start 2023-05-12T09:07:49.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.033+0000 7f1209fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040cd640 0x7f120415f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.033+0000 7f1209fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12040d0b50 0x7f12040b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.033+0000 7f1209fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120415a280 0x7f12040b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.033+0000 7f1209fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12040b2a50 con 0x7f12040cd640 2023-05-12T09:07:49.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.033+0000 7f1209fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12040b49c0 con 0x7f120415a280 2023-05-12T09:07:49.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.033+0000 7f1209fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12040b2ca0 con 0x7f12040d0b50 2023-05-12T09:07:49.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f12037fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040cd640 0x7f120415f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f12037fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040cd640 0x7f120415f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57560/0 (socket says 172.21.15.116:57560) 2023-05-12T09:07:49.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f12037fe700 1 -- 172.21.15.116:0/3232859295 learned_addr learned my addr 172.21.15.116:0/3232859295 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:49.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f11fbfff700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12040d0b50 0x7f12040b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f1203fff700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120415a280 0x7f12040b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f12037fe700 1 -- 172.21.15.116:0/3232859295 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12040d0b50 msgr2=0x7f12040b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f12037fe700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12040d0b50 0x7f12040b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f12037fe700 1 -- 172.21.15.116:0/3232859295 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120415a280 msgr2=0x7f12040b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f12037fe700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120415a280 0x7f12040b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f12037fe700 1 -- 172.21.15.116:0/3232859295 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc009a70 con 0x7f12040cd640 2023-05-12T09:07:49.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f12037fe700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040cd640 0x7f120415f2d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c480 tx=0x7f11f400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:49.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f1200ff9700 1 -- 172.21.15.116:0/3232859295 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4005d70 con 0x7f12040cd640 2023-05-12T09:07:49.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f1200ff9700 1 -- 172.21.15.116:0/3232859295 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f400ce90 con 0x7f12040cd640 2023-05-12T09:07:49.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.034+0000 7f1200ff9700 1 -- 172.21.15.116:0/3232859295 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f40072d0 con 0x7f12040cd640 2023-05-12T09:07:49.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.035+0000 7f1209fff700 1 -- 172.21.15.116:0/3232859295 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12040cf650 con 0x7f12040cd640 2023-05-12T09:07:49.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.035+0000 7f1209fff700 1 -- 172.21.15.116:0/3232859295 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12040cf370 con 0x7f12040cd640 2023-05-12T09:07:49.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.036+0000 7f1209fff700 1 -- 172.21.15.116:0/3232859295 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120415a650 con 0x7f12040cd640 2023-05-12T09:07:49.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.037+0000 7f1200ff9700 1 -- 172.21.15.116:0/3232859295 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11f4007430 con 0x7f12040cd640 2023-05-12T09:07:49.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.037+0000 7f1200ff9700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11e406ace0 0x7f11e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.037+0000 7f1200ff9700 1 -- 172.21.15.116:0/3232859295 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f11f4088940 con 0x7f12040cd640 2023-05-12T09:07:49.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.038+0000 7f11fbfff700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11e406ace0 0x7f11e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.038+0000 7f11fbfff700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11e406ace0 0x7f11e406d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f12041f5ab0 tx=0x7f11ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:49.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.042+0000 7f1200ff9700 1 -- 172.21.15.116:0/3232859295 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f11f40537a0 con 0x7f12040cd640 2023-05-12T09:07:49.280 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.278+0000 7f1209fff700 1 -- 172.21.15.116:0/3232859295 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12040b5a10 con 0x7f12040cd640 2023-05-12T09:07:49.281 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.279+0000 7f1200ff9700 1 -- 172.21.15.116:0/3232859295 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f11f4056dc0 con 0x7f12040cd640 2023-05-12T09:07:49.281 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:49.281 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:07:10.529423+0000","modified":"2023-05-12T09:07:38.475430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-12T09:07:49.283 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 -- 172.21.15.116:0/3232859295 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11e406ace0 msgr2=0x7f11e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.283 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11e406ace0 0x7f11e406d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f12041f5ab0 tx=0x7f11ec009040 comp rx=0 tx=0).stop 2023-05-12T09:07:49.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 -- 172.21.15.116:0/3232859295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040cd640 msgr2=0x7f120415f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040cd640 0x7f120415f2d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c480 tx=0x7f11f400c790 comp rx=0 tx=0).stop 2023-05-12T09:07:49.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 -- 172.21.15.116:0/3232859295 shutdown_connections 2023-05-12T09:07:49.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120415a280 0x7f12040b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12040cd640 0x7f120415f2d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11e406ace0 0x7f11e406d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 --2- 172.21.15.116:0/3232859295 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12040d0b50 0x7f12040b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 -- 172.21.15.116:0/3232859295 >> 172.21.15.116:0/3232859295 conn(0x7f1204066260 msgr2=0x7f12040b8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:49.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 -- 172.21.15.116:0/3232859295 shutdown_connections 2023-05-12T09:07:49.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.281+0000 7f1209fff700 1 -- 172.21.15.116:0/3232859295 wait complete. 2023-05-12T09:07:49.285 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 9 2023-05-12T09:07:49.300 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:49.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.482+0000 7fc78efff700 1 Processor -- start 2023-05-12T09:07:49.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.482+0000 7fc78efff700 1 -- start start 2023-05-12T09:07:49.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.483+0000 7fc78efff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc7880b87a0 0x7fc7880cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.483+0000 7fc78efff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc788160d40 0x7fc7880d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.483+0000 7fc78efff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7880cdc60 con 0x7fc7881601e0 2023-05-12T09:07:49.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.483+0000 7fc78efff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7880d02d0 con 0x7fc788160d40 2023-05-12T09:07:49.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.483+0000 7fc78efff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7880d0cb0 con 0x7fc7880b87a0 2023-05-12T09:07:49.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc78d59c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc788160d40 0x7fc7880d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc787fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc7881601e0 0x7fc788160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60620/0 (socket says 172.21.15.116:60620) 2023-05-12T09:07:49.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc787fff700 1 -- 172.21.15.116:0/747629514 learned_addr learned my addr 172.21.15.116:0/747629514 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:49.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc78d59c700 1 -- 172.21.15.116:0/747629514 >> v2:172.21.15.182:3300/0 conn(0x7fc7880b87a0 msgr2=0x7fc7880cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:49.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc78d59c700 1 --2- 172.21.15.116:0/747629514 >> v2:172.21.15.182:3300/0 conn(0x7fc7880b87a0 0x7fc7880cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc78d59c700 1 -- 172.21.15.116:0/747629514 >> v1:172.21.15.116:6789/0 conn(0x7fc7881601e0 legacy=0x7fc788160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc78d59c700 1 -- 172.21.15.116:0/747629514 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880cd6a0 con 0x7fc788160d40 2023-05-12T09:07:49.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc7877fe700 1 -- 172.21.15.116:0/747629514 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321909500 0 0) 0x7fc7880cdc60 con 0x7fc7881601e0 2023-05-12T09:07:49.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc78d59c700 1 --2- 172.21.15.116:0/747629514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 0x7fc7880d1100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc7880b4ac0 tx=0x7fc78000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3a0762648f52ab server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:49.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc7877fe700 1 -- 172.21.15.116:0/747629514 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78000e070 con 0x7fc788160d40 2023-05-12T09:07:49.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.484+0000 7fc7877fe700 1 -- 172.21.15.116:0/747629514 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78000bb90 con 0x7fc788160d40 2023-05-12T09:07:49.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.485+0000 7fc7877fe700 1 -- 172.21.15.116:0/747629514 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780012430 con 0x7fc788160d40 2023-05-12T09:07:49.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.485+0000 7fc78efff700 1 -- 172.21.15.116:0/747629514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 msgr2=0x7fc7880d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.485+0000 7fc78efff700 1 --2- 172.21.15.116:0/747629514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 0x7fc7880d1100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc7880b4ac0 tx=0x7fc78000b330 comp rx=0 tx=0).stop 2023-05-12T09:07:49.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.485+0000 7fc78efff700 1 -- 172.21.15.116:0/747629514 shutdown_connections 2023-05-12T09:07:49.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.485+0000 7fc78efff700 1 --2- 172.21.15.116:0/747629514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 0x7fc7880d1100 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.485+0000 7fc78efff700 1 --2- 172.21.15.116:0/747629514 >> v2:172.21.15.182:3300/0 conn(0x7fc7880b87a0 0x7fc7880cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.485+0000 7fc78efff700 1 -- 172.21.15.116:0/747629514 >> 172.21.15.116:0/747629514 conn(0x7fc788071b10 msgr2=0x7fc788071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:49.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.485+0000 7fc78efff700 1 -- 172.21.15.116:0/747629514 shutdown_connections 2023-05-12T09:07:49.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.485+0000 7fc78efff700 1 -- 172.21.15.116:0/747629514 wait complete. 2023-05-12T09:07:49.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.487+0000 7fc78efff700 1 Processor -- start 2023-05-12T09:07:49.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.487+0000 7fc78efff700 1 -- start start 2023-05-12T09:07:49.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78efff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7880b87a0 0x7fc788151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78efff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc7881601e0 0x7fc7881f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78efff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 0x7fc788153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78efff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7881f3e10 con 0x7fc788160d40 2023-05-12T09:07:49.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78efff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7881540a0 con 0x7fc7881601e0 2023-05-12T09:07:49.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78efff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc788152370 con 0x7fc7880b87a0 2023-05-12T09:07:49.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78d59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 0x7fc788153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78d59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 0x7fc788153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57580/0 (socket says 172.21.15.116:57580) 2023-05-12T09:07:49.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78d59c700 1 -- 172.21.15.116:0/2785877852 learned_addr learned my addr 172.21.15.116:0/2785877852 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:49.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc787fff700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc7881601e0 0x7fc7881f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78cd9b700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7880b87a0 0x7fc788151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78d59c700 1 -- 172.21.15.116:0/2785877852 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7880b87a0 msgr2=0x7fc788151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78d59c700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7880b87a0 0x7fc788151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78d59c700 1 -- 172.21.15.116:0/2785877852 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc7881601e0 msgr2=0x7fc7881f38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78d59c700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc7881601e0 0x7fc7881f38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.488+0000 7fc78d59c700 1 -- 172.21.15.116:0/2785877852 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780009a70 con 0x7fc788160d40 2023-05-12T09:07:49.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.489+0000 7fc78d59c700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 0x7fc788153b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc780014040 tx=0x7fc780004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:49.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.489+0000 7fc7857fa700 1 -- 172.21.15.116:0/2785877852 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78001b810 con 0x7fc788160d40 2023-05-12T09:07:49.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.489+0000 7fc7857fa700 1 -- 172.21.15.116:0/2785877852 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc780020070 con 0x7fc788160d40 2023-05-12T09:07:49.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.489+0000 7fc7857fa700 1 -- 172.21.15.116:0/2785877852 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78001bbb0 con 0x7fc788160d40 2023-05-12T09:07:49.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.489+0000 7fc78efff700 1 -- 172.21.15.116:0/2785877852 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7880d1640 con 0x7fc788160d40 2023-05-12T09:07:49.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.489+0000 7fc78efff700 1 -- 172.21.15.116:0/2785877852 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7880cd980 con 0x7fc788160d40 2023-05-12T09:07:49.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.490+0000 7fc78efff700 1 -- 172.21.15.116:0/2785877852 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7880d17d0 con 0x7fc788160d40 2023-05-12T09:07:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.491+0000 7fc7857fa700 1 -- 172.21.15.116:0/2785877852 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc78001bd10 con 0x7fc788160d40 2023-05-12T09:07:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.492+0000 7fc7857fa700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc76c06ad10 0x7fc76c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.492+0000 7fc7857fa700 1 -- 172.21.15.116:0/2785877852 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc780022070 con 0x7fc788160d40 2023-05-12T09:07:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.492+0000 7fc78cd9b700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc76c06ad10 0x7fc76c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.493+0000 7fc78cd9b700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc76c06ad10 0x7fc76c06d1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7880b22a0 tx=0x7fc77c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:49.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.496+0000 7fc7857fa700 1 -- 172.21.15.116:0/2785877852 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc78005a0c0 con 0x7fc788160d40 2023-05-12T09:07:49.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.694+0000 7fc78efff700 1 -- 172.21.15.116:0/2785877852 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7880b52f0 con 0x7fc788160d40 2023-05-12T09:07:49.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.696+0000 7fc7857fa700 1 -- 172.21.15.116:0/2785877852 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7fc780059c50 con 0x7fc788160d40 2023-05-12T09:07:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:49.698 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:49.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 -- 172.21.15.116:0/2785877852 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc76c06ad10 msgr2=0x7fc76c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc76c06ad10 0x7fc76c06d1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7880b22a0 tx=0x7fc77c009190 comp rx=0 tx=0).stop 2023-05-12T09:07:49.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 -- 172.21.15.116:0/2785877852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 msgr2=0x7fc788153b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 0x7fc788153b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc780014040 tx=0x7fc780004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 -- 172.21.15.116:0/2785877852 shutdown_connections 2023-05-12T09:07:49.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc788160d40 0x7fc788153b60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc76c06ad10 0x7fc76c06d1c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc7880b87a0 0x7fc788151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 --2- 172.21.15.116:0/2785877852 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc7881601e0 0x7fc7881f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 -- 172.21.15.116:0/2785877852 >> 172.21.15.116:0/2785877852 conn(0x7fc788071b10 msgr2=0x7fc788071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:49.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 -- 172.21.15.116:0/2785877852 shutdown_connections 2023-05-12T09:07:49.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.698+0000 7fc78efff700 1 -- 172.21.15.116:0/2785877852 wait complete. 2023-05-12T09:07:49.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:07:49.719 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:07:49.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.903+0000 7f74889ff700 1 Processor -- start 2023-05-12T09:07:49.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.903+0000 7f74889ff700 1 -- start start 2023-05-12T09:07:49.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.904+0000 7f74889ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f74840cfbf0 0x7f74841608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.904+0000 7f74889ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74840d1100 0x7f74840d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.904+0000 7f74889ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74840d0020 con 0x7f74840b87a0 2023-05-12T09:07:49.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.904+0000 7f74889ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74840d02d0 con 0x7f74840cfbf0 2023-05-12T09:07:49.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.904+0000 7f74889ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74840d0cb0 con 0x7f74840d1100 2023-05-12T09:07:49.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.905+0000 7f747bfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f74840cfbf0 0x7f74841608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.905+0000 7f747bfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f74840cfbf0 0x7f74841608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57586/0 (socket says 172.21.15.116:57586) 2023-05-12T09:07:49.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.905+0000 7f747bfff700 1 -- 172.21.15.116:0/21441241 learned_addr learned my addr 172.21.15.116:0/21441241 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:49.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.905+0000 7f7482d9d700 1 --2- 172.21.15.116:0/21441241 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74840d1100 0x7f74840d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.905+0000 7f747bfff700 1 -- 172.21.15.116:0/21441241 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74840d1100 msgr2=0x7f74840d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:49.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.905+0000 7f747bfff700 1 --2- 172.21.15.116:0/21441241 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74840d1100 0x7f74840d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.905+0000 7f747bfff700 1 -- 172.21.15.116:0/21441241 >> v1:172.21.15.182:6789/0 conn(0x7f74840b87a0 legacy=0x7f74841601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.905+0000 7f747bfff700 1 -- 172.21.15.116:0/21441241 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74840cdc60 con 0x7f74840cfbf0 2023-05-12T09:07:49.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.905+0000 7f747bfff700 1 --2- 172.21.15.116:0/21441241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 0x7f74841608f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f746c0098f0 tx=0x7f746c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31260704aa960a83 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:49.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f7481d9b700 1 -- 172.21.15.116:0/21441241 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c011830 con 0x7f74840cfbf0 2023-05-12T09:07:49.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f7481d9b700 1 -- 172.21.15.116:0/21441241 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c011990 con 0x7f74840cfbf0 2023-05-12T09:07:49.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f7481d9b700 1 -- 172.21.15.116:0/21441241 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c011d20 con 0x7f74840cfbf0 2023-05-12T09:07:49.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f74889ff700 1 -- 172.21.15.116:0/21441241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 msgr2=0x7f74841608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f74889ff700 1 --2- 172.21.15.116:0/21441241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 0x7f74841608f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f746c0098f0 tx=0x7f746c009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:49.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f74889ff700 1 -- 172.21.15.116:0/21441241 shutdown_connections 2023-05-12T09:07:49.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f74889ff700 1 --2- 172.21.15.116:0/21441241 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74840d1100 0x7f74840d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f74889ff700 1 --2- 172.21.15.116:0/21441241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 0x7f74841608f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f74889ff700 1 -- 172.21.15.116:0/21441241 >> 172.21.15.116:0/21441241 conn(0x7f7484071b10 msgr2=0x7f7484071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:49.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f74889ff700 1 -- 172.21.15.116:0/21441241 shutdown_connections 2023-05-12T09:07:49.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.906+0000 7f74889ff700 1 -- 172.21.15.116:0/21441241 wait complete. 2023-05-12T09:07:49.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.908+0000 7f74889ff700 1 Processor -- start 2023-05-12T09:07:49.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.908+0000 7f74889ff700 1 -- start start 2023-05-12T09:07:49.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f74889ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74840b87a0 0x7f7484153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f74889ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 0x7f74840cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f74889ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74840d1100 0x7f7484159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f74889ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74840cafb0 con 0x7f74840cfbf0 2023-05-12T09:07:49.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f74889ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74840ca3a0 con 0x7f74840d1100 2023-05-12T09:07:49.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f74889ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74840ca680 con 0x7f74840b87a0 2023-05-12T09:07:49.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f747bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 0x7f74840cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f747bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 0x7f74840cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57588/0 (socket says 172.21.15.116:57588) 2023-05-12T09:07:49.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f747bfff700 1 -- 172.21.15.116:0/2701562644 learned_addr learned my addr 172.21.15.116:0/2701562644 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:49.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f747bfff700 1 -- 172.21.15.116:0/2701562644 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74840b87a0 msgr2=0x7f7484153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f747bfff700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74840b87a0 0x7f7484153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f747bfff700 1 -- 172.21.15.116:0/2701562644 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74840d1100 msgr2=0x7f7484159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:49.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f747bfff700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74840d1100 0x7f7484159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:49.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.909+0000 7f747bfff700 1 -- 172.21.15.116:0/2701562644 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c009550 con 0x7f74840cfbf0 2023-05-12T09:07:49.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.910+0000 7f747bfff700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 0x7f74840cb7a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f746c000c00 tx=0x7f746c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:49.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.910+0000 7f747affd700 1 -- 172.21.15.116:0/2701562644 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0044f0 con 0x7f74840cfbf0 2023-05-12T09:07:49.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.910+0000 7f747affd700 1 -- 172.21.15.116:0/2701562644 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c01f070 con 0x7f74840cfbf0 2023-05-12T09:07:49.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.910+0000 7f74889ff700 1 -- 172.21.15.116:0/2701562644 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74840cd980 con 0x7f74840cfbf0 2023-05-12T09:07:49.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.910+0000 7f747affd700 1 -- 172.21.15.116:0/2701562644 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0038c0 con 0x7f74840cfbf0 2023-05-12T09:07:49.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.910+0000 7f74889ff700 1 -- 172.21.15.116:0/2701562644 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74840cd6a0 con 0x7f74840cfbf0 2023-05-12T09:07:49.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.911+0000 7f74889ff700 1 -- 172.21.15.116:0/2701562644 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7484160e30 con 0x7f74840cfbf0 2023-05-12T09:07:49.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.912+0000 7f747affd700 1 -- 172.21.15.116:0/2701562644 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f746c021030 con 0x7f74840cfbf0 2023-05-12T09:07:49.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.913+0000 7f747affd700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f746406ace0 0x7f746406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:49.917 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.913+0000 7f747affd700 1 -- 172.21.15.116:0/2701562644 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f746c08ac80 con 0x7f74840cfbf0 2023-05-12T09:07:49.917 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.913+0000 7f748259c700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f746406ace0 0x7f746406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:49.917 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.914+0000 7f748259c700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f746406ace0 0x7f746406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7474000f60 tx=0x7f7474007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:49.919 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:49.917+0000 7f747affd700 1 -- 172.21.15.116:0/2701562644 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f746c055a30 con 0x7f74840cfbf0 2023-05-12T09:07:50.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.111+0000 7f74889ff700 1 -- 172.21.15.116:0/2701562644 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7484074430 con 0x7f74840cfbf0 2023-05-12T09:07:50.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.112+0000 7f747affd700 1 -- 172.21.15.116:0/2701562644 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f746c0150a0 con 0x7f74840cfbf0 2023-05-12T09:07:50.114 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:07:50.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 -- 172.21.15.116:0/2701562644 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f746406ace0 msgr2=0x7f746406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f746406ace0 0x7f746406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7474000f60 tx=0x7f7474007a40 comp rx=0 tx=0).stop 2023-05-12T09:07:50.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 -- 172.21.15.116:0/2701562644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 msgr2=0x7f74840cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 0x7f74840cb7a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f746c000c00 tx=0x7f746c004750 comp rx=0 tx=0).stop 2023-05-12T09:07:50.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 -- 172.21.15.116:0/2701562644 shutdown_connections 2023-05-12T09:07:50.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74840d1100 0x7f7484159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f746406ace0 0x7f746406d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74840b87a0 0x7f7484153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 --2- 172.21.15.116:0/2701562644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74840cfbf0 0x7f74840cb7a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 -- 172.21.15.116:0/2701562644 >> 172.21.15.116:0/2701562644 conn(0x7f7484071b10 msgr2=0x7f748415ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:50.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 -- 172.21.15.116:0/2701562644 shutdown_connections 2023-05-12T09:07:50.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.114+0000 7f74889ff700 1 -- 172.21.15.116:0/2701562644 wait complete. 2023-05-12T09:07:50.133 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:07:50.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.318+0000 7f114abff700 1 Processor -- start 2023-05-12T09:07:50.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.318+0000 7f114abff700 1 -- start start 2023-05-12T09:07:50.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.319+0000 7f114abff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f11440b87a0 0x7f11440cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.319+0000 7f114abff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11440cdc60 con 0x7f1144160d40 2023-05-12T09:07:50.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.319+0000 7f114abff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11440cd6a0 con 0x7f11441601e0 2023-05-12T09:07:50.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.319+0000 7f114abff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11440d02d0 con 0x7f11440b87a0 2023-05-12T09:07:50.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.319+0000 7f114919c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1144160d40 0x7f11440d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60624/0 (socket says 172.21.15.116:60624) 2023-05-12T09:07:50.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.319+0000 7f114919c700 1 -- 172.21.15.116:0/1437185041 learned_addr learned my addr 172.21.15.116:0/1437185041 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:50.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.320+0000 7f114899b700 1 --2- 172.21.15.116:0/1437185041 >> v2:172.21.15.182:3300/0 conn(0x7f11440b87a0 0x7f11440cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.320+0000 7f11437fe700 1 -- 172.21.15.116:0/1437185041 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317612193 0 0) 0x7f11440cdc60 con 0x7f1144160d40 2023-05-12T09:07:50.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.320+0000 7f11437fe700 1 -- 172.21.15.116:0/1437185041 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11340035b0 con 0x7f1144160d40 2023-05-12T09:07:50.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.320+0000 7f114899b700 1 -- 172.21.15.116:0/1437185041 >> v1:172.21.15.182:6789/0 conn(0x7f11441601e0 legacy=0x7f1144160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.320+0000 7f114899b700 1 -- 172.21.15.116:0/1437185041 >> v1:172.21.15.116:6789/0 conn(0x7f1144160d40 legacy=0x7f11440d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.320+0000 7f114899b700 1 -- 172.21.15.116:0/1437185041 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440cd980 con 0x7f11440b87a0 2023-05-12T09:07:50.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.320+0000 7f114899b700 1 --2- 172.21.15.116:0/1437185041 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11440b87a0 0x7f11440cfbf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1138009840 tx=0x7f1138009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9edaeb9ff1dfb9a server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:50.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.321+0000 7f11437fe700 1 -- 172.21.15.116:0/1437185041 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138011830 con 0x7f11440b87a0 2023-05-12T09:07:50.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.321+0000 7f11437fe700 1 -- 172.21.15.116:0/1437185041 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138011990 con 0x7f11440b87a0 2023-05-12T09:07:50.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.321+0000 7f11437fe700 1 -- 172.21.15.116:0/1437185041 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138011d20 con 0x7f11440b87a0 2023-05-12T09:07:50.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.321+0000 7f114abff700 1 -- 172.21.15.116:0/1437185041 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11440b87a0 msgr2=0x7f11440cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.321+0000 7f114abff700 1 --2- 172.21.15.116:0/1437185041 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11440b87a0 0x7f11440cfbf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1138009840 tx=0x7f1138009b50 comp rx=0 tx=0).stop 2023-05-12T09:07:50.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.321+0000 7f114abff700 1 -- 172.21.15.116:0/1437185041 shutdown_connections 2023-05-12T09:07:50.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.321+0000 7f114abff700 1 --2- 172.21.15.116:0/1437185041 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11440b87a0 0x7f11440cfbf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.321+0000 7f114abff700 1 -- 172.21.15.116:0/1437185041 >> 172.21.15.116:0/1437185041 conn(0x7f1144071b10 msgr2=0x7f1144071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:50.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.321+0000 7f114abff700 1 -- 172.21.15.116:0/1437185041 shutdown_connections 2023-05-12T09:07:50.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.322+0000 7f114abff700 1 -- 172.21.15.116:0/1437185041 wait complete. 2023-05-12T09:07:50.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.323+0000 7f114abff700 1 Processor -- start 2023-05-12T09:07:50.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.323+0000 7f114abff700 1 -- start start 2023-05-12T09:07:50.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.324+0000 7f114abff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11440b87a0 0x7f11441538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.324+0000 7f114abff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441601e0 0x7f11441595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.324+0000 7f114abff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1144160d40 0x7f1144159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.324+0000 7f114abff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440cce60 con 0x7f11441601e0 2023-05-12T09:07:50.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.324+0000 7f114abff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440cc8a0 con 0x7f11440b87a0 2023-05-12T09:07:50.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.324+0000 7f114abff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11440ccb80 con 0x7f1144160d40 2023-05-12T09:07:50.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.324+0000 7f1143fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441601e0 0x7f11441595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f1143fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441601e0 0x7f11441595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57600/0 (socket says 172.21.15.116:57600) 2023-05-12T09:07:50.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f1143fff700 1 -- 172.21.15.116:0/3108431894 learned_addr learned my addr 172.21.15.116:0/3108431894 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:50.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f114899b700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11440b87a0 0x7f11441538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f114919c700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1144160d40 0x7f1144159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f1143fff700 1 -- 172.21.15.116:0/3108431894 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1144160d40 msgr2=0x7f1144159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f1143fff700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1144160d40 0x7f1144159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f1143fff700 1 -- 172.21.15.116:0/3108431894 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11440b87a0 msgr2=0x7f11441538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f1143fff700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11440b87a0 0x7f11441538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f1143fff700 1 -- 172.21.15.116:0/3108431894 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11380094a0 con 0x7f11441601e0 2023-05-12T09:07:50.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f114919c700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1144160d40 0x7f1144159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:50.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f114899b700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11440b87a0 0x7f11441538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:50.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f1143fff700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441601e0 0x7f11441595a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f113000c4e0 tx=0x7f113000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:50.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f11417fa700 1 -- 172.21.15.116:0/3108431894 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11300052d0 con 0x7f11441601e0 2023-05-12T09:07:50.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f11417fa700 1 -- 172.21.15.116:0/3108431894 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130005430 con 0x7f11441601e0 2023-05-12T09:07:50.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f114abff700 1 -- 172.21.15.116:0/3108431894 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11440d19a0 con 0x7f11441601e0 2023-05-12T09:07:50.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.325+0000 7f11417fa700 1 -- 172.21.15.116:0/3108431894 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11300038c0 con 0x7f11441601e0 2023-05-12T09:07:50.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.326+0000 7f114abff700 1 -- 172.21.15.116:0/3108431894 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11440d1810 con 0x7f11441601e0 2023-05-12T09:07:50.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.327+0000 7f114abff700 1 -- 172.21.15.116:0/3108431894 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11440d1b30 con 0x7f11441601e0 2023-05-12T09:07:50.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.327+0000 7f11417fa700 1 -- 172.21.15.116:0/3108431894 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1130003a20 con 0x7f11441601e0 2023-05-12T09:07:50.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.329+0000 7f11417fa700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f112806ad10 0x7f112806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.329+0000 7f11417fa700 1 -- 172.21.15.116:0/3108431894 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1130088cf0 con 0x7f11441601e0 2023-05-12T09:07:50.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.329+0000 7f114899b700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f112806ad10 0x7f112806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.330+0000 7f114899b700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f112806ad10 0x7f112806d1c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f11380090b0 tx=0x7f1138008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:50.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.333+0000 7f11417fa700 1 -- 172.21.15.116:0/3108431894 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1130053a10 con 0x7f11441601e0 2023-05-12T09:07:50.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.526+0000 7f114abff700 1 -- 172.21.15.116:0/3108431894 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11441e5fe0 con 0x7f11441601e0 2023-05-12T09:07:50.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.526+0000 7f11417fa700 1 -- 172.21.15.116:0/3108431894 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1130017020 con 0x7f11441601e0 2023-05-12T09:07:50.529 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:07:50.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.528+0000 7f114abff700 1 -- 172.21.15.116:0/3108431894 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f112806ad10 msgr2=0x7f112806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.528+0000 7f114abff700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f112806ad10 0x7f112806d1c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f11380090b0 tx=0x7f1138008030 comp rx=0 tx=0).stop 2023-05-12T09:07:50.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.528+0000 7f114abff700 1 -- 172.21.15.116:0/3108431894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441601e0 msgr2=0x7f11441595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.528+0000 7f114abff700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441601e0 0x7f11441595a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f113000c4e0 tx=0x7f113000c8a0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.529+0000 7f114abff700 1 -- 172.21.15.116:0/3108431894 shutdown_connections 2023-05-12T09:07:50.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.529+0000 7f114abff700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f112806ad10 0x7f112806d1c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.529+0000 7f114abff700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1144160d40 0x7f1144159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.529+0000 7f114abff700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f11440b87a0 0x7f11441538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.529+0000 7f114abff700 1 --2- 172.21.15.116:0/3108431894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441601e0 0x7f11441595a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.529+0000 7f114abff700 1 -- 172.21.15.116:0/3108431894 >> 172.21.15.116:0/3108431894 conn(0x7f1144071b10 msgr2=0x7f11440d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:50.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.529+0000 7f114abff700 1 -- 172.21.15.116:0/3108431894 shutdown_connections 2023-05-12T09:07:50.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.529+0000 7f114abff700 1 -- 172.21.15.116:0/3108431894 wait complete. 2023-05-12T09:07:50.548 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:07:50.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.735+0000 7f278c3ff700 1 Processor -- start 2023-05-12T09:07:50.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.735+0000 7f278c3ff700 1 -- start start 2023-05-12T09:07:50.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.736+0000 7f278c3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27840b87a0 0x7f27840cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.737+0000 7f278c3ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f2784160d40 0x7f27840d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.739 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.737+0000 7f278c3ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27840cdc60 con 0x7f27841601e0 2023-05-12T09:07:50.739 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.737+0000 7f278c3ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27840d02d0 con 0x7f2784160d40 2023-05-12T09:07:50.739 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.737+0000 7f278c3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27840d0cb0 con 0x7f27840b87a0 2023-05-12T09:07:50.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.737+0000 7f278a19b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27840b87a0 0x7f27840cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.737+0000 7f278a99c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f2784160d40 0x7f27840d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.737+0000 7f278a19b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27840b87a0 0x7f27840cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:49522/0 (socket says 172.21.15.116:49522) 2023-05-12T09:07:50.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.737+0000 7f278a19b700 1 -- 172.21.15.116:0/2989405971 learned_addr learned my addr 172.21.15.116:0/2989405971 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:50.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.738+0000 7f278a19b700 1 -- 172.21.15.116:0/2989405971 >> v2:172.21.15.182:3300/0 conn(0x7f2784160d40 msgr2=0x7f27840d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:50.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.738+0000 7f278a19b700 1 --2- 172.21.15.116:0/2989405971 >> v2:172.21.15.182:3300/0 conn(0x7f2784160d40 0x7f27840d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.738+0000 7f278a19b700 1 -- 172.21.15.116:0/2989405971 >> v1:172.21.15.182:6789/0 conn(0x7f27841601e0 legacy=0x7f2784160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.738+0000 7f278a19b700 1 -- 172.21.15.116:0/2989405971 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27840cd6a0 con 0x7f27840b87a0 2023-05-12T09:07:50.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.738+0000 7f278a99c700 1 --2- 172.21.15.116:0/2989405971 >> v2:172.21.15.182:3300/0 conn(0x7f2784160d40 0x7f27840d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:50.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.738+0000 7f278a19b700 1 --2- 172.21.15.116:0/2989405971 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27840b87a0 0x7f27840cfbf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27800098f0 tx=0x7f2780009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c46454c69c656ed1 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:50.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.738+0000 7f2789199700 1 -- 172.21.15.116:0/2989405971 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780011830 con 0x7f27840b87a0 2023-05-12T09:07:50.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.738+0000 7f2789199700 1 -- 172.21.15.116:0/2989405971 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2780011990 con 0x7f27840b87a0 2023-05-12T09:07:50.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.738+0000 7f2789199700 1 -- 172.21.15.116:0/2989405971 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780011d20 con 0x7f27840b87a0 2023-05-12T09:07:50.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.739+0000 7f278c3ff700 1 -- 172.21.15.116:0/2989405971 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27840b87a0 msgr2=0x7f27840cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.739+0000 7f278c3ff700 1 --2- 172.21.15.116:0/2989405971 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27840b87a0 0x7f27840cfbf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27800098f0 tx=0x7f2780009c00 comp rx=0 tx=0).stop 2023-05-12T09:07:50.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.739+0000 7f278c3ff700 1 -- 172.21.15.116:0/2989405971 shutdown_connections 2023-05-12T09:07:50.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.739+0000 7f278c3ff700 1 --2- 172.21.15.116:0/2989405971 >> v2:172.21.15.182:3300/0 conn(0x7f2784160d40 0x7f27840d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.739+0000 7f278c3ff700 1 --2- 172.21.15.116:0/2989405971 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27840b87a0 0x7f27840cfbf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.739+0000 7f278c3ff700 1 -- 172.21.15.116:0/2989405971 >> 172.21.15.116:0/2989405971 conn(0x7f2784071b10 msgr2=0x7f2784071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:50.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.739+0000 7f278c3ff700 1 -- 172.21.15.116:0/2989405971 shutdown_connections 2023-05-12T09:07:50.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.739+0000 7f278c3ff700 1 -- 172.21.15.116:0/2989405971 wait complete. 2023-05-12T09:07:50.745 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.740+0000 7f278c3ff700 1 Processor -- start 2023-05-12T09:07:50.745 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.741+0000 7f278c3ff700 1 -- start start 2023-05-12T09:07:50.745 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.741+0000 7f278c3ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f27840b87a0 0x7f27840cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.745 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278c3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27841601e0 0x7f2784151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.745 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278c3ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2784160d40 0x7f27840d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278c3ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784151c90 con 0x7f2784160d40 2023-05-12T09:07:50.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278c3ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27841f5e00 con 0x7f27840b87a0 2023-05-12T09:07:50.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278c3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27841f60e0 con 0x7f27841601e0 2023-05-12T09:07:50.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278a99c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2784160d40 0x7f27840d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278a19b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f27840b87a0 0x7f27840cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278a99c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2784160d40 0x7f27840d2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57602/0 (socket says 172.21.15.116:57602) 2023-05-12T09:07:50.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278a99c700 1 -- 172.21.15.116:0/2911084229 learned_addr learned my addr 172.21.15.116:0/2911084229 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:50.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278999a700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27841601e0 0x7f2784151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278a99c700 1 -- 172.21.15.116:0/2911084229 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27841601e0 msgr2=0x7f2784151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278a99c700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27841601e0 0x7f2784151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278a99c700 1 -- 172.21.15.116:0/2911084229 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f27840b87a0 msgr2=0x7f27840cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278a99c700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f27840b87a0 0x7f27840cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278a99c700 1 -- 172.21.15.116:0/2911084229 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c009a70 con 0x7f2784160d40 2023-05-12T09:07:50.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.742+0000 7f278a99c700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2784160d40 0x7f27840d2b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f277c00efc0 tx=0x7f277c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:50.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.743+0000 7f277affd700 1 -- 172.21.15.116:0/2911084229 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00ca90 con 0x7f2784160d40 2023-05-12T09:07:50.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.743+0000 7f277affd700 1 -- 172.21.15.116:0/2911084229 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c00f040 con 0x7f2784160d40 2023-05-12T09:07:50.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.743+0000 7f277affd700 1 -- 172.21.15.116:0/2911084229 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00ce30 con 0x7f2784160d40 2023-05-12T09:07:50.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.743+0000 7f278c3ff700 1 -- 172.21.15.116:0/2911084229 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2780009550 con 0x7f2784160d40 2023-05-12T09:07:50.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.743+0000 7f278c3ff700 1 -- 172.21.15.116:0/2911084229 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27840d1640 con 0x7f2784160d40 2023-05-12T09:07:50.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.744+0000 7f278c3ff700 1 -- 172.21.15.116:0/2911084229 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27840cd980 con 0x7f2784160d40 2023-05-12T09:07:50.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.746+0000 7f277affd700 1 -- 172.21.15.116:0/2911084229 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f277c003a20 con 0x7f2784160d40 2023-05-12T09:07:50.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.747+0000 7f277affd700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f276806ace0 0x7f276806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:50.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.747+0000 7f277affd700 1 -- 172.21.15.116:0/2911084229 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f277c08a920 con 0x7f2784160d40 2023-05-12T09:07:50.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.747+0000 7f278a19b700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f276806ace0 0x7f276806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:50.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.748+0000 7f278a19b700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f276806ace0 0x7f276806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2780009c40 tx=0x7f2780008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:50.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.750+0000 7f277affd700 1 -- 172.21.15.116:0/2911084229 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f277c0556c0 con 0x7f2784160d40 2023-05-12T09:07:50.945 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.943+0000 7f278c3ff700 1 -- 172.21.15.116:0/2911084229 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27840d17d0 con 0x7f2784160d40 2023-05-12T09:07:50.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.944+0000 7f277affd700 1 -- 172.21.15.116:0/2911084229 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f277c009cd0 con 0x7f2784160d40 2023-05-12T09:07:50.946 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:07:50.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 -- 172.21.15.116:0/2911084229 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f276806ace0 msgr2=0x7f276806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f276806ace0 0x7f276806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2780009c40 tx=0x7f2780008030 comp rx=0 tx=0).stop 2023-05-12T09:07:50.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 -- 172.21.15.116:0/2911084229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2784160d40 msgr2=0x7f27840d2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:50.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2784160d40 0x7f27840d2b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f277c00efc0 tx=0x7f277c00c3a0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 -- 172.21.15.116:0/2911084229 shutdown_connections 2023-05-12T09:07:50.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2784160d40 0x7f27840d2b50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f27840b87a0 0x7f27840cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f276806ace0 0x7f276806d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 --2- 172.21.15.116:0/2911084229 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f27841601e0 0x7f2784151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:50.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 -- 172.21.15.116:0/2911084229 >> 172.21.15.116:0/2911084229 conn(0x7f2784071b10 msgr2=0x7f27840b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:50.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 -- 172.21.15.116:0/2911084229 shutdown_connections 2023-05-12T09:07:50.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:50.946+0000 7f278c3ff700 1 -- 172.21.15.116:0/2911084229 wait complete. 2023-05-12T09:07:50.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:07:51.152 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.149+0000 7f5733dff700 1 Processor -- start 2023-05-12T09:07:51.152 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.149+0000 7f5733dff700 1 -- start start 2023-05-12T09:07:51.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.150+0000 7f5733dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f572c15a5a0 0x7f572c06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.150+0000 7f5733dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 0x7f572c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.150+0000 7f5733dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c0cb280 con 0x7f572c06a920 2023-05-12T09:07:51.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.150+0000 7f5733dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c06adc0 con 0x7f572c15a5a0 2023-05-12T09:07:51.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.150+0000 7f5733dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c15a970 con 0x7f572c071200 2023-05-12T09:07:51.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.151+0000 7f573139a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f572c06a920 0x7f572c070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60632/0 (socket says 172.21.15.116:60632) 2023-05-12T09:07:51.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.151+0000 7f573139a700 1 -- 172.21.15.116:0/2948452284 learned_addr learned my addr 172.21.15.116:0/2948452284 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:51.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.151+0000 7f573239c700 1 --2- 172.21.15.116:0/2948452284 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 0x7f572c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.151+0000 7f5731b9b700 1 --2- 172.21.15.116:0/2948452284 >> v2:172.21.15.182:3300/0 conn(0x7f572c15a5a0 0x7f572c06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.151+0000 7f5730b99700 1 -- 172.21.15.116:0/2948452284 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339846012 0 0) 0x7f571c001290 con 0x7f572c06a920 2023-05-12T09:07:51.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.151+0000 7f5730b99700 1 -- 172.21.15.116:0/2948452284 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57180035b0 con 0x7f572c06a920 2023-05-12T09:07:51.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.151+0000 7f573239c700 1 -- 172.21.15.116:0/2948452284 >> v2:172.21.15.182:3300/0 conn(0x7f572c15a5a0 msgr2=0x7f572c06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:51.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.151+0000 7f573239c700 1 --2- 172.21.15.116:0/2948452284 >> v2:172.21.15.182:3300/0 conn(0x7f572c15a5a0 0x7f572c06a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.151+0000 7f573239c700 1 -- 172.21.15.116:0/2948452284 >> v1:172.21.15.116:6789/0 conn(0x7f572c06a920 legacy=0x7f572c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.151+0000 7f573239c700 1 -- 172.21.15.116:0/2948452284 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c071700 con 0x7f572c071200 2023-05-12T09:07:51.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.152+0000 7f573239c700 1 --2- 172.21.15.116:0/2948452284 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 0x7f572c06d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5724009d90 tx=0x7f572400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e72191fdfd6ceca4 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:51.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.152+0000 7f5730b99700 1 -- 172.21.15.116:0/2948452284 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572400e070 con 0x7f572c071200 2023-05-12T09:07:51.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.152+0000 7f5730b99700 1 -- 172.21.15.116:0/2948452284 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572400bb20 con 0x7f572c071200 2023-05-12T09:07:51.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.152+0000 7f5730b99700 1 -- 172.21.15.116:0/2948452284 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724012430 con 0x7f572c071200 2023-05-12T09:07:51.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.152+0000 7f5733dff700 1 -- 172.21.15.116:0/2948452284 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 msgr2=0x7f572c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.152+0000 7f5733dff700 1 --2- 172.21.15.116:0/2948452284 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 0x7f572c06d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5724009d90 tx=0x7f572400b330 comp rx=0 tx=0).stop 2023-05-12T09:07:51.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.152+0000 7f5733dff700 1 -- 172.21.15.116:0/2948452284 shutdown_connections 2023-05-12T09:07:51.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.152+0000 7f5733dff700 1 --2- 172.21.15.116:0/2948452284 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 0x7f572c06d1a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.152+0000 7f5733dff700 1 --2- 172.21.15.116:0/2948452284 >> v2:172.21.15.182:3300/0 conn(0x7f572c15a5a0 0x7f572c06a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.152+0000 7f5733dff700 1 -- 172.21.15.116:0/2948452284 >> 172.21.15.116:0/2948452284 conn(0x7f572c0cf720 msgr2=0x7f572c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:51.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.153+0000 7f5733dff700 1 -- 172.21.15.116:0/2948452284 shutdown_connections 2023-05-12T09:07:51.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.153+0000 7f5733dff700 1 -- 172.21.15.116:0/2948452284 wait complete. 2023-05-12T09:07:51.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.155+0000 7f5733dff700 1 Processor -- start 2023-05-12T09:07:51.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.155+0000 7f5733dff700 1 -- start start 2023-05-12T09:07:51.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.156+0000 7f5733dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c06a920 0x7f572c0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.156+0000 7f5733dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 0x7f572c0ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.156+0000 7f5733dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f572c15a5a0 0x7f572c15c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.156+0000 7f5733dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0ce5d0 con 0x7f572c06a920 2023-05-12T09:07:51.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.156+0000 7f5733dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1f5820 con 0x7f572c15a5a0 2023-05-12T09:07:51.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.156+0000 7f5733dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1f5ae0 con 0x7f572c071200 2023-05-12T09:07:51.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.156+0000 7f5731b9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c06a920 0x7f572c0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f5731b9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c06a920 0x7f572c0c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57612/0 (socket says 172.21.15.116:57612) 2023-05-12T09:07:51.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f5731b9b700 1 -- 172.21.15.116:0/3210208193 learned_addr learned my addr 172.21.15.116:0/3210208193 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:51.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f573139a700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 0x7f572c0ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f573239c700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f572c15a5a0 0x7f572c15c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f5731b9b700 1 -- 172.21.15.116:0/3210208193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 msgr2=0x7f572c0ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f5731b9b700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 0x7f572c0ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f5731b9b700 1 -- 172.21.15.116:0/3210208193 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f572c15a5a0 msgr2=0x7f572c15c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f5731b9b700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f572c15a5a0 0x7f572c15c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f5731b9b700 1 -- 172.21.15.116:0/3210208193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5724009a70 con 0x7f572c06a920 2023-05-12T09:07:51.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f5731b9b700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c06a920 0x7f572c0c5470 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f572800e870 tx=0x7f572800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:51.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f57227fc700 1 -- 172.21.15.116:0/3210208193 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728009590 con 0x7f572c06a920 2023-05-12T09:07:51.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f57227fc700 1 -- 172.21.15.116:0/3210208193 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572800ee70 con 0x7f572c06a920 2023-05-12T09:07:51.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f5733dff700 1 -- 172.21.15.116:0/3210208193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c06c6c0 con 0x7f572c06a920 2023-05-12T09:07:51.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.157+0000 7f57227fc700 1 -- 172.21.15.116:0/3210208193 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800ca50 con 0x7f572c06a920 2023-05-12T09:07:51.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.158+0000 7f5733dff700 1 -- 172.21.15.116:0/3210208193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c0719e0 con 0x7f572c06a920 2023-05-12T09:07:51.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.159+0000 7f5733dff700 1 -- 172.21.15.116:0/3210208193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c06c9a0 con 0x7f572c06a920 2023-05-12T09:07:51.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.159+0000 7f57227fc700 1 -- 172.21.15.116:0/3210208193 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f572800cbb0 con 0x7f572c06a920 2023-05-12T09:07:51.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.161+0000 7f57227fc700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f571006ace0 0x7f571006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.161+0000 7f57227fc700 1 -- 172.21.15.116:0/3210208193 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5728089770 con 0x7f572c06a920 2023-05-12T09:07:51.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.161+0000 7f573139a700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f571006ace0 0x7f571006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.162+0000 7f573139a700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f571006ace0 0x7f571006d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f572c0b3640 tx=0x7f571c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:51.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.165+0000 7f57227fc700 1 -- 172.21.15.116:0/3210208193 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5728057f20 con 0x7f572c06a920 2023-05-12T09:07:51.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.358+0000 7f5733dff700 1 -- 172.21.15.116:0/3210208193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f572c074430 con 0x7f572c06a920 2023-05-12T09:07:51.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.358+0000 7f57227fc700 1 -- 172.21.15.116:0/3210208193 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f572800ce60 con 0x7f572c06a920 2023-05-12T09:07:51.361 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:07:51.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 -- 172.21.15.116:0/3210208193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f571006ace0 msgr2=0x7f571006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f571006ace0 0x7f571006d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f572c0b3640 tx=0x7f571c009040 comp rx=0 tx=0).stop 2023-05-12T09:07:51.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 -- 172.21.15.116:0/3210208193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c06a920 msgr2=0x7f572c0c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c06a920 0x7f572c0c5470 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f572800e870 tx=0x7f572800ec30 comp rx=0 tx=0).stop 2023-05-12T09:07:51.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 -- 172.21.15.116:0/3210208193 shutdown_connections 2023-05-12T09:07:51.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f572c15a5a0 0x7f572c15c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c06a920 0x7f572c0c5470 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f571006ace0 0x7f571006d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 --2- 172.21.15.116:0/3210208193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f572c071200 0x7f572c0ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 -- 172.21.15.116:0/3210208193 >> 172.21.15.116:0/3210208193 conn(0x7f572c0cf720 msgr2=0x7f572c0b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:51.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 -- 172.21.15.116:0/3210208193 shutdown_connections 2023-05-12T09:07:51.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.361+0000 7f5733dff700 1 -- 172.21.15.116:0/3210208193 wait complete. 2023-05-12T09:07:51.380 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.563+0000 7fb9d05ff700 1 Processor -- start 2023-05-12T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.564+0000 7fb9d05ff700 1 -- start start 2023-05-12T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.565+0000 7fb9d05ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fb9c806aaf0 0x7fb9c8070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.565+0000 7fb9d05ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c8071030 0x7fb9c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.565+0000 7fb9d05ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c80cb280 con 0x7fb9c815a5a0 2023-05-12T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.565+0000 7fb9d05ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c815a970 con 0x7fb9c806aaf0 2023-05-12T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.565+0000 7fb9d05ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8071470 con 0x7fb9c8071030 2023-05-12T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.565+0000 7fb9cdb9a700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fb9c806aaf0 0x7fb9c8070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.565+0000 7fb9ce39b700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7fb9c815a5a0 0x7fb9c806a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:46376/0 (socket says 172.21.15.116:46376) 2023-05-12T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.565+0000 7fb9ce39b700 1 -- 172.21.15.116:0/3905434684 learned_addr learned my addr 172.21.15.116:0/3905434684 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.565+0000 7fb9ceb9c700 1 --2- 172.21.15.116:0/3905434684 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c8071030 0x7fb9c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.566+0000 7fb9cd399700 1 -- 172.21.15.116:0/3905434684 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466516828 0 0) 0x7fb9c4001110 con 0x7fb9c815a5a0 2023-05-12T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.566+0000 7fb9cd399700 1 -- 172.21.15.116:0/3905434684 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b40035b0 con 0x7fb9c815a5a0 2023-05-12T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.566+0000 7fb9ceb9c700 1 -- 172.21.15.116:0/3905434684 >> v2:172.21.15.182:3300/0 conn(0x7fb9c806aaf0 msgr2=0x7fb9c8070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.566+0000 7fb9ceb9c700 1 --2- 172.21.15.116:0/3905434684 >> v2:172.21.15.182:3300/0 conn(0x7fb9c806aaf0 0x7fb9c8070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.566+0000 7fb9ceb9c700 1 -- 172.21.15.116:0/3905434684 >> v1:172.21.15.182:6789/0 conn(0x7fb9c815a5a0 legacy=0x7fb9c806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.566+0000 7fb9ceb9c700 1 -- 172.21.15.116:0/3905434684 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c8071700 con 0x7fb9c8071030 2023-05-12T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.566+0000 7fb9ceb9c700 1 --2- 172.21.15.116:0/3905434684 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c8071030 0x7fb9c806d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009d90 tx=0x7fb9c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=529e07e4bfb9d28a server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.566+0000 7fb9cd399700 1 -- 172.21.15.116:0/3905434684 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000e070 con 0x7fb9c8071030 2023-05-12T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.566+0000 7fb9cd399700 1 -- 172.21.15.116:0/3905434684 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c000bb20 con 0x7fb9c8071030 2023-05-12T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.566+0000 7fb9cd399700 1 -- 172.21.15.116:0/3905434684 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0012430 con 0x7fb9c8071030 2023-05-12T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.567+0000 7fb9d05ff700 1 -- 172.21.15.116:0/3905434684 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c8071030 msgr2=0x7fb9c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.567+0000 7fb9d05ff700 1 --2- 172.21.15.116:0/3905434684 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c8071030 0x7fb9c806d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009d90 tx=0x7fb9c000b330 comp rx=0 tx=0).stop 2023-05-12T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.567+0000 7fb9d05ff700 1 -- 172.21.15.116:0/3905434684 shutdown_connections 2023-05-12T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.567+0000 7fb9d05ff700 1 --2- 172.21.15.116:0/3905434684 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c8071030 0x7fb9c806d1a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.567+0000 7fb9d05ff700 1 --2- 172.21.15.116:0/3905434684 >> v2:172.21.15.182:3300/0 conn(0x7fb9c806aaf0 0x7fb9c8070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.567+0000 7fb9d05ff700 1 -- 172.21.15.116:0/3905434684 >> 172.21.15.116:0/3905434684 conn(0x7fb9c80cf720 msgr2=0x7fb9c80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.567+0000 7fb9d05ff700 1 -- 172.21.15.116:0/3905434684 shutdown_connections 2023-05-12T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.567+0000 7fb9d05ff700 1 -- 172.21.15.116:0/3905434684 wait complete. 2023-05-12T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.569+0000 7fb9d05ff700 1 Processor -- start 2023-05-12T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.569+0000 7fb9d05ff700 1 -- start start 2023-05-12T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9d05ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c806aaf0 0x7fb9c80c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9d05ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9c8071030 0x7fb9c80ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9d05ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c815a5a0 0x7fb9c8150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9d05ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80ce620 con 0x7fb9c815a5a0 2023-05-12T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9d05ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80c7780 con 0x7fb9c8071030 2023-05-12T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9d05ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8150560 con 0x7fb9c806aaf0 2023-05-12T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9ceb9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c815a5a0 0x7fb9c8150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9ceb9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c815a5a0 0x7fb9c8150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57618/0 (socket says 172.21.15.116:57618) 2023-05-12T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9ceb9c700 1 -- 172.21.15.116:0/3062828201 learned_addr learned my addr 172.21.15.116:0/3062828201 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9cdb9a700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9c8071030 0x7fb9c80ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9ce39b700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c806aaf0 0x7fb9c80c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9ceb9c700 1 -- 172.21.15.116:0/3062828201 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c806aaf0 msgr2=0x7fb9c80c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.570+0000 7fb9ceb9c700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c806aaf0 0x7fb9c80c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.571+0000 7fb9ceb9c700 1 -- 172.21.15.116:0/3062828201 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9c8071030 msgr2=0x7fb9c80ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.571+0000 7fb9ceb9c700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9c8071030 0x7fb9c80ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.571+0000 7fb9ceb9c700 1 -- 172.21.15.116:0/3062828201 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0009a70 con 0x7fb9c815a5a0 2023-05-12T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.571+0000 7fb9ceb9c700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c815a5a0 0x7fb9c8150020 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8070600 tx=0x7fb9c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.571+0000 7fb9beffd700 1 -- 172.21.15.116:0/3062828201 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c00129f0 con 0x7fb9c815a5a0 2023-05-12T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.571+0000 7fb9beffd700 1 -- 172.21.15.116:0/3062828201 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c0020070 con 0x7fb9c815a5a0 2023-05-12T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.571+0000 7fb9beffd700 1 -- 172.21.15.116:0/3062828201 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0012db0 con 0x7fb9c815a5a0 2023-05-12T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.571+0000 7fb9d05ff700 1 -- 172.21.15.116:0/3062828201 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c806c6c0 con 0x7fb9c815a5a0 2023-05-12T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.571+0000 7fb9d05ff700 1 -- 172.21.15.116:0/3062828201 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c80719e0 con 0x7fb9c815a5a0 2023-05-12T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.572+0000 7fb9bcff9700 1 -- 172.21.15.116:0/3062828201 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c806c9a0 con 0x7fb9c815a5a0 2023-05-12T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.574+0000 7fb9beffd700 1 -- 172.21.15.116:0/3062828201 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9c0004040 con 0x7fb9c815a5a0 2023-05-12T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.575+0000 7fb9beffd700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb9ac06ace0 0x7fb9ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.575+0000 7fb9beffd700 1 -- 172.21.15.116:0/3062828201 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb9c0022070 con 0x7fb9c815a5a0 2023-05-12T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.575+0000 7fb9ce39b700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb9ac06ace0 0x7fb9ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.576+0000 7fb9ce39b700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb9ac06ace0 0x7fb9ac06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4001270 tx=0x7fb9c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.579+0000 7fb9beffd700 1 -- 172.21.15.116:0/3062828201 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb9c0056220 con 0x7fb9c815a5a0 2023-05-12T09:07:51.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.775+0000 7fb9bcff9700 1 -- 172.21.15.116:0/3062828201 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb9c80c7930 con 0x7fb9c815a5a0 2023-05-12T09:07:51.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.776+0000 7fb9beffd700 1 -- 172.21.15.116:0/3062828201 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb9c002c020 con 0x7fb9c815a5a0 2023-05-12T09:07:51.780 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:07:51.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 -- 172.21.15.116:0/3062828201 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb9ac06ace0 msgr2=0x7fb9ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb9ac06ace0 0x7fb9ac06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4001270 tx=0x7fb9c4009040 comp rx=0 tx=0).stop 2023-05-12T09:07:51.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 -- 172.21.15.116:0/3062828201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c815a5a0 msgr2=0x7fb9c8150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:51.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c815a5a0 0x7fb9c8150020 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8070600 tx=0x7fb9c0004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 -- 172.21.15.116:0/3062828201 shutdown_connections 2023-05-12T09:07:51.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c815a5a0 0x7fb9c8150020 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb9ac06ace0 0x7fb9ac06d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb9c806aaf0 0x7fb9c80c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 --2- 172.21.15.116:0/3062828201 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb9c8071030 0x7fb9c80ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:51.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 -- 172.21.15.116:0/3062828201 >> 172.21.15.116:0/3062828201 conn(0x7fb9c80cf720 msgr2=0x7fb9c806a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:51.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 -- 172.21.15.116:0/3062828201 shutdown_connections 2023-05-12T09:07:51.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.778+0000 7fb9bcff9700 1 -- 172.21.15.116:0/3062828201 wait complete. 2023-05-12T09:07:51.798 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.992+0000 7f4fe4bff700 1 Processor -- start 2023-05-12T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.992+0000 7f4fe4bff700 1 -- start start 2023-05-12T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.994+0000 7f4fe4bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe00b87a0 0x7f4fe00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.994+0000 7f4fe4bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f4fe0160d40 0x7f4fe00d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.994+0000 7f4fe4bff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe00cdc60 con 0x7f4fe01601e0 2023-05-12T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.994+0000 7f4fe4bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe00d02d0 con 0x7f4fe0160d40 2023-05-12T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.994+0000 7f4fe4bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe00d0cb0 con 0x7f4fe00b87a0 2023-05-12T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.994+0000 7f4fded9d700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f4fe0160d40 0x7f4fe00d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.994+0000 7f4fde59c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe00b87a0 0x7f4fe00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.994+0000 7f4fded9d700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f4fe0160d40 0x7f4fe00d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:35644/0 (socket says 172.21.15.116:35644) 2023-05-12T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.994+0000 7f4fded9d700 1 -- 172.21.15.116:0/1051541328 learned_addr learned my addr 172.21.15.116:0/1051541328 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.995+0000 7f4fded9d700 1 -- 172.21.15.116:0/1051541328 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe00b87a0 msgr2=0x7f4fe00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.995+0000 7f4fded9d700 1 --2- 172.21.15.116:0/1051541328 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe00b87a0 0x7f4fe00cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.995+0000 7f4fded9d700 1 -- 172.21.15.116:0/1051541328 >> v1:172.21.15.182:6789/0 conn(0x7f4fe01601e0 legacy=0x7f4fe0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.995+0000 7f4fded9d700 1 -- 172.21.15.116:0/1051541328 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe00cd6a0 con 0x7f4fe0160d40 2023-05-12T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.995+0000 7f4fde59c700 1 --2- 172.21.15.116:0/1051541328 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe00b87a0 0x7f4fe00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.995+0000 7f4fded9d700 1 --2- 172.21.15.116:0/1051541328 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4fe0160d40 0x7f4fe00d1100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009e50 tx=0x7f4fd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afd6f14fd1a072af server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.995+0000 7f4fddd9b700 1 -- 172.21.15.116:0/1051541328 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800e070 con 0x7f4fe0160d40 2023-05-12T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.995+0000 7f4fddd9b700 1 -- 172.21.15.116:0/1051541328 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd800b910 con 0x7f4fe0160d40 2023-05-12T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.995+0000 7f4fddd9b700 1 -- 172.21.15.116:0/1051541328 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800bcc0 con 0x7f4fe0160d40 2023-05-12T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.996+0000 7f4fe4bff700 1 -- 172.21.15.116:0/1051541328 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4fe0160d40 msgr2=0x7f4fe00d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.996+0000 7f4fe4bff700 1 --2- 172.21.15.116:0/1051541328 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4fe0160d40 0x7f4fe00d1100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009e50 tx=0x7f4fd800b330 comp rx=0 tx=0).stop 2023-05-12T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.996+0000 7f4fe4bff700 1 -- 172.21.15.116:0/1051541328 shutdown_connections 2023-05-12T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.996+0000 7f4fe4bff700 1 --2- 172.21.15.116:0/1051541328 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4fe0160d40 0x7f4fe00d1100 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.996+0000 7f4fe4bff700 1 --2- 172.21.15.116:0/1051541328 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe00b87a0 0x7f4fe00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.996+0000 7f4fe4bff700 1 -- 172.21.15.116:0/1051541328 >> 172.21.15.116:0/1051541328 conn(0x7f4fe0071b10 msgr2=0x7f4fe0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.996+0000 7f4fe4bff700 1 -- 172.21.15.116:0/1051541328 shutdown_connections 2023-05-12T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.996+0000 7f4fe4bff700 1 -- 172.21.15.116:0/1051541328 wait complete. 2023-05-12T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.998+0000 7f4fe4bff700 1 Processor -- start 2023-05-12T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.998+0000 7f4fe4bff700 1 -- start start 2023-05-12T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fe4bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fe00b87a0 0x7f4fe015f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fe4bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe01601e0 0x7f4fe015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fe4bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4fe0160d40 0x7f4fe01502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fe4bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe015ed10 con 0x7f4fe00b87a0 2023-05-12T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fe4bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe015eff0 con 0x7f4fe0160d40 2023-05-12T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fe4bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe015f2d0 con 0x7f4fe01601e0 2023-05-12T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fde59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fe00b87a0 0x7f4fe015f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fde59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fe00b87a0 0x7f4fe015f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53680/0 (socket says 172.21.15.116:53680) 2023-05-12T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fde59c700 1 -- 172.21.15.116:0/2934232765 learned_addr learned my addr 172.21.15.116:0/2934232765 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fd7fff700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe01601e0 0x7f4fe015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fded9d700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4fe0160d40 0x7f4fe01502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fde59c700 1 -- 172.21.15.116:0/2934232765 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe01601e0 msgr2=0x7f4fe015a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fde59c700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe01601e0 0x7f4fe015a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fde59c700 1 -- 172.21.15.116:0/2934232765 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4fe0160d40 msgr2=0x7f4fe01502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fde59c700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4fe0160d40 0x7f4fe01502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:51.999+0000 7f4fde59c700 1 -- 172.21.15.116:0/2934232765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd00094a0 con 0x7f4fe00b87a0 2023-05-12T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.000+0000 7f4fde59c700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fe00b87a0 0x7f4fe015f560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000ebe0 tx=0x7f4fd000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.000+0000 7f4fd6ffd700 1 -- 172.21.15.116:0/2934232765 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd000c850 con 0x7f4fe00b87a0 2023-05-12T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.000+0000 7f4fd6ffd700 1 -- 172.21.15.116:0/2934232765 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd000c9b0 con 0x7f4fe00b87a0 2023-05-12T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.000+0000 7f4fe4bff700 1 -- 172.21.15.116:0/2934232765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd8009b30 con 0x7f4fe00b87a0 2023-05-12T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.000+0000 7f4fd6ffd700 1 -- 172.21.15.116:0/2934232765 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd000cd40 con 0x7f4fe00b87a0 2023-05-12T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.000+0000 7f4fe4bff700 1 -- 172.21.15.116:0/2934232765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe00d1640 con 0x7f4fe00b87a0 2023-05-12T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.001+0000 7f4fe4bff700 1 -- 172.21.15.116:0/2934232765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe00cd980 con 0x7f4fe00b87a0 2023-05-12T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.002+0000 7f4fd6ffd700 1 -- 172.21.15.116:0/2934232765 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fd0013470 con 0x7f4fe00b87a0 2023-05-12T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.003+0000 7f4fd6ffd700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fc006ace0 0x7f4fc006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.003+0000 7f4fd6ffd700 1 -- 172.21.15.116:0/2934232765 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4fd0089810 con 0x7f4fe00b87a0 2023-05-12T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.003+0000 7f4fd7fff700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fc006ace0 0x7f4fc006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.004+0000 7f4fd7fff700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fc006ace0 0x7f4fc006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fe01e8f20 tx=0x7f4fc8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.007+0000 7f4fd6ffd700 1 -- 172.21.15.116:0/2934232765 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4fd00545c0 con 0x7f4fe00b87a0 2023-05-12T09:07:52.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.239+0000 7f4fe4bff700 1 -- 172.21.15.116:0/2934232765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fe01e78e0 con 0x7f4fe00b87a0 2023-05-12T09:07:52.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.240+0000 7f4fd6ffd700 1 -- 172.21.15.116:0/2934232765 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f4fd000cea0 con 0x7f4fe00b87a0 2023-05-12T09:07:52.242 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:52.242 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:07:10.529423+0000","modified":"2023-05-12T09:07:38.475430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-12T09:07:52.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 -- 172.21.15.116:0/2934232765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fc006ace0 msgr2=0x7f4fc006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fc006ace0 0x7f4fc006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fe01e8f20 tx=0x7f4fc8009040 comp rx=0 tx=0).stop 2023-05-12T09:07:52.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 -- 172.21.15.116:0/2934232765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fe00b87a0 msgr2=0x7f4fe015f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fe00b87a0 0x7f4fe015f560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000ebe0 tx=0x7f4fd000eef0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 -- 172.21.15.116:0/2934232765 shutdown_connections 2023-05-12T09:07:52.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4fe0160d40 0x7f4fe01502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fe00b87a0 0x7f4fe015f560 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fc006ace0 0x7f4fc006d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 --2- 172.21.15.116:0/2934232765 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4fe01601e0 0x7f4fe015a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 -- 172.21.15.116:0/2934232765 >> 172.21.15.116:0/2934232765 conn(0x7f4fe0071b10 msgr2=0x7f4fe0071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:52.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 -- 172.21.15.116:0/2934232765 shutdown_connections 2023-05-12T09:07:52.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.242+0000 7f4fe4bff700 1 -- 172.21.15.116:0/2934232765 wait complete. 2023-05-12T09:07:52.247 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 9 2023-05-12T09:07:52.261 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:07:52.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.444+0000 7f340fbff700 1 Processor -- start 2023-05-12T09:07:52.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.444+0000 7f340fbff700 1 -- start start 2023-05-12T09:07:52.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.445+0000 7f340fbff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f3408158da0 0x7f340806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.445+0000 7f340fbff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f340806cc00 0x7f340806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.445+0000 7f340fbff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34080ca890 con 0x7f34081589d0 2023-05-12T09:07:52.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.445+0000 7f340fbff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34080cd860 con 0x7f340806cc00 2023-05-12T09:07:52.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340fbff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34080ca5b0 con 0x7f3408158da0 2023-05-12T09:07:52.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340d99b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f34081589d0 0x7f34080cd150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40188/0 (socket says 172.21.15.116:40188) 2023-05-12T09:07:52.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340d99b700 1 -- 172.21.15.116:0/295751536 learned_addr learned my addr 172.21.15.116:0/295751536 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:52.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340e19c700 1 --2- 172.21.15.116:0/295751536 >> v2:172.21.15.116:3300/0 conn(0x7f340806cc00 0x7f340806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340d19a700 1 --2- 172.21.15.116:0/295751536 >> v2:172.21.15.182:3300/0 conn(0x7f3408158da0 0x7f340806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340c999700 1 -- 172.21.15.116:0/295751536 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788652740 0 0) 0x7f34080ca890 con 0x7f34081589d0 2023-05-12T09:07:52.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340c999700 1 -- 172.21.15.116:0/295751536 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33f40035b0 con 0x7f34081589d0 2023-05-12T09:07:52.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340e19c700 1 -- 172.21.15.116:0/295751536 >> v2:172.21.15.182:3300/0 conn(0x7f3408158da0 msgr2=0x7f340806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:52.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340e19c700 1 --2- 172.21.15.116:0/295751536 >> v2:172.21.15.182:3300/0 conn(0x7f3408158da0 0x7f340806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340e19c700 1 -- 172.21.15.116:0/295751536 >> v1:172.21.15.116:6789/0 conn(0x7f34081589d0 legacy=0x7f34080cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340e19c700 1 -- 172.21.15.116:0/295751536 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080cc670 con 0x7f340806cc00 2023-05-12T09:07:52.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.446+0000 7f340d19a700 1 --2- 172.21.15.116:0/295751536 >> v2:172.21.15.182:3300/0 conn(0x7f3408158da0 0x7f340806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:52.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340e19c700 1 --2- 172.21.15.116:0/295751536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f340806cc00 0x7f340806a3e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3408070550 tx=0x7f340000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9418b72374df019 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:52.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340c999700 1 -- 172.21.15.116:0/295751536 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000e070 con 0x7f340806cc00 2023-05-12T09:07:52.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340c999700 1 -- 172.21.15.116:0/295751536 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000bb20 con 0x7f340806cc00 2023-05-12T09:07:52.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340c999700 1 -- 172.21.15.116:0/295751536 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400012430 con 0x7f340806cc00 2023-05-12T09:07:52.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340fbff700 1 -- 172.21.15.116:0/295751536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f340806cc00 msgr2=0x7f340806a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340fbff700 1 --2- 172.21.15.116:0/295751536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f340806cc00 0x7f340806a3e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3408070550 tx=0x7f340000b330 comp rx=0 tx=0).stop 2023-05-12T09:07:52.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340fbff700 1 -- 172.21.15.116:0/295751536 shutdown_connections 2023-05-12T09:07:52.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340fbff700 1 --2- 172.21.15.116:0/295751536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f340806cc00 0x7f340806a3e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340fbff700 1 --2- 172.21.15.116:0/295751536 >> v2:172.21.15.182:3300/0 conn(0x7f3408158da0 0x7f340806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340fbff700 1 -- 172.21.15.116:0/295751536 >> 172.21.15.116:0/295751536 conn(0x7f34080cf720 msgr2=0x7f34080cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:52.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.447+0000 7f340fbff700 1 -- 172.21.15.116:0/295751536 shutdown_connections 2023-05-12T09:07:52.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.448+0000 7f340fbff700 1 -- 172.21.15.116:0/295751536 wait complete. 2023-05-12T09:07:52.456 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.449+0000 7f340fbff700 1 Processor -- start 2023-05-12T09:07:52.456 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.449+0000 7f340fbff700 1 -- start start 2023-05-12T09:07:52.458 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.450+0000 7f340fbff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f340806cc00 0x7f34081ee200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.450+0000 7f340fbff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34081589d0 0x7f340815af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.450+0000 7f340fbff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3408158da0 0x7f340815b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.450+0000 7f340fbff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34080c7010 con 0x7f3408158da0 2023-05-12T09:07:52.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.450+0000 7f340fbff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340815bb30 con 0x7f34081589d0 2023-05-12T09:07:52.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.450+0000 7f340fbff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340815be10 con 0x7f340806cc00 2023-05-12T09:07:52.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.450+0000 7f340e19c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3408158da0 0x7f340815b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.450+0000 7f340e19c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3408158da0 0x7f340815b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53696/0 (socket says 172.21.15.116:53696) 2023-05-12T09:07:52.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.450+0000 7f340e19c700 1 -- 172.21.15.116:0/199507143 learned_addr learned my addr 172.21.15.116:0/199507143 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:52.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f340d19a700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34081589d0 0x7f340815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f340d99b700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f340806cc00 0x7f34081ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f340e19c700 1 -- 172.21.15.116:0/199507143 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f340806cc00 msgr2=0x7f34081ee200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f340e19c700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f340806cc00 0x7f34081ee200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f340e19c700 1 -- 172.21.15.116:0/199507143 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34081589d0 msgr2=0x7f340815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f340e19c700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34081589d0 0x7f340815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f340e19c700 1 -- 172.21.15.116:0/199507143 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8009430 con 0x7f3408158da0 2023-05-12T09:07:52.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f340e19c700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3408158da0 0x7f340815b4b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3400014040 tx=0x7f3400004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:52.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f33fe7fc700 1 -- 172.21.15.116:0/199507143 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34000129f0 con 0x7f3408158da0 2023-05-12T09:07:52.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f33fe7fc700 1 -- 172.21.15.116:0/199507143 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3400020070 con 0x7f3408158da0 2023-05-12T09:07:52.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f340fbff700 1 -- 172.21.15.116:0/199507143 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3400009a70 con 0x7f3408158da0 2023-05-12T09:07:52.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.451+0000 7f33fe7fc700 1 -- 172.21.15.116:0/199507143 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400012d90 con 0x7f3408158da0 2023-05-12T09:07:52.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.452+0000 7f340fbff700 1 -- 172.21.15.116:0/199507143 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34080ccc30 con 0x7f3408158da0 2023-05-12T09:07:52.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.452+0000 7f340fbff700 1 -- 172.21.15.116:0/199507143 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34080cc950 con 0x7f3408158da0 2023-05-12T09:07:52.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.453+0000 7f33fe7fc700 1 -- 172.21.15.116:0/199507143 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3400004040 con 0x7f3408158da0 2023-05-12T09:07:52.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.454+0000 7f33fe7fc700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f33ec06ace0 0x7f33ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.454+0000 7f33fe7fc700 1 -- 172.21.15.116:0/199507143 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3400022070 con 0x7f3408158da0 2023-05-12T09:07:52.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.454+0000 7f340d99b700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f33ec06ace0 0x7f33ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.455+0000 7f340d99b700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f33ec06ace0 0x7f33ec06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3404007fd0 tx=0x7f3404007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:52.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.459+0000 7f33fe7fc700 1 -- 172.21.15.116:0/199507143 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f34000562b0 con 0x7f3408158da0 2023-05-12T09:07:52.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.655+0000 7f340fbff700 1 -- 172.21.15.116:0/199507143 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f340806a920 con 0x7f3408158da0 2023-05-12T09:07:52.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.656+0000 7f33fe7fc700 1 -- 172.21.15.116:0/199507143 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20086 (secure 0 0 0) 0x7f34000598d0 con 0x7f3408158da0 2023-05-12T09:07:52.659 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:52.659 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:15.052142+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:07:52.660 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 -- 172.21.15.116:0/199507143 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f33ec06ace0 msgr2=0x7f33ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f33ec06ace0 0x7f33ec06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3404007fd0 tx=0x7f3404007dc0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 -- 172.21.15.116:0/199507143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3408158da0 msgr2=0x7f340815b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3408158da0 0x7f340815b4b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3400014040 tx=0x7f3400004ad0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 -- 172.21.15.116:0/199507143 shutdown_connections 2023-05-12T09:07:52.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3408158da0 0x7f340815b4b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f33ec06ace0 0x7f33ec06d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f340806cc00 0x7f34081ee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 --2- 172.21.15.116:0/199507143 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34081589d0 0x7f340815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 -- 172.21.15.116:0/199507143 >> 172.21.15.116:0/199507143 conn(0x7f34080cf720 msgr2=0x7f34080af050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:52.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 -- 172.21.15.116:0/199507143 shutdown_connections 2023-05-12T09:07:52.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.659+0000 7f340fbff700 1 -- 172.21.15.116:0/199507143 wait complete. 2023-05-12T09:07:52.679 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:07:52.864 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.861+0000 7fae85dff700 1 Processor -- start 2023-05-12T09:07:52.864 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.861+0000 7fae85dff700 1 -- start start 2023-05-12T09:07:52.868 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.863+0000 7fae85dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800b87a0 0x7fae800cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.863+0000 7fae85dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae800cdc60 con 0x7fae801601e0 2023-05-12T09:07:52.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.863+0000 7fae85dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae800cd6a0 con 0x7fae80160d40 2023-05-12T09:07:52.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.863+0000 7fae85dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae800d02d0 con 0x7fae800b87a0 2023-05-12T09:07:52.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.863+0000 7fae7effd700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fae801601e0 0x7fae80160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40196/0 (socket says 172.21.15.116:40196) 2023-05-12T09:07:52.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.863+0000 7fae7effd700 1 -- 172.21.15.116:0/1167557436 learned_addr learned my addr 172.21.15.116:0/1167557436 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:52.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.863+0000 7fae7f7fe700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800b87a0 0x7fae800cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.863+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983225435 0 0) 0x7fae800cdc60 con 0x7fae801601e0 2023-05-12T09:07:52.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.863+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae680035b0 con 0x7fae801601e0 2023-05-12T09:07:52.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203819472 0 0) 0x7fae800cd6a0 con 0x7fae80160d40 2023-05-12T09:07:52.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae800cdc60 con 0x7fae80160d40 2023-05-12T09:07:52.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 574284997 0 0) 0x7fae680035b0 con 0x7fae801601e0 2023-05-12T09:07:52.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800b87a0 msgr2=0x7fae800cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:52.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800b87a0 0x7fae800cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 >> v1:172.21.15.182:6789/0 conn(0x7fae80160d40 legacy=0x7fae800d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae800cd980 con 0x7fae801601e0 2023-05-12T09:07:52.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7f7fe700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800b87a0 0x7fae800cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:07:52.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7fae74001670 con 0x7fae801601e0 2023-05-12T09:07:52.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 >> v1:172.21.15.116:6789/0 conn(0x7fae801601e0 legacy=0x7fae80160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fae68003bc0 0x7fae68003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800b87a0 0x7fae68004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae68004d90 0x7fae68005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae800d02d0 con 0x7fae68004d90 2023-05-12T09:07:52.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6800bac0 con 0x7fae68003bc0 2023-05-12T09:07:52.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6800bc00 con 0x7fae800b87a0 2023-05-12T09:07:52.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7ffff700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae68004d90 0x7fae68005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7f7fe700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fae68003bc0 0x7fae68003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.864+0000 7fae7effd700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800b87a0 0x7fae68004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae7ffff700 1 -- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800b87a0 msgr2=0x7fae68004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:52.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae7ffff700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800b87a0 0x7fae68004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae7ffff700 1 -- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fae68003bc0 msgr2=0x7fae68003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:52.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae7ffff700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fae68003bc0 0x7fae68003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae7ffff700 1 -- 172.21.15.116:0/1167557436 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700094a0 con 0x7fae68004d90 2023-05-12T09:07:52.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae7ffff700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae68004d90 0x7fae68005200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae7800c2f0 tx=0x7fae68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9431d82258048507 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:52.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78001f30 con 0x7fae68004d90 2023-05-12T09:07:52.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7800ce90 con 0x7fae68004d90 2023-05-12T09:07:52.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae7e7fc700 1 -- 172.21.15.116:0/1167557436 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78003c40 con 0x7fae68004d90 2023-05-12T09:07:52.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae85dff700 1 -- 172.21.15.116:0/1167557436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae68004d90 msgr2=0x7fae68005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae85dff700 1 --2- 172.21.15.116:0/1167557436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae68004d90 0x7fae68005200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae7800c2f0 tx=0x7fae68005880 comp rx=0 tx=0).stop 2023-05-12T09:07:52.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.865+0000 7fae7ffff700 1 -- 172.21.15.116:0/1167557436 reap_dead start 2023-05-12T09:07:52.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.866+0000 7fae85dff700 1 -- 172.21.15.116:0/1167557436 shutdown_connections 2023-05-12T09:07:52.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.866+0000 7fae85dff700 1 -- 172.21.15.116:0/1167557436 >> 172.21.15.116:0/1167557436 conn(0x7fae80071b10 msgr2=0x7fae80071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:52.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.866+0000 7fae85dff700 1 -- 172.21.15.116:0/1167557436 shutdown_connections 2023-05-12T09:07:52.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.866+0000 7fae85dff700 1 -- 172.21.15.116:0/1167557436 wait complete. 2023-05-12T09:07:52.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.867+0000 7fae85dff700 1 Processor -- start 2023-05-12T09:07:52.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.867+0000 7fae85dff700 1 -- start start 2023-05-12T09:07:52.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.868+0000 7fae85dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fae68004d90 0x7fae800c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.868+0000 7fae85dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800cc840 0x7fae8014cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.868+0000 7fae85dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae8014d270 0x7fae8015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.868+0000 7fae85dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae800cba80 con 0x7fae8014d270 2023-05-12T09:07:52.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.868+0000 7fae85dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae800cbd60 con 0x7fae68004d90 2023-05-12T09:07:52.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.868+0000 7fae85dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae800cc040 con 0x7fae800cc840 2023-05-12T09:07:52.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae8014d270 0x7fae8015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae8014d270 0x7fae8015e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53716/0 (socket says 172.21.15.116:53716) 2023-05-12T09:07:52.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7ffff700 1 -- 172.21.15.116:0/513279196 learned_addr learned my addr 172.21.15.116:0/513279196 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:52.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7effd700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800cc840 0x7fae8014cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7f7fe700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fae68004d90 0x7fae800c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7ffff700 1 -- 172.21.15.116:0/513279196 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800cc840 msgr2=0x7fae8014cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7ffff700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800cc840 0x7fae8014cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7ffff700 1 -- 172.21.15.116:0/513279196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fae68004d90 msgr2=0x7fae800c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:52.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7ffff700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fae68004d90 0x7fae800c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:52.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7ffff700 1 -- 172.21.15.116:0/513279196 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae800cfd80 con 0x7fae8014d270 2023-05-12T09:07:52.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae7ffff700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae8014d270 0x7fae8015e5c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae78002230 tx=0x7fae78001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:52.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.869+0000 7fae67fff700 1 -- 172.21.15.116:0/513279196 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7800cc90 con 0x7fae8014d270 2023-05-12T09:07:52.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.870+0000 7fae67fff700 1 -- 172.21.15.116:0/513279196 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae780050d0 con 0x7fae8014d270 2023-05-12T09:07:52.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.870+0000 7fae85dff700 1 -- 172.21.15.116:0/513279196 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae800cfbf0 con 0x7fae8014d270 2023-05-12T09:07:52.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.870+0000 7fae67fff700 1 -- 172.21.15.116:0/513279196 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78005480 con 0x7fae8014d270 2023-05-12T09:07:52.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.870+0000 7fae85dff700 1 -- 172.21.15.116:0/513279196 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae800cff10 con 0x7fae8014d270 2023-05-12T09:07:52.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.871+0000 7fae85dff700 1 -- 172.21.15.116:0/513279196 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae800cc530 con 0x7fae8014d270 2023-05-12T09:07:52.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.872+0000 7fae67fff700 1 -- 172.21.15.116:0/513279196 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae78019070 con 0x7fae8014d270 2023-05-12T09:07:52.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.872+0000 7fae67fff700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae6c06ace0 0x7fae6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:52.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.873+0000 7fae67fff700 1 -- 172.21.15.116:0/513279196 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fae7808a100 con 0x7fae8014d270 2023-05-12T09:07:52.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.873+0000 7fae7f7fe700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae6c06ace0 0x7fae6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:52.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.873+0000 7fae7f7fe700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae6c06ace0 0x7fae6c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fae70009de0 tx=0x7fae70009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:52.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:52.877+0000 7fae67fff700 1 -- 172.21.15.116:0/513279196 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fae78055000 con 0x7fae8014d270 2023-05-12T09:07:53.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.111+0000 7fae85dff700 1 -- 172.21.15.116:0/513279196 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae800b52f0 con 0x7fae8014d270 2023-05-12T09:07:53.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.112+0000 7fae67fff700 1 -- 172.21.15.116:0/513279196 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7fae78002090 con 0x7fae8014d270 2023-05-12T09:07:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:07:53.115 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:07:10.529423+0000","modified":"2023-05-12T09:07:38.475430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-12T09:07:53.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 -- 172.21.15.116:0/513279196 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae6c06ace0 msgr2=0x7fae6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae6c06ace0 0x7fae6c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fae70009de0 tx=0x7fae70009210 comp rx=0 tx=0).stop 2023-05-12T09:07:53.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 -- 172.21.15.116:0/513279196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae8014d270 msgr2=0x7fae8015e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae8014d270 0x7fae8015e5c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae78002230 tx=0x7fae78001650 comp rx=0 tx=0).stop 2023-05-12T09:07:53.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 -- 172.21.15.116:0/513279196 shutdown_connections 2023-05-12T09:07:53.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae8014d270 0x7fae8015e5c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fae68004d90 0x7fae800c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fae6c06ace0 0x7fae6c06d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 --2- 172.21.15.116:0/513279196 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fae800cc840 0x7fae8014cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 -- 172.21.15.116:0/513279196 >> 172.21.15.116:0/513279196 conn(0x7fae80071b10 msgr2=0x7fae800cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:53.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 -- 172.21.15.116:0/513279196 shutdown_connections 2023-05-12T09:07:53.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.114+0000 7fae85dff700 1 -- 172.21.15.116:0/513279196 wait complete. 2023-05-12T09:07:53.119 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 9 2023-05-12T09:07:53.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-12T09:07:10.529423+0000', 'modified': '2023-05-12T09:07:38.475430+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.182:6833/765908362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.182:6832', 'nonce': 765908362}, {'type': 'v1', 'addr': '172.21.15.182:6833', 'nonce': 765908362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-12T09:07:53.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-12T09:07:53.538 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-12T09:07:53.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.723+0000 7f331d1ff700 1 Processor -- start 2023-05-12T09:07:53.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.723+0000 7f331d1ff700 1 -- start start 2023-05-12T09:07:53.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.724+0000 7f331d1ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f33180b87a0 0x7f33180cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.724+0000 7f331d1ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f33181601e0 0x7f3318160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.724+0000 7f331d1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3318160b70 0x7f33180d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.724+0000 7f331d1ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33180d02d0 con 0x7f33180b87a0 2023-05-12T09:07:53.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.724+0000 7f331d1ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33180d0cb0 con 0x7f33181601e0 2023-05-12T09:07:53.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.724+0000 7f331d1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180b2730 con 0x7f3318160b70 2023-05-12T09:07:53.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f3316d9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f33180b87a0 0x7f33180cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f3316d9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f33180b87a0 0x7f33180cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53728/0 (socket says 172.21.15.116:53728) 2023-05-12T09:07:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f3316d9d700 1 -- 172.21.15.116:0/2193892743 learned_addr learned my addr 172.21.15.116:0/2193892743 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f331759e700 1 --2- 172.21.15.116:0/2193892743 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3318160b70 0x7f33180d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f330ffff700 1 --2- 172.21.15.116:0/2193892743 >> v2:172.21.15.182:3300/0 conn(0x7f33181601e0 0x7f3318160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f3316d9d700 1 -- 172.21.15.116:0/2193892743 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3318160b70 msgr2=0x7f33180d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f3316d9d700 1 --2- 172.21.15.116:0/2193892743 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3318160b70 0x7f33180d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f3316d9d700 1 -- 172.21.15.116:0/2193892743 >> v2:172.21.15.182:3300/0 conn(0x7f33181601e0 msgr2=0x7f3318160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:53.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f3316d9d700 1 --2- 172.21.15.116:0/2193892743 >> v2:172.21.15.182:3300/0 conn(0x7f33181601e0 0x7f3318160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f3316d9d700 1 -- 172.21.15.116:0/2193892743 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180cdc60 con 0x7f33180b87a0 2023-05-12T09:07:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.725+0000 7f3316d9d700 1 --2- 172.21.15.116:0/2193892743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 0x7f33180cfbf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33180b8f60 tx=0x7f3308009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511701e636a0985 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331659c700 1 -- 172.21.15.116:0/2193892743 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800b870 con 0x7f33180b87a0 2023-05-12T09:07:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331659c700 1 -- 172.21.15.116:0/2193892743 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330800b9d0 con 0x7f33180b87a0 2023-05-12T09:07:53.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331659c700 1 -- 172.21.15.116:0/2193892743 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800bd60 con 0x7f33180b87a0 2023-05-12T09:07:53.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331d1ff700 1 -- 172.21.15.116:0/2193892743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 msgr2=0x7f33180cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331d1ff700 1 --2- 172.21.15.116:0/2193892743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 0x7f33180cfbf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33180b8f60 tx=0x7f3308009bd0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331d1ff700 1 -- 172.21.15.116:0/2193892743 shutdown_connections 2023-05-12T09:07:53.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331d1ff700 1 --2- 172.21.15.116:0/2193892743 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3318160b70 0x7f33180d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331d1ff700 1 --2- 172.21.15.116:0/2193892743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 0x7f33180cfbf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331d1ff700 1 --2- 172.21.15.116:0/2193892743 >> v2:172.21.15.182:3300/0 conn(0x7f33181601e0 0x7f3318160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331d1ff700 1 -- 172.21.15.116:0/2193892743 >> 172.21.15.116:0/2193892743 conn(0x7f3318071b10 msgr2=0x7f3318071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:53.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331d1ff700 1 -- 172.21.15.116:0/2193892743 shutdown_connections 2023-05-12T09:07:53.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.726+0000 7f331d1ff700 1 -- 172.21.15.116:0/2193892743 wait complete. 2023-05-12T09:07:53.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.728+0000 7f331d1ff700 1 Processor -- start 2023-05-12T09:07:53.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.728+0000 7f331d1ff700 1 -- start start 2023-05-12T09:07:53.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.729+0000 7f331d1ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 0x7f3318155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.729+0000 7f331d1ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f33181601e0 0x7f33180b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.729+0000 7f331d1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3318160b70 0x7f3318150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.729+0000 7f331d1ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318157290 con 0x7f33180b87a0 2023-05-12T09:07:53.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.729+0000 7f331d1ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318156610 con 0x7f33181601e0 2023-05-12T09:07:53.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.729+0000 7f331d1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33181568f0 con 0x7f3318160b70 2023-05-12T09:07:53.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.729+0000 7f3316d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 0x7f3318155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.729+0000 7f3316d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 0x7f3318155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53740/0 (socket says 172.21.15.116:53740) 2023-05-12T09:07:53.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.729+0000 7f3316d9d700 1 -- 172.21.15.116:0/2914963632 learned_addr learned my addr 172.21.15.116:0/2914963632 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:53.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f3316d9d700 1 -- 172.21.15.116:0/2914963632 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3318160b70 msgr2=0x7f3318150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f3316d9d700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3318160b70 0x7f3318150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f3316d9d700 1 -- 172.21.15.116:0/2914963632 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f33181601e0 msgr2=0x7f33180b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f3316d9d700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f33181601e0 0x7f33180b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f3316d9d700 1 -- 172.21.15.116:0/2914963632 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3308009550 con 0x7f33180b87a0 2023-05-12T09:07:53.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f3316d9d700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 0x7f3318155dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3308000c00 tx=0x7f3308004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:53.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f330f7fe700 1 -- 172.21.15.116:0/2914963632 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308004540 con 0x7f33180b87a0 2023-05-12T09:07:53.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f330f7fe700 1 -- 172.21.15.116:0/2914963632 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33080036a0 con 0x7f33180b87a0 2023-05-12T09:07:53.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f330f7fe700 1 -- 172.21.15.116:0/2914963632 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308003a50 con 0x7f33180b87a0 2023-05-12T09:07:53.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f331d1ff700 1 -- 172.21.15.116:0/2914963632 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33180cd6a0 con 0x7f33180b87a0 2023-05-12T09:07:53.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.730+0000 7f331d1ff700 1 -- 172.21.15.116:0/2914963632 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3318160fd0 con 0x7f33180b87a0 2023-05-12T09:07:53.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.732+0000 7f330f7fe700 1 -- 172.21.15.116:0/2914963632 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3308021070 con 0x7f33180b87a0 2023-05-12T09:07:53.739 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.733+0000 7f330f7fe700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32f806ace0 0x7f32f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.739 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.733+0000 7f330f7fe700 1 -- 172.21.15.116:0/2914963632 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f330808ae90 con 0x7f33180b87a0 2023-05-12T09:07:53.739 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.733+0000 7f330ffff700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32f806ace0 0x7f32f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.739 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.734+0000 7f330ffff700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32f806ace0 0x7f32f806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f331815fd70 tx=0x7f3300008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:53.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.735+0000 7f3330bb5b80 1 Processor -- start 2023-05-12T09:07:53.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.736+0000 7f3330bb5b80 1 -- start start 2023-05-12T09:07:53.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548da2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da32d0 0x561548d87180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548d5a740 0x561548d876c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548c46600 con 0x561548da32d0 2023-05-12T09:07:53.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548cb5790 con 0x561548d5a740 2023-05-12T09:07:53.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x561548caea60 con 0x561548da2230 2023-05-12T09:07:53.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f330ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da32d0 0x561548d87180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f3316d9d700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548da2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f330ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da32d0 0x561548d87180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53748/0 (socket says 172.21.15.116:53748) 2023-05-12T09:07:53.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f330ffff700 1 -- 172.21.15.116:0/2147339196 learned_addr learned my addr 172.21.15.116:0/2147339196 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:53.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f331759e700 1 --2- 172.21.15.116:0/2147339196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548d5a740 0x561548d876c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f330ffff700 1 -- 172.21.15.116:0/2147339196 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 msgr2=0x561548da2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:53.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f330ffff700 1 --2- 172.21.15.116:0/2147339196 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548da2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f330ffff700 1 -- 172.21.15.116:0/2147339196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548d5a740 msgr2=0x561548d876c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:53.744 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f330ffff700 1 --2- 172.21.15.116:0/2147339196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548d5a740 0x561548d876c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.744 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.737+0000 7f330ffff700 1 -- 172.21.15.116:0/2147339196 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561548aa2790 con 0x561548da32d0 2023-05-12T09:07:53.744 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.738+0000 7f330ffff700 1 --2- 172.21.15.116:0/2147339196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da32d0 0x561548d87180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3300015860 tx=0x7f3300011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e361fd225edf4d33 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:53.744 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.738+0000 7f330cff9700 1 -- 172.21.15.116:0/2147339196 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300020600 con 0x561548da32d0 2023-05-12T09:07:53.744 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.738+0000 7f330cff9700 1 -- 172.21.15.116:0/2147339196 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3300020760 con 0x561548da32d0 2023-05-12T09:07:53.745 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.738+0000 7f330cff9700 1 -- 172.21.15.116:0/2147339196 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300020ad0 con 0x561548da32d0 2023-05-12T09:07:53.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.738+0000 7f3330bb5b80 1 -- 172.21.15.116:0/2147339196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da32d0 msgr2=0x561548d87180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.739+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/2147339196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da32d0 0x561548d87180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3300015860 tx=0x7f3300011000 comp rx=0 tx=0).stop 2023-05-12T09:07:53.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.739+0000 7f3330bb5b80 1 -- 172.21.15.116:0/2147339196 shutdown_connections 2023-05-12T09:07:53.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.739+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/2147339196 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548d5a740 0x561548d876c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.739+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/2147339196 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548da2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.739+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/2147339196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da32d0 0x561548d87180 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.739+0000 7f3330bb5b80 1 -- 172.21.15.116:0/2147339196 >> 172.21.15.116:0/2147339196 conn(0x561548d51b60 msgr2=0x561548d570c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:53.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.739+0000 7f3330bb5b80 1 -- 172.21.15.116:0/2147339196 shutdown_connections 2023-05-12T09:07:53.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.739+0000 7f3330bb5b80 1 -- 172.21.15.116:0/2147339196 wait complete. 2023-05-12T09:07:53.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.739+0000 7f3330bb5b80 1 -- start start 2023-05-12T09:07:53.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.740+0000 7f3330bb5b80 1 Processor -- start 2023-05-12T09:07:53.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548d5a740 0x561548db2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da2230 0x561548d7f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d79770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548c4aad0 con 0x561548da2230 2023-05-12T09:07:53.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548c4a770 con 0x561548da32d0 2023-05-12T09:07:53.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x561548aa3390 con 0x561548d5a740 2023-05-12T09:07:53.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f3330bb5b80 10 client.0 _ll_register_callbacks cb 0x561548c4c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-12T09:07:53.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f330ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da2230 0x561548d7f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f330ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da2230 0x561548d7f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53760/0 (socket says 172.21.15.116:53760) 2023-05-12T09:07:53.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f330ffff700 1 -- 172.21.15.116:0/3172110583 learned_addr learned my addr 172.21.15.116:0/3172110583 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:53.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f331759e700 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d79770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f3316d9d700 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548d5a740 0x561548db2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f330ffff700 1 -- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548d5a740 msgr2=0x561548db2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:53.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f330ffff700 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548d5a740 0x561548db2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f330ffff700 1 -- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 msgr2=0x561548d79770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:53.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f330ffff700 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d79770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f330ffff700 1 -- 172.21.15.116:0/3172110583 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33000155a0 con 0x561548da2230 2023-05-12T09:07:53.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.741+0000 7f331759e700 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d79770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:07:53.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f330ffff700 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da2230 0x561548d7f6b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3300006b20 tx=0x7f3300006ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac43967861beee5 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:53.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f32f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-05-12T09:07:53.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f32f5ffb700 1 -- 172.21.15.116:0/3172110583 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300020ce0 con 0x561548da2230 2023-05-12T09:07:53.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f32f5ffb700 1 -- 172.21.15.116:0/3172110583 <== mon.0 v2:172.21.15.116:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3300020e40 con 0x561548da2230 2023-05-12T09:07:53.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f3330bb5b80 1 -- 172.21.15.116:0/3172110583 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561548d4f170 con 0x561548da2230 2023-05-12T09:07:53.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f32f5ffb700 1 -- 172.21.15.116:0/3172110583 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3300006040 con 0x561548da2230 2023-05-12T09:07:53.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f3330bb5b80 10 client.4842 fetch_fsmap learned FSMap version 9 2023-05-12T09:07:53.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f3330bb5b80 1 -- 172.21.15.116:0/3172110583 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x561548c752e0 con 0x561548da2230 2023-05-12T09:07:53.754 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f32f5ffb700 1 -- 172.21.15.116:0/3172110583 <== mon.0 v2:172.21.15.116:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561548d4f170 con 0x561548da2230 2023-05-12T09:07:53.754 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f32f5ffb700 1 -- 172.21.15.116:0/3172110583 <== mon.0 v2:172.21.15.116:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3300033060 con 0x561548da2230 2023-05-12T09:07:53.754 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f3330bb5b80 10 client.4842 fetch_fsmap finished waiting for FSMap version 9 2023-05-12T09:07:53.754 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f3330bb5b80 10 client.4842 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-12T09:07:53.754 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f3330bb5b80 20 client.4842 populate_metadata read hostname 'smithi116' 2023-05-12T09:07:53.754 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x561548db5120 0x561548db54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.754 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f3330bb5b80 4 client.4842 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-12T09:07:53.755 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.742+0000 7f3330bb5b80 1 -- 172.21.15.116:0/3172110583 --> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561548d2c2f0 con 0x561548db5120 2023-05-12T09:07:53.755 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.743+0000 7f3316d9d700 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x561548db5120 0x561548db54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.755 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.743+0000 7f3316d9d700 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x561548db5120 0x561548db54f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f68ac9c24960a8c0 server_cookie=ef5dbb1227d6529 in_seq=0 out_seq=0 2023-05-12T09:07:53.755 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.743+0000 7f32f5ffb700 10 client.4842 ms_handle_connect on v2:172.21.15.182:6832/765908362 2023-05-12T09:07:53.755 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.744+0000 7f32f5ffb700 1 -- 172.21.15.116:0/3172110583 <== mds.0 v2:172.21.15.182:6832/765908362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18412 (crc 0 0 0) 0x561548d2c2f0 con 0x561548db5120 2023-05-12T09:07:53.755 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.744+0000 7f32f5ffb700 10 client.4842 handle_command_reply: tid=0 2023-05-12T09:07:53.755 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.744+0000 7f3330bb5b80 1 client.4842 shutdown 2023-05-12T09:07:53.755 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 1 -- 172.21.15.116:0/3172110583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da2230 msgr2=0x561548d7f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.756 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da2230 0x561548d7f6b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3300006b20 tx=0x7f3300006ab0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.756 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 1 -- 172.21.15.116:0/3172110583 shutdown_connections 2023-05-12T09:07:53.756 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x561548db5120 0x561548db54f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.756 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d79770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.756 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548d5a740 0x561548db2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.756 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f32f5ffb700 0 client.4842 ms_handle_reset on v2:172.21.15.182:6832/765908362 2023-05-12T09:07:53.756 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/3172110583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548da2230 0x561548d7f6b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 1 -- 172.21.15.116:0/3172110583 >> 172.21.15.116:0/3172110583 conn(0x561548d51b60 msgr2=0x561548d5c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:53.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 1 -- 172.21.15.116:0/3172110583 shutdown_connections 2023-05-12T09:07:53.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 1 -- 172.21.15.116:0/3172110583 wait complete. 2023-05-12T09:07:53.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.745+0000 7f3330bb5b80 20 client.4842 trim_cache size 0 max 16384 2023-05-12T09:07:53.766 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.763+0000 7f3330bb5b80 1 Processor -- start 2023-05-12T09:07:53.766 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.763+0000 7f3330bb5b80 1 -- start start 2023-05-12T09:07:53.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.764+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548d5c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.764+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548d7bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.764+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d7c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.764+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548dbbc30 con 0x561548d5a740 2023-05-12T09:07:53.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.764+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548da3140 con 0x561548da32d0 2023-05-12T09:07:53.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.764+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x561548da13a0 con 0x561548da2230 2023-05-12T09:07:53.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.764+0000 7f3316d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548d5c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f3316d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548d5c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53762/0 (socket says 172.21.15.116:53762) 2023-05-12T09:07:53.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f3316d9d700 1 -- 172.21.15.116:0/2278796077 learned_addr learned my addr 172.21.15.116:0/2278796077 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:53.772 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f331759e700 1 --2- 172.21.15.116:0/2278796077 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d7c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.773 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f330ffff700 1 --2- 172.21.15.116:0/2278796077 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548d7bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.773 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f3316d9d700 1 -- 172.21.15.116:0/2278796077 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 msgr2=0x561548d7bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:53.773 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f3316d9d700 1 --2- 172.21.15.116:0/2278796077 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548d7bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.773 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f3316d9d700 1 -- 172.21.15.116:0/2278796077 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 msgr2=0x561548d7c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:53.773 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f3316d9d700 1 --2- 172.21.15.116:0/2278796077 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d7c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.774 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f3316d9d700 1 -- 172.21.15.116:0/2278796077 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561548c75030 con 0x561548d5a740 2023-05-12T09:07:53.774 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f3316d9d700 1 --2- 172.21.15.116:0/2278796077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548d5c800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f330800c010 tx=0x7f330805d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dced8444675abc68 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:53.774 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f330d7fa700 1 -- 172.21.15.116:0/2278796077 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308087070 con 0x561548d5a740 2023-05-12T09:07:53.774 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f330d7fa700 1 -- 172.21.15.116:0/2278796077 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3308085070 con 0x561548d5a740 2023-05-12T09:07:53.774 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.765+0000 7f330d7fa700 1 -- 172.21.15.116:0/2278796077 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308057ca0 con 0x561548d5a740 2023-05-12T09:07:53.774 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.766+0000 7f3330bb5b80 1 -- 172.21.15.116:0/2278796077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 msgr2=0x561548d5c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.775 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.766+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/2278796077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548d5c800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f330800c010 tx=0x7f330805d040 comp rx=0 tx=0).stop 2023-05-12T09:07:53.775 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.766+0000 7f3330bb5b80 1 -- 172.21.15.116:0/2278796077 shutdown_connections 2023-05-12T09:07:53.775 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.766+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/2278796077 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d7c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.775 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.766+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/2278796077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548d5c800 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.775 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.766+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/2278796077 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548d7bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.766+0000 7f3330bb5b80 1 -- 172.21.15.116:0/2278796077 >> 172.21.15.116:0/2278796077 conn(0x561548d51b60 msgr2=0x561548da36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:53.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.766+0000 7f3330bb5b80 1 -- 172.21.15.116:0/2278796077 shutdown_connections 2023-05-12T09:07:53.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.766+0000 7f3330bb5b80 1 -- 172.21.15.116:0/2278796077 wait complete. 2023-05-12T09:07:53.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.767+0000 7f3330bb5b80 1 -- start start 2023-05-12T09:07:53.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.767+0000 7f3330bb5b80 1 Processor -- start 2023-05-12T09:07:53.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548dec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548d56840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3330bb5b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d58fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548d56420 con 0x561548d5a740 2023-05-12T09:07:53.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548def8e0 con 0x561548da32d0 2023-05-12T09:07:53.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3330bb5b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x561548d597a0 con 0x561548da2230 2023-05-12T09:07:53.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3330bb5b80 10 client.0 _ll_register_callbacks cb 0x561548c4c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-12T09:07:53.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3316d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548dec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3316d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548dec4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53764/0 (socket says 172.21.15.116:53764) 2023-05-12T09:07:53.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3316d9d700 1 -- 172.21.15.116:0/955052163 learned_addr learned my addr 172.21.15.116:0/955052163 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:53.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f330ffff700 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548d56840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f331759e700 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d58fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3316d9d700 1 -- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 msgr2=0x561548d56840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:53.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3316d9d700 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548d56840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3316d9d700 1 -- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 msgr2=0x561548d58fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:53.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3316d9d700 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d58fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.768+0000 7f3316d9d700 1 -- 172.21.15.116:0/955052163 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3318160fd0 con 0x561548d5a740 2023-05-12T09:07:53.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f3316d9d700 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548dec4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3308061e10 tx=0x7f3308088e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304eba1abffe51a8 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:53.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f32f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-05-12T09:07:53.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f32f5ffb700 1 -- 172.21.15.116:0/955052163 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308087070 con 0x561548d5a740 2023-05-12T09:07:53.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f32f5ffb700 1 -- 172.21.15.116:0/955052163 <== mon.0 v2:172.21.15.116:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f33080781c0 con 0x561548d5a740 2023-05-12T09:07:53.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f3330bb5b80 1 -- 172.21.15.116:0/955052163 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3300020760 con 0x561548d5a740 2023-05-12T09:07:53.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f32f5ffb700 1 -- 172.21.15.116:0/955052163 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3308061ea0 con 0x561548d5a740 2023-05-12T09:07:53.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f3330bb5b80 10 client.4848 fetch_fsmap learned FSMap version 9 2023-05-12T09:07:53.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f3330bb5b80 1 -- 172.21.15.116:0/955052163 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x561548c5bb10 con 0x561548d5a740 2023-05-12T09:07:53.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f32f5ffb700 1 -- 172.21.15.116:0/955052163 <== mon.0 v2:172.21.15.116:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3300020760 con 0x561548d5a740 2023-05-12T09:07:53.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f32f5ffb700 1 -- 172.21.15.116:0/955052163 <== mon.0 v2:172.21.15.116:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f33080617c0 con 0x561548d5a740 2023-05-12T09:07:53.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f3330bb5b80 10 client.4848 fetch_fsmap finished waiting for FSMap version 9 2023-05-12T09:07:53.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f3330bb5b80 10 client.4848 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-12T09:07:53.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f3330bb5b80 20 client.4848 populate_metadata read hostname 'smithi116' 2023-05-12T09:07:53.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x561548def110 0x561548d5b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:53.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f3330bb5b80 4 client.4848 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-05-12T09:07:53.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.769+0000 7f3330bb5b80 1 -- 172.21.15.116:0/955052163 --> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561548ca7ba0 con 0x561548def110 2023-05-12T09:07:53.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f330ffff700 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x561548def110 0x561548d5b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:53.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f32f5ffb700 10 client.4848 ms_handle_connect on v2:172.21.15.182:6832/765908362 2023-05-12T09:07:53.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f330ffff700 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x561548def110 0x561548d5b860 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6af39a6f953b49 server_cookie=532d7ee05317bc8 in_seq=0 out_seq=0 2023-05-12T09:07:53.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f32f5ffb700 1 -- 172.21.15.116:0/955052163 <== mds.0 v2:172.21.15.182:6832/765908362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x561548ca7ba0 con 0x561548def110 2023-05-12T09:07:53.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f32f5ffb700 10 client.4848 handle_command_reply: tid=0 2023-05-12T09:07:53.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f3330bb5b80 1 client.4848 shutdown 2023-05-12T09:07:53.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f3330bb5b80 1 -- 172.21.15.116:0/955052163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 msgr2=0x561548dec4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548dec4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3308061e10 tx=0x7f3308088e30 comp rx=0 tx=0).stop 2023-05-12T09:07:53.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f3330bb5b80 1 -- 172.21.15.116:0/955052163 shutdown_connections 2023-05-12T09:07:53.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:6832/765908362,v1:172.21.15.182:6833/765908362] conn(0x561548def110 0x561548d5b860 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x561548da32d0 0x561548d58fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561548d5a740 0x561548dec4c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f32f5ffb700 0 client.4848 ms_handle_reset on v2:172.21.15.182:6832/765908362 2023-05-12T09:07:53.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f3330bb5b80 1 --2- 172.21.15.116:0/955052163 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x561548da2230 0x561548d56840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.770+0000 7f3330bb5b80 1 -- 172.21.15.116:0/955052163 >> 172.21.15.116:0/955052163 conn(0x561548d51b60 msgr2=0x561548d79520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:53.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.771+0000 7f3330bb5b80 1 -- 172.21.15.116:0/955052163 shutdown_connections 2023-05-12T09:07:53.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.771+0000 7f3330bb5b80 1 -- 172.21.15.116:0/955052163 wait complete. 2023-05-12T09:07:53.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.771+0000 7f3330bb5b80 20 client.4848 trim_cache size 0 max 16384 2023-05-12T09:07:53.785 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-05-12T09:07:53.785 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_fsid": "09fd430d-d641-4faf-8b07-e4040d2273e8", 2023-05-12T09:07:53.785 INFO:teuthology.orchestra.run.smithi116.stdout: "whoami": 0, 2023-05-12T09:07:53.785 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 4290, 2023-05-12T09:07:53.786 INFO:teuthology.orchestra.run.smithi116.stdout: "want_state": "up:active", 2023-05-12T09:07:53.786 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "up:active", 2023-05-12T09:07:53.786 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs", 2023-05-12T09:07:53.786 INFO:teuthology.orchestra.run.smithi116.stdout: "rank_uptime": 43.238880923000004, 2023-05-12T09:07:53.786 INFO:teuthology.orchestra.run.smithi116.stdout: "mdsmap_epoch": 9, 2023-05-12T09:07:53.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_epoch": 24, 2023-05-12T09:07:53.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_epoch_barrier": 24, 2023-05-12T09:07:53.787 INFO:teuthology.orchestra.run.smithi116.stdout: "uptime": 48.753457943000001 2023-05-12T09:07:53.787 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-05-12T09:07:53.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.771+0000 7f331d1ff700 1 -- 172.21.15.116:0/2914963632 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32f806ace0 msgr2=0x7f32f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.771+0000 7f331d1ff700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32f806ace0 0x7f32f806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f331815fd70 tx=0x7f3300008040 comp rx=0 tx=0).stop 2023-05-12T09:07:53.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.771+0000 7f331d1ff700 1 -- 172.21.15.116:0/2914963632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 msgr2=0x7f3318155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:53.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.771+0000 7f331d1ff700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 0x7f3318155dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3308000c00 tx=0x7f3308004750 comp rx=0 tx=0).stop 2023-05-12T09:07:53.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.771+0000 7f331d1ff700 1 -- 172.21.15.116:0/2914963632 shutdown_connections 2023-05-12T09:07:53.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.771+0000 7f331d1ff700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f32f806ace0 0x7f32f806d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.771+0000 7f331d1ff700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3318160b70 0x7f3318150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.788 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.772+0000 7f331d1ff700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33180b87a0 0x7f3318155dc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.789 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.772+0000 7f331d1ff700 1 --2- 172.21.15.116:0/2914963632 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f33181601e0 0x7f33180b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:53.789 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.772+0000 7f331d1ff700 1 -- 172.21.15.116:0/2914963632 >> 172.21.15.116:0/2914963632 conn(0x7f3318071b10 msgr2=0x7f331815a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:53.789 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.772+0000 7f331d1ff700 1 -- 172.21.15.116:0/2914963632 shutdown_connections 2023-05-12T09:07:53.789 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:53.772+0000 7f331d1ff700 1 -- 172.21.15.116:0/2914963632 wait complete. 2023-05-12T09:07:53.791 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-05-12T09:07:53.803 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-05-12T09:07:53.803 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-12T09:07:53.804 INFO:tasks.ceph_fuse:client.0 config is {} 2023-05-12T09:07:53.804 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-12T09:07:53.804 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-12T09:07:53.804 INFO:tasks.ceph_fuse:client.2 config is {} 2023-05-12T09:07:53.805 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-12T09:07:53.805 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-12T09:07:53.805 INFO:tasks.ceph_fuse:client.1 config is {} 2023-05-12T09:07:53.805 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-12T09:07:53.806 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-12T09:07:53.806 INFO:tasks.ceph_fuse:client.3 config is {} 2023-05-12T09:07:53.806 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-12T09:07:53.806 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-12T09:07:53.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:53.807 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2023-05-12T09:07:53.848 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-05-12T09:07:53.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:53.850 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-12T09:07:53.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:53.955 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2023-05-12T09:07:54.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:54.063 DEBUG:teuthology.orchestra.run.smithi182:> ip netns list 2023-05-12T09:07:54.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:54.111 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link delete ceph-brx 2023-05-12T09:07:54.180 INFO:teuthology.orchestra.run.smithi182.stderr:Cannot find device "ceph-brx" 2023-05-12T09:07:54.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T09:07:54.183 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-05-12T09:07:54.183 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-12T09:07:54.368 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.365+0000 7f0d309ff700 1 Processor -- start 2023-05-12T09:07:54.368 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.365+0000 7f0d309ff700 1 -- start start 2023-05-12T09:07:54.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.366+0000 7f0d309ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d2c0adf70 0x7f0d2c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:54.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.366+0000 7f0d309ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0d2c15cf10 0x7f0d2c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:54.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.366+0000 7f0d309ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2c0cc9e0 con 0x7f0d2c0cd760 2023-05-12T09:07:54.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.366+0000 7f0d309ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c15de20 con 0x7f0d2c15cf10 2023-05-12T09:07:54.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.366+0000 7f0d309ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c15d860 con 0x7f0d2c0adf70 2023-05-12T09:07:54.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.366+0000 7f0d2a59c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f0d2c0cd760 0x7f0d2c0cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40212/0 (socket says 172.21.15.116:40212) 2023-05-12T09:07:54.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.366+0000 7f0d2a59c700 1 -- 172.21.15.116:0/104507665 learned_addr learned my addr 172.21.15.116:0/104507665 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:07:54.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.366+0000 7f0d2ad9d700 1 --2- 172.21.15.116:0/104507665 >> v2:172.21.15.116:3300/0 conn(0x7f0d2c15cf10 0x7f0d2c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:54.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.366+0000 7f0d23fff700 1 --2- 172.21.15.116:0/104507665 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d2c0adf70 0x7f0d2c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:54.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.367+0000 7f0d29d9b700 1 -- 172.21.15.116:0/104507665 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462967426 0 0) 0x7f0d2c0cc9e0 con 0x7f0d2c0cd760 2023-05-12T09:07:54.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.367+0000 7f0d29d9b700 1 -- 172.21.15.116:0/104507665 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d180035b0 con 0x7f0d2c0cd760 2023-05-12T09:07:54.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.367+0000 7f0d2ad9d700 1 -- 172.21.15.116:0/104507665 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d2c0adf70 msgr2=0x7f0d2c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:54.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.367+0000 7f0d2ad9d700 1 --2- 172.21.15.116:0/104507665 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d2c0adf70 0x7f0d2c0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:54.372 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.367+0000 7f0d2ad9d700 1 -- 172.21.15.116:0/104507665 >> v1:172.21.15.116:6789/0 conn(0x7f0d2c0cd760 legacy=0x7f0d2c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:54.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.367+0000 7f0d2ad9d700 1 -- 172.21.15.116:0/104507665 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c15db40 con 0x7f0d2c15cf10 2023-05-12T09:07:54.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.367+0000 7f0d2ad9d700 1 --2- 172.21.15.116:0/104507665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c15cf10 0x7f0d2c06c6c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009d90 tx=0x7f0d2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929e20c34c7be4f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:54.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.367+0000 7f0d29d9b700 1 -- 172.21.15.116:0/104507665 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400e070 con 0x7f0d2c15cf10 2023-05-12T09:07:54.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.367+0000 7f0d29d9b700 1 -- 172.21.15.116:0/104507665 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400bb20 con 0x7f0d2c15cf10 2023-05-12T09:07:54.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.367+0000 7f0d29d9b700 1 -- 172.21.15.116:0/104507665 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24012430 con 0x7f0d2c15cf10 2023-05-12T09:07:54.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.368+0000 7f0d309ff700 1 -- 172.21.15.116:0/104507665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c15cf10 msgr2=0x7f0d2c06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:54.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.368+0000 7f0d309ff700 1 --2- 172.21.15.116:0/104507665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c15cf10 0x7f0d2c06c6c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009d90 tx=0x7f0d2400b330 comp rx=0 tx=0).stop 2023-05-12T09:07:54.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.368+0000 7f0d309ff700 1 -- 172.21.15.116:0/104507665 shutdown_connections 2023-05-12T09:07:54.374 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.368+0000 7f0d309ff700 1 --2- 172.21.15.116:0/104507665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c15cf10 0x7f0d2c06c6c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:54.374 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.368+0000 7f0d309ff700 1 --2- 172.21.15.116:0/104507665 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d2c0adf70 0x7f0d2c0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:54.374 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.368+0000 7f0d309ff700 1 -- 172.21.15.116:0/104507665 >> 172.21.15.116:0/104507665 conn(0x7f0d2c0cf720 msgr2=0x7f0d2c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:54.374 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.368+0000 7f0d309ff700 1 -- 172.21.15.116:0/104507665 shutdown_connections 2023-05-12T09:07:54.374 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.368+0000 7f0d309ff700 1 -- 172.21.15.116:0/104507665 wait complete. 2023-05-12T09:07:54.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.370+0000 7f0d309ff700 1 Processor -- start 2023-05-12T09:07:54.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.370+0000 7f0d309ff700 1 -- start start 2023-05-12T09:07:54.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d309ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d2c0adf70 0x7f0d2c0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:54.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d309ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c0cd760 0x7f0d2c0c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:54.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d309ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d2c15cf10 0x7f0d2c15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:54.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d309ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0c8860 con 0x7f0d2c0cd760 2023-05-12T09:07:54.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d309ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b4860 con 0x7f0d2c15cf10 2023-05-12T09:07:54.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d309ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0c72c0 con 0x7f0d2c0adf70 2023-05-12T09:07:54.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d23fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c0cd760 0x7f0d2c0c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:54.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d2a59c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d2c0adf70 0x7f0d2c0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:54.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d23fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c0cd760 0x7f0d2c0c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53778/0 (socket says 172.21.15.116:53778) 2023-05-12T09:07:54.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d23fff700 1 -- 172.21.15.116:0/799174748 learned_addr learned my addr 172.21.15.116:0/799174748 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:54.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d2ad9d700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d2c15cf10 0x7f0d2c15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:54.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d23fff700 1 -- 172.21.15.116:0/799174748 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d2c0adf70 msgr2=0x7f0d2c0b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:54.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d23fff700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d2c0adf70 0x7f0d2c0b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:54.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d23fff700 1 -- 172.21.15.116:0/799174748 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d2c15cf10 msgr2=0x7f0d2c15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:54.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d23fff700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d2c15cf10 0x7f0d2c15b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:54.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.372+0000 7f0d23fff700 1 -- 172.21.15.116:0/799174748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24009a70 con 0x7f0d2c0cd760 2023-05-12T09:07:54.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.373+0000 7f0d23fff700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c0cd760 0x7f0d2c0c6d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400e900 tx=0x7f0d1400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:54.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.373+0000 7f0d22ffd700 1 -- 172.21.15.116:0/799174748 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14013680 con 0x7f0d2c0cd760 2023-05-12T09:07:54.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.373+0000 7f0d22ffd700 1 -- 172.21.15.116:0/799174748 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d140137e0 con 0x7f0d2c0cd760 2023-05-12T09:07:54.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.373+0000 7f0d22ffd700 1 -- 172.21.15.116:0/799174748 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14013b50 con 0x7f0d2c0cd760 2023-05-12T09:07:54.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.373+0000 7f0d309ff700 1 -- 172.21.15.116:0/799174748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c071600 con 0x7f0d2c0cd760 2023-05-12T09:07:54.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.373+0000 7f0d309ff700 1 -- 172.21.15.116:0/799174748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c0cc670 con 0x7f0d2c0cd760 2023-05-12T09:07:54.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.374+0000 7f0d309ff700 1 -- 172.21.15.116:0/799174748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c0cd3b0 con 0x7f0d2c0cd760 2023-05-12T09:07:54.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.375+0000 7f0d22ffd700 1 -- 172.21.15.116:0/799174748 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d14013cb0 con 0x7f0d2c0cd760 2023-05-12T09:07:54.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.376+0000 7f0d22ffd700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d0c06ace0 0x7f0d0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:54.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.376+0000 7f0d22ffd700 1 -- 172.21.15.116:0/799174748 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0d14089a50 con 0x7f0d2c0cd760 2023-05-12T09:07:54.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.376+0000 7f0d2a59c700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d0c06ace0 0x7f0d0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:54.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.377+0000 7f0d2a59c700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d0c06ace0 0x7f0d0c06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c007fd0 tx=0x7f0d1c007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:54.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.380+0000 7f0d22ffd700 1 -- 172.21.15.116:0/799174748 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0d14054810 con 0x7f0d2c0cd760 2023-05-12T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.625+0000 7f0d309ff700 1 -- 172.21.15.116:0/799174748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d2c0b22d0 con 0x7f0d2c0cd760 2023-05-12T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.625+0000 7f0d22ffd700 1 -- 172.21.15.116:0/799174748 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0d14021070 con 0x7f0d2c0cd760 2023-05-12T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-12T09:07:54.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 -- 172.21.15.116:0/799174748 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d0c06ace0 msgr2=0x7f0d0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:54.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d0c06ace0 0x7f0d0c06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c007fd0 tx=0x7f0d1c007dc0 comp rx=0 tx=0).stop 2023-05-12T09:07:54.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 -- 172.21.15.116:0/799174748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c0cd760 msgr2=0x7f0d2c0c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c0cd760 0x7f0d2c0c6d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400e900 tx=0x7f0d1400ec10 comp rx=0 tx=0).stop 2023-05-12T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 -- 172.21.15.116:0/799174748 shutdown_connections 2023-05-12T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d2c15cf10 0x7f0d2c15b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d0c06ace0 0x7f0d0c06d190 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c007fd0 tx=0x7f0d1c007dc0 comp rx=0 tx=0).stop 2023-05-12T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d2c0adf70 0x7f0d2c0b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 --2- 172.21.15.116:0/799174748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d2c0cd760 0x7f0d2c0c6d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 -- 172.21.15.116:0/799174748 >> 172.21.15.116:0/799174748 conn(0x7f0d2c0cf720 msgr2=0x7f0d2c0c4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 -- 172.21.15.116:0/799174748 shutdown_connections 2023-05-12T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:54.628+0000 7f0d309ff700 1 -- 172.21.15.116:0/799174748 wait complete. 2023-05-12T09:07:54.648 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-12T09:07:54.649 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-12T09:07:54.649 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2023-05-12T09:07:54.649 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-12T09:07:54.649 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-12T09:07:54.649 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-12T09:07:54.650 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-12T09:07:54.650 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-12T09:07:54.650 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-12T09:07:54.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:54.651 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2023-05-12T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-12T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-12T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2023-05-12T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2023-05-12T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2023-05-12T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2023-05-12T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-12T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-12T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42055sec preferred_lft 42055sec 2023-05-12T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2023-05-12T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:54.695 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-12T09:07:54.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:54.696 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:54.696 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:54.697 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add name ceph-brx type bridge 2023-05-12T09:07:54.697 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr flush dev ceph-brx 2023-05-12T09:07:54.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set ceph-brx up 2023-05-12T09:07:54.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-12T09:07:54.698 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:54.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:54.910 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-12T09:07:54.972 INFO:teuthology.orchestra.run.smithi116.stdout:1 2023-05-12T09:07:54.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:54.974 DEBUG:teuthology.orchestra.run.smithi116:> route 2023-05-12T09:07:55.019 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2023-05-12T09:07:55.019 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-12T09:07:55.020 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-12T09:07:55.020 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-12T09:07:55.020 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-12T09:07:55.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:55.021 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:55.022 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:55.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-12T09:07:55.023 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-12T09:07:55.023 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-12T09:07:55.024 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:55.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:55.210 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2023-05-12T09:07:55.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:55.253 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2023-05-12T09:07:55.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:55.335 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:55.335 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:55.335 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-12T09:07:55.336 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-12T09:07:55.336 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:55.501 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-12T09:07:55.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:55.502 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:55.503 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:55.503 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-12T09:07:55.503 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-12T09:07:55.503 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-12T09:07:55.504 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-12T09:07:55.504 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-12T09:07:55.504 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:55.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:55.727 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:55.728 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:55.728 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2023-05-12T09:07:55.728 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.0 master ceph-brx 2023-05-12T09:07:55.729 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:55.894 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-12T09:07:55.895 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:07:55.895 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-12T09:07:55.937 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-12T09:07:55.938 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:07:55.938 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-12T09:07:56.018 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-05-12T09:07:56.122 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:07:56.123 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:07:56.184 INFO:teuthology.orchestra.run.smithi116.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:07:56.186 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:07:56.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:56.187 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-05-12T09:07:56.227 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-12T09:07:56.228 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-12T09:07:56.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-05-12T09:07:56.336 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:07:56.337 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:07:56.399 INFO:teuthology.orchestra.run.smithi116.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:07:56.401 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:07:56.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:56.402 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-05-12T09:07:56.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:2023-05-12T09:07:56.425+0000 7f628e50a5c0 -1 init, newargv = 0x555ff0b27610 newargc=15 2023-05-12T09:07:56.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:ceph-fuse[116635]: starting ceph client 2023-05-12T09:07:56.437 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:ceph-fuse[116635]: starting fuse 2023-05-12T09:07:56.446 INFO:teuthology.orchestra.run.smithi116.stdout:42 2023-05-12T09:07:56.446 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-12T09:07:56.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-12T09:07:56.447 DEBUG:teuthology.orchestra.run.smithi116:> import glob 2023-05-12T09:07:56.447 DEBUG:teuthology.orchestra.run.smithi116:> import re 2023-05-12T09:07:56.447 DEBUG:teuthology.orchestra.run.smithi116:> import os 2023-05-12T09:07:56.448 DEBUG:teuthology.orchestra.run.smithi116:> import subprocess 2023-05-12T09:07:56.448 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:56.448 DEBUG:teuthology.orchestra.run.smithi116:> def _find_admin_socket(client_name): 2023-05-12T09:07:56.448 DEBUG:teuthology.orchestra.run.smithi116:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-12T09:07:56.449 DEBUG:teuthology.orchestra.run.smithi116:> files = glob.glob(asok_path) 2023-05-12T09:07:56.449 DEBUG:teuthology.orchestra.run.smithi116:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-12T09:07:56.449 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:56.449 DEBUG:teuthology.orchestra.run.smithi116:> # Given a non-glob path, it better be there 2023-05-12T09:07:56.450 DEBUG:teuthology.orchestra.run.smithi116:> if "*" not in asok_path: 2023-05-12T09:07:56.450 DEBUG:teuthology.orchestra.run.smithi116:> assert(len(files) == 1) 2023-05-12T09:07:56.450 DEBUG:teuthology.orchestra.run.smithi116:> return files[0] 2023-05-12T09:07:56.450 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:56.450 DEBUG:teuthology.orchestra.run.smithi116:> for f in files: 2023-05-12T09:07:56.451 DEBUG:teuthology.orchestra.run.smithi116:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-12T09:07:56.451 DEBUG:teuthology.orchestra.run.smithi116:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-12T09:07:56.451 DEBUG:teuthology.orchestra.run.smithi116:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-12T09:07:56.451 DEBUG:teuthology.orchestra.run.smithi116:> contents = proc_f.read() 2023-05-12T09:07:56.452 DEBUG:teuthology.orchestra.run.smithi116:> if mountpoint in contents: 2023-05-12T09:07:56.452 DEBUG:teuthology.orchestra.run.smithi116:> return f 2023-05-12T09:07:56.452 DEBUG:teuthology.orchestra.run.smithi116:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-12T09:07:56.452 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:56.453 DEBUG:teuthology.orchestra.run.smithi116:> print(_find_admin_socket("client.0")) 2023-05-12T09:07:56.453 DEBUG:teuthology.orchestra.run.smithi116:> ' 2023-05-12T09:07:56.622 INFO:teuthology.orchestra.run.smithi116.stdout:/var/run/ceph/ceph-client.0.116635.asok 2023-05-12T09:07:56.799 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.116635.asok 2023-05-12T09:07:56.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:56.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.116635.asok status 2023-05-12T09:07:57.014 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-05-12T09:07:57.014 INFO:teuthology.orchestra.run.smithi116.stdout: "metadata": { 2023-05-12T09:07:57.015 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_sha1": "5a6b166b7c43e2b5890833e75dd257ab21264ded", 2023-05-12T09:07:57.015 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev)", 2023-05-12T09:07:57.015 INFO:teuthology.orchestra.run.smithi116.stdout: "entity_id": "0", 2023-05-12T09:07:57.015 INFO:teuthology.orchestra.run.smithi116.stdout: "hostname": "smithi116", 2023-05-12T09:07:57.016 INFO:teuthology.orchestra.run.smithi116.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-12T09:07:57.016 INFO:teuthology.orchestra.run.smithi116.stdout: "pid": "116635", 2023-05-12T09:07:57.016 INFO:teuthology.orchestra.run.smithi116.stdout: "root": "/" 2023-05-12T09:07:57.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:57.016 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_count": 0, 2023-05-12T09:07:57.016 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_pinned_count": 0, 2023-05-12T09:07:57.017 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 4866, 2023-05-12T09:07:57.017 INFO:teuthology.orchestra.run.smithi116.stdout: "inst": { 2023-05-12T09:07:57.017 INFO:teuthology.orchestra.run.smithi116.stdout: "name": { 2023-05-12T09:07:57.017 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "client", 2023-05-12T09:07:57.017 INFO:teuthology.orchestra.run.smithi116.stdout: "num": 4866 2023-05-12T09:07:57.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:57.017 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-05-12T09:07:57.018 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-05-12T09:07:57.018 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "192.168.0.1:0", 2023-05-12T09:07:57.018 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 653242174 2023-05-12T09:07:57.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:07:57.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:57.018 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-05-12T09:07:57.019 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-05-12T09:07:57.019 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "192.168.0.1:0", 2023-05-12T09:07:57.019 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 653242174 2023-05-12T09:07:57.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:57.019 INFO:teuthology.orchestra.run.smithi116.stdout: "inst_str": "client.4866 192.168.0.1:0/653242174", 2023-05-12T09:07:57.019 INFO:teuthology.orchestra.run.smithi116.stdout: "addr_str": "192.168.0.1:0/653242174", 2023-05-12T09:07:57.020 INFO:teuthology.orchestra.run.smithi116.stdout: "inode_count": 1, 2023-05-12T09:07:57.020 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_epoch": 9, 2023-05-12T09:07:57.020 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch": 24, 2023-05-12T09:07:57.020 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch_barrier": 0, 2023-05-12T09:07:57.020 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklisted": false, 2023-05-12T09:07:57.020 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs" 2023-05-12T09:07:57.020 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-05-12T09:07:57.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-12T09:07:57.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.209+0000 7fc34afff700 1 Processor -- start 2023-05-12T09:07:57.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.209+0000 7fc34afff700 1 -- start start 2023-05-12T09:07:57.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.210+0000 7fc34afff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3440cd760 0x7fc3440cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:57.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.210+0000 7fc34afff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc3440adf70 0x7fc3440cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:57.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.210+0000 7fc34afff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc34415cf10 0x7fc34406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:57.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.210+0000 7fc34afff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3440cc9e0 con 0x7fc34415cf10 2023-05-12T09:07:57.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.210+0000 7fc34afff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34415de20 con 0x7fc3440adf70 2023-05-12T09:07:57.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.210+0000 7fc34afff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440ce070 con 0x7fc3440cd760 2023-05-12T09:07:57.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.210+0000 7fc34959c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc34415cf10 0x7fc34406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:57.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc34959c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc34415cf10 0x7fc34406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53780/0 (socket says 172.21.15.116:53780) 2023-05-12T09:07:57.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc34959c700 1 -- 172.21.15.116:0/3211484034 learned_addr learned my addr 172.21.15.116:0/3211484034 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:57.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc348d9b700 1 --2- 172.21.15.116:0/3211484034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3440cd760 0x7fc3440cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:57.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc343fff700 1 --2- 172.21.15.116:0/3211484034 >> v2:172.21.15.182:3300/0 conn(0x7fc3440adf70 0x7fc3440cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:57.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc34959c700 1 -- 172.21.15.116:0/3211484034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3440cd760 msgr2=0x7fc3440cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:57.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc34959c700 1 --2- 172.21.15.116:0/3211484034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3440cd760 0x7fc3440cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc34959c700 1 -- 172.21.15.116:0/3211484034 >> v2:172.21.15.182:3300/0 conn(0x7fc3440adf70 msgr2=0x7fc3440cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:07:57.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc34959c700 1 --2- 172.21.15.116:0/3211484034 >> v2:172.21.15.182:3300/0 conn(0x7fc3440adf70 0x7fc3440cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc34959c700 1 -- 172.21.15.116:0/3211484034 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34415d860 con 0x7fc34415cf10 2023-05-12T09:07:57.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc34959c700 1 --2- 172.21.15.116:0/3211484034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc34415cf10 0x7fc34406c6c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc3440708e0 tx=0x7fc33c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc40c1c78e1d9b6 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:57.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc3437fe700 1 -- 172.21.15.116:0/3211484034 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00e070 con 0x7fc34415cf10 2023-05-12T09:07:57.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc3437fe700 1 -- 172.21.15.116:0/3211484034 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c00b9c0 con 0x7fc34415cf10 2023-05-12T09:07:57.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.211+0000 7fc3437fe700 1 -- 172.21.15.116:0/3211484034 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00bd70 con 0x7fc34415cf10 2023-05-12T09:07:57.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.212+0000 7fc34afff700 1 -- 172.21.15.116:0/3211484034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc34415cf10 msgr2=0x7fc34406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:57.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.212+0000 7fc34afff700 1 --2- 172.21.15.116:0/3211484034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc34415cf10 0x7fc34406c6c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc3440708e0 tx=0x7fc33c00b330 comp rx=0 tx=0).stop 2023-05-12T09:07:57.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.212+0000 7fc34afff700 1 -- 172.21.15.116:0/3211484034 shutdown_connections 2023-05-12T09:07:57.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.212+0000 7fc34afff700 1 --2- 172.21.15.116:0/3211484034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc34415cf10 0x7fc34406c6c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.212+0000 7fc34afff700 1 --2- 172.21.15.116:0/3211484034 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3440cd760 0x7fc3440cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.212+0000 7fc34afff700 1 --2- 172.21.15.116:0/3211484034 >> v2:172.21.15.182:3300/0 conn(0x7fc3440adf70 0x7fc3440cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.212+0000 7fc34afff700 1 -- 172.21.15.116:0/3211484034 >> 172.21.15.116:0/3211484034 conn(0x7fc3440cf720 msgr2=0x7fc3440cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:57.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.212+0000 7fc34afff700 1 -- 172.21.15.116:0/3211484034 shutdown_connections 2023-05-12T09:07:57.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.212+0000 7fc34afff700 1 -- 172.21.15.116:0/3211484034 wait complete. 2023-05-12T09:07:57.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.214+0000 7fc34afff700 1 Processor -- start 2023-05-12T09:07:57.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.215+0000 7fc34afff700 1 -- start start 2023-05-12T09:07:57.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc34afff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3440adf70 0x7fc3441508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:57.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc34afff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3440cd760 0x7fc34414f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:57.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc34afff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc34415cf10 0x7fc34414fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:57.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc34afff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440c3270 con 0x7fc3440cd760 2023-05-12T09:07:57.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc34afff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440c2660 con 0x7fc3440adf70 2023-05-12T09:07:57.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc34afff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440c2940 con 0x7fc34415cf10 2023-05-12T09:07:57.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc343fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3440cd760 0x7fc34414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:57.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc343fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3440cd760 0x7fc34414f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53786/0 (socket says 172.21.15.116:53786) 2023-05-12T09:07:57.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc343fff700 1 -- 172.21.15.116:0/3605027662 learned_addr learned my addr 172.21.15.116:0/3605027662 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:07:57.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc34959c700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc34415cf10 0x7fc34414fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:57.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.216+0000 7fc348d9b700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3440adf70 0x7fc3441508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:57.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc343fff700 1 -- 172.21.15.116:0/3605027662 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc34415cf10 msgr2=0x7fc34414fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:57.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc343fff700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc34415cf10 0x7fc34414fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc343fff700 1 -- 172.21.15.116:0/3605027662 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3440adf70 msgr2=0x7fc3441508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:57.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc343fff700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3440adf70 0x7fc3441508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc343fff700 1 -- 172.21.15.116:0/3605027662 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c009b30 con 0x7fc3440cd760 2023-05-12T09:07:57.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc343fff700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3440cd760 0x7fc34414f750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc33000e730 tx=0x7fc33000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:57.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc3417fa700 1 -- 172.21.15.116:0/3605027662 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33000c070 con 0x7fc3440cd760 2023-05-12T09:07:57.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc3417fa700 1 -- 172.21.15.116:0/3605027662 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc330013610 con 0x7fc3440cd760 2023-05-12T09:07:57.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc34afff700 1 -- 172.21.15.116:0/3605027662 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3440cc670 con 0x7fc3440cd760 2023-05-12T09:07:57.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc3417fa700 1 -- 172.21.15.116:0/3605027662 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3300139c0 con 0x7fc3440cd760 2023-05-12T09:07:57.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.217+0000 7fc34afff700 1 -- 172.21.15.116:0/3605027662 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34415db40 con 0x7fc3440cd760 2023-05-12T09:07:57.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.218+0000 7fc34afff700 1 -- 172.21.15.116:0/3605027662 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc344071600 con 0x7fc3440cd760 2023-05-12T09:07:57.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.219+0000 7fc3417fa700 1 -- 172.21.15.116:0/3605027662 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc330013b20 con 0x7fc3440cd760 2023-05-12T09:07:57.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.220+0000 7fc3417fa700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc32806ace0 0x7fc32806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:07:57.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.220+0000 7fc3417fa700 1 -- 172.21.15.116:0/3605027662 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc330089120 con 0x7fc3440cd760 2023-05-12T09:07:57.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.220+0000 7fc348d9b700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc32806ace0 0x7fc32806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:07:57.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.221+0000 7fc348d9b700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc32806ace0 0x7fc32806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc338009950 tx=0x7fc338008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:07:57.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.224+0000 7fc3417fa700 1 -- 172.21.15.116:0/3605027662 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc330053ed0 con 0x7fc3440cd760 2023-05-12T09:07:57.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.461+0000 7fc34afff700 1 -- 172.21.15.116:0/3605027662 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc3440c54d0 con 0x7fc3440cd760 2023-05-12T09:07:57.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.462+0000 7fc3417fa700 1 -- 172.21.15.116:0/3605027662 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc3300574f0 con 0x7fc3440cd760 2023-05-12T09:07:57.465 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-12T09:07:57.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 -- 172.21.15.116:0/3605027662 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc32806ace0 msgr2=0x7fc32806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:57.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc32806ace0 0x7fc32806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc338009950 tx=0x7fc338008040 comp rx=0 tx=0).stop 2023-05-12T09:07:57.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 -- 172.21.15.116:0/3605027662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3440cd760 msgr2=0x7fc34414f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:07:57.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3440cd760 0x7fc34414f750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc33000e730 tx=0x7fc33000ea40 comp rx=0 tx=0).stop 2023-05-12T09:07:57.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 -- 172.21.15.116:0/3605027662 shutdown_connections 2023-05-12T09:07:57.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc32806ace0 0x7fc32806d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc34415cf10 0x7fc34414fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3440adf70 0x7fc3441508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 --2- 172.21.15.116:0/3605027662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3440cd760 0x7fc34414f750 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:07:57.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 -- 172.21.15.116:0/3605027662 >> 172.21.15.116:0/3605027662 conn(0x7fc3440cf720 msgr2=0x7fc3440caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:07:57.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 -- 172.21.15.116:0/3605027662 shutdown_connections 2023-05-12T09:07:57.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:07:57.464+0000 7fc34afff700 1 -- 172.21.15.116:0/3605027662 wait complete. 2023-05-12T09:07:57.484 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-12T09:07:57.484 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-12T09:07:57.484 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2023-05-12T09:07:57.485 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-12T09:07:57.485 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-12T09:07:57.485 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-12T09:07:57.485 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-12T09:07:57.485 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-12T09:07:57.485 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-12T09:07:57.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:57.486 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2023-05-12T09:07:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-12T09:07:57.528 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-12T09:07:57.528 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2023-05-12T09:07:57.529 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:57.529 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2023-05-12T09:07:57.529 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:07:57.529 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:57.529 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2023-05-12T09:07:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:07:57.530 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:57.530 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2023-05-12T09:07:57.530 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:07:57.530 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:57.530 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-12T09:07:57.530 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:57.530 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-12T09:07:57.530 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42053sec preferred_lft 42053sec 2023-05-12T09:07:57.531 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2023-05-12T09:07:57.531 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:57.531 INFO:teuthology.orchestra.run.smithi116.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-12T09:07:57.531 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 46:82:4a:82:a6:fc brd ff:ff:ff:ff:ff:ff 2023-05-12T09:07:57.531 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-12T09:07:57.531 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:57.531 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::c814:ddff:fe94:e5ba/64 scope link 2023-05-12T09:07:57.532 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:57.532 INFO:teuthology.orchestra.run.smithi116.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-12T09:07:57.532 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 46:82:4a:82:a6:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-12T09:07:57.532 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::4482:4aff:fe82:a6fc/64 scope link 2023-05-12T09:07:57.532 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:57.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:57.533 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-12T09:07:57.640 INFO:teuthology.orchestra.run.smithi116.stdout:1 2023-05-12T09:07:57.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:57.643 DEBUG:teuthology.orchestra.run.smithi116:> route 2023-05-12T09:07:57.687 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2023-05-12T09:07:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-12T09:07:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-12T09:07:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-12T09:07:57.688 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-12T09:07:57.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:57.689 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:57.689 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:57.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-12T09:07:57.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-12T09:07:57.691 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-12T09:07:57.691 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:57.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:57.881 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2023-05-12T09:07:57.923 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-12T09:07:57.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:57.924 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2023-05-12T09:07:58.005 INFO:teuthology.orchestra.run.smithi116.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-12T09:07:58.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:58.007 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:58.007 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:58.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-12T09:07:58.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-12T09:07:58.007 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:58.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:58.174 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-12T09:07:58.237 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-12T09:07:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-12T09:07:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2023-05-12T09:07:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2023-05-12T09:07:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:58.238 INFO:teuthology.orchestra.run.smithi116.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-12T09:07:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 6a:9c:76:e8:28:c6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-12T09:07:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-12T09:07:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::689c:76ff:fee8:28c6/64 scope link 2023-05-12T09:07:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:58.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:58.240 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-12T09:07:58.303 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-12T09:07:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-12T09:07:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2023-05-12T09:07:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2023-05-12T09:07:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:58.305 INFO:teuthology.orchestra.run.smithi116.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-12T09:07:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 6a:9c:76:e8:28:c6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-12T09:07:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-12T09:07:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::689c:76ff:fee8:28c6/64 scope link 2023-05-12T09:07:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:07:58.306 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-12T09:07:58.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:58.307 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:58.307 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:58.307 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-12T09:07:58.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-12T09:07:58.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-12T09:07:58.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-12T09:07:58.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-12T09:07:58.309 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:58.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:58.534 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:07:58.535 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:07:58.535 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.1 up 2023-05-12T09:07:58.535 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.1 master ceph-brx 2023-05-12T09:07:58.535 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:07:58.704 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-05-12T09:07:58.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:07:58.705 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-05-12T09:07:58.746 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-05-12T09:07:58.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:07:58.746 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-05-12T09:07:58.826 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-05-12T09:07:58.929 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:07:58.930 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:07:58.990 INFO:teuthology.orchestra.run.smithi116.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:07:58.992 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:07:58.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:58.993 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-05-12T09:07:59.034 INFO:teuthology.orchestra.run.smithi116.stdout:42 2023-05-12T09:07:59.034 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-05-12T09:07:59.035 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-05-12T09:07:59.078 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-05-12T09:07:59.141 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:07:59.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:07:59.207 INFO:teuthology.orchestra.run.smithi116.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:07:59.209 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:07:59.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:59.210 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-05-12T09:07:59.234 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi116.stderr:2023-05-12T09:07:59.231+0000 7fe09fbdc5c0 -1 init, newargv = 0x55cee4fdd0c0 newargc=15 2023-05-12T09:07:59.235 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi116.stderr:ceph-fuse[117358]: starting ceph client 2023-05-12T09:07:59.242 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi116.stderr:ceph-fuse[117358]: starting fuse 2023-05-12T09:07:59.254 INFO:teuthology.orchestra.run.smithi116.stdout:42 2023-05-12T09:07:59.254 INFO:teuthology.orchestra.run.smithi116.stdout:44 2023-05-12T09:07:59.255 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2023-05-12T09:07:59.255 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-12T09:07:59.255 DEBUG:teuthology.orchestra.run.smithi116:> import glob 2023-05-12T09:07:59.256 DEBUG:teuthology.orchestra.run.smithi116:> import re 2023-05-12T09:07:59.256 DEBUG:teuthology.orchestra.run.smithi116:> import os 2023-05-12T09:07:59.256 DEBUG:teuthology.orchestra.run.smithi116:> import subprocess 2023-05-12T09:07:59.256 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:59.257 DEBUG:teuthology.orchestra.run.smithi116:> def _find_admin_socket(client_name): 2023-05-12T09:07:59.257 DEBUG:teuthology.orchestra.run.smithi116:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-05-12T09:07:59.257 DEBUG:teuthology.orchestra.run.smithi116:> files = glob.glob(asok_path) 2023-05-12T09:07:59.257 DEBUG:teuthology.orchestra.run.smithi116:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-05-12T09:07:59.258 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:59.258 DEBUG:teuthology.orchestra.run.smithi116:> # Given a non-glob path, it better be there 2023-05-12T09:07:59.258 DEBUG:teuthology.orchestra.run.smithi116:> if "*" not in asok_path: 2023-05-12T09:07:59.259 DEBUG:teuthology.orchestra.run.smithi116:> assert(len(files) == 1) 2023-05-12T09:07:59.259 DEBUG:teuthology.orchestra.run.smithi116:> return files[0] 2023-05-12T09:07:59.259 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:59.260 DEBUG:teuthology.orchestra.run.smithi116:> for f in files: 2023-05-12T09:07:59.260 DEBUG:teuthology.orchestra.run.smithi116:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-12T09:07:59.260 DEBUG:teuthology.orchestra.run.smithi116:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-12T09:07:59.260 DEBUG:teuthology.orchestra.run.smithi116:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-12T09:07:59.261 DEBUG:teuthology.orchestra.run.smithi116:> contents = proc_f.read() 2023-05-12T09:07:59.261 DEBUG:teuthology.orchestra.run.smithi116:> if mountpoint in contents: 2023-05-12T09:07:59.261 DEBUG:teuthology.orchestra.run.smithi116:> return f 2023-05-12T09:07:59.261 DEBUG:teuthology.orchestra.run.smithi116:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-12T09:07:59.262 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:07:59.262 DEBUG:teuthology.orchestra.run.smithi116:> print(_find_admin_socket("client.2")) 2023-05-12T09:07:59.262 DEBUG:teuthology.orchestra.run.smithi116:> ' 2023-05-12T09:07:59.429 INFO:teuthology.orchestra.run.smithi116.stdout:/var/run/ceph/ceph-client.2.117358.asok 2023-05-12T09:07:59.607 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.117358.asok 2023-05-12T09:07:59.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:07:59.608 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.117358.asok status 2023-05-12T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-05-12T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "metadata": { 2023-05-12T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_sha1": "5a6b166b7c43e2b5890833e75dd257ab21264ded", 2023-05-12T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev)", 2023-05-12T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "entity_id": "2", 2023-05-12T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "hostname": "smithi116", 2023-05-12T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-05-12T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "pid": "117358", 2023-05-12T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "root": "/" 2023-05-12T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_count": 0, 2023-05-12T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_pinned_count": 0, 2023-05-12T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 4852, 2023-05-12T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "inst": { 2023-05-12T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "name": { 2023-05-12T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "client", 2023-05-12T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "num": 4852 2023-05-12T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-05-12T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-05-12T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:0", 2023-05-12T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3943805735 2023-05-12T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-05-12T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-05-12T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:0", 2023-05-12T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3943805735 2023-05-12T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "inst_str": "client.4852 172.21.15.116:0/3943805735", 2023-05-12T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addr_str": "172.21.15.116:0/3943805735", 2023-05-12T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "inode_count": 1, 2023-05-12T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_epoch": 9, 2023-05-12T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch": 26, 2023-05-12T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch_barrier": 0, 2023-05-12T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklisted": false, 2023-05-12T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs" 2023-05-12T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-05-12T09:07:59.833 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-12T09:08:00.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.013+0000 7fa83a5ff700 1 Processor -- start 2023-05-12T09:08:00.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.014+0000 7fa83a5ff700 1 -- start start 2023-05-12T09:08:00.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa83a5ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fa8340cd760 0x7fa8340cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:00.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa83a5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 0x7fa8340cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:00.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa83a5ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa83415cf10 0x7fa83406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:00.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa83a5ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8340cc9e0 con 0x7fa83415cf10 2023-05-12T09:08:00.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa83a5ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83415de20 con 0x7fa8340cd760 2023-05-12T09:08:00.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa83a5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340ce070 con 0x7fa8340adf70 2023-05-12T09:08:00.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa838b9c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa83415cf10 0x7fa83406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:00.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa838b9c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa83415cf10 0x7fa83406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53796/0 (socket says 172.21.15.116:53796) 2023-05-12T09:08:00.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa838b9c700 1 -- 172.21.15.116:0/218547961 learned_addr learned my addr 172.21.15.116:0/218547961 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:00.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa82bfff700 1 --2- 172.21.15.116:0/218547961 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 0x7fa8340cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:00.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa833fff700 1 --2- 172.21.15.116:0/218547961 >> v2:172.21.15.182:3300/0 conn(0x7fa8340cd760 0x7fa8340cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa838b9c700 1 -- 172.21.15.116:0/218547961 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 msgr2=0x7fa8340cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa838b9c700 1 --2- 172.21.15.116:0/218547961 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 0x7fa8340cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa838b9c700 1 -- 172.21.15.116:0/218547961 >> v2:172.21.15.182:3300/0 conn(0x7fa8340cd760 msgr2=0x7fa8340cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa838b9c700 1 --2- 172.21.15.116:0/218547961 >> v2:172.21.15.182:3300/0 conn(0x7fa8340cd760 0x7fa8340cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa838b9c700 1 -- 172.21.15.116:0/218547961 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83415d860 con 0x7fa83415cf10 2023-05-12T09:08:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa82bfff700 1 --2- 172.21.15.116:0/218547961 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 0x7fa8340cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.015+0000 7fa833fff700 1 --2- 172.21.15.116:0/218547961 >> v2:172.21.15.182:3300/0 conn(0x7fa8340cd760 0x7fa8340cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:00.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa838b9c700 1 --2- 172.21.15.116:0/218547961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 0x7fa83406c6c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa8340cc230 tx=0x7fa82c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adefd9d503cfb62d server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:00.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa8337fe700 1 -- 172.21.15.116:0/218547961 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00bbc0 con 0x7fa83415cf10 2023-05-12T09:08:00.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa8337fe700 1 -- 172.21.15.116:0/218547961 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c00bd20 con 0x7fa83415cf10 2023-05-12T09:08:00.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa8337fe700 1 -- 172.21.15.116:0/218547961 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0116a0 con 0x7fa83415cf10 2023-05-12T09:08:00.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa83a5ff700 1 -- 172.21.15.116:0/218547961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 msgr2=0x7fa83406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:00.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa83a5ff700 1 --2- 172.21.15.116:0/218547961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 0x7fa83406c6c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa8340cc230 tx=0x7fa82c00b330 comp rx=0 tx=0).stop 2023-05-12T09:08:00.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa83a5ff700 1 -- 172.21.15.116:0/218547961 shutdown_connections 2023-05-12T09:08:00.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa83a5ff700 1 --2- 172.21.15.116:0/218547961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 0x7fa83406c6c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa83a5ff700 1 --2- 172.21.15.116:0/218547961 >> v2:172.21.15.182:3300/0 conn(0x7fa8340cd760 0x7fa8340cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa83a5ff700 1 --2- 172.21.15.116:0/218547961 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 0x7fa8340cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.016+0000 7fa83a5ff700 1 -- 172.21.15.116:0/218547961 >> 172.21.15.116:0/218547961 conn(0x7fa8340cf720 msgr2=0x7fa8340cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:00.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.017+0000 7fa83a5ff700 1 -- 172.21.15.116:0/218547961 shutdown_connections 2023-05-12T09:08:00.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.017+0000 7fa83a5ff700 1 -- 172.21.15.116:0/218547961 wait complete. 2023-05-12T09:08:00.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.018+0000 7fa83a5ff700 1 Processor -- start 2023-05-12T09:08:00.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.018+0000 7fa83a5ff700 1 -- start start 2023-05-12T09:08:00.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.019+0000 7fa83a5ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 0x7fa83406d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:00.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.019+0000 7fa83a5ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa8340cd760 0x7fa8340b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:00.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.019+0000 7fa83a5ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 0x7fa8340b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:00.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.019+0000 7fa83a5ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8341e4330 con 0x7fa83415cf10 2023-05-12T09:08:00.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.019+0000 7fa83a5ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8341e4610 con 0x7fa8340cd760 2023-05-12T09:08:00.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.019+0000 7fa83a5ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8341e48f0 con 0x7fa8340adf70 2023-05-12T09:08:00.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa838b9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 0x7fa8340b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:00.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa838b9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 0x7fa8340b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53798/0 (socket says 172.21.15.116:53798) 2023-05-12T09:08:00.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa838b9c700 1 -- 172.21.15.116:0/2522893891 learned_addr learned my addr 172.21.15.116:0/2522893891 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:00.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa833fff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 0x7fa83406d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:00.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa82bfff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa8340cd760 0x7fa8340b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:00.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa838b9c700 1 -- 172.21.15.116:0/2522893891 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 msgr2=0x7fa83406d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:00.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa838b9c700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 0x7fa83406d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa838b9c700 1 -- 172.21.15.116:0/2522893891 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa8340cd760 msgr2=0x7fa8340b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:00.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa838b9c700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa8340cd760 0x7fa8340b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa838b9c700 1 -- 172.21.15.116:0/2522893891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c009b30 con 0x7fa83415cf10 2023-05-12T09:08:00.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa833fff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 0x7fa83406d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:00.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.020+0000 7fa838b9c700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 0x7fa8340b3b50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00b370 tx=0x7fa82c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:00.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.021+0000 7fa8317fa700 1 -- 172.21.15.116:0/2522893891 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00cea0 con 0x7fa83415cf10 2023-05-12T09:08:00.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.021+0000 7fa8317fa700 1 -- 172.21.15.116:0/2522893891 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c004960 con 0x7fa83415cf10 2023-05-12T09:08:00.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.021+0000 7fa83a5ff700 1 -- 172.21.15.116:0/2522893891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8340cc670 con 0x7fa83415cf10 2023-05-12T09:08:00.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.021+0000 7fa8317fa700 1 -- 172.21.15.116:0/2522893891 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0116a0 con 0x7fa83415cf10 2023-05-12T09:08:00.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.021+0000 7fa83a5ff700 1 -- 172.21.15.116:0/2522893891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83415db40 con 0x7fa83415cf10 2023-05-12T09:08:00.028 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.022+0000 7fa83a5ff700 1 -- 172.21.15.116:0/2522893891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa834071600 con 0x7fa83415cf10 2023-05-12T09:08:00.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.023+0000 7fa8317fa700 1 -- 172.21.15.116:0/2522893891 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa82c011800 con 0x7fa83415cf10 2023-05-12T09:08:00.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.024+0000 7fa8317fa700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa81406ace0 0x7fa81406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:00.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.024+0000 7fa8317fa700 1 -- 172.21.15.116:0/2522893891 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa82c08b0b0 con 0x7fa83415cf10 2023-05-12T09:08:00.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.024+0000 7fa833fff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa81406ace0 0x7fa81406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:00.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.025+0000 7fa833fff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa81406ace0 0x7fa81406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa824006fd0 tx=0x7fa824008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:00.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.029+0000 7fa8317fa700 1 -- 172.21.15.116:0/2522893891 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa82c055e20 con 0x7fa83415cf10 2023-05-12T09:08:00.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.265+0000 7fa83a5ff700 1 -- 172.21.15.116:0/2522893891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa834071b50 con 0x7fa83415cf10 2023-05-12T09:08:00.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.265+0000 7fa8317fa700 1 -- 172.21.15.116:0/2522893891 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa82c027070 con 0x7fa83415cf10 2023-05-12T09:08:00.269 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-12T09:08:00.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.267+0000 7fa83a5ff700 1 -- 172.21.15.116:0/2522893891 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa81406ace0 msgr2=0x7fa81406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:00.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.267+0000 7fa83a5ff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa81406ace0 0x7fa81406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa824006fd0 tx=0x7fa824008040 comp rx=0 tx=0).stop 2023-05-12T09:08:00.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.267+0000 7fa83a5ff700 1 -- 172.21.15.116:0/2522893891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 msgr2=0x7fa8340b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:00.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.267+0000 7fa83a5ff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 0x7fa8340b3b50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00b370 tx=0x7fa82c004ad0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.268+0000 7fa83a5ff700 1 -- 172.21.15.116:0/2522893891 shutdown_connections 2023-05-12T09:08:00.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.268+0000 7fa83a5ff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa83415cf10 0x7fa8340b3b50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.268+0000 7fa83a5ff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa81406ace0 0x7fa81406d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.268+0000 7fa83a5ff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8340adf70 0x7fa83406d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.268+0000 7fa83a5ff700 1 --2- 172.21.15.116:0/2522893891 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa8340cd760 0x7fa8340b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:00.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.268+0000 7fa83a5ff700 1 -- 172.21.15.116:0/2522893891 >> 172.21.15.116:0/2522893891 conn(0x7fa8340cf720 msgr2=0x7fa834159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:00.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.268+0000 7fa83a5ff700 1 -- 172.21.15.116:0/2522893891 shutdown_connections 2023-05-12T09:08:00.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:00.268+0000 7fa83a5ff700 1 -- 172.21.15.116:0/2522893891 wait complete. 2023-05-12T09:08:00.287 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-12T09:08:00.288 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-12T09:08:00.288 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi182.front.sepia.ceph.com 2023-05-12T09:08:00.288 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-12T09:08:00.288 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-12T09:08:00.288 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-12T09:08:00.289 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-12T09:08:00.289 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-12T09:08:00.289 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-12T09:08:00.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:00.290 DEBUG:teuthology.orchestra.run.smithi182:> ip addr 2023-05-12T09:08:00.337 INFO:teuthology.orchestra.run.smithi182.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-12T09:08:00.337 INFO:teuthology.orchestra.run.smithi182.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-12T09:08:00.337 INFO:teuthology.orchestra.run.smithi182.stdout: inet 127.0.0.1/8 scope host lo 2023-05-12T09:08:00.337 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:00.338 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 ::1/128 scope host 2023-05-12T09:08:00.338 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:00.338 INFO:teuthology.orchestra.run.smithi182.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:08:00.338 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:d9:19:46 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:08:00.338 INFO:teuthology.orchestra.run.smithi182.stdout: altname enp7s0f0 2023-05-12T09:08:00.338 INFO:teuthology.orchestra.run.smithi182.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:08:00.338 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:d9:19:47 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:08:00.339 INFO:teuthology.orchestra.run.smithi182.stdout: altname enp7s0f1 2023-05-12T09:08:00.339 INFO:teuthology.orchestra.run.smithi182.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:08:00.339 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:88:77:8c brd ff:ff:ff:ff:ff:ff 2023-05-12T09:08:00.339 INFO:teuthology.orchestra.run.smithi182.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-12T09:08:00.339 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:88:77:8d brd ff:ff:ff:ff:ff:ff 2023-05-12T09:08:00.339 INFO:teuthology.orchestra.run.smithi182.stdout: inet 172.21.15.182/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-12T09:08:00.339 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft 42056sec preferred_lft 42056sec 2023-05-12T09:08:00.339 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 fe80::ec4:7aff:fe88:778d/64 scope link 2023-05-12T09:08:00.340 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:00.341 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-12T09:08:00.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:00.341 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-05-12T09:08:00.341 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-05-12T09:08:00.342 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link add name ceph-brx type bridge 2023-05-12T09:08:00.342 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip addr flush dev ceph-brx 2023-05-12T09:08:00.342 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link set ceph-brx up 2023-05-12T09:08:00.342 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-12T09:08:00.343 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-05-12T09:08:00.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:00.747 DEBUG:teuthology.orchestra.run.smithi182:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-12T09:08:00.852 INFO:teuthology.orchestra.run.smithi182.stdout:1 2023-05-12T09:08:00.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:00.855 DEBUG:teuthology.orchestra.run.smithi182:> route 2023-05-12T09:08:00.923 INFO:teuthology.orchestra.run.smithi182.stdout:Kernel IP routing table 2023-05-12T09:08:00.923 INFO:teuthology.orchestra.run.smithi182.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-12T09:08:00.923 INFO:teuthology.orchestra.run.smithi182.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-12T09:08:00.923 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-12T09:08:00.924 INFO:teuthology.orchestra.run.smithi182.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-12T09:08:00.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:00.924 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-05-12T09:08:00.925 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-05-12T09:08:00.925 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-12T09:08:00.925 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-12T09:08:00.925 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-12T09:08:00.926 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-05-12T09:08:01.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:01.678 DEBUG:teuthology.orchestra.run.smithi182:> ip netns list 2023-05-12T09:08:01.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:01.721 DEBUG:teuthology.orchestra.run.smithi182:> ip netns list-id 2023-05-12T09:08:01.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:01.803 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-05-12T09:08:01.803 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-05-12T09:08:01.803 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-12T09:08:01.803 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-12T09:08:01.804 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-05-12T09:08:01.971 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-12T09:08:01.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:01.972 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-05-12T09:08:01.972 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-05-12T09:08:01.972 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-12T09:08:01.973 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-12T09:08:01.973 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-12T09:08:01.973 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-12T09:08:01.973 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-12T09:08:01.973 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-05-12T09:08:02.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:02.225 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-05-12T09:08:02.225 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-05-12T09:08:02.225 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link set brx.0 up 2023-05-12T09:08:02.226 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link set dev brx.0 master ceph-brx 2023-05-12T09:08:02.226 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-05-12T09:08:02.391 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-05-12T09:08:02.392 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:08:02.392 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-05-12T09:08:02.434 INFO:teuthology.orchestra.run.smithi182.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-05-12T09:08:02.434 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:08:02.434 DEBUG:teuthology.orchestra.run.smithi182:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-05-12T09:08:02.514 DEBUG:teuthology.orchestra.run.smithi182:> sudo modprobe fuse 2023-05-12T09:08:02.622 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:08:02.623 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:08:02.684 INFO:teuthology.orchestra.run.smithi182.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:08:02.686 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:08:02.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:02.687 DEBUG:teuthology.orchestra.run.smithi182:> ls /sys/fs/fuse/connections 2023-05-12T09:08:02.728 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-12T09:08:02.728 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-05-12T09:08:02.772 DEBUG:teuthology.orchestra.run.smithi182:> sudo modprobe fuse 2023-05-12T09:08:02.836 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:08:02.836 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:08:02.899 INFO:teuthology.orchestra.run.smithi182.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:08:02.901 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:08:02.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:02.902 DEBUG:teuthology.orchestra.run.smithi182:> ls /sys/fs/fuse/connections 2023-05-12T09:08:02.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi182.stderr:2023-05-12T09:08:02.951+0000 7ff7e12655c0 -1 init, newargv = 0x56343da7f100 newargc=15 2023-05-12T09:08:02.955 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi182.stderr:ceph-fuse[139833]: starting ceph client 2023-05-12T09:08:02.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi182.stderr:ceph-fuse[139833]: starting fuse 2023-05-12T09:08:04.044 DEBUG:teuthology.orchestra.run.smithi182:> sudo modprobe fuse 2023-05-12T09:08:04.116 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:08:04.116 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:08:04.179 INFO:teuthology.orchestra.run.smithi182.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:08:04.181 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:08:04.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:04.182 DEBUG:teuthology.orchestra.run.smithi182:> ls /sys/fs/fuse/connections 2023-05-12T09:08:04.224 INFO:teuthology.orchestra.run.smithi182.stdout:42 2023-05-12T09:08:04.224 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-12T09:08:04.224 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-12T09:08:04.225 DEBUG:teuthology.orchestra.run.smithi182:> import glob 2023-05-12T09:08:04.225 DEBUG:teuthology.orchestra.run.smithi182:> import re 2023-05-12T09:08:04.225 DEBUG:teuthology.orchestra.run.smithi182:> import os 2023-05-12T09:08:04.225 DEBUG:teuthology.orchestra.run.smithi182:> import subprocess 2023-05-12T09:08:04.226 DEBUG:teuthology.orchestra.run.smithi182:> 2023-05-12T09:08:04.226 DEBUG:teuthology.orchestra.run.smithi182:> def _find_admin_socket(client_name): 2023-05-12T09:08:04.226 DEBUG:teuthology.orchestra.run.smithi182:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-05-12T09:08:04.226 DEBUG:teuthology.orchestra.run.smithi182:> files = glob.glob(asok_path) 2023-05-12T09:08:04.227 DEBUG:teuthology.orchestra.run.smithi182:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-05-12T09:08:04.227 DEBUG:teuthology.orchestra.run.smithi182:> 2023-05-12T09:08:04.227 DEBUG:teuthology.orchestra.run.smithi182:> # Given a non-glob path, it better be there 2023-05-12T09:08:04.227 DEBUG:teuthology.orchestra.run.smithi182:> if "*" not in asok_path: 2023-05-12T09:08:04.228 DEBUG:teuthology.orchestra.run.smithi182:> assert(len(files) == 1) 2023-05-12T09:08:04.228 DEBUG:teuthology.orchestra.run.smithi182:> return files[0] 2023-05-12T09:08:04.228 DEBUG:teuthology.orchestra.run.smithi182:> 2023-05-12T09:08:04.228 DEBUG:teuthology.orchestra.run.smithi182:> for f in files: 2023-05-12T09:08:04.228 DEBUG:teuthology.orchestra.run.smithi182:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-12T09:08:04.229 DEBUG:teuthology.orchestra.run.smithi182:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-12T09:08:04.229 DEBUG:teuthology.orchestra.run.smithi182:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-12T09:08:04.229 DEBUG:teuthology.orchestra.run.smithi182:> contents = proc_f.read() 2023-05-12T09:08:04.229 DEBUG:teuthology.orchestra.run.smithi182:> if mountpoint in contents: 2023-05-12T09:08:04.230 DEBUG:teuthology.orchestra.run.smithi182:> return f 2023-05-12T09:08:04.230 DEBUG:teuthology.orchestra.run.smithi182:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-12T09:08:04.230 DEBUG:teuthology.orchestra.run.smithi182:> 2023-05-12T09:08:04.230 DEBUG:teuthology.orchestra.run.smithi182:> print(_find_admin_socket("client.1")) 2023-05-12T09:08:04.230 DEBUG:teuthology.orchestra.run.smithi182:> ' 2023-05-12T09:08:04.398 INFO:teuthology.orchestra.run.smithi182.stdout:/var/run/ceph/ceph-client.1.139833.asok 2023-05-12T09:08:04.576 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.139833.asok 2023-05-12T09:08:04.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:04.577 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.139833.asok status 2023-05-12T09:08:04.791 INFO:teuthology.orchestra.run.smithi182.stdout:{ 2023-05-12T09:08:04.792 INFO:teuthology.orchestra.run.smithi182.stdout: "metadata": { 2023-05-12T09:08:04.792 INFO:teuthology.orchestra.run.smithi182.stdout: "ceph_sha1": "5a6b166b7c43e2b5890833e75dd257ab21264ded", 2023-05-12T09:08:04.792 INFO:teuthology.orchestra.run.smithi182.stdout: "ceph_version": "ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev)", 2023-05-12T09:08:04.792 INFO:teuthology.orchestra.run.smithi182.stdout: "entity_id": "1", 2023-05-12T09:08:04.792 INFO:teuthology.orchestra.run.smithi182.stdout: "hostname": "smithi182", 2023-05-12T09:08:04.793 INFO:teuthology.orchestra.run.smithi182.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-05-12T09:08:04.793 INFO:teuthology.orchestra.run.smithi182.stdout: "pid": "139833", 2023-05-12T09:08:04.793 INFO:teuthology.orchestra.run.smithi182.stdout: "root": "/" 2023-05-12T09:08:04.793 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2023-05-12T09:08:04.793 INFO:teuthology.orchestra.run.smithi182.stdout: "dentry_count": 0, 2023-05-12T09:08:04.793 INFO:teuthology.orchestra.run.smithi182.stdout: "dentry_pinned_count": 0, 2023-05-12T09:08:04.793 INFO:teuthology.orchestra.run.smithi182.stdout: "id": 4691, 2023-05-12T09:08:04.793 INFO:teuthology.orchestra.run.smithi182.stdout: "inst": { 2023-05-12T09:08:04.794 INFO:teuthology.orchestra.run.smithi182.stdout: "name": { 2023-05-12T09:08:04.794 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "client", 2023-05-12T09:08:04.794 INFO:teuthology.orchestra.run.smithi182.stdout: "num": 4691 2023-05-12T09:08:04.794 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2023-05-12T09:08:04.794 INFO:teuthology.orchestra.run.smithi182.stdout: "addr": { 2023-05-12T09:08:04.794 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "v1", 2023-05-12T09:08:04.794 INFO:teuthology.orchestra.run.smithi182.stdout: "addr": "192.168.0.1:0", 2023-05-12T09:08:04.794 INFO:teuthology.orchestra.run.smithi182.stdout: "nonce": 4237875194 2023-05-12T09:08:04.795 INFO:teuthology.orchestra.run.smithi182.stdout: } 2023-05-12T09:08:04.795 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2023-05-12T09:08:04.795 INFO:teuthology.orchestra.run.smithi182.stdout: "addr": { 2023-05-12T09:08:04.795 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "v1", 2023-05-12T09:08:04.795 INFO:teuthology.orchestra.run.smithi182.stdout: "addr": "192.168.0.1:0", 2023-05-12T09:08:04.795 INFO:teuthology.orchestra.run.smithi182.stdout: "nonce": 4237875194 2023-05-12T09:08:04.795 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2023-05-12T09:08:04.796 INFO:teuthology.orchestra.run.smithi182.stdout: "inst_str": "client.4691 192.168.0.1:0/4237875194", 2023-05-12T09:08:04.796 INFO:teuthology.orchestra.run.smithi182.stdout: "addr_str": "192.168.0.1:0/4237875194", 2023-05-12T09:08:04.796 INFO:teuthology.orchestra.run.smithi182.stdout: "inode_count": 1, 2023-05-12T09:08:04.796 INFO:teuthology.orchestra.run.smithi182.stdout: "mds_epoch": 9, 2023-05-12T09:08:04.796 INFO:teuthology.orchestra.run.smithi182.stdout: "osd_epoch": 26, 2023-05-12T09:08:04.796 INFO:teuthology.orchestra.run.smithi182.stdout: "osd_epoch_barrier": 0, 2023-05-12T09:08:04.796 INFO:teuthology.orchestra.run.smithi182.stdout: "blocklisted": false, 2023-05-12T09:08:04.796 INFO:teuthology.orchestra.run.smithi182.stdout: "fs_name": "cephfs" 2023-05-12T09:08:04.797 INFO:teuthology.orchestra.run.smithi182.stdout:} 2023-05-12T09:08:04.805 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-12T09:08:05.002 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:04.999+0000 7f79805ff700 1 Processor -- start 2023-05-12T09:08:05.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:04.999+0000 7f79805ff700 1 -- start start 2023-05-12T09:08:05.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.000+0000 7f79805ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780cea00 0x7f79780cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:05.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.000+0000 7f79805ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79780d0c00 con 0x7f797806b4f0 2023-05-12T09:08:05.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.000+0000 7f79805ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79780cf450 con 0x7f79780aff90 2023-05-12T09:08:05.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.000+0000 7f79805ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797815cef0 con 0x7f79780cea00 2023-05-12T09:08:05.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.000+0000 7f797eb9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f797806b4f0 0x7f79780ad9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:44358/0 (socket says 172.21.15.116:44358) 2023-05-12T09:08:05.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.000+0000 7f797eb9c700 1 -- 172.21.15.116:0/848308015 learned_addr learned my addr 172.21.15.116:0/848308015 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:05.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.001+0000 7f797db9a700 1 --2- 172.21.15.116:0/848308015 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780cea00 0x7f79780cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:05.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.001+0000 7f797d399700 1 -- 172.21.15.116:0/848308015 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828692157 0 0) 0x7f79780d0c00 con 0x7f797806b4f0 2023-05-12T09:08:05.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.001+0000 7f797d399700 1 -- 172.21.15.116:0/848308015 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79640035b0 con 0x7f797806b4f0 2023-05-12T09:08:05.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.001+0000 7f797d399700 1 -- 172.21.15.116:0/848308015 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136908002 0 0) 0x7f79780cf450 con 0x7f79780aff90 2023-05-12T09:08:05.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.001+0000 7f797d399700 1 -- 172.21.15.116:0/848308015 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79780d0c00 con 0x7f79780aff90 2023-05-12T09:08:05.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.001+0000 7f797db9a700 1 -- 172.21.15.116:0/848308015 >> v1:172.21.15.182:6789/0 conn(0x7f79780aff90 legacy=0x7f79780d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:05.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.001+0000 7f797db9a700 1 -- 172.21.15.116:0/848308015 >> v1:172.21.15.116:6789/0 conn(0x7f797806b4f0 legacy=0x7f79780ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:05.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.001+0000 7f797d399700 1 -- 172.21.15.116:0/848308015 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2135874362 0 0) 0x7f79640035b0 con 0x7f797806b4f0 2023-05-12T09:08:05.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.001+0000 7f797db9a700 1 -- 172.21.15.116:0/848308015 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79780cf730 con 0x7f79780cea00 2023-05-12T09:08:05.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.001+0000 7f797db9a700 1 --2- 172.21.15.116:0/848308015 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780cea00 0x7f79780cee70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7968009870 tx=0x7f7968009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9baddaa6f75b233 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:05.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.002+0000 7f797d399700 1 -- 172.21.15.116:0/848308015 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79700019f0 con 0x7f79780cea00 2023-05-12T09:08:05.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.002+0000 7f797d399700 1 -- 172.21.15.116:0/848308015 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7968004030 con 0x7f79780cea00 2023-05-12T09:08:05.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.002+0000 7f797d399700 1 -- 172.21.15.116:0/848308015 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79680043a0 con 0x7f79780cea00 2023-05-12T09:08:05.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.002+0000 7f79805ff700 1 -- 172.21.15.116:0/848308015 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780cea00 msgr2=0x7f79780cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:05.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.002+0000 7f79805ff700 1 --2- 172.21.15.116:0/848308015 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780cea00 0x7f79780cee70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7968009870 tx=0x7f7968009b80 comp rx=0 tx=0).stop 2023-05-12T09:08:05.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.002+0000 7f79805ff700 1 -- 172.21.15.116:0/848308015 shutdown_connections 2023-05-12T09:08:05.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.002+0000 7f79805ff700 1 --2- 172.21.15.116:0/848308015 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780cea00 0x7f79780cee70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:05.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.002+0000 7f79805ff700 1 -- 172.21.15.116:0/848308015 >> 172.21.15.116:0/848308015 conn(0x7f797809a100 msgr2=0x7f79780d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:05.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.002+0000 7f79805ff700 1 -- 172.21.15.116:0/848308015 shutdown_connections 2023-05-12T09:08:05.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.002+0000 7f79805ff700 1 -- 172.21.15.116:0/848308015 wait complete. 2023-05-12T09:08:05.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.004+0000 7f79805ff700 1 Processor -- start 2023-05-12T09:08:05.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.004+0000 7f79805ff700 1 -- start start 2023-05-12T09:08:05.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.005+0000 7f79805ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f797806b4f0 0x7f79780b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:05.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.005+0000 7f79805ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780aff90 0x7f7978148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:05.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.005+0000 7f79805ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79780cea00 0x7f79781e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:05.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.005+0000 7f79805ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780c7aa0 con 0x7f79780cea00 2023-05-12T09:08:05.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.005+0000 7f79805ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780c74e0 con 0x7f797806b4f0 2023-05-12T09:08:05.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.005+0000 7f79805ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780c77c0 con 0x7f79780aff90 2023-05-12T09:08:05.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.005+0000 7f797eb9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79780cea00 0x7f79781e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:05.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.005+0000 7f797eb9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79780cea00 0x7f79781e50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39662/0 (socket says 172.21.15.116:39662) 2023-05-12T09:08:05.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.005+0000 7f797eb9c700 1 -- 172.21.15.116:0/941995557 learned_addr learned my addr 172.21.15.116:0/941995557 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:05.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.005+0000 7f797e39b700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f797806b4f0 0x7f79780b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:05.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f797db9a700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780aff90 0x7f7978148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:05.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f797eb9c700 1 -- 172.21.15.116:0/941995557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780aff90 msgr2=0x7f7978148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:05.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f797eb9c700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780aff90 0x7f7978148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:05.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f797eb9c700 1 -- 172.21.15.116:0/941995557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f797806b4f0 msgr2=0x7f79780b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:05.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f797eb9c700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f797806b4f0 0x7f79780b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:05.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f797eb9c700 1 -- 172.21.15.116:0/941995557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680094a0 con 0x7f79780cea00 2023-05-12T09:08:05.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f797e39b700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f797806b4f0 0x7f79780b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:05.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f797eb9c700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79780cea00 0x7f79781e50a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f797000cc00 tx=0x7f797000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:05.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f796effd700 1 -- 172.21.15.116:0/941995557 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000aa20 con 0x7f79780cea00 2023-05-12T09:08:05.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f796effd700 1 -- 172.21.15.116:0/941995557 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797000ab80 con 0x7f79780cea00 2023-05-12T09:08:05.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f796effd700 1 -- 172.21.15.116:0/941995557 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79700070d0 con 0x7f79780cea00 2023-05-12T09:08:05.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.006+0000 7f79805ff700 1 -- 172.21.15.116:0/941995557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79780cfcf0 con 0x7f79780cea00 2023-05-12T09:08:05.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.007+0000 7f79805ff700 1 -- 172.21.15.116:0/941995557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79780cfa10 con 0x7f79780cea00 2023-05-12T09:08:05.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.008+0000 7f79805ff700 1 -- 172.21.15.116:0/941995557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79780cffd0 con 0x7f79780cea00 2023-05-12T09:08:05.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.009+0000 7f796effd700 1 -- 172.21.15.116:0/941995557 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7970007230 con 0x7f79780cea00 2023-05-12T09:08:05.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.009+0000 7f796effd700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f795c06ace0 0x7f795c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:05.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.010+0000 7f796effd700 1 -- 172.21.15.116:0/941995557 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f79700892f0 con 0x7f79780cea00 2023-05-12T09:08:05.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.010+0000 7f797e39b700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f795c06ace0 0x7f795c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:05.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.010+0000 7f797e39b700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f795c06ace0 0x7f795c06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7974001220 tx=0x7f7974009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:05.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.014+0000 7f796effd700 1 -- 172.21.15.116:0/941995557 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7970053fd0 con 0x7f79780cea00 2023-05-12T09:08:05.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.252+0000 7f79805ff700 1 -- 172.21.15.116:0/941995557 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79781e5d30 con 0x7f79780cea00 2023-05-12T09:08:05.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.252+0000 7f796effd700 1 -- 172.21.15.116:0/941995557 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f79700575f0 con 0x7f79780cea00 2023-05-12T09:08:05.255 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-12T09:08:05.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.254+0000 7f79805ff700 1 -- 172.21.15.116:0/941995557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f795c06ace0 msgr2=0x7f795c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:05.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.254+0000 7f79805ff700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f795c06ace0 0x7f795c06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7974001220 tx=0x7f7974009040 comp rx=0 tx=0).stop 2023-05-12T09:08:05.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.254+0000 7f79805ff700 1 -- 172.21.15.116:0/941995557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79780cea00 msgr2=0x7f79781e50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:05.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.254+0000 7f79805ff700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79780cea00 0x7f79781e50a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f797000cc00 tx=0x7f797000cf10 comp rx=0 tx=0).stop 2023-05-12T09:08:05.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.255+0000 7f79805ff700 1 -- 172.21.15.116:0/941995557 shutdown_connections 2023-05-12T09:08:05.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.255+0000 7f79805ff700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79780cea00 0x7f79781e50a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:05.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.255+0000 7f79805ff700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f797806b4f0 0x7f79780b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:05.259 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.255+0000 7f79805ff700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f795c06ace0 0x7f795c06d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:05.259 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.255+0000 7f79805ff700 1 --2- 172.21.15.116:0/941995557 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79780aff90 0x7f7978148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:05.259 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.255+0000 7f79805ff700 1 -- 172.21.15.116:0/941995557 >> 172.21.15.116:0/941995557 conn(0x7f797809a100 msgr2=0x7f79780d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:05.259 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.255+0000 7f79805ff700 1 -- 172.21.15.116:0/941995557 shutdown_connections 2023-05-12T09:08:05.259 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:05.255+0000 7f79805ff700 1 -- 172.21.15.116:0/941995557 wait complete. 2023-05-12T09:08:05.274 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-12T09:08:05.275 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-12T09:08:05.275 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi182.front.sepia.ceph.com 2023-05-12T09:08:05.275 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-12T09:08:05.275 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-12T09:08:05.276 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-12T09:08:05.276 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-12T09:08:05.276 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-12T09:08:05.276 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-12T09:08:05.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:05.277 DEBUG:teuthology.orchestra.run.smithi182:> ip addr 2023-05-12T09:08:05.319 INFO:teuthology.orchestra.run.smithi182.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-12T09:08:05.320 INFO:teuthology.orchestra.run.smithi182.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-12T09:08:05.320 INFO:teuthology.orchestra.run.smithi182.stdout: inet 127.0.0.1/8 scope host lo 2023-05-12T09:08:05.320 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:05.320 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 ::1/128 scope host 2023-05-12T09:08:05.320 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:05.320 INFO:teuthology.orchestra.run.smithi182.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:08:05.321 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:d9:19:46 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:08:05.321 INFO:teuthology.orchestra.run.smithi182.stdout: altname enp7s0f0 2023-05-12T09:08:05.321 INFO:teuthology.orchestra.run.smithi182.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:08:05.321 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:d9:19:47 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:08:05.321 INFO:teuthology.orchestra.run.smithi182.stdout: altname enp7s0f1 2023-05-12T09:08:05.321 INFO:teuthology.orchestra.run.smithi182.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:08:05.321 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:88:77:8c brd ff:ff:ff:ff:ff:ff 2023-05-12T09:08:05.321 INFO:teuthology.orchestra.run.smithi182.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-12T09:08:05.322 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:88:77:8d brd ff:ff:ff:ff:ff:ff 2023-05-12T09:08:05.322 INFO:teuthology.orchestra.run.smithi182.stdout: inet 172.21.15.182/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-12T09:08:05.322 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft 42051sec preferred_lft 42051sec 2023-05-12T09:08:05.322 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 fe80::ec4:7aff:fe88:778d/64 scope link 2023-05-12T09:08:05.322 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:05.322 INFO:teuthology.orchestra.run.smithi182.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-12T09:08:05.322 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether c6:ac:5a:b3:8f:50 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:08:05.323 INFO:teuthology.orchestra.run.smithi182.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-12T09:08:05.323 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:05.323 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 fe80::10cb:b7ff:fe93:fd1/64 scope link 2023-05-12T09:08:05.323 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:05.323 INFO:teuthology.orchestra.run.smithi182.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-12T09:08:05.323 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether c6:ac:5a:b3:8f:50 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-12T09:08:05.323 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 fe80::c4ac:5aff:feb3:8f50/64 scope link 2023-05-12T09:08:05.323 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:05.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:05.325 DEBUG:teuthology.orchestra.run.smithi182:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-12T09:08:05.425 INFO:teuthology.orchestra.run.smithi182.stdout:1 2023-05-12T09:08:05.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:05.428 DEBUG:teuthology.orchestra.run.smithi182:> route 2023-05-12T09:08:05.472 INFO:teuthology.orchestra.run.smithi182.stdout:Kernel IP routing table 2023-05-12T09:08:05.473 INFO:teuthology.orchestra.run.smithi182.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-12T09:08:05.473 INFO:teuthology.orchestra.run.smithi182.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-12T09:08:05.473 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-12T09:08:05.473 INFO:teuthology.orchestra.run.smithi182.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-12T09:08:05.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:05.474 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-05-12T09:08:05.475 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-05-12T09:08:05.475 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-12T09:08:05.475 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-12T09:08:05.475 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-12T09:08:05.476 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-05-12T09:08:05.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:05.668 DEBUG:teuthology.orchestra.run.smithi182:> ip netns list 2023-05-12T09:08:05.710 INFO:teuthology.orchestra.run.smithi182.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-12T09:08:05.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:05.711 DEBUG:teuthology.orchestra.run.smithi182:> ip netns list-id 2023-05-12T09:08:05.793 INFO:teuthology.orchestra.run.smithi182.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-12T09:08:05.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:05.794 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-05-12T09:08:05.795 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-05-12T09:08:05.795 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-12T09:08:05.795 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-12T09:08:05.795 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-05-12T09:08:05.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:05.961 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-12T09:08:06.024 INFO:teuthology.orchestra.run.smithi182.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-12T09:08:06.025 INFO:teuthology.orchestra.run.smithi182.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-12T09:08:06.025 INFO:teuthology.orchestra.run.smithi182.stdout: inet 127.0.0.1/8 scope host lo 2023-05-12T09:08:06.025 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:06.025 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 ::1/128 scope host 2023-05-12T09:08:06.025 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:06.025 INFO:teuthology.orchestra.run.smithi182.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-12T09:08:06.025 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 6a:d9:28:1d:fa:e4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-12T09:08:06.026 INFO:teuthology.orchestra.run.smithi182.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-12T09:08:06.026 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:06.026 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 fe80::68d9:28ff:fe1d:fae4/64 scope link 2023-05-12T09:08:06.026 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:06.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:06.028 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-12T09:08:06.093 INFO:teuthology.orchestra.run.smithi182.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-12T09:08:06.093 INFO:teuthology.orchestra.run.smithi182.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-12T09:08:06.094 INFO:teuthology.orchestra.run.smithi182.stdout: inet 127.0.0.1/8 scope host lo 2023-05-12T09:08:06.094 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:06.094 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 ::1/128 scope host 2023-05-12T09:08:06.094 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:06.094 INFO:teuthology.orchestra.run.smithi182.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-12T09:08:06.095 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 6a:d9:28:1d:fa:e4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-12T09:08:06.095 INFO:teuthology.orchestra.run.smithi182.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-12T09:08:06.095 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:06.095 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 fe80::68d9:28ff:fe1d:fae4/64 scope link 2023-05-12T09:08:06.095 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:08:06.096 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-12T09:08:06.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:06.097 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-05-12T09:08:06.097 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-05-12T09:08:06.098 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-12T09:08:06.098 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-12T09:08:06.098 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-12T09:08:06.098 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-12T09:08:06.099 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-12T09:08:06.099 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-05-12T09:08:06.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:06.322 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-05-12T09:08:06.322 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-05-12T09:08:06.322 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link set brx.1 up 2023-05-12T09:08:06.322 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link set dev brx.1 master ceph-brx 2023-05-12T09:08:06.323 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-05-12T09:08:06.487 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-05-12T09:08:06.487 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:08:06.488 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-05-12T09:08:06.529 INFO:teuthology.orchestra.run.smithi182.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-05-12T09:08:06.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:08:06.530 DEBUG:teuthology.orchestra.run.smithi182:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-05-12T09:08:06.611 DEBUG:teuthology.orchestra.run.smithi182:> sudo modprobe fuse 2023-05-12T09:08:06.714 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:08:06.715 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:08:06.776 INFO:teuthology.orchestra.run.smithi182.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:08:06.778 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:08:06.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:06.779 DEBUG:teuthology.orchestra.run.smithi182:> ls /sys/fs/fuse/connections 2023-05-12T09:08:06.820 INFO:teuthology.orchestra.run.smithi182.stdout:42 2023-05-12T09:08:06.820 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-05-12T09:08:06.821 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-05-12T09:08:06.865 DEBUG:teuthology.orchestra.run.smithi182:> sudo modprobe fuse 2023-05-12T09:08:06.929 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:08:06.929 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:08:06.992 INFO:teuthology.orchestra.run.smithi182.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:08:06.994 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:08:06.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:06.995 DEBUG:teuthology.orchestra.run.smithi182:> ls /sys/fs/fuse/connections 2023-05-12T09:08:07.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi182.stderr:2023-05-12T09:08:07.021+0000 7fd816d3a5c0 -1 init, newargv = 0x5644cace8f90 newargc=15 2023-05-12T09:08:07.024 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi182.stderr:ceph-fuse[140568]: starting ceph client 2023-05-12T09:08:07.030 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi182.stderr:ceph-fuse[140568]: starting fuse 2023-05-12T09:08:07.042 INFO:teuthology.orchestra.run.smithi182.stdout:42 2023-05-12T09:08:07.043 INFO:teuthology.orchestra.run.smithi182.stdout:44 2023-05-12T09:08:07.043 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2023-05-12T09:08:07.043 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-12T09:08:07.044 DEBUG:teuthology.orchestra.run.smithi182:> import glob 2023-05-12T09:08:07.044 DEBUG:teuthology.orchestra.run.smithi182:> import re 2023-05-12T09:08:07.044 DEBUG:teuthology.orchestra.run.smithi182:> import os 2023-05-12T09:08:07.044 DEBUG:teuthology.orchestra.run.smithi182:> import subprocess 2023-05-12T09:08:07.045 DEBUG:teuthology.orchestra.run.smithi182:> 2023-05-12T09:08:07.045 DEBUG:teuthology.orchestra.run.smithi182:> def _find_admin_socket(client_name): 2023-05-12T09:08:07.045 DEBUG:teuthology.orchestra.run.smithi182:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-05-12T09:08:07.045 DEBUG:teuthology.orchestra.run.smithi182:> files = glob.glob(asok_path) 2023-05-12T09:08:07.046 DEBUG:teuthology.orchestra.run.smithi182:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-05-12T09:08:07.046 DEBUG:teuthology.orchestra.run.smithi182:> 2023-05-12T09:08:07.046 DEBUG:teuthology.orchestra.run.smithi182:> # Given a non-glob path, it better be there 2023-05-12T09:08:07.046 DEBUG:teuthology.orchestra.run.smithi182:> if "*" not in asok_path: 2023-05-12T09:08:07.047 DEBUG:teuthology.orchestra.run.smithi182:> assert(len(files) == 1) 2023-05-12T09:08:07.047 DEBUG:teuthology.orchestra.run.smithi182:> return files[0] 2023-05-12T09:08:07.047 DEBUG:teuthology.orchestra.run.smithi182:> 2023-05-12T09:08:07.047 DEBUG:teuthology.orchestra.run.smithi182:> for f in files: 2023-05-12T09:08:07.048 DEBUG:teuthology.orchestra.run.smithi182:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-12T09:08:07.048 DEBUG:teuthology.orchestra.run.smithi182:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-12T09:08:07.048 DEBUG:teuthology.orchestra.run.smithi182:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-12T09:08:07.048 DEBUG:teuthology.orchestra.run.smithi182:> contents = proc_f.read() 2023-05-12T09:08:07.048 DEBUG:teuthology.orchestra.run.smithi182:> if mountpoint in contents: 2023-05-12T09:08:07.049 DEBUG:teuthology.orchestra.run.smithi182:> return f 2023-05-12T09:08:07.049 DEBUG:teuthology.orchestra.run.smithi182:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-12T09:08:07.049 DEBUG:teuthology.orchestra.run.smithi182:> 2023-05-12T09:08:07.050 DEBUG:teuthology.orchestra.run.smithi182:> print(_find_admin_socket("client.3")) 2023-05-12T09:08:07.050 DEBUG:teuthology.orchestra.run.smithi182:> ' 2023-05-12T09:08:07.217 INFO:teuthology.orchestra.run.smithi182.stdout:/var/run/ceph/ceph-client.3.140568.asok 2023-05-12T09:08:07.395 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.140568.asok 2023-05-12T09:08:07.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:07.398 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.140568.asok status 2023-05-12T09:08:07.611 INFO:teuthology.orchestra.run.smithi182.stdout:{ 2023-05-12T09:08:07.611 INFO:teuthology.orchestra.run.smithi182.stdout: "metadata": { 2023-05-12T09:08:07.611 INFO:teuthology.orchestra.run.smithi182.stdout: "ceph_sha1": "5a6b166b7c43e2b5890833e75dd257ab21264ded", 2023-05-12T09:08:07.611 INFO:teuthology.orchestra.run.smithi182.stdout: "ceph_version": "ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev)", 2023-05-12T09:08:07.611 INFO:teuthology.orchestra.run.smithi182.stdout: "entity_id": "3", 2023-05-12T09:08:07.612 INFO:teuthology.orchestra.run.smithi182.stdout: "hostname": "smithi182", 2023-05-12T09:08:07.612 INFO:teuthology.orchestra.run.smithi182.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-05-12T09:08:07.612 INFO:teuthology.orchestra.run.smithi182.stdout: "pid": "140568", 2023-05-12T09:08:07.612 INFO:teuthology.orchestra.run.smithi182.stdout: "root": "/" 2023-05-12T09:08:07.612 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2023-05-12T09:08:07.612 INFO:teuthology.orchestra.run.smithi182.stdout: "dentry_count": 0, 2023-05-12T09:08:07.612 INFO:teuthology.orchestra.run.smithi182.stdout: "dentry_pinned_count": 0, 2023-05-12T09:08:07.613 INFO:teuthology.orchestra.run.smithi182.stdout: "id": 4703, 2023-05-12T09:08:07.613 INFO:teuthology.orchestra.run.smithi182.stdout: "inst": { 2023-05-12T09:08:07.613 INFO:teuthology.orchestra.run.smithi182.stdout: "name": { 2023-05-12T09:08:07.613 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "client", 2023-05-12T09:08:07.613 INFO:teuthology.orchestra.run.smithi182.stdout: "num": 4703 2023-05-12T09:08:07.613 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2023-05-12T09:08:07.613 INFO:teuthology.orchestra.run.smithi182.stdout: "addr": { 2023-05-12T09:08:07.614 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "v1", 2023-05-12T09:08:07.614 INFO:teuthology.orchestra.run.smithi182.stdout: "addr": "192.168.0.2:0", 2023-05-12T09:08:07.614 INFO:teuthology.orchestra.run.smithi182.stdout: "nonce": 1168064160 2023-05-12T09:08:07.614 INFO:teuthology.orchestra.run.smithi182.stdout: } 2023-05-12T09:08:07.614 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2023-05-12T09:08:07.614 INFO:teuthology.orchestra.run.smithi182.stdout: "addr": { 2023-05-12T09:08:07.614 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "v1", 2023-05-12T09:08:07.614 INFO:teuthology.orchestra.run.smithi182.stdout: "addr": "192.168.0.2:0", 2023-05-12T09:08:07.615 INFO:teuthology.orchestra.run.smithi182.stdout: "nonce": 1168064160 2023-05-12T09:08:07.615 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2023-05-12T09:08:07.615 INFO:teuthology.orchestra.run.smithi182.stdout: "inst_str": "client.4703 192.168.0.2:0/1168064160", 2023-05-12T09:08:07.615 INFO:teuthology.orchestra.run.smithi182.stdout: "addr_str": "192.168.0.2:0/1168064160", 2023-05-12T09:08:07.615 INFO:teuthology.orchestra.run.smithi182.stdout: "inode_count": 1, 2023-05-12T09:08:07.615 INFO:teuthology.orchestra.run.smithi182.stdout: "mds_epoch": 9, 2023-05-12T09:08:07.615 INFO:teuthology.orchestra.run.smithi182.stdout: "osd_epoch": 26, 2023-05-12T09:08:07.616 INFO:teuthology.orchestra.run.smithi182.stdout: "osd_epoch_barrier": 0, 2023-05-12T09:08:07.616 INFO:teuthology.orchestra.run.smithi182.stdout: "blocklisted": false, 2023-05-12T09:08:07.616 INFO:teuthology.orchestra.run.smithi182.stdout: "fs_name": "cephfs" 2023-05-12T09:08:07.616 INFO:teuthology.orchestra.run.smithi182.stdout:} 2023-05-12T09:08:07.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:07.624 DEBUG:teuthology.orchestra.run.smithi116:> stat --file-system '--printf=%T 2023-05-12T09:08:07.625 DEBUG:teuthology.orchestra.run.smithi116:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-12T09:08:07.672 INFO:teuthology.orchestra.run.smithi116.stdout:fuseblk 2023-05-12T09:08:07.672 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-12T09:08:07.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:07.673 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-12T09:08:07.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:07.740 DEBUG:teuthology.orchestra.run.smithi116:> stat --file-system '--printf=%T 2023-05-12T09:08:07.740 DEBUG:teuthology.orchestra.run.smithi116:> ' -- /home/ubuntu/cephtest/mnt.2 2023-05-12T09:08:07.783 INFO:teuthology.orchestra.run.smithi116.stdout:fuseblk 2023-05-12T09:08:07.783 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-05-12T09:08:07.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:07.784 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-12T09:08:07.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:07.885 DEBUG:teuthology.orchestra.run.smithi182:> stat --file-system '--printf=%T 2023-05-12T09:08:07.886 DEBUG:teuthology.orchestra.run.smithi182:> ' -- /home/ubuntu/cephtest/mnt.1 2023-05-12T09:08:07.928 INFO:teuthology.orchestra.run.smithi182.stdout:fuseblk 2023-05-12T09:08:07.929 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-05-12T09:08:07.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:07.929 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-12T09:08:08.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:08.033 DEBUG:teuthology.orchestra.run.smithi182:> stat --file-system '--printf=%T 2023-05-12T09:08:08.033 DEBUG:teuthology.orchestra.run.smithi182:> ' -- /home/ubuntu/cephtest/mnt.3 2023-05-12T09:08:08.074 INFO:teuthology.orchestra.run.smithi182.stdout:fuseblk 2023-05-12T09:08:08.075 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-05-12T09:08:08.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:08.075 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-12T09:08:08.177 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-12T09:08:08.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.378+0000 7f4cb1bff700 1 Processor -- start 2023-05-12T09:08:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.378+0000 7f4cb1bff700 1 -- start start 2023-05-12T09:08:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.379+0000 7f4cb1bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0cd760 0x7f4cac0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.379+0000 7f4cb1bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f4cac0adf70 0x7f4cac0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.379+0000 7f4cb1bff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cac0cc9e0 con 0x7f4cac15cf10 2023-05-12T09:08:08.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.379+0000 7f4cb1bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac15de20 con 0x7f4cac0adf70 2023-05-12T09:08:08.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.379+0000 7f4cb1bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0ce070 con 0x7f4cac0cd760 2023-05-12T09:08:08.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.380+0000 7f4cab7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0cd760 0x7f4cac0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.380+0000 7f4ca3fff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f4cac0adf70 0x7f4cac0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.380+0000 7f4cabfff700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f4cac15cf10 0x7f4cac06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:49650/0 (socket says 172.21.15.116:49650) 2023-05-12T09:08:08.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.380+0000 7f4cabfff700 1 -- 172.21.15.116:0/3536441586 learned_addr learned my addr 172.21.15.116:0/3536441586 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:08.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.380+0000 7f4cab7fe700 1 -- 172.21.15.116:0/3536441586 >> v2:172.21.15.182:3300/0 conn(0x7f4cac0adf70 msgr2=0x7f4cac0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:08.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.380+0000 7f4cab7fe700 1 --2- 172.21.15.116:0/3536441586 >> v2:172.21.15.182:3300/0 conn(0x7f4cac0adf70 0x7f4cac0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.380+0000 7f4cab7fe700 1 -- 172.21.15.116:0/3536441586 >> v1:172.21.15.182:6789/0 conn(0x7f4cac15cf10 legacy=0x7f4cac06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:08.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.380+0000 7f4caaffd700 1 -- 172.21.15.116:0/3536441586 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633026894 0 0) 0x7f4cac0cc9e0 con 0x7f4cac15cf10 2023-05-12T09:08:08.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.380+0000 7f4cab7fe700 1 -- 172.21.15.116:0/3536441586 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac15d860 con 0x7f4cac0cd760 2023-05-12T09:08:08.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.380+0000 7f4ca3fff700 1 --2- 172.21.15.116:0/3536441586 >> v2:172.21.15.182:3300/0 conn(0x7f4cac0adf70 0x7f4cac0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:08.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.381+0000 7f4cab7fe700 1 --2- 172.21.15.116:0/3536441586 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0cd760 0x7f4cac0cdb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009840 tx=0x7f4c9c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=325c86bc67b21ef2 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:08.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.381+0000 7f4caaffd700 1 -- 172.21.15.116:0/3536441586 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c011830 con 0x7f4cac0cd760 2023-05-12T09:08:08.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.381+0000 7f4caaffd700 1 -- 172.21.15.116:0/3536441586 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c011990 con 0x7f4cac0cd760 2023-05-12T09:08:08.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.381+0000 7f4caaffd700 1 -- 172.21.15.116:0/3536441586 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c011d20 con 0x7f4cac0cd760 2023-05-12T09:08:08.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.381+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3536441586 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0cd760 msgr2=0x7f4cac0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:08.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.381+0000 7f4cb1bff700 1 --2- 172.21.15.116:0/3536441586 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0cd760 0x7f4cac0cdb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009840 tx=0x7f4c9c009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:08.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.381+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3536441586 shutdown_connections 2023-05-12T09:08:08.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.381+0000 7f4cb1bff700 1 --2- 172.21.15.116:0/3536441586 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0cd760 0x7f4cac0cdb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.382+0000 7f4cb1bff700 1 --2- 172.21.15.116:0/3536441586 >> v2:172.21.15.182:3300/0 conn(0x7f4cac0adf70 0x7f4cac0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.382+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3536441586 >> 172.21.15.116:0/3536441586 conn(0x7f4cac0cf720 msgr2=0x7f4cac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:08.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.382+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3536441586 shutdown_connections 2023-05-12T09:08:08.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.382+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3536441586 wait complete. 2023-05-12T09:08:08.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.383+0000 7f4cb1bff700 1 Processor -- start 2023-05-12T09:08:08.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.383+0000 7f4cb1bff700 1 -- start start 2023-05-12T09:08:08.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.384+0000 7f4cb1bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0adf70 0x7f4cac0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.384+0000 7f4cb1bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4cac0cd760 0x7f4cac146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.384+0000 7f4cb1bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cac15cf10 0x7f4cac0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.384+0000 7f4cb1bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac1472a0 con 0x7f4cac15cf10 2023-05-12T09:08:08.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.384+0000 7f4cb1bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac146fa0 con 0x7f4cac0cd760 2023-05-12T09:08:08.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.384+0000 7f4cb1bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0b3140 con 0x7f4cac0adf70 2023-05-12T09:08:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cabfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cac15cf10 0x7f4cac0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cabfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cac15cf10 0x7f4cac0b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39664/0 (socket says 172.21.15.116:39664) 2023-05-12T09:08:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cabfff700 1 -- 172.21.15.116:0/3683058767 learned_addr learned my addr 172.21.15.116:0/3683058767 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cab7fe700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0adf70 0x7f4cac0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4ca3fff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4cac0cd760 0x7f4cac146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cabfff700 1 -- 172.21.15.116:0/3683058767 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0adf70 msgr2=0x7f4cac0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cabfff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0adf70 0x7f4cac0b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cabfff700 1 -- 172.21.15.116:0/3683058767 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4cac0cd760 msgr2=0x7f4cac146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cabfff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4cac0cd760 0x7f4cac146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cabfff700 1 -- 172.21.15.116:0/3683058767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94009430 con 0x7f4cac15cf10 2023-05-12T09:08:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cab7fe700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0adf70 0x7f4cac0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4ca3fff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4cac0cd760 0x7f4cac146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.385+0000 7f4cabfff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cac15cf10 0x7f4cac0b2910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400cba0 tx=0x7f4ca400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.386+0000 7f4ca8ff9700 1 -- 172.21.15.116:0/3683058767 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca400aaa0 con 0x7f4cac15cf10 2023-05-12T09:08:08.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.386+0000 7f4ca8ff9700 1 -- 172.21.15.116:0/3683058767 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca400ac20 con 0x7f4cac15cf10 2023-05-12T09:08:08.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.386+0000 7f4ca8ff9700 1 -- 172.21.15.116:0/3683058767 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca40070d0 con 0x7f4cac15cf10 2023-05-12T09:08:08.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.386+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3683058767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9c0094a0 con 0x7f4cac15cf10 2023-05-12T09:08:08.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.386+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3683058767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cac0cc670 con 0x7f4cac15cf10 2023-05-12T09:08:08.393 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.387+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3683058767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cac15db40 con 0x7f4cac15cf10 2023-05-12T09:08:08.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.388+0000 7f4ca8ff9700 1 -- 172.21.15.116:0/3683058767 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ca4007230 con 0x7f4cac15cf10 2023-05-12T09:08:08.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.388+0000 7f4ca8ff9700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c8c06ace0 0x7f4c8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.389+0000 7f4ca8ff9700 1 -- 172.21.15.116:0/3683058767 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4ca4089350 con 0x7f4cac15cf10 2023-05-12T09:08:08.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.389+0000 7f4cab7fe700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c8c06ace0 0x7f4c8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.389+0000 7f4cab7fe700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c8c06ace0 0x7f4c8c06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009fd0 tx=0x7f4c9c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.393+0000 7f4ca8ff9700 1 -- 172.21.15.116:0/3683058767 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4ca4054030 con 0x7f4cac15cf10 2023-05-12T09:08:08.589 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.586+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3683058767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cac071600 con 0x7f4cac15cf10 2023-05-12T09:08:08.590 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.587+0000 7f4ca8ff9700 1 -- 172.21.15.116:0/3683058767 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7f4ca4057650 con 0x7f4cac15cf10 2023-05-12T09:08:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:08.591 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:08.593 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3683058767 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c8c06ace0 msgr2=0x7f4c8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:08.593 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c8c06ace0 0x7f4c8c06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009fd0 tx=0x7f4c9c008030 comp rx=0 tx=0).stop 2023-05-12T09:08:08.593 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3683058767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cac15cf10 msgr2=0x7f4cac0b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:08.593 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cac15cf10 0x7f4cac0b2910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400cba0 tx=0x7f4ca400ceb0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.593 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3683058767 shutdown_connections 2023-05-12T09:08:08.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cac15cf10 0x7f4cac0b2910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4c8c06ace0 0x7f4c8c06d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4cac0adf70 0x7f4cac0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 --2- 172.21.15.116:0/3683058767 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4cac0cd760 0x7f4cac146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3683058767 >> 172.21.15.116:0/3683058767 conn(0x7f4cac0cf720 msgr2=0x7f4cac159010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:08.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3683058767 shutdown_connections 2023-05-12T09:08:08.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.590+0000 7f4cb1bff700 1 -- 172.21.15.116:0/3683058767 wait complete. 2023-05-12T09:08:08.611 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:08.611 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:08.797 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.794+0000 7f66c2dff700 1 Processor -- start 2023-05-12T09:08:08.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.795+0000 7f66c2dff700 1 -- start start 2023-05-12T09:08:08.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66c2dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f66bc0cf010 0x7f66bc160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66c2dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f66bc0cff50 0x7f66bc0d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66c2dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc0cd520 con 0x7f66bc15c590 2023-05-12T09:08:08.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66c2dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc0d2640 con 0x7f66bc0cf010 2023-05-12T09:08:08.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66c2dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc1610d0 con 0x7f66bc0cff50 2023-05-12T09:08:08.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66bbfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f66bc0cf010 0x7f66bc160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66c0b9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f66bc15c590 0x7f66bc0cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:44368/0 (socket says 172.21.15.116:44368) 2023-05-12T09:08:08.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66c0b9b700 1 -- 172.21.15.116:0/3331132720 learned_addr learned my addr 172.21.15.116:0/3331132720 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:08.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66c139c700 1 --2- 172.21.15.116:0/3331132720 >> v2:172.21.15.182:3300/0 conn(0x7f66bc0cff50 0x7f66bc0d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66bbfff700 1 -- 172.21.15.116:0/3331132720 >> v2:172.21.15.182:3300/0 conn(0x7f66bc0cff50 msgr2=0x7f66bc0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:08.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66bbfff700 1 --2- 172.21.15.116:0/3331132720 >> v2:172.21.15.182:3300/0 conn(0x7f66bc0cff50 0x7f66bc0d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66bbfff700 1 -- 172.21.15.116:0/3331132720 >> v1:172.21.15.116:6789/0 conn(0x7f66bc15c590 legacy=0x7f66bc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:08.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.796+0000 7f66bbfff700 1 -- 172.21.15.116:0/3331132720 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc0b23c0 con 0x7f66bc0cf010 2023-05-12T09:08:08.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.797+0000 7f66bbfff700 1 --2- 172.21.15.116:0/3331132720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc0cf010 0x7f66bc160b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0b20b0 tx=0x7f66a8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47e9f66182e9f87 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:08.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.797+0000 7f66bb7fe700 1 -- 172.21.15.116:0/3331132720 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8011830 con 0x7f66bc0cf010 2023-05-12T09:08:08.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.797+0000 7f66bb7fe700 1 -- 172.21.15.116:0/3331132720 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a8011990 con 0x7f66bc0cf010 2023-05-12T09:08:08.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.797+0000 7f66bb7fe700 1 -- 172.21.15.116:0/3331132720 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8011d20 con 0x7f66bc0cf010 2023-05-12T09:08:08.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.797+0000 7f66c2dff700 1 -- 172.21.15.116:0/3331132720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc0cf010 msgr2=0x7f66bc160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:08.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.797+0000 7f66c2dff700 1 --2- 172.21.15.116:0/3331132720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc0cf010 0x7f66bc160b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0b20b0 tx=0x7f66a8009b20 comp rx=0 tx=0).stop 2023-05-12T09:08:08.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.798+0000 7f66c2dff700 1 -- 172.21.15.116:0/3331132720 shutdown_connections 2023-05-12T09:08:08.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.798+0000 7f66c2dff700 1 --2- 172.21.15.116:0/3331132720 >> v2:172.21.15.182:3300/0 conn(0x7f66bc0cff50 0x7f66bc0d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.798+0000 7f66c2dff700 1 --2- 172.21.15.116:0/3331132720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc0cf010 0x7f66bc160b90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.798+0000 7f66c2dff700 1 -- 172.21.15.116:0/3331132720 >> 172.21.15.116:0/3331132720 conn(0x7f66bc071b10 msgr2=0x7f66bc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:08.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.798+0000 7f66c2dff700 1 -- 172.21.15.116:0/3331132720 shutdown_connections 2023-05-12T09:08:08.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.798+0000 7f66c2dff700 1 -- 172.21.15.116:0/3331132720 wait complete. 2023-05-12T09:08:08.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.799+0000 7f66c2dff700 1 Processor -- start 2023-05-12T09:08:08.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.799+0000 7f66c2dff700 1 -- start start 2023-05-12T09:08:08.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.800+0000 7f66c2dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f66bc0cf010 0x7f66bc0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.800+0000 7f66c2dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f66bc0cff50 0x7f66bc0b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.800+0000 7f66c2dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc15c590 0x7f66bc14bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.800+0000 7f66c2dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0c8750 con 0x7f66bc15c590 2023-05-12T09:08:08.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.800+0000 7f66c2dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0c7b40 con 0x7f66bc0cff50 2023-05-12T09:08:08.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.800+0000 7f66c2dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0c7e20 con 0x7f66bc0cf010 2023-05-12T09:08:08.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.800+0000 7f66c139c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc15c590 0x7f66bc14bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66c139c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc15c590 0x7f66bc14bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39694/0 (socket says 172.21.15.116:39694) 2023-05-12T09:08:08.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66c139c700 1 -- 172.21.15.116:0/316960255 learned_addr learned my addr 172.21.15.116:0/316960255 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:08.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66c0b9b700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f66bc0cf010 0x7f66bc0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66bbfff700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f66bc0cff50 0x7f66bc0b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66c139c700 1 -- 172.21.15.116:0/316960255 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f66bc0cf010 msgr2=0x7f66bc0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:08.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66c139c700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f66bc0cf010 0x7f66bc0cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66c139c700 1 -- 172.21.15.116:0/316960255 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f66bc0cff50 msgr2=0x7f66bc0b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:08.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66c139c700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f66bc0cff50 0x7f66bc0b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:08.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66c139c700 1 -- 172.21.15.116:0/316960255 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80094a0 con 0x7f66bc15c590 2023-05-12T09:08:08.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66bbfff700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f66bc0cff50 0x7f66bc0b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:08.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66c139c700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc15c590 0x7f66bc14bf40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66b4007e40 tx=0x7f66b400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:08.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66b97fa700 1 -- 172.21.15.116:0/316960255 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b400eea0 con 0x7f66bc15c590 2023-05-12T09:08:08.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66b97fa700 1 -- 172.21.15.116:0/316960255 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4014420 con 0x7f66bc15c590 2023-05-12T09:08:08.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66c2dff700 1 -- 172.21.15.116:0/316960255 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc0cd770 con 0x7f66bc15c590 2023-05-12T09:08:08.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.801+0000 7f66b97fa700 1 -- 172.21.15.116:0/316960255 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b40147b0 con 0x7f66bc15c590 2023-05-12T09:08:08.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.802+0000 7f66c2dff700 1 -- 172.21.15.116:0/316960255 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc0cf560 con 0x7f66bc15c590 2023-05-12T09:08:08.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.803+0000 7f66c2dff700 1 -- 172.21.15.116:0/316960255 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc15c960 con 0x7f66bc15c590 2023-05-12T09:08:08.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.803+0000 7f66b97fa700 1 -- 172.21.15.116:0/316960255 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f66b4014910 con 0x7f66bc15c590 2023-05-12T09:08:08.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.804+0000 7f66b97fa700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f66a006ace0 0x7f66a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:08.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.805+0000 7f66b97fa700 1 -- 172.21.15.116:0/316960255 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f66b408a100 con 0x7f66bc15c590 2023-05-12T09:08:08.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.805+0000 7f66c0b9b700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f66a006ace0 0x7f66a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:08.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.805+0000 7f66c0b9b700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f66a006ace0 0x7f66a006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f66b0005910 tx=0x7f66b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:08.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:08.809+0000 7f66b97fa700 1 -- 172.21.15.116:0/316960255 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f66b4054d60 con 0x7f66bc15c590 2023-05-12T09:08:09.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.001+0000 7f66c2dff700 1 -- 172.21.15.116:0/316960255 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f66bc0c8890 con 0x7f66bc15c590 2023-05-12T09:08:09.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.001+0000 7f66b97fa700 1 -- 172.21.15.116:0/316960255 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f66b4058380 con 0x7f66bc15c590 2023-05-12T09:08:09.005 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:09.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.003+0000 7f66c2dff700 1 -- 172.21.15.116:0/316960255 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f66a006ace0 msgr2=0x7f66a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.003+0000 7f66c2dff700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f66a006ace0 0x7f66a006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f66b0005910 tx=0x7f66b0009040 comp rx=0 tx=0).stop 2023-05-12T09:08:09.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.004+0000 7f66c2dff700 1 -- 172.21.15.116:0/316960255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc15c590 msgr2=0x7f66bc14bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.004+0000 7f66c2dff700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc15c590 0x7f66bc14bf40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66b4007e40 tx=0x7f66b400e3c0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.004+0000 7f66c2dff700 1 -- 172.21.15.116:0/316960255 shutdown_connections 2023-05-12T09:08:09.007 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.004+0000 7f66c2dff700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66bc15c590 0x7f66bc14bf40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.004+0000 7f66c2dff700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f66a006ace0 0x7f66a006d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.004+0000 7f66c2dff700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f66bc0cf010 0x7f66bc0cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.004+0000 7f66c2dff700 1 --2- 172.21.15.116:0/316960255 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f66bc0cff50 0x7f66bc0b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.004+0000 7f66c2dff700 1 -- 172.21.15.116:0/316960255 >> 172.21.15.116:0/316960255 conn(0x7f66bc071b10 msgr2=0x7f66bc15a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:09.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.004+0000 7f66c2dff700 1 -- 172.21.15.116:0/316960255 shutdown_connections 2023-05-12T09:08:09.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.004+0000 7f66c2dff700 1 -- 172.21.15.116:0/316960255 wait complete. 2023-05-12T09:08:09.024 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:09.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.208+0000 7fa3455ff700 1 Processor -- start 2023-05-12T09:08:09.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.208+0000 7fa3455ff700 1 -- start start 2023-05-12T09:08:09.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.209+0000 7fa3455ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fa34015d090 0x7fa3400cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.209+0000 7fa3455ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa34015d8d0 0x7fa3400d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.209+0000 7fa3455ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3400cd4c0 con 0x7fa34015d460 2023-05-12T09:08:09.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.209+0000 7fa3455ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3400cd7a0 con 0x7fa34015d8d0 2023-05-12T09:08:09.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.209+0000 7fa3455ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3400cda80 con 0x7fa34015d090 2023-05-12T09:08:09.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.210+0000 7fa33f7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa34015d8d0 0x7fa3400d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.210+0000 7fa33f7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa34015d8d0 0x7fa3400d0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39706/0 (socket says 172.21.15.116:39706) 2023-05-12T09:08:09.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.210+0000 7fa33f7fe700 1 -- 172.21.15.116:0/3950954132 learned_addr learned my addr 172.21.15.116:0/3950954132 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:09.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.210+0000 7fa33effd700 1 --2- 172.21.15.116:0/3950954132 >> v2:172.21.15.182:3300/0 conn(0x7fa34015d090 0x7fa3400cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.210+0000 7fa33f7fe700 1 -- 172.21.15.116:0/3950954132 >> v2:172.21.15.182:3300/0 conn(0x7fa34015d090 msgr2=0x7fa3400cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:09.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.210+0000 7fa33f7fe700 1 --2- 172.21.15.116:0/3950954132 >> v2:172.21.15.182:3300/0 conn(0x7fa34015d090 0x7fa3400cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.210+0000 7fa33f7fe700 1 -- 172.21.15.116:0/3950954132 >> v1:172.21.15.116:6789/0 conn(0x7fa34015d460 legacy=0x7fa3400d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.210+0000 7fa33f7fe700 1 -- 172.21.15.116:0/3950954132 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400cf440 con 0x7fa34015d8d0 2023-05-12T09:08:09.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.210+0000 7fa33f7fe700 1 --2- 172.21.15.116:0/3950954132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d8d0 0x7fa3400d0a40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa340072b10 tx=0x7fa33800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ae7b85cda707b1 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:09.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa33e7fc700 1 -- 172.21.15.116:0/3950954132 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33800e070 con 0x7fa34015d8d0 2023-05-12T09:08:09.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa33e7fc700 1 -- 172.21.15.116:0/3950954132 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33800b910 con 0x7fa34015d8d0 2023-05-12T09:08:09.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa33e7fc700 1 -- 172.21.15.116:0/3950954132 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33800bcc0 con 0x7fa34015d8d0 2023-05-12T09:08:09.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa3455ff700 1 -- 172.21.15.116:0/3950954132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d8d0 msgr2=0x7fa3400d0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa3455ff700 1 --2- 172.21.15.116:0/3950954132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d8d0 0x7fa3400d0a40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa340072b10 tx=0x7fa33800b330 comp rx=0 tx=0).stop 2023-05-12T09:08:09.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa3455ff700 1 -- 172.21.15.116:0/3950954132 shutdown_connections 2023-05-12T09:08:09.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa3455ff700 1 --2- 172.21.15.116:0/3950954132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d8d0 0x7fa3400d0a40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa3455ff700 1 --2- 172.21.15.116:0/3950954132 >> v2:172.21.15.182:3300/0 conn(0x7fa34015d090 0x7fa3400cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa3455ff700 1 -- 172.21.15.116:0/3950954132 >> 172.21.15.116:0/3950954132 conn(0x7fa340071b10 msgr2=0x7fa340071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa3455ff700 1 -- 172.21.15.116:0/3950954132 shutdown_connections 2023-05-12T09:08:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.211+0000 7fa3455ff700 1 -- 172.21.15.116:0/3950954132 wait complete. 2023-05-12T09:08:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.213+0000 7fa3455ff700 1 Processor -- start 2023-05-12T09:08:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.213+0000 7fa3455ff700 1 -- start start 2023-05-12T09:08:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.214+0000 7fa3455ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa34015d090 0x7fa3401f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.214+0000 7fa3455ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d460 0x7fa340155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.214+0000 7fa3455ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa3400cca30 0x7fa34015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.214+0000 7fa3455ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3401f2880 con 0x7fa34015d460 2023-05-12T09:08:09.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.214+0000 7fa3455ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34014fb80 con 0x7fa34015d090 2023-05-12T09:08:09.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.214+0000 7fa3455ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400cd1d0 con 0x7fa3400cca30 2023-05-12T09:08:09.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.214+0000 7fa337fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d460 0x7fa340155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.214+0000 7fa337fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d460 0x7fa340155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39712/0 (socket says 172.21.15.116:39712) 2023-05-12T09:08:09.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.214+0000 7fa337fff700 1 -- 172.21.15.116:0/3480731426 learned_addr learned my addr 172.21.15.116:0/3480731426 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:09.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa337fff700 1 -- 172.21.15.116:0/3480731426 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa3400cca30 msgr2=0x7fa34015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa33effd700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa34015d090 0x7fa3401f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa337fff700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa3400cca30 0x7fa34015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa337fff700 1 -- 172.21.15.116:0/3480731426 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa34015d090 msgr2=0x7fa3401f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa337fff700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa34015d090 0x7fa3401f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa337fff700 1 -- 172.21.15.116:0/3480731426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338009b30 con 0x7fa34015d460 2023-05-12T09:08:09.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa33effd700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa34015d090 0x7fa3401f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:09.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa337fff700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d460 0x7fa340155960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa32800c4e0 tx=0x7fa32800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:09.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa3377fe700 1 -- 172.21.15.116:0/3480731426 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280052d0 con 0x7fa34015d460 2023-05-12T09:08:09.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa3377fe700 1 -- 172.21.15.116:0/3480731426 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328005430 con 0x7fa34015d460 2023-05-12T09:08:09.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa3377fe700 1 -- 172.21.15.116:0/3480731426 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280038c0 con 0x7fa34015d460 2023-05-12T09:08:09.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa3455ff700 1 -- 172.21.15.116:0/3480731426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3400d0180 con 0x7fa34015d460 2023-05-12T09:08:09.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.215+0000 7fa3455ff700 1 -- 172.21.15.116:0/3480731426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3400cf720 con 0x7fa34015d460 2023-05-12T09:08:09.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.216+0000 7fa3455ff700 1 -- 172.21.15.116:0/3480731426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3400cf0c0 con 0x7fa34015d460 2023-05-12T09:08:09.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.217+0000 7fa3377fe700 1 -- 172.21.15.116:0/3480731426 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa328003a20 con 0x7fa34015d460 2023-05-12T09:08:09.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.218+0000 7fa3377fe700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa32006ace0 0x7fa32006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.218+0000 7fa3377fe700 1 -- 172.21.15.116:0/3480731426 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa328088ce0 con 0x7fa34015d460 2023-05-12T09:08:09.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.218+0000 7fa33effd700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa32006ace0 0x7fa32006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.219+0000 7fa33effd700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa32006ace0 0x7fa32006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa330009b60 tx=0x7fa330008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:09.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.222+0000 7fa3377fe700 1 -- 172.21.15.116:0/3480731426 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa328053a50 con 0x7fa34015d460 2023-05-12T09:08:09.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.417+0000 7fa3455ff700 1 -- 172.21.15.116:0/3480731426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa340074430 con 0x7fa34015d460 2023-05-12T09:08:09.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.417+0000 7fa3377fe700 1 -- 172.21.15.116:0/3480731426 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa328017020 con 0x7fa34015d460 2023-05-12T09:08:09.420 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:09.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.419+0000 7fa3455ff700 1 -- 172.21.15.116:0/3480731426 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa32006ace0 msgr2=0x7fa32006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.419+0000 7fa3455ff700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa32006ace0 0x7fa32006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa330009b60 tx=0x7fa330008040 comp rx=0 tx=0).stop 2023-05-12T09:08:09.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.419+0000 7fa3455ff700 1 -- 172.21.15.116:0/3480731426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d460 msgr2=0x7fa340155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.419+0000 7fa3455ff700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d460 0x7fa340155960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa32800c4e0 tx=0x7fa32800c8a0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.419+0000 7fa3455ff700 1 -- 172.21.15.116:0/3480731426 shutdown_connections 2023-05-12T09:08:09.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.419+0000 7fa3455ff700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa32006ace0 0x7fa32006d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.419+0000 7fa3455ff700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa3400cca30 0x7fa34015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.419+0000 7fa3455ff700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa34015d090 0x7fa3401f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.419+0000 7fa3455ff700 1 --2- 172.21.15.116:0/3480731426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa34015d460 0x7fa340155960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.420+0000 7fa3455ff700 1 -- 172.21.15.116:0/3480731426 >> 172.21.15.116:0/3480731426 conn(0x7fa340071b10 msgr2=0x7fa3400b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:09.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.420+0000 7fa3455ff700 1 -- 172.21.15.116:0/3480731426 shutdown_connections 2023-05-12T09:08:09.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.420+0000 7fa3455ff700 1 -- 172.21.15.116:0/3480731426 wait complete. 2023-05-12T09:08:09.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:09.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.624+0000 7f09ea3ff700 1 Processor -- start 2023-05-12T09:08:09.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.625+0000 7f09ea3ff700 1 -- start start 2023-05-12T09:08:09.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09ea3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 0x7f09e4160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09ea3ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f09e40cf010 0x7f09e40cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09ea3ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f09e40cfd80 0x7f09e40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09ea3ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e40cd520 con 0x7f09e40cfd80 2023-05-12T09:08:09.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09ea3ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e40d2640 con 0x7f09e40cf010 2023-05-12T09:08:09.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09ea3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e41610d0 con 0x7f09e415c590 2023-05-12T09:08:09.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09e899c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f09e40cfd80 0x7f09e40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09e899c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f09e40cfd80 0x7f09e40d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39716/0 (socket says 172.21.15.116:39716) 2023-05-12T09:08:09.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09e899c700 1 -- 172.21.15.116:0/2410702099 learned_addr learned my addr 172.21.15.116:0/2410702099 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:09.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09e37fe700 1 --2- 172.21.15.116:0/2410702099 >> v2:172.21.15.182:3300/0 conn(0x7f09e40cf010 0x7f09e40cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.626+0000 7f09e3fff700 1 --2- 172.21.15.116:0/2410702099 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 0x7f09e4160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.627+0000 7f09e899c700 1 -- 172.21.15.116:0/2410702099 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 msgr2=0x7f09e4160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:09.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.627+0000 7f09e899c700 1 --2- 172.21.15.116:0/2410702099 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 0x7f09e4160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.627+0000 7f09e899c700 1 -- 172.21.15.116:0/2410702099 >> v2:172.21.15.182:3300/0 conn(0x7f09e40cf010 msgr2=0x7f09e40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:09.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.627+0000 7f09e899c700 1 --2- 172.21.15.116:0/2410702099 >> v2:172.21.15.182:3300/0 conn(0x7f09e40cf010 0x7f09e40cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.627+0000 7f09e899c700 1 -- 172.21.15.116:0/2410702099 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40d0200 con 0x7f09e40cfd80 2023-05-12T09:08:09.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.627+0000 7f09e899c700 1 --2- 172.21.15.116:0/2410702099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 0x7f09e40d0aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09e40d3f90 tx=0x7f09dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ed4af26df4178b server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:09.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.627+0000 7f09e2ffd700 1 -- 172.21.15.116:0/2410702099 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00e070 con 0x7f09e40cfd80 2023-05-12T09:08:09.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.627+0000 7f09e2ffd700 1 -- 172.21.15.116:0/2410702099 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc00b9c0 con 0x7f09e40cfd80 2023-05-12T09:08:09.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.627+0000 7f09e2ffd700 1 -- 172.21.15.116:0/2410702099 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00bd70 con 0x7f09e40cfd80 2023-05-12T09:08:09.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.628+0000 7f09ea3ff700 1 -- 172.21.15.116:0/2410702099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 msgr2=0x7f09e40d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.628+0000 7f09ea3ff700 1 --2- 172.21.15.116:0/2410702099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 0x7f09e40d0aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09e40d3f90 tx=0x7f09dc00b330 comp rx=0 tx=0).stop 2023-05-12T09:08:09.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.628+0000 7f09ea3ff700 1 -- 172.21.15.116:0/2410702099 shutdown_connections 2023-05-12T09:08:09.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.628+0000 7f09ea3ff700 1 --2- 172.21.15.116:0/2410702099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 0x7f09e40d0aa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.628+0000 7f09ea3ff700 1 --2- 172.21.15.116:0/2410702099 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 0x7f09e4160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.628+0000 7f09ea3ff700 1 --2- 172.21.15.116:0/2410702099 >> v2:172.21.15.182:3300/0 conn(0x7f09e40cf010 0x7f09e40cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.628+0000 7f09ea3ff700 1 -- 172.21.15.116:0/2410702099 >> 172.21.15.116:0/2410702099 conn(0x7f09e4071b10 msgr2=0x7f09e4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:09.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.628+0000 7f09ea3ff700 1 -- 172.21.15.116:0/2410702099 shutdown_connections 2023-05-12T09:08:09.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.628+0000 7f09ea3ff700 1 -- 172.21.15.116:0/2410702099 wait complete. 2023-05-12T09:08:09.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.629+0000 7f09ea3ff700 1 Processor -- start 2023-05-12T09:08:09.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.630+0000 7f09ea3ff700 1 -- start start 2023-05-12T09:08:09.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.630+0000 7f09ea3ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f09e40cf010 0x7f09e4155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.630+0000 7f09ea3ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 0x7f09e40b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.630+0000 7f09ea3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 0x7f09e41f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.630+0000 7f09ea3ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4155a60 con 0x7f09e40cfd80 2023-05-12T09:08:09.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.630+0000 7f09ea3ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40b7680 con 0x7f09e40cf010 2023-05-12T09:08:09.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.630+0000 7f09ea3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40b7960 con 0x7f09e415c590 2023-05-12T09:08:09.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e37fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 0x7f09e40b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e37fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 0x7f09e40b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39728/0 (socket says 172.21.15.116:39728) 2023-05-12T09:08:09.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e37fe700 1 -- 172.21.15.116:0/3693515637 learned_addr learned my addr 172.21.15.116:0/3693515637 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:09.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e3fff700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f09e40cf010 0x7f09e4155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e899c700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 0x7f09e41f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e37fe700 1 -- 172.21.15.116:0/3693515637 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 msgr2=0x7f09e41f32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e37fe700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 0x7f09e41f32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e37fe700 1 -- 172.21.15.116:0/3693515637 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f09e40cf010 msgr2=0x7f09e4155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e37fe700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f09e40cf010 0x7f09e4155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e37fe700 1 -- 172.21.15.116:0/3693515637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc009b30 con 0x7f09e40cfd80 2023-05-12T09:08:09.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e899c700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 0x7f09e41f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:09.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.631+0000 7f09e37fe700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 0x7f09e40b6d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09d800e810 tx=0x7f09d800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:09.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.632+0000 7f09e0ff9700 1 -- 172.21.15.116:0/3693515637 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8013610 con 0x7f09e40cfd80 2023-05-12T09:08:09.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.632+0000 7f09e0ff9700 1 -- 172.21.15.116:0/3693515637 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d8013770 con 0x7f09e40cfd80 2023-05-12T09:08:09.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.632+0000 7f09e0ff9700 1 -- 172.21.15.116:0/3693515637 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8013b20 con 0x7f09e40cfd80 2023-05-12T09:08:09.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.632+0000 7f09ea3ff700 1 -- 172.21.15.116:0/3693515637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e40cf560 con 0x7f09e40cfd80 2023-05-12T09:08:09.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.632+0000 7f09ea3ff700 1 -- 172.21.15.116:0/3693515637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e40b23c0 con 0x7f09e40cfd80 2023-05-12T09:08:09.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.633+0000 7f09ea3ff700 1 -- 172.21.15.116:0/3693515637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e40cd750 con 0x7f09e40cfd80 2023-05-12T09:08:09.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.634+0000 7f09e0ff9700 1 -- 172.21.15.116:0/3693515637 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09d8013c80 con 0x7f09e40cfd80 2023-05-12T09:08:09.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.635+0000 7f09e0ff9700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09d006ace0 0x7f09d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:09.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.635+0000 7f09e0ff9700 1 -- 172.21.15.116:0/3693515637 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f09d8089400 con 0x7f09e40cfd80 2023-05-12T09:08:09.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.635+0000 7f09e3fff700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09d006ace0 0x7f09d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:09.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.636+0000 7f09e3fff700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09d006ace0 0x7f09d006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f09e40d07a0 tx=0x7f09d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:09.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.640+0000 7f09e0ff9700 1 -- 172.21.15.116:0/3693515637 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f09d8057c20 con 0x7f09e40cfd80 2023-05-12T09:08:09.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.833+0000 7f09ea3ff700 1 -- 172.21.15.116:0/3693515637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09e40b51f0 con 0x7f09e40cfd80 2023-05-12T09:08:09.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.834+0000 7f09e0ff9700 1 -- 172.21.15.116:0/3693515637 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f09d80577b0 con 0x7f09e40cfd80 2023-05-12T09:08:09.837 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:09.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 -- 172.21.15.116:0/3693515637 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09d006ace0 msgr2=0x7f09d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09d006ace0 0x7f09d006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f09e40d07a0 tx=0x7f09d4008040 comp rx=0 tx=0).stop 2023-05-12T09:08:09.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 -- 172.21.15.116:0/3693515637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 msgr2=0x7f09e40b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:09.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 0x7f09e40b6d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09d800e810 tx=0x7f09d800eb20 comp rx=0 tx=0).stop 2023-05-12T09:08:09.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 -- 172.21.15.116:0/3693515637 shutdown_connections 2023-05-12T09:08:09.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09d006ace0 0x7f09d006d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f09e415c590 0x7f09e41f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f09e40cf010 0x7f09e4155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 --2- 172.21.15.116:0/3693515637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09e40cfd80 0x7f09e40b6d50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:09.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 -- 172.21.15.116:0/3693515637 >> 172.21.15.116:0/3693515637 conn(0x7f09e4071b10 msgr2=0x7f09e4160180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:09.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 -- 172.21.15.116:0/3693515637 shutdown_connections 2023-05-12T09:08:09.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:09.836+0000 7f09ea3ff700 1 -- 172.21.15.116:0/3693515637 wait complete. 2023-05-12T09:08:09.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:09.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:08:09.993 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:08:10.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.043+0000 7f42cffff700 1 Processor -- start 2023-05-12T09:08:10.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.043+0000 7f42cffff700 1 -- start start 2023-05-12T09:08:10.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.045+0000 7f42cffff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f42c80cd520 0x7f42c80cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.045+0000 7f42cffff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c815d660 con 0x7f42c80cfe20 2023-05-12T09:08:10.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.045+0000 7f42cffff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c815cd70 con 0x7f42c815a140 2023-05-12T09:08:10.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.045+0000 7f42cffff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c80d02a0 con 0x7f42c80cd520 2023-05-12T09:08:10.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.045+0000 7f42cd59a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f42c80cd520 0x7f42c80cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.045+0000 7f42ce59c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f42c80cfe20 0x7f42c80b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:44378/0 (socket says 172.21.15.116:44378) 2023-05-12T09:08:10.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.045+0000 7f42ce59c700 1 -- 172.21.15.116:0/1005045624 learned_addr learned my addr 172.21.15.116:0/1005045624 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:10.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.045+0000 7f42ccd99700 1 -- 172.21.15.116:0/1005045624 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381494119 0 0) 0x7f42c815d660 con 0x7f42c80cfe20 2023-05-12T09:08:10.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.046+0000 7f42ccd99700 1 -- 172.21.15.116:0/1005045624 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b40035b0 con 0x7f42c80cfe20 2023-05-12T09:08:10.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.046+0000 7f42cd59a700 1 -- 172.21.15.116:0/1005045624 >> v1:172.21.15.182:6789/0 conn(0x7f42c815a140 legacy=0x7f42c8160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.046+0000 7f42cd59a700 1 -- 172.21.15.116:0/1005045624 >> v1:172.21.15.116:6789/0 conn(0x7f42c80cfe20 legacy=0x7f42c80b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.046+0000 7f42cd59a700 1 -- 172.21.15.116:0/1005045624 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c815d010 con 0x7f42c80cd520 2023-05-12T09:08:10.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.046+0000 7f42cd59a700 1 --2- 172.21.15.116:0/1005045624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cd520 0x7f42c80cf8e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009840 tx=0x7f42b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d729606a60bca3 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:10.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.046+0000 7f42ccd99700 1 -- 172.21.15.116:0/1005045624 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8011830 con 0x7f42c80cd520 2023-05-12T09:08:10.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.046+0000 7f42ccd99700 1 -- 172.21.15.116:0/1005045624 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b8011990 con 0x7f42c80cd520 2023-05-12T09:08:10.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.046+0000 7f42ccd99700 1 -- 172.21.15.116:0/1005045624 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8011d20 con 0x7f42c80cd520 2023-05-12T09:08:10.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.047+0000 7f42cffff700 1 -- 172.21.15.116:0/1005045624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cd520 msgr2=0x7f42c80cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.047+0000 7f42cffff700 1 --2- 172.21.15.116:0/1005045624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cd520 0x7f42c80cf8e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009840 tx=0x7f42b8009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:10.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.047+0000 7f42cffff700 1 -- 172.21.15.116:0/1005045624 shutdown_connections 2023-05-12T09:08:10.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.047+0000 7f42cffff700 1 --2- 172.21.15.116:0/1005045624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cd520 0x7f42c80cf8e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.047+0000 7f42cffff700 1 -- 172.21.15.116:0/1005045624 >> 172.21.15.116:0/1005045624 conn(0x7f42c8071b10 msgr2=0x7f42c8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:10.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.047+0000 7f42cffff700 1 -- 172.21.15.116:0/1005045624 shutdown_connections 2023-05-12T09:08:10.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.047+0000 7f42cffff700 1 -- 172.21.15.116:0/1005045624 wait complete. 2023-05-12T09:08:10.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.049+0000 7f42cffff700 1 Processor -- start 2023-05-12T09:08:10.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.049+0000 7f42cffff700 1 -- start start 2023-05-12T09:08:10.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cffff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42c80cd520 0x7f42c8150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cfe20 0x7f42c80cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cffff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42c815a140 0x7f42c80ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cffff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8150ed0 con 0x7f42c80cfe20 2023-05-12T09:08:10.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cffff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80d0b00 con 0x7f42c815a140 2023-05-12T09:08:10.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cffff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80c9fa0 con 0x7f42c80cd520 2023-05-12T09:08:10.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cd59a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cfe20 0x7f42c80cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cd59a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cfe20 0x7f42c80cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39738/0 (socket says 172.21.15.116:39738) 2023-05-12T09:08:10.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cd59a700 1 -- 172.21.15.116:0/4219276467 learned_addr learned my addr 172.21.15.116:0/4219276467 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:10.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cdd9b700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42c80cd520 0x7f42c8150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42ce59c700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42c815a140 0x7f42c80ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cd59a700 1 -- 172.21.15.116:0/4219276467 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42c80cd520 msgr2=0x7f42c8150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cd59a700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42c80cd520 0x7f42c8150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cd59a700 1 -- 172.21.15.116:0/4219276467 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42c815a140 msgr2=0x7f42c80ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cd59a700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42c815a140 0x7f42c80ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42cd59a700 1 -- 172.21.15.116:0/4219276467 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b80094a0 con 0x7f42c80cfe20 2023-05-12T09:08:10.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.051+0000 7f42ce59c700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42c815a140 0x7f42c80ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:10.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.052+0000 7f42cd59a700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cfe20 0x7f42c80cc820 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009fd0 tx=0x7f42b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:10.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.052+0000 7f42be7fc700 1 -- 172.21.15.116:0/4219276467 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80036a0 con 0x7f42c80cfe20 2023-05-12T09:08:10.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.052+0000 7f42be7fc700 1 -- 172.21.15.116:0/4219276467 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b801f070 con 0x7f42c80cfe20 2023-05-12T09:08:10.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.052+0000 7f42cffff700 1 -- 172.21.15.116:0/4219276467 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c815daf0 con 0x7f42c80cfe20 2023-05-12T09:08:10.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.052+0000 7f42be7fc700 1 -- 172.21.15.116:0/4219276467 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8003a20 con 0x7f42c80cfe20 2023-05-12T09:08:10.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.052+0000 7f42cffff700 1 -- 172.21.15.116:0/4219276467 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c815d2f0 con 0x7f42c80cfe20 2023-05-12T09:08:10.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.053+0000 7f42cffff700 1 -- 172.21.15.116:0/4219276467 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c80cdb00 con 0x7f42c80cfe20 2023-05-12T09:08:10.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.054+0000 7f42be7fc700 1 -- 172.21.15.116:0/4219276467 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f42b8003b80 con 0x7f42c80cfe20 2023-05-12T09:08:10.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.055+0000 7f42be7fc700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f42ac06ace0 0x7f42ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.055+0000 7f42be7fc700 1 -- 172.21.15.116:0/4219276467 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f42b8021070 con 0x7f42c80cfe20 2023-05-12T09:08:10.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.055+0000 7f42cdd9b700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f42ac06ace0 0x7f42ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.056+0000 7f42cdd9b700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f42ac06ace0 0x7f42ac06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f42c4007fd0 tx=0x7f42c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:10.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.059+0000 7f42be7fc700 1 -- 172.21.15.116:0/4219276467 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f42b8055de0 con 0x7f42c80cfe20 2023-05-12T09:08:10.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.254+0000 7f42cffff700 1 -- 172.21.15.116:0/4219276467 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42c80b51f0 con 0x7f42c80cfe20 2023-05-12T09:08:10.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.255+0000 7f42be7fc700 1 -- 172.21.15.116:0/4219276467 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42b80150a0 con 0x7f42c80cfe20 2023-05-12T09:08:10.258 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:10.260 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 -- 172.21.15.116:0/4219276467 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f42ac06ace0 msgr2=0x7f42ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.260 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f42ac06ace0 0x7f42ac06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f42c4007fd0 tx=0x7f42c4009040 comp rx=0 tx=0).stop 2023-05-12T09:08:10.260 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 -- 172.21.15.116:0/4219276467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cfe20 msgr2=0x7f42c80cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cfe20 0x7f42c80cc820 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009fd0 tx=0x7f42b8004750 comp rx=0 tx=0).stop 2023-05-12T09:08:10.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 -- 172.21.15.116:0/4219276467 shutdown_connections 2023-05-12T09:08:10.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42c815a140 0x7f42c80ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f42ac06ace0 0x7f42ac06d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42c80cd520 0x7f42c8150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 --2- 172.21.15.116:0/4219276467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42c80cfe20 0x7f42c80cc820 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 -- 172.21.15.116:0/4219276467 >> 172.21.15.116:0/4219276467 conn(0x7f42c8071b10 msgr2=0x7f42c80cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:10.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 -- 172.21.15.116:0/4219276467 shutdown_connections 2023-05-12T09:08:10.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.257+0000 7f42cffff700 1 -- 172.21.15.116:0/4219276467 wait complete. 2023-05-12T09:08:10.277 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:10.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.461+0000 7fc60bfff700 1 Processor -- start 2023-05-12T09:08:10.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.461+0000 7fc60bfff700 1 -- start start 2023-05-12T09:08:10.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.462+0000 7fc60bfff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc60415c590 0x7fc604160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.462+0000 7fc60bfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 0x7fc6040cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.463+0000 7fc60bfff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040cd520 con 0x7fc6040cfd80 2023-05-12T09:08:10.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.463+0000 7fc60bfff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040d2640 con 0x7fc60415c590 2023-05-12T09:08:10.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.463+0000 7fc60bfff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6041610d0 con 0x7fc6040cf010 2023-05-12T09:08:10.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.463+0000 7fc60959a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 0x7fc6040cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.463+0000 7fc60959a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 0x7fc6040cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:56204/0 (socket says 172.21.15.116:56204) 2023-05-12T09:08:10.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.463+0000 7fc60959a700 1 -- 172.21.15.116:0/3057597534 learned_addr learned my addr 172.21.15.116:0/3057597534 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:10.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.463+0000 7fc609d9b700 1 --2- 172.21.15.116:0/3057597534 >> v2:172.21.15.182:3300/0 conn(0x7fc60415c590 0x7fc604160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.463+0000 7fc60959a700 1 -- 172.21.15.116:0/3057597534 >> v2:172.21.15.182:3300/0 conn(0x7fc60415c590 msgr2=0x7fc604160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:10.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.463+0000 7fc60959a700 1 --2- 172.21.15.116:0/3057597534 >> v2:172.21.15.182:3300/0 conn(0x7fc60415c590 0x7fc604160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.463+0000 7fc60959a700 1 -- 172.21.15.116:0/3057597534 >> v1:172.21.15.182:6789/0 conn(0x7fc6040cfd80 legacy=0x7fc6040d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.464+0000 7fc60959a700 1 -- 172.21.15.116:0/3057597534 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040d0200 con 0x7fc6040cf010 2023-05-12T09:08:10.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.464+0000 7fc60959a700 1 --2- 172.21.15.116:0/3057597534 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 0x7fc6040cf840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40098f0 tx=0x7fc5f4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f325ac180ff7d27b server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:10.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.464+0000 7fc608d99700 1 -- 172.21.15.116:0/3057597534 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4011830 con 0x7fc6040cf010 2023-05-12T09:08:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.464+0000 7fc608d99700 1 -- 172.21.15.116:0/3057597534 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f4011990 con 0x7fc6040cf010 2023-05-12T09:08:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.464+0000 7fc608d99700 1 -- 172.21.15.116:0/3057597534 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4011d20 con 0x7fc6040cf010 2023-05-12T09:08:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.465+0000 7fc60bfff700 1 -- 172.21.15.116:0/3057597534 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 msgr2=0x7fc6040cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.465+0000 7fc60bfff700 1 --2- 172.21.15.116:0/3057597534 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 0x7fc6040cf840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40098f0 tx=0x7fc5f4009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:10.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.465+0000 7fc60bfff700 1 -- 172.21.15.116:0/3057597534 shutdown_connections 2023-05-12T09:08:10.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.465+0000 7fc60bfff700 1 --2- 172.21.15.116:0/3057597534 >> v2:172.21.15.182:3300/0 conn(0x7fc60415c590 0x7fc604160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.465+0000 7fc60bfff700 1 --2- 172.21.15.116:0/3057597534 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 0x7fc6040cf840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.465+0000 7fc60bfff700 1 -- 172.21.15.116:0/3057597534 >> 172.21.15.116:0/3057597534 conn(0x7fc604071b10 msgr2=0x7fc604071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:10.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.465+0000 7fc60bfff700 1 -- 172.21.15.116:0/3057597534 shutdown_connections 2023-05-12T09:08:10.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.465+0000 7fc60bfff700 1 -- 172.21.15.116:0/3057597534 wait complete. 2023-05-12T09:08:10.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.466+0000 7fc60bfff700 1 Processor -- start 2023-05-12T09:08:10.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.467+0000 7fc60bfff700 1 -- start start 2023-05-12T09:08:10.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.467+0000 7fc60bfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 0x7fc6041f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.467+0000 7fc60bfff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc6040cfd80 0x7fc6040b7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.467+0000 7fc60bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60415c590 0x7fc6040b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.467+0000 7fc60bfff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040b6da0 con 0x7fc60415c590 2023-05-12T09:08:10.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.467+0000 7fc60bfff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040b7ce0 con 0x7fc6040cfd80 2023-05-12T09:08:10.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.467+0000 7fc60bfff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040c6a00 con 0x7fc6040cf010 2023-05-12T09:08:10.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.468+0000 7fc60a59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60415c590 0x7fc6040b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.468+0000 7fc60959a700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc6040cfd80 0x7fc6040b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.468+0000 7fc609d9b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 0x7fc6041f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.468+0000 7fc60a59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60415c590 0x7fc6040b6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39742/0 (socket says 172.21.15.116:39742) 2023-05-12T09:08:10.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.468+0000 7fc60a59c700 1 -- 172.21.15.116:0/3289025424 learned_addr learned my addr 172.21.15.116:0/3289025424 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:10.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.468+0000 7fc60a59c700 1 -- 172.21.15.116:0/3289025424 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 msgr2=0x7fc6041f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.468+0000 7fc60a59c700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 0x7fc6041f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.468+0000 7fc60a59c700 1 -- 172.21.15.116:0/3289025424 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc6040cfd80 msgr2=0x7fc6040b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.468+0000 7fc60a59c700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc6040cfd80 0x7fc6040b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.468+0000 7fc60a59c700 1 -- 172.21.15.116:0/3289025424 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4009550 con 0x7fc60415c590 2023-05-12T09:08:10.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.469+0000 7fc60a59c700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60415c590 0x7fc6040b6860 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00cc50 tx=0x7fc5fc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:10.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.469+0000 7fc5fa7fc700 1 -- 172.21.15.116:0/3289025424 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc003c00 con 0x7fc60415c590 2023-05-12T09:08:10.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.469+0000 7fc5fa7fc700 1 -- 172.21.15.116:0/3289025424 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc003d60 con 0x7fc60415c590 2023-05-12T09:08:10.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.469+0000 7fc5fa7fc700 1 -- 172.21.15.116:0/3289025424 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00aab0 con 0x7fc60415c590 2023-05-12T09:08:10.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.469+0000 7fc60bfff700 1 -- 172.21.15.116:0/3289025424 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6040cf560 con 0x7fc60415c590 2023-05-12T09:08:10.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.469+0000 7fc60bfff700 1 -- 172.21.15.116:0/3289025424 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6040b23c0 con 0x7fc60415c590 2023-05-12T09:08:10.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.470+0000 7fc60bfff700 1 -- 172.21.15.116:0/3289025424 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6040cd770 con 0x7fc60415c590 2023-05-12T09:08:10.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.471+0000 7fc5fa7fc700 1 -- 172.21.15.116:0/3289025424 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5fc00ac10 con 0x7fc60415c590 2023-05-12T09:08:10.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.472+0000 7fc5fa7fc700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5e806ace0 0x7fc5e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.472+0000 7fc5fa7fc700 1 -- 172.21.15.116:0/3289025424 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc5fc089740 con 0x7fc60415c590 2023-05-12T09:08:10.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.472+0000 7fc609d9b700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5e806ace0 0x7fc5e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.473+0000 7fc609d9b700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5e806ace0 0x7fc5e806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc600009b40 tx=0x7fc600009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:10.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.477+0000 7fc5fa7fc700 1 -- 172.21.15.116:0/3289025424 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc5fc0544c0 con 0x7fc60415c590 2023-05-12T09:08:10.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.677+0000 7fc60bfff700 1 -- 172.21.15.116:0/3289025424 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc6040b51f0 con 0x7fc60415c590 2023-05-12T09:08:10.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.677+0000 7fc5fa7fc700 1 -- 172.21.15.116:0/3289025424 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc5fc057ae0 con 0x7fc60415c590 2023-05-12T09:08:10.680 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:10.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.679+0000 7fc60bfff700 1 -- 172.21.15.116:0/3289025424 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5e806ace0 msgr2=0x7fc5e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.679+0000 7fc60bfff700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5e806ace0 0x7fc5e806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc600009b40 tx=0x7fc600009210 comp rx=0 tx=0).stop 2023-05-12T09:08:10.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.679+0000 7fc60bfff700 1 -- 172.21.15.116:0/3289025424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60415c590 msgr2=0x7fc6040b6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.679+0000 7fc60bfff700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60415c590 0x7fc6040b6860 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00cc50 tx=0x7fc5fc00cf60 comp rx=0 tx=0).stop 2023-05-12T09:08:10.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.679+0000 7fc60bfff700 1 -- 172.21.15.116:0/3289025424 shutdown_connections 2023-05-12T09:08:10.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.679+0000 7fc60bfff700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60415c590 0x7fc6040b6860 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.679+0000 7fc60bfff700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5e806ace0 0x7fc5e806d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.679+0000 7fc60bfff700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc6040cf010 0x7fc6041f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.679+0000 7fc60bfff700 1 --2- 172.21.15.116:0/3289025424 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc6040cfd80 0x7fc6040b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.680+0000 7fc60bfff700 1 -- 172.21.15.116:0/3289025424 >> 172.21.15.116:0/3289025424 conn(0x7fc604071b10 msgr2=0x7fc6040d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:10.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.680+0000 7fc60bfff700 1 -- 172.21.15.116:0/3289025424 shutdown_connections 2023-05-12T09:08:10.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.680+0000 7fc60bfff700 1 -- 172.21.15.116:0/3289025424 wait complete. 2023-05-12T09:08:10.700 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:10.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.881+0000 7f3b013ff700 1 Processor -- start 2023-05-12T09:08:10.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.881+0000 7f3b013ff700 1 -- start start 2023-05-12T09:08:10.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.882+0000 7f3b013ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15c590 0x7f3afc160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.882+0000 7f3b013ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3afc0cd520 con 0x7f3afc0cff50 2023-05-12T09:08:10.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.882+0000 7f3b013ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3afc0d2640 con 0x7f3afc0cf010 2023-05-12T09:08:10.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.882+0000 7f3b013ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1610d0 con 0x7f3afc15c590 2023-05-12T09:08:10.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3afb7fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f3afc0cff50 0x7f3afc0d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:44386/0 (socket says 172.21.15.116:44386) 2023-05-12T09:08:10.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3afb7fe700 1 -- 172.21.15.116:0/2083464330 learned_addr learned my addr 172.21.15.116:0/2083464330 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:10.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3afaffd700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15c590 0x7f3afc160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543360148 0 0) 0x7f3afc0cd520 con 0x7f3afc0cff50 2023-05-12T09:08:10.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae40035b0 con 0x7f3afc0cff50 2023-05-12T09:08:10.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961007667 0 0) 0x7f3afc0d2640 con 0x7f3afc0cf010 2023-05-12T09:08:10.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3afc0cd520 con 0x7f3afc0cf010 2023-05-12T09:08:10.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3690025734 0 0) 0x7f3ae40035b0 con 0x7f3afc0cff50 2023-05-12T09:08:10.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15c590 msgr2=0x7f3afc160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:10.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15c590 0x7f3afc160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 >> v1:172.21.15.182:6789/0 conn(0x7f3afc0cf010 legacy=0x7f3afc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc0b23c0 con 0x7f3afc0cff50 2023-05-12T09:08:10.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f3af40019f0 con 0x7f3afc0cff50 2023-05-12T09:08:10.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.883+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 >> v1:172.21.15.116:6789/0 conn(0x7f3afc0cff50 legacy=0x7f3afc0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3af9ffb700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15c590 0x7f3ae4003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3af9ffb700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3ae4004120 0x7f3ae4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3af9ffb700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ae4004d90 0x7f3ae4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1610d0 con 0x7f3ae4004d90 2023-05-12T09:08:10.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae400bac0 con 0x7f3ae4004120 2023-05-12T09:08:10.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae400bc80 con 0x7f3afc15c590 2023-05-12T09:08:10.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3afb7fe700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ae4004d90 0x7f3ae4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3afaffd700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15c590 0x7f3ae4003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3afa7fc700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3ae4004120 0x7f3ae4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3afb7fe700 1 -- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15c590 msgr2=0x7f3ae4003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:10.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3afb7fe700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15c590 0x7f3ae4003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3afb7fe700 1 -- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3ae4004120 msgr2=0x7f3ae4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:10.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3afb7fe700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3ae4004120 0x7f3ae4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3afb7fe700 1 -- 172.21.15.116:0/2083464330 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae40035b0 con 0x7f3ae4004d90 2023-05-12T09:08:10.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3afa7fc700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3ae4004120 0x7f3ae4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:10.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.884+0000 7f3afaffd700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15c590 0x7f3ae4003bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:10.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3afb7fe700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ae4004d90 0x7f3ae4005200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3af4002230 tx=0x7f3ae4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3cbf98f59c1169 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:10.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af40072d0 con 0x7f3ae4004d90 2023-05-12T09:08:10.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af4007430 con 0x7f3ae4004d90 2023-05-12T09:08:10.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3af9ffb700 1 -- 172.21.15.116:0/2083464330 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af40077c0 con 0x7f3ae4004d90 2023-05-12T09:08:10.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3b013ff700 1 -- 172.21.15.116:0/2083464330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ae4004d90 msgr2=0x7f3ae4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3b013ff700 1 --2- 172.21.15.116:0/2083464330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ae4004d90 0x7f3ae4005200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3af4002230 tx=0x7f3ae4005880 comp rx=0 tx=0).stop 2023-05-12T09:08:10.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3afb7fe700 1 -- 172.21.15.116:0/2083464330 reap_dead start 2023-05-12T09:08:10.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3b013ff700 1 -- 172.21.15.116:0/2083464330 shutdown_connections 2023-05-12T09:08:10.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3b013ff700 1 -- 172.21.15.116:0/2083464330 >> 172.21.15.116:0/2083464330 conn(0x7f3afc071b10 msgr2=0x7f3afc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:10.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3b013ff700 1 -- 172.21.15.116:0/2083464330 shutdown_connections 2023-05-12T09:08:10.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.885+0000 7f3b013ff700 1 -- 172.21.15.116:0/2083464330 wait complete. 2023-05-12T09:08:10.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.887+0000 7f3b013ff700 1 Processor -- start 2023-05-12T09:08:10.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.887+0000 7f3b013ff700 1 -- start start 2023-05-12T09:08:10.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.888+0000 7f3b013ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15b3d0 0x7f3afc0c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.888+0000 7f3b013ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3afc15b7a0 0x7f3afc0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.888+0000 7f3b013ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3afc0b5d00 0x7f3afc0cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.888+0000 7f3b013ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0c98a0 con 0x7f3afc0b5d00 2023-05-12T09:08:10.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.888+0000 7f3b013ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0c9080 con 0x7f3afc15b7a0 2023-05-12T09:08:10.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.888+0000 7f3b013ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0b6200 con 0x7f3afc15b3d0 2023-05-12T09:08:10.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.888+0000 7f3afb7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3afc0b5d00 0x7f3afc0cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.888+0000 7f3afb7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3afc0b5d00 0x7f3afc0cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39754/0 (socket says 172.21.15.116:39754) 2023-05-12T09:08:10.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.888+0000 7f3afb7fe700 1 -- 172.21.15.116:0/3855711999 learned_addr learned my addr 172.21.15.116:0/3855711999 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:10.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3afb7fe700 1 -- 172.21.15.116:0/3855711999 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15b3d0 msgr2=0x7f3afc0c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3afb7fe700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15b3d0 0x7f3afc0c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3afa7fc700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3afc15b7a0 0x7f3afc0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3afb7fe700 1 -- 172.21.15.116:0/3855711999 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3afc15b7a0 msgr2=0x7f3afc0cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:10.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3afb7fe700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3afc15b7a0 0x7f3afc0cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:10.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3afb7fe700 1 -- 172.21.15.116:0/3855711999 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc0cd770 con 0x7f3afc0b5d00 2023-05-12T09:08:10.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3afa7fc700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3afc15b7a0 0x7f3afc0cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:10.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3afb7fe700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3afc0b5d00 0x7f3afc0cba00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3af4000f80 tx=0x7f3af4001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:10.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3ae37fe700 1 -- 172.21.15.116:0/3855711999 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af401f630 con 0x7f3afc0b5d00 2023-05-12T09:08:10.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3ae37fe700 1 -- 172.21.15.116:0/3855711999 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af401f790 con 0x7f3afc0b5d00 2023-05-12T09:08:10.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3b013ff700 1 -- 172.21.15.116:0/3855711999 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc0cf560 con 0x7f3afc0b5d00 2023-05-12T09:08:10.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3ae37fe700 1 -- 172.21.15.116:0/3855711999 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af401fb20 con 0x7f3afc0b5d00 2023-05-12T09:08:10.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.889+0000 7f3b013ff700 1 -- 172.21.15.116:0/3855711999 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc15c960 con 0x7f3afc0b5d00 2023-05-12T09:08:10.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.890+0000 7f3b013ff700 1 -- 172.21.15.116:0/3855711999 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc0c9c60 con 0x7f3afc0b5d00 2023-05-12T09:08:10.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.891+0000 7f3ae37fe700 1 -- 172.21.15.116:0/3855711999 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3af401fc80 con 0x7f3afc0b5d00 2023-05-12T09:08:10.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.892+0000 7f3ae37fe700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3ae806ace0 0x7f3ae806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:10.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.892+0000 7f3ae37fe700 1 -- 172.21.15.116:0/3855711999 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3af408b140 con 0x7f3afc0b5d00 2023-05-12T09:08:10.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.892+0000 7f3afaffd700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3ae806ace0 0x7f3ae806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:10.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.893+0000 7f3afaffd700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3ae806ace0 0x7f3ae806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009b70 tx=0x7f3aec009630 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:10.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:10.897+0000 7f3ae37fe700 1 -- 172.21.15.116:0/3855711999 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3af4055fd0 con 0x7f3afc0b5d00 2023-05-12T09:08:11.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.091+0000 7f3b013ff700 1 -- 172.21.15.116:0/3855711999 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3afc0b51f0 con 0x7f3afc0b5d00 2023-05-12T09:08:11.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.092+0000 7f3ae37fe700 1 -- 172.21.15.116:0/3855711999 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7f3af40595f0 con 0x7f3afc0b5d00 2023-05-12T09:08:11.095 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:11.096 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:11.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.094+0000 7f3b013ff700 1 -- 172.21.15.116:0/3855711999 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3ae806ace0 msgr2=0x7f3ae806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.094+0000 7f3b013ff700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3ae806ace0 0x7f3ae806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009b70 tx=0x7f3aec009630 comp rx=0 tx=0).stop 2023-05-12T09:08:11.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.094+0000 7f3b013ff700 1 -- 172.21.15.116:0/3855711999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3afc0b5d00 msgr2=0x7f3afc0cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.094+0000 7f3b013ff700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3afc0b5d00 0x7f3afc0cba00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3af4000f80 tx=0x7f3af4001d00 comp rx=0 tx=0).stop 2023-05-12T09:08:11.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.094+0000 7f3b013ff700 1 -- 172.21.15.116:0/3855711999 shutdown_connections 2023-05-12T09:08:11.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.094+0000 7f3b013ff700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3afc0b5d00 0x7f3afc0cba00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.094+0000 7f3b013ff700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3ae806ace0 0x7f3ae806d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.094+0000 7f3b013ff700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3afc15b3d0 0x7f3afc0c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.094+0000 7f3b013ff700 1 --2- 172.21.15.116:0/3855711999 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3afc15b7a0 0x7f3afc0cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.094+0000 7f3b013ff700 1 -- 172.21.15.116:0/3855711999 >> 172.21.15.116:0/3855711999 conn(0x7f3afc071b10 msgr2=0x7f3afc0d32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:11.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.095+0000 7f3b013ff700 1 -- 172.21.15.116:0/3855711999 shutdown_connections 2023-05-12T09:08:11.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.095+0000 7f3b013ff700 1 -- 172.21.15.116:0/3855711999 wait complete. 2023-05-12T09:08:11.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:11.116 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:11.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.300+0000 7ff2a45ff700 1 Processor -- start 2023-05-12T09:08:11.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.300+0000 7ff2a45ff700 1 -- start start 2023-05-12T09:08:11.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.301+0000 7ff2a45ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0cfbf0 0x7ff29c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.301+0000 7ff2a45ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff29c0d1100 0x7ff29c0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.301+0000 7ff2a45ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29c0d0020 con 0x7ff29c0b87a0 2023-05-12T09:08:11.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.301+0000 7ff2a45ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c0d02d0 con 0x7ff29c0d1100 2023-05-12T09:08:11.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.301+0000 7ff2a45ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0d0cb0 con 0x7ff29c0cfbf0 2023-05-12T09:08:11.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.301+0000 7ff2a2b9c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff29c0d1100 0x7ff29c0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.301+0000 7ff2a2b9c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff29c0d1100 0x7ff29c0d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39760/0 (socket says 172.21.15.116:39760) 2023-05-12T09:08:11.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.301+0000 7ff2a2b9c700 1 -- 172.21.15.116:0/167375871 learned_addr learned my addr 172.21.15.116:0/167375871 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:11.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.301+0000 7ff2a239b700 1 --1- 172.21.15.116:0/167375871 >> v1:172.21.15.116:6789/0 conn(0x7ff29c0b87a0 0x7ff29c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:44398/0 (socket says 172.21.15.116:44398) 2023-05-12T09:08:11.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.301+0000 7ff2a1b9a700 1 --2- 172.21.15.116:0/167375871 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0cfbf0 0x7ff29c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.302+0000 7ff2a2b9c700 1 -- 172.21.15.116:0/167375871 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0cfbf0 msgr2=0x7ff29c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:11.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.302+0000 7ff2a2b9c700 1 --2- 172.21.15.116:0/167375871 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0cfbf0 0x7ff29c1608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.302+0000 7ff2a2b9c700 1 -- 172.21.15.116:0/167375871 >> v1:172.21.15.116:6789/0 conn(0x7ff29c0b87a0 legacy=0x7ff29c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.302+0000 7ff2a2b9c700 1 -- 172.21.15.116:0/167375871 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c0cdc60 con 0x7ff29c0d1100 2023-05-12T09:08:11.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.302+0000 7ff2a1b9a700 1 --2- 172.21.15.116:0/167375871 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0cfbf0 0x7ff29c1608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:11.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.302+0000 7ff2a2b9c700 1 --2- 172.21.15.116:0/167375871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0d1100 0x7ff29c0d1580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff294009e50 tx=0x7ff29400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34c25246b078138 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:11.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.302+0000 7ff2a1399700 1 -- 172.21.15.116:0/167375871 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400e070 con 0x7ff29c0d1100 2023-05-12T09:08:11.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.302+0000 7ff2a1399700 1 -- 172.21.15.116:0/167375871 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29400b9c0 con 0x7ff29c0d1100 2023-05-12T09:08:11.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.302+0000 7ff2a1399700 1 -- 172.21.15.116:0/167375871 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400bd70 con 0x7ff29c0d1100 2023-05-12T09:08:11.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.303+0000 7ff2a45ff700 1 -- 172.21.15.116:0/167375871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0d1100 msgr2=0x7ff29c0d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.303+0000 7ff2a45ff700 1 --2- 172.21.15.116:0/167375871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0d1100 0x7ff29c0d1580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff294009e50 tx=0x7ff29400b330 comp rx=0 tx=0).stop 2023-05-12T09:08:11.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.303+0000 7ff2a45ff700 1 -- 172.21.15.116:0/167375871 shutdown_connections 2023-05-12T09:08:11.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.303+0000 7ff2a45ff700 1 --2- 172.21.15.116:0/167375871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0d1100 0x7ff29c0d1580 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.303+0000 7ff2a45ff700 1 --2- 172.21.15.116:0/167375871 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0cfbf0 0x7ff29c1608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.303+0000 7ff2a45ff700 1 -- 172.21.15.116:0/167375871 >> 172.21.15.116:0/167375871 conn(0x7ff29c071b10 msgr2=0x7ff29c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:11.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.303+0000 7ff2a45ff700 1 -- 172.21.15.116:0/167375871 shutdown_connections 2023-05-12T09:08:11.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.303+0000 7ff2a45ff700 1 -- 172.21.15.116:0/167375871 wait complete. 2023-05-12T09:08:11.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.304+0000 7ff2a45ff700 1 Processor -- start 2023-05-12T09:08:11.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.305+0000 7ff2a45ff700 1 -- start start 2023-05-12T09:08:11.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.305+0000 7ff2a45ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0b87a0 0x7ff29c1f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.305+0000 7ff2a45ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff29c0cfbf0 0x7ff29c15b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a45ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0d1100 0x7ff29c0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a45ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0c9f80 con 0x7ff29c0b87a0 2023-05-12T09:08:11.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a45ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c1f6340 con 0x7ff29c0cfbf0 2023-05-12T09:08:11.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a45ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15b750 con 0x7ff29c0d1100 2023-05-12T09:08:11.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a239b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0b87a0 0x7ff29c1f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a239b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0b87a0 0x7ff29c1f5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39766/0 (socket says 172.21.15.116:39766) 2023-05-12T09:08:11.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a239b700 1 -- 172.21.15.116:0/909284683 learned_addr learned my addr 172.21.15.116:0/909284683 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:11.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a1b9a700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff29c0cfbf0 0x7ff29c15b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a2b9c700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0d1100 0x7ff29c0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a239b700 1 -- 172.21.15.116:0/909284683 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0d1100 msgr2=0x7ff29c0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a239b700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0d1100 0x7ff29c0c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a239b700 1 -- 172.21.15.116:0/909284683 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff29c0cfbf0 msgr2=0x7ff29c15b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a239b700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff29c0cfbf0 0x7ff29c15b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a239b700 1 -- 172.21.15.116:0/909284683 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294009b30 con 0x7ff29c0b87a0 2023-05-12T09:08:11.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.306+0000 7ff2a239b700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0b87a0 0x7ff29c1f5e00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff29800c500 tx=0x7ff29800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:11.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.307+0000 7ff292ffd700 1 -- 172.21.15.116:0/909284683 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298005cb0 con 0x7ff29c0b87a0 2023-05-12T09:08:11.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.307+0000 7ff292ffd700 1 -- 172.21.15.116:0/909284683 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff298005e10 con 0x7ff29c0b87a0 2023-05-12T09:08:11.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.307+0000 7ff2a45ff700 1 -- 172.21.15.116:0/909284683 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c0cd980 con 0x7ff29c0b87a0 2023-05-12T09:08:11.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.307+0000 7ff292ffd700 1 -- 172.21.15.116:0/909284683 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980072d0 con 0x7ff29c0b87a0 2023-05-12T09:08:11.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.307+0000 7ff2a45ff700 1 -- 172.21.15.116:0/909284683 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c0cd6a0 con 0x7ff29c0b87a0 2023-05-12T09:08:11.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.308+0000 7ff2a45ff700 1 -- 172.21.15.116:0/909284683 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c160e30 con 0x7ff29c0b87a0 2023-05-12T09:08:11.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.309+0000 7ff292ffd700 1 -- 172.21.15.116:0/909284683 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff298007430 con 0x7ff29c0b87a0 2023-05-12T09:08:11.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.310+0000 7ff292ffd700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff28006ace0 0x7ff28006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.310+0000 7ff292ffd700 1 -- 172.21.15.116:0/909284683 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff298088b20 con 0x7ff29c0b87a0 2023-05-12T09:08:11.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.310+0000 7ff2a1b9a700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff28006ace0 0x7ff28006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.311+0000 7ff2a1b9a700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff28006ace0 0x7ff28006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff29c15e9d0 tx=0x7ff28c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:11.317 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.314+0000 7ff292ffd700 1 -- 172.21.15.116:0/909284683 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff298053940 con 0x7ff29c0b87a0 2023-05-12T09:08:11.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.506+0000 7ff2a45ff700 1 -- 172.21.15.116:0/909284683 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff29c074430 con 0x7ff29c0b87a0 2023-05-12T09:08:11.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.507+0000 7ff292ffd700 1 -- 172.21.15.116:0/909284683 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff298017020 con 0x7ff29c0b87a0 2023-05-12T09:08:11.510 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:11.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 -- 172.21.15.116:0/909284683 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff28006ace0 msgr2=0x7ff28006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff28006ace0 0x7ff28006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff29c15e9d0 tx=0x7ff28c008040 comp rx=0 tx=0).stop 2023-05-12T09:08:11.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 -- 172.21.15.116:0/909284683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0b87a0 msgr2=0x7ff29c1f5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0b87a0 0x7ff29c1f5e00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff29800c500 tx=0x7ff29800c8c0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 -- 172.21.15.116:0/909284683 shutdown_connections 2023-05-12T09:08:11.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff28006ace0 0x7ff28006d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff29c0d1100 0x7ff29c0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff29c0b87a0 0x7ff29c1f5e00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 --2- 172.21.15.116:0/909284683 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff29c0cfbf0 0x7ff29c15b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 -- 172.21.15.116:0/909284683 >> 172.21.15.116:0/909284683 conn(0x7ff29c071b10 msgr2=0x7ff29c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:11.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 -- 172.21.15.116:0/909284683 shutdown_connections 2023-05-12T09:08:11.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.509+0000 7ff2a45ff700 1 -- 172.21.15.116:0/909284683 wait complete. 2023-05-12T09:08:11.530 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:11.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.716+0000 7fb4c51ff700 1 Processor -- start 2023-05-12T09:08:11.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.717+0000 7fb4c51ff700 1 -- start start 2023-05-12T09:08:11.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4c51ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c00b87a0 0x7fb4c00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4c51ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb4c01601e0 0x7fb4c0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4c51ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c0160ff0 con 0x7fb4c0160b70 2023-05-12T09:08:11.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4c51ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c00d02d0 con 0x7fb4c01601e0 2023-05-12T09:08:11.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4c51ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00d0cb0 con 0x7fb4c00b87a0 2023-05-12T09:08:11.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4b7fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb4c01601e0 0x7fb4c0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4b7fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb4c01601e0 0x7fb4c0160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39772/0 (socket says 172.21.15.116:39772) 2023-05-12T09:08:11.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4b7fff700 1 -- 172.21.15.116:0/982337254 learned_addr learned my addr 172.21.15.116:0/982337254 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:11.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4bed9d700 1 --2- 172.21.15.116:0/982337254 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c00b87a0 0x7fb4c00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4b7fff700 1 -- 172.21.15.116:0/982337254 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c00b87a0 msgr2=0x7fb4c00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:11.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4b7fff700 1 --2- 172.21.15.116:0/982337254 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c00b87a0 0x7fb4c00cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.718+0000 7fb4b7fff700 1 -- 172.21.15.116:0/982337254 >> v1:172.21.15.182:6789/0 conn(0x7fb4c0160b70 legacy=0x7fb4c00d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:11.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.719+0000 7fb4b7fff700 1 -- 172.21.15.116:0/982337254 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c00cdc60 con 0x7fb4c01601e0 2023-05-12T09:08:11.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.719+0000 7fb4bed9d700 1 --2- 172.21.15.116:0/982337254 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c00b87a0 0x7fb4c00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:11.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.719+0000 7fb4b7fff700 1 --2- 172.21.15.116:0/982337254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c01601e0 0x7fb4c0160630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80098f0 tx=0x7fb4a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7476d0867ad080 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:11.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.719+0000 7fb4be59c700 1 -- 172.21.15.116:0/982337254 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8004230 con 0x7fb4c01601e0 2023-05-12T09:08:11.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.719+0000 7fb4be59c700 1 -- 172.21.15.116:0/982337254 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8004390 con 0x7fb4c01601e0 2023-05-12T09:08:11.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.719+0000 7fb4be59c700 1 -- 172.21.15.116:0/982337254 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80036a0 con 0x7fb4c01601e0 2023-05-12T09:08:11.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.719+0000 7fb4c51ff700 1 -- 172.21.15.116:0/982337254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c01601e0 msgr2=0x7fb4c0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.719+0000 7fb4c51ff700 1 --2- 172.21.15.116:0/982337254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c01601e0 0x7fb4c0160630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80098f0 tx=0x7fb4a8009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:11.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.720+0000 7fb4c51ff700 1 -- 172.21.15.116:0/982337254 shutdown_connections 2023-05-12T09:08:11.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.720+0000 7fb4c51ff700 1 --2- 172.21.15.116:0/982337254 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c00b87a0 0x7fb4c00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.720+0000 7fb4c51ff700 1 --2- 172.21.15.116:0/982337254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c01601e0 0x7fb4c0160630 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.720+0000 7fb4c51ff700 1 -- 172.21.15.116:0/982337254 >> 172.21.15.116:0/982337254 conn(0x7fb4c0071b10 msgr2=0x7fb4c0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:11.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.720+0000 7fb4c51ff700 1 -- 172.21.15.116:0/982337254 shutdown_connections 2023-05-12T09:08:11.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.720+0000 7fb4c51ff700 1 -- 172.21.15.116:0/982337254 wait complete. 2023-05-12T09:08:11.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.721+0000 7fb4c51ff700 1 Processor -- start 2023-05-12T09:08:11.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.721+0000 7fb4c51ff700 1 -- start start 2023-05-12T09:08:11.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.722+0000 7fb4c51ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b87a0 0x7fb4c00cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.722+0000 7fb4c51ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c01601e0 0x7fb4c00ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.722+0000 7fb4c51ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb4c0160b70 0x7fb4c00b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.722+0000 7fb4c51ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c015eb90 con 0x7fb4c00b87a0 2023-05-12T09:08:11.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.722+0000 7fb4c51ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c015da90 con 0x7fb4c0160b70 2023-05-12T09:08:11.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.722+0000 7fb4c51ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c015d1f0 con 0x7fb4c01601e0 2023-05-12T09:08:11.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.722+0000 7fb4bed9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b87a0 0x7fb4c00cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4bed9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b87a0 0x7fb4c00cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39782/0 (socket says 172.21.15.116:39782) 2023-05-12T09:08:11.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4bed9d700 1 -- 172.21.15.116:0/1577068364 learned_addr learned my addr 172.21.15.116:0/1577068364 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:11.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4b7fff700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c01601e0 0x7fb4c00ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4bf59e700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb4c0160b70 0x7fb4c00b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4bed9d700 1 -- 172.21.15.116:0/1577068364 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c01601e0 msgr2=0x7fb4c00ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4bed9d700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c01601e0 0x7fb4c00ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4bed9d700 1 -- 172.21.15.116:0/1577068364 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb4c0160b70 msgr2=0x7fb4c00b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4bed9d700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb4c0160b70 0x7fb4c00b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4bed9d700 1 -- 172.21.15.116:0/1577068364 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8009550 con 0x7fb4c00b87a0 2023-05-12T09:08:11.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4bf59e700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb4c0160b70 0x7fb4c00b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:11.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4bed9d700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b87a0 0x7fb4c00cc520 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000c750 tx=0x7fb4b000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:11.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4b77fe700 1 -- 172.21.15.116:0/1577068364 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0011800 con 0x7fb4c00b87a0 2023-05-12T09:08:11.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.723+0000 7fb4b77fe700 1 -- 172.21.15.116:0/1577068364 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b0011960 con 0x7fb4c00b87a0 2023-05-12T09:08:11.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.724+0000 7fb4c51ff700 1 -- 172.21.15.116:0/1577068364 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c00cd980 con 0x7fb4c00b87a0 2023-05-12T09:08:11.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.724+0000 7fb4b77fe700 1 -- 172.21.15.116:0/1577068364 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0011cd0 con 0x7fb4c00b87a0 2023-05-12T09:08:11.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.724+0000 7fb4c51ff700 1 -- 172.21.15.116:0/1577068364 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c00cd6a0 con 0x7fb4c00b87a0 2023-05-12T09:08:11.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.725+0000 7fb4c51ff700 1 -- 172.21.15.116:0/1577068364 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c00d2110 con 0x7fb4c00b87a0 2023-05-12T09:08:11.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.725+0000 7fb4b77fe700 1 -- 172.21.15.116:0/1577068364 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4b0021350 con 0x7fb4c00b87a0 2023-05-12T09:08:11.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.726+0000 7fb4b77fe700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb4a006ace0 0x7fb4a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:11.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.726+0000 7fb4b77fe700 1 -- 172.21.15.116:0/1577068364 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb4b0089830 con 0x7fb4c00b87a0 2023-05-12T09:08:11.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.726+0000 7fb4b7fff700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb4a006ace0 0x7fb4a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:11.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.727+0000 7fb4b7fff700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb4a006ace0 0x7fb4a006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009130 tx=0x7fb4a8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:11.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.731+0000 7fb4b77fe700 1 -- 172.21.15.116:0/1577068364 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb4b0057fa0 con 0x7fb4c00b87a0 2023-05-12T09:08:11.926 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.923+0000 7fb4c51ff700 1 -- 172.21.15.116:0/1577068364 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4c0074430 con 0x7fb4c00b87a0 2023-05-12T09:08:11.926 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.923+0000 7fb4b77fe700 1 -- 172.21.15.116:0/1577068364 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4b0057b30 con 0x7fb4c00b87a0 2023-05-12T09:08:11.927 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:11.929 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.925+0000 7fb4c51ff700 1 -- 172.21.15.116:0/1577068364 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb4a006ace0 msgr2=0x7fb4a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.929 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.925+0000 7fb4c51ff700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb4a006ace0 0x7fb4a006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009130 tx=0x7fb4a8008030 comp rx=0 tx=0).stop 2023-05-12T09:08:11.929 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.925+0000 7fb4c51ff700 1 -- 172.21.15.116:0/1577068364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b87a0 msgr2=0x7fb4c00cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:11.929 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.925+0000 7fb4c51ff700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b87a0 0x7fb4c00cc520 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000c750 tx=0x7fb4b000cb10 comp rx=0 tx=0).stop 2023-05-12T09:08:11.929 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.925+0000 7fb4c51ff700 1 -- 172.21.15.116:0/1577068364 shutdown_connections 2023-05-12T09:08:11.929 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.925+0000 7fb4c51ff700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb4c0160b70 0x7fb4c00b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.929 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.925+0000 7fb4c51ff700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4c00b87a0 0x7fb4c00cc520 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.930 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.925+0000 7fb4c51ff700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb4a006ace0 0x7fb4a006d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.930 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.925+0000 7fb4c51ff700 1 --2- 172.21.15.116:0/1577068364 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb4c01601e0 0x7fb4c00ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:11.930 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.925+0000 7fb4c51ff700 1 -- 172.21.15.116:0/1577068364 >> 172.21.15.116:0/1577068364 conn(0x7fb4c0071b10 msgr2=0x7fb4c006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:11.930 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.926+0000 7fb4c51ff700 1 -- 172.21.15.116:0/1577068364 shutdown_connections 2023-05-12T09:08:11.930 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:11.926+0000 7fb4c51ff700 1 -- 172.21.15.116:0/1577068364 wait complete. 2023-05-12T09:08:11.945 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:12.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.130+0000 7efd377ff700 1 Processor -- start 2023-05-12T09:08:12.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.130+0000 7efd377ff700 1 -- start start 2023-05-12T09:08:12.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.131+0000 7efd377ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd3015c590 0x7efd30160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.131+0000 7efd377ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7efd300cff50 0x7efd300d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.131+0000 7efd377ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300cd520 con 0x7efd300cf010 2023-05-12T09:08:12.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.131+0000 7efd377ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd300d2640 con 0x7efd300cff50 2023-05-12T09:08:12.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.131+0000 7efd377ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd301610d0 con 0x7efd3015c590 2023-05-12T09:08:12.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.131+0000 7efd3559b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd3015c590 0x7efd30160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.131+0000 7efd34d9a700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7efd300cf010 0x7efd300cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:34316/0 (socket says 172.21.15.116:34316) 2023-05-12T09:08:12.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.131+0000 7efd3559b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd3015c590 0x7efd30160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:44156/0 (socket says 172.21.15.116:44156) 2023-05-12T09:08:12.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.131+0000 7efd3559b700 1 -- 172.21.15.116:0/3128399190 learned_addr learned my addr 172.21.15.116:0/3128399190 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:12.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.131+0000 7efd35d9c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7efd300cff50 0x7efd300d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.132+0000 7efd27fff700 1 -- 172.21.15.116:0/3128399190 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908385782 0 0) 0x7efd300cd520 con 0x7efd300cf010 2023-05-12T09:08:12.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.132+0000 7efd27fff700 1 -- 172.21.15.116:0/3128399190 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd1c0035b0 con 0x7efd300cf010 2023-05-12T09:08:12.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.132+0000 7efd3559b700 1 -- 172.21.15.116:0/3128399190 >> v2:172.21.15.182:3300/0 conn(0x7efd300cff50 msgr2=0x7efd300d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:12.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.132+0000 7efd3559b700 1 --2- 172.21.15.116:0/3128399190 >> v2:172.21.15.182:3300/0 conn(0x7efd300cff50 0x7efd300d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.132+0000 7efd3559b700 1 -- 172.21.15.116:0/3128399190 >> v1:172.21.15.182:6789/0 conn(0x7efd300cf010 legacy=0x7efd300cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.132+0000 7efd3559b700 1 -- 172.21.15.116:0/3128399190 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300b23c0 con 0x7efd3015c590 2023-05-12T09:08:12.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.132+0000 7efd3559b700 1 --2- 172.21.15.116:0/3128399190 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd3015c590 0x7efd30160b90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0098f0 tx=0x7efd2c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=802c6979c6d1f8a3 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:12.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.132+0000 7efd27fff700 1 -- 172.21.15.116:0/3128399190 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c011830 con 0x7efd3015c590 2023-05-12T09:08:12.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.133+0000 7efd27fff700 1 -- 172.21.15.116:0/3128399190 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c011990 con 0x7efd3015c590 2023-05-12T09:08:12.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.133+0000 7efd27fff700 1 -- 172.21.15.116:0/3128399190 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c011d20 con 0x7efd3015c590 2023-05-12T09:08:12.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.133+0000 7efd377ff700 1 -- 172.21.15.116:0/3128399190 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd3015c590 msgr2=0x7efd30160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.133+0000 7efd377ff700 1 --2- 172.21.15.116:0/3128399190 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd3015c590 0x7efd30160b90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0098f0 tx=0x7efd2c009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:12.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.133+0000 7efd377ff700 1 -- 172.21.15.116:0/3128399190 shutdown_connections 2023-05-12T09:08:12.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.133+0000 7efd377ff700 1 --2- 172.21.15.116:0/3128399190 >> v2:172.21.15.182:3300/0 conn(0x7efd300cff50 0x7efd300d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.133+0000 7efd377ff700 1 --2- 172.21.15.116:0/3128399190 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd3015c590 0x7efd30160b90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.133+0000 7efd377ff700 1 -- 172.21.15.116:0/3128399190 >> 172.21.15.116:0/3128399190 conn(0x7efd30071b10 msgr2=0x7efd30071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:12.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.133+0000 7efd377ff700 1 -- 172.21.15.116:0/3128399190 shutdown_connections 2023-05-12T09:08:12.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.133+0000 7efd377ff700 1 -- 172.21.15.116:0/3128399190 wait complete. 2023-05-12T09:08:12.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.135+0000 7efd377ff700 1 Processor -- start 2023-05-12T09:08:12.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.135+0000 7efd377ff700 1 -- start start 2023-05-12T09:08:12.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd377ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd300cf010 0x7efd301f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd377ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd300cff50 0x7efd300c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd377ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efd3015c590 0x7efd3015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd377ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd301f5a20 con 0x7efd300cff50 2023-05-12T09:08:12.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd377ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c6dc0 con 0x7efd3015c590 2023-05-12T09:08:12.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd377ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c70a0 con 0x7efd300cf010 2023-05-12T09:08:12.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd34d9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd300cff50 0x7efd300c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd34d9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd300cff50 0x7efd300c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42884/0 (socket says 172.21.15.116:42884) 2023-05-12T09:08:12.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd34d9a700 1 -- 172.21.15.116:0/818189212 learned_addr learned my addr 172.21.15.116:0/818189212 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:12.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd35d9c700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efd3015c590 0x7efd3015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd3559b700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd300cf010 0x7efd301f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd34d9a700 1 -- 172.21.15.116:0/818189212 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd300cf010 msgr2=0x7efd301f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd34d9a700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd300cf010 0x7efd301f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd34d9a700 1 -- 172.21.15.116:0/818189212 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efd3015c590 msgr2=0x7efd3015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd34d9a700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efd3015c590 0x7efd3015e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.136+0000 7efd34d9a700 1 -- 172.21.15.116:0/818189212 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c009550 con 0x7efd300cff50 2023-05-12T09:08:12.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.137+0000 7efd34d9a700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd300cff50 0x7efd300c97c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efd2000c700 tx=0x7efd2000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:12.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.137+0000 7efd25ffb700 1 -- 172.21.15.116:0/818189212 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20005cb0 con 0x7efd300cff50 2023-05-12T09:08:12.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.137+0000 7efd25ffb700 1 -- 172.21.15.116:0/818189212 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd20005e10 con 0x7efd300cff50 2023-05-12T09:08:12.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.137+0000 7efd377ff700 1 -- 172.21.15.116:0/818189212 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd300cd770 con 0x7efd300cff50 2023-05-12T09:08:12.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.137+0000 7efd25ffb700 1 -- 172.21.15.116:0/818189212 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200072d0 con 0x7efd300cff50 2023-05-12T09:08:12.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.137+0000 7efd377ff700 1 -- 172.21.15.116:0/818189212 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300cf560 con 0x7efd300cff50 2023-05-12T09:08:12.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.138+0000 7efd377ff700 1 -- 172.21.15.116:0/818189212 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3015c960 con 0x7efd300cff50 2023-05-12T09:08:12.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.139+0000 7efd25ffb700 1 -- 172.21.15.116:0/818189212 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd20007430 con 0x7efd300cff50 2023-05-12T09:08:12.151 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.140+0000 7efd25ffb700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efd1406ace0 0x7efd1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.151 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.140+0000 7efd25ffb700 1 -- 172.21.15.116:0/818189212 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efd20088a00 con 0x7efd300cff50 2023-05-12T09:08:12.151 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.140+0000 7efd3559b700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efd1406ace0 0x7efd1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.151 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.141+0000 7efd3559b700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efd1406ace0 0x7efd1406d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd2c000c00 tx=0x7efd2c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:12.152 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.144+0000 7efd25ffb700 1 -- 172.21.15.116:0/818189212 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efd200538c0 con 0x7efd300cff50 2023-05-12T09:08:12.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.337+0000 7efd377ff700 1 -- 172.21.15.116:0/818189212 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd301f5b60 con 0x7efd300cff50 2023-05-12T09:08:12.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.338+0000 7efd25ffb700 1 -- 172.21.15.116:0/818189212 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd20017020 con 0x7efd300cff50 2023-05-12T09:08:12.341 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:12.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 -- 172.21.15.116:0/818189212 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efd1406ace0 msgr2=0x7efd1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efd1406ace0 0x7efd1406d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd2c000c00 tx=0x7efd2c008030 comp rx=0 tx=0).stop 2023-05-12T09:08:12.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 -- 172.21.15.116:0/818189212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd300cff50 msgr2=0x7efd300c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd300cff50 0x7efd300c97c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efd2000c700 tx=0x7efd2000ca10 comp rx=0 tx=0).stop 2023-05-12T09:08:12.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 -- 172.21.15.116:0/818189212 shutdown_connections 2023-05-12T09:08:12.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efd3015c590 0x7efd3015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efd1406ace0 0x7efd1406d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efd300cf010 0x7efd301f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 --2- 172.21.15.116:0/818189212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd300cff50 0x7efd300c97c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 -- 172.21.15.116:0/818189212 >> 172.21.15.116:0/818189212 conn(0x7efd30071b10 msgr2=0x7efd300cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:12.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 -- 172.21.15.116:0/818189212 shutdown_connections 2023-05-12T09:08:12.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.340+0000 7efd377ff700 1 -- 172.21.15.116:0/818189212 wait complete. 2023-05-12T09:08:12.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:12.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.543+0000 7f54951ff700 1 Processor -- start 2023-05-12T09:08:12.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.543+0000 7f54951ff700 1 -- start start 2023-05-12T09:08:12.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.544+0000 7f54951ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f54900b87a0 0x7f54900cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.544+0000 7f54951ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5490160d40 0x7f54900d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.544+0000 7f54951ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54900cdc60 con 0x7f54901601e0 2023-05-12T09:08:12.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.544+0000 7f54951ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54900d02d0 con 0x7f5490160d40 2023-05-12T09:08:12.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.544+0000 7f54951ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54900d0cb0 con 0x7f54900b87a0 2023-05-12T09:08:12.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.544+0000 7f548f59e700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5490160d40 0x7f54900d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.544+0000 7f548f59e700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5490160d40 0x7f54900d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42894/0 (socket says 172.21.15.116:42894) 2023-05-12T09:08:12.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.544+0000 7f548f59e700 1 -- 172.21.15.116:0/632345078 learned_addr learned my addr 172.21.15.116:0/632345078 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:12.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.545+0000 7f548ed9d700 1 --2- 172.21.15.116:0/632345078 >> v2:172.21.15.182:3300/0 conn(0x7f54900b87a0 0x7f54900cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.545+0000 7f548f59e700 1 -- 172.21.15.116:0/632345078 >> v2:172.21.15.182:3300/0 conn(0x7f54900b87a0 msgr2=0x7f54900cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:12.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.545+0000 7f548f59e700 1 --2- 172.21.15.116:0/632345078 >> v2:172.21.15.182:3300/0 conn(0x7f54900b87a0 0x7f54900cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.545+0000 7f548f59e700 1 -- 172.21.15.116:0/632345078 >> v1:172.21.15.182:6789/0 conn(0x7f54901601e0 legacy=0x7f5490160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.545+0000 7f548f59e700 1 -- 172.21.15.116:0/632345078 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900cd6a0 con 0x7f5490160d40 2023-05-12T09:08:12.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.545+0000 7f548f59e700 1 --2- 172.21.15.116:0/632345078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 0x7f54900d1100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f54900b4ac0 tx=0x7f548800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7291becfb2f2293 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:12.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.545+0000 7f548dd9b700 1 -- 172.21.15.116:0/632345078 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800e070 con 0x7f5490160d40 2023-05-12T09:08:12.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.545+0000 7f548dd9b700 1 -- 172.21.15.116:0/632345078 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548800b980 con 0x7f5490160d40 2023-05-12T09:08:12.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.545+0000 7f548dd9b700 1 -- 172.21.15.116:0/632345078 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800bd30 con 0x7f5490160d40 2023-05-12T09:08:12.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.546+0000 7f54951ff700 1 -- 172.21.15.116:0/632345078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 msgr2=0x7f54900d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.546+0000 7f54951ff700 1 --2- 172.21.15.116:0/632345078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 0x7f54900d1100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f54900b4ac0 tx=0x7f548800b330 comp rx=0 tx=0).stop 2023-05-12T09:08:12.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.546+0000 7f54951ff700 1 -- 172.21.15.116:0/632345078 shutdown_connections 2023-05-12T09:08:12.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.546+0000 7f54951ff700 1 --2- 172.21.15.116:0/632345078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 0x7f54900d1100 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.546+0000 7f54951ff700 1 --2- 172.21.15.116:0/632345078 >> v2:172.21.15.182:3300/0 conn(0x7f54900b87a0 0x7f54900cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.546+0000 7f54951ff700 1 -- 172.21.15.116:0/632345078 >> 172.21.15.116:0/632345078 conn(0x7f5490071b10 msgr2=0x7f5490071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:12.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.546+0000 7f54951ff700 1 -- 172.21.15.116:0/632345078 shutdown_connections 2023-05-12T09:08:12.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.546+0000 7f54951ff700 1 -- 172.21.15.116:0/632345078 wait complete. 2023-05-12T09:08:12.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.548+0000 7f54951ff700 1 Processor -- start 2023-05-12T09:08:12.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.549+0000 7f54951ff700 1 -- start start 2023-05-12T09:08:12.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f54951ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f54900b87a0 0x7f5490150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f54951ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f54901601e0 0x7f54900cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f54951ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 0x7f54900b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f54951ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549015c4e0 con 0x7f5490160d40 2023-05-12T09:08:12.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f54951ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549015c7c0 con 0x7f54900b87a0 2023-05-12T09:08:12.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f54951ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549015caa0 con 0x7f54901601e0 2023-05-12T09:08:12.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f548f59e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 0x7f54900b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f548f59e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 0x7f54900b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42904/0 (socket says 172.21.15.116:42904) 2023-05-12T09:08:12.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f548f59e700 1 -- 172.21.15.116:0/1385187299 learned_addr learned my addr 172.21.15.116:0/1385187299 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:12.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f548ed9d700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f54900b87a0 0x7f5490150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f548e59c700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f54901601e0 0x7f54900cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f548f59e700 1 -- 172.21.15.116:0/1385187299 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f54901601e0 msgr2=0x7f54900cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f548f59e700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f54901601e0 0x7f54900cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f548f59e700 1 -- 172.21.15.116:0/1385187299 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f54900b87a0 msgr2=0x7f5490150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f548f59e700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f54900b87a0 0x7f5490150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.550+0000 7f548f59e700 1 -- 172.21.15.116:0/1385187299 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488009b30 con 0x7f5490160d40 2023-05-12T09:08:12.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.551+0000 7f548f59e700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 0x7f54900b72a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5490072760 tx=0x7f5488004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:12.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.551+0000 7f54777fe700 1 -- 172.21.15.116:0/1385187299 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54880048b0 con 0x7f5490160d40 2023-05-12T09:08:12.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.551+0000 7f54777fe700 1 -- 172.21.15.116:0/1385187299 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54880092e0 con 0x7f5490160d40 2023-05-12T09:08:12.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.551+0000 7f54951ff700 1 -- 172.21.15.116:0/1385187299 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54900d1640 con 0x7f5490160d40 2023-05-12T09:08:12.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.551+0000 7f54777fe700 1 -- 172.21.15.116:0/1385187299 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548801b670 con 0x7f5490160d40 2023-05-12T09:08:12.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.551+0000 7f54951ff700 1 -- 172.21.15.116:0/1385187299 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54900cd980 con 0x7f5490160d40 2023-05-12T09:08:12.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.552+0000 7f54951ff700 1 -- 172.21.15.116:0/1385187299 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54900d17d0 con 0x7f5490160d40 2023-05-12T09:08:12.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.553+0000 7f54777fe700 1 -- 172.21.15.116:0/1385187299 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f548801b7d0 con 0x7f5490160d40 2023-05-12T09:08:12.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.554+0000 7f54777fe700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f547c06ace0 0x7f547c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.554+0000 7f54777fe700 1 -- 172.21.15.116:0/1385187299 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f548808ac80 con 0x7f5490160d40 2023-05-12T09:08:12.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.554+0000 7f548ed9d700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f547c06ace0 0x7f547c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.554+0000 7f548ed9d700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f547c06ace0 0x7f547c06d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5480006b20 tx=0x7f5480008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:12.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.558+0000 7f54777fe700 1 -- 172.21.15.116:0/1385187299 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f54880559f0 con 0x7f5490160d40 2023-05-12T09:08:12.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.754+0000 7f54951ff700 1 -- 172.21.15.116:0/1385187299 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5490074430 con 0x7f5490160d40 2023-05-12T09:08:12.758 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.755+0000 7f54777fe700 1 -- 172.21.15.116:0/1385187299 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5488059010 con 0x7f5490160d40 2023-05-12T09:08:12.758 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:12.760 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 -- 172.21.15.116:0/1385187299 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f547c06ace0 msgr2=0x7f547c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.760 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f547c06ace0 0x7f547c06d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5480006b20 tx=0x7f5480008040 comp rx=0 tx=0).stop 2023-05-12T09:08:12.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 -- 172.21.15.116:0/1385187299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 msgr2=0x7f54900b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 0x7f54900b72a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5490072760 tx=0x7f5488004ad0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 -- 172.21.15.116:0/1385187299 shutdown_connections 2023-05-12T09:08:12.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5490160d40 0x7f54900b72a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f54900b87a0 0x7f5490150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f547c06ace0 0x7f547c06d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 --2- 172.21.15.116:0/1385187299 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f54901601e0 0x7f54900cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.762 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 -- 172.21.15.116:0/1385187299 >> 172.21.15.116:0/1385187299 conn(0x7f5490071b10 msgr2=0x7f5490160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:12.762 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 -- 172.21.15.116:0/1385187299 shutdown_connections 2023-05-12T09:08:12.762 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.757+0000 7f54951ff700 1 -- 172.21.15.116:0/1385187299 wait complete. 2023-05-12T09:08:12.777 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:12.964 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.961+0000 7fe3ab1ff700 1 Processor -- start 2023-05-12T09:08:12.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.961+0000 7fe3ab1ff700 1 -- start start 2023-05-12T09:08:12.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.962+0000 7fe3ab1ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe3a40cfbf0 0x7fe3a41608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.962+0000 7fe3ab1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40d1100 0x7fe3a40d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3ab1ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a40d0020 con 0x7fe3a40b87a0 2023-05-12T09:08:12.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3ab1ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a40d02d0 con 0x7fe3a40cfbf0 2023-05-12T09:08:12.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3ab1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40d0cb0 con 0x7fe3a40d1100 2023-05-12T09:08:12.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3a3fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe3a40cfbf0 0x7fe3a41608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3a3fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe3a40cfbf0 0x7fe3a41608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42916/0 (socket says 172.21.15.116:42916) 2023-05-12T09:08:12.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3a3fff700 1 -- 172.21.15.116:0/981993428 learned_addr learned my addr 172.21.15.116:0/981993428 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:12.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3a979c700 1 --2- 172.21.15.116:0/981993428 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40d1100 0x7fe3a40d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3a3fff700 1 -- 172.21.15.116:0/981993428 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40d1100 msgr2=0x7fe3a40d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:12.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3a3fff700 1 --2- 172.21.15.116:0/981993428 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40d1100 0x7fe3a40d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3a3fff700 1 -- 172.21.15.116:0/981993428 >> v1:172.21.15.116:6789/0 conn(0x7fe3a40b87a0 legacy=0x7fe3a41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3a3fff700 1 -- 172.21.15.116:0/981993428 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a40cdc60 con 0x7fe3a40cfbf0 2023-05-12T09:08:12.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3a37fe700 1 -- 172.21.15.116:0/981993428 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096988080 0 0) 0x7fe3a40d0020 con 0x7fe3a40b87a0 2023-05-12T09:08:12.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.963+0000 7fe3a979c700 1 --2- 172.21.15.116:0/981993428 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40d1100 0x7fe3a40d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:12.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3a3fff700 1 --2- 172.21.15.116:0/981993428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40cfbf0 0x7fe3a41608f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe3900098f0 tx=0x7fe390009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3645eea179f524 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:12.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3a37fe700 1 -- 172.21.15.116:0/981993428 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000b8a0 con 0x7fe3a40cfbf0 2023-05-12T09:08:12.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3a37fe700 1 -- 172.21.15.116:0/981993428 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39000ba00 con 0x7fe3a40cfbf0 2023-05-12T09:08:12.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3a37fe700 1 -- 172.21.15.116:0/981993428 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000bd90 con 0x7fe3a40cfbf0 2023-05-12T09:08:12.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/981993428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40cfbf0 msgr2=0x7fe3a41608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3ab1ff700 1 --2- 172.21.15.116:0/981993428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40cfbf0 0x7fe3a41608f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe3900098f0 tx=0x7fe390009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:12.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/981993428 shutdown_connections 2023-05-12T09:08:12.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3ab1ff700 1 --2- 172.21.15.116:0/981993428 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40d1100 0x7fe3a40d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3ab1ff700 1 --2- 172.21.15.116:0/981993428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40cfbf0 0x7fe3a41608f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/981993428 >> 172.21.15.116:0/981993428 conn(0x7fe3a4071b10 msgr2=0x7fe3a4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:12.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.964+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/981993428 shutdown_connections 2023-05-12T09:08:12.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.965+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/981993428 wait complete. 2023-05-12T09:08:12.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.967+0000 7fe3ab1ff700 1 Processor -- start 2023-05-12T09:08:12.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.967+0000 7fe3ab1ff700 1 -- start start 2023-05-12T09:08:12.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3ab1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40b87a0 0x7fe3a41512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3ab1ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe3a40cfbf0 0x7fe3a415d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3ab1ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40d1100 0x7fe3a40d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3ab1ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40c7db0 con 0x7fe3a40d1100 2023-05-12T09:08:12.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3ab1ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a415e7d0 con 0x7fe3a40cfbf0 2023-05-12T09:08:12.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3ab1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a415eab0 con 0x7fe3a40b87a0 2023-05-12T09:08:12.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a979c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40d1100 0x7fe3a40d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a979c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40d1100 0x7fe3a40d25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42922/0 (socket says 172.21.15.116:42922) 2023-05-12T09:08:12.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a979c700 1 -- 172.21.15.116:0/4249592382 learned_addr learned my addr 172.21.15.116:0/4249592382 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:12.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a3fff700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe3a40cfbf0 0x7fe3a415d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a8f9b700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40b87a0 0x7fe3a41512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a979c700 1 -- 172.21.15.116:0/4249592382 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40b87a0 msgr2=0x7fe3a41512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a979c700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40b87a0 0x7fe3a41512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a979c700 1 -- 172.21.15.116:0/4249592382 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe3a40cfbf0 msgr2=0x7fe3a415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:12.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a979c700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe3a40cfbf0 0x7fe3a415d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:12.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a979c700 1 -- 172.21.15.116:0/4249592382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe390009550 con 0x7fe3a40d1100 2023-05-12T09:08:12.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.968+0000 7fe3a8f9b700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40b87a0 0x7fe3a41512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:12.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.969+0000 7fe3a979c700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40d1100 0x7fe3a40d25b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00cd50 tx=0x7fe39c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:12.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.969+0000 7fe3a17fa700 1 -- 172.21.15.116:0/4249592382 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00f480 con 0x7fe3a40d1100 2023-05-12T09:08:12.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.969+0000 7fe3a17fa700 1 -- 172.21.15.116:0/4249592382 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c00f600 con 0x7fe3a40d1100 2023-05-12T09:08:12.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.969+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/4249592382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a40cd980 con 0x7fe3a40d1100 2023-05-12T09:08:12.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.969+0000 7fe3a17fa700 1 -- 172.21.15.116:0/4249592382 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00f9b0 con 0x7fe3a40d1100 2023-05-12T09:08:12.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.969+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/4249592382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a40cd6a0 con 0x7fe3a40d1100 2023-05-12T09:08:12.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.970+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/4249592382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a4160de0 con 0x7fe3a40d1100 2023-05-12T09:08:12.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.971+0000 7fe3a17fa700 1 -- 172.21.15.116:0/4249592382 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe39c00b040 con 0x7fe3a40d1100 2023-05-12T09:08:12.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.972+0000 7fe3a17fa700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe38806ace0 0x7fe38806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:12.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.972+0000 7fe3a17fa700 1 -- 172.21.15.116:0/4249592382 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe39c089ff0 con 0x7fe3a40d1100 2023-05-12T09:08:12.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.972+0000 7fe3a8f9b700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe38806ace0 0x7fe38806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:12.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.973+0000 7fe3a8f9b700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe38806ace0 0x7fe38806d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe398000f60 tx=0x7fe398009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:12.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:12.976+0000 7fe3a17fa700 1 -- 172.21.15.116:0/4249592382 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe39c054dc0 con 0x7fe3a40d1100 2023-05-12T09:08:13.171 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.168+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/4249592382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe3a4074430 con 0x7fe3a40d1100 2023-05-12T09:08:13.172 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.169+0000 7fe3a17fa700 1 -- 172.21.15.116:0/4249592382 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe39c01d020 con 0x7fe3a40d1100 2023-05-12T09:08:13.172 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:13.174 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/4249592382 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe38806ace0 msgr2=0x7fe38806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.174 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe38806ace0 0x7fe38806d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe398000f60 tx=0x7fe398009040 comp rx=0 tx=0).stop 2023-05-12T09:08:13.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/4249592382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40d1100 msgr2=0x7fe3a40d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40d1100 0x7fe3a40d25b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00cd50 tx=0x7fe39c00a560 comp rx=0 tx=0).stop 2023-05-12T09:08:13.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/4249592382 shutdown_connections 2023-05-12T09:08:13.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a40d1100 0x7fe3a40d25b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe38806ace0 0x7fe38806d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe3a40b87a0 0x7fe3a41512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 --2- 172.21.15.116:0/4249592382 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe3a40cfbf0 0x7fe3a415d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.176 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/4249592382 >> 172.21.15.116:0/4249592382 conn(0x7fe3a4071b10 msgr2=0x7fe3a4160170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:13.176 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/4249592382 shutdown_connections 2023-05-12T09:08:13.176 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.171+0000 7fe3ab1ff700 1 -- 172.21.15.116:0/4249592382 wait complete. 2023-05-12T09:08:13.192 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:13.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.373+0000 7fc98cdff700 1 Processor -- start 2023-05-12T09:08:13.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.373+0000 7fc98cdff700 1 -- start start 2023-05-12T09:08:13.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.374+0000 7fc98cdff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc98815a5a0 0x7fc98806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.374+0000 7fc98cdff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc98806a920 0x7fc988070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.374+0000 7fc98cdff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9880cb280 con 0x7fc988071030 2023-05-12T09:08:13.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.374+0000 7fc98cdff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98806adc0 con 0x7fc98806a920 2023-05-12T09:08:13.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.374+0000 7fc98cdff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98815a970 con 0x7fc98815a5a0 2023-05-12T09:08:13.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.375+0000 7fc97ffff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc98806a920 0x7fc988070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.375+0000 7fc986d9d700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc988071030 0x7fc98815dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42416/0 (socket says 172.21.15.116:42416) 2023-05-12T09:08:13.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.375+0000 7fc986d9d700 1 -- 172.21.15.116:0/3593594217 learned_addr learned my addr 172.21.15.116:0/3593594217 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:13.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.375+0000 7fc98659c700 1 --2- 172.21.15.116:0/3593594217 >> v2:172.21.15.182:3300/0 conn(0x7fc98815a5a0 0x7fc98806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.375+0000 7fc97ffff700 1 -- 172.21.15.116:0/3593594217 >> v2:172.21.15.182:3300/0 conn(0x7fc98815a5a0 msgr2=0x7fc98806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:13.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.375+0000 7fc97ffff700 1 --2- 172.21.15.116:0/3593594217 >> v2:172.21.15.182:3300/0 conn(0x7fc98815a5a0 0x7fc98806a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.375+0000 7fc97ffff700 1 -- 172.21.15.116:0/3593594217 >> v1:172.21.15.116:6789/0 conn(0x7fc988071030 legacy=0x7fc98815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.375+0000 7fc985d9b700 1 -- 172.21.15.116:0/3593594217 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911536534 0 0) 0x7fc980001490 con 0x7fc988071030 2023-05-12T09:08:13.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.375+0000 7fc97ffff700 1 -- 172.21.15.116:0/3593594217 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc988071470 con 0x7fc98806a920 2023-05-12T09:08:13.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.375+0000 7fc97ffff700 1 --2- 172.21.15.116:0/3593594217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc98806a920 0x7fc988070af0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc988067990 tx=0x7fc970009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef5b81a903f2558 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:13.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc985d9b700 1 -- 172.21.15.116:0/3593594217 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970011830 con 0x7fc98806a920 2023-05-12T09:08:13.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc985d9b700 1 -- 172.21.15.116:0/3593594217 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc970011990 con 0x7fc98806a920 2023-05-12T09:08:13.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc985d9b700 1 -- 172.21.15.116:0/3593594217 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970011d40 con 0x7fc98806a920 2023-05-12T09:08:13.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc98cdff700 1 -- 172.21.15.116:0/3593594217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc98806a920 msgr2=0x7fc988070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc98cdff700 1 --2- 172.21.15.116:0/3593594217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc98806a920 0x7fc988070af0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc988067990 tx=0x7fc970009b40 comp rx=0 tx=0).stop 2023-05-12T09:08:13.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc98cdff700 1 -- 172.21.15.116:0/3593594217 shutdown_connections 2023-05-12T09:08:13.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc98cdff700 1 --2- 172.21.15.116:0/3593594217 >> v2:172.21.15.182:3300/0 conn(0x7fc98815a5a0 0x7fc98806a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc98cdff700 1 --2- 172.21.15.116:0/3593594217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc98806a920 0x7fc988070af0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc98cdff700 1 -- 172.21.15.116:0/3593594217 >> 172.21.15.116:0/3593594217 conn(0x7fc9880cf720 msgr2=0x7fc9880cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:13.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc98cdff700 1 -- 172.21.15.116:0/3593594217 shutdown_connections 2023-05-12T09:08:13.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.376+0000 7fc98cdff700 1 -- 172.21.15.116:0/3593594217 wait complete. 2023-05-12T09:08:13.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.379+0000 7fc98cdff700 1 Processor -- start 2023-05-12T09:08:13.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.379+0000 7fc98cdff700 1 -- start start 2023-05-12T09:08:13.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.380+0000 7fc98cdff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc98806a920 0x7fc9880c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.380+0000 7fc98cdff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc988071030 0x7fc98815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.380+0000 7fc98cdff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc98815a5a0 0x7fc988154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.380+0000 7fc98cdff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc988151e10 con 0x7fc988071030 2023-05-12T09:08:13.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.380+0000 7fc98cdff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9880c4e60 con 0x7fc98806a920 2023-05-12T09:08:13.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.380+0000 7fc98cdff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98815b390 con 0x7fc98815a5a0 2023-05-12T09:08:13.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.380+0000 7fc97ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc988071030 0x7fc98815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.380+0000 7fc97ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc988071030 0x7fc98815aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42944/0 (socket says 172.21.15.116:42944) 2023-05-12T09:08:13.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.380+0000 7fc97ffff700 1 -- 172.21.15.116:0/1804773872 learned_addr learned my addr 172.21.15.116:0/1804773872 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:13.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc98659c700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc98806a920 0x7fc9880c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc97ffff700 1 -- 172.21.15.116:0/1804773872 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc98815a5a0 msgr2=0x7fc988154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc97ffff700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc98815a5a0 0x7fc988154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc97ffff700 1 -- 172.21.15.116:0/1804773872 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc98806a920 msgr2=0x7fc9880c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc97ffff700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc98806a920 0x7fc9880c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc97ffff700 1 -- 172.21.15.116:0/1804773872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970009440 con 0x7fc988071030 2023-05-12T09:08:13.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc98659c700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc98806a920 0x7fc9880c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:13.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc97ffff700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc988071030 0x7fc98815aab0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc970009b80 tx=0x7fc970004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:13.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc97effd700 1 -- 172.21.15.116:0/1804773872 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970004520 con 0x7fc988071030 2023-05-12T09:08:13.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc97effd700 1 -- 172.21.15.116:0/1804773872 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9700036a0 con 0x7fc988071030 2023-05-12T09:08:13.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc98cdff700 1 -- 172.21.15.116:0/1804773872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9880719e0 con 0x7fc988071030 2023-05-12T09:08:13.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc97effd700 1 -- 172.21.15.116:0/1804773872 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970003a50 con 0x7fc988071030 2023-05-12T09:08:13.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.381+0000 7fc98cdff700 1 -- 172.21.15.116:0/1804773872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc988071700 con 0x7fc988071030 2023-05-12T09:08:13.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.382+0000 7fc98cdff700 1 -- 172.21.15.116:0/1804773872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98806c6c0 con 0x7fc988071030 2023-05-12T09:08:13.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.383+0000 7fc97effd700 1 -- 172.21.15.116:0/1804773872 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc970003bb0 con 0x7fc988071030 2023-05-12T09:08:13.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.384+0000 7fc97effd700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc96806ace0 0x7fc96806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.384+0000 7fc97effd700 1 -- 172.21.15.116:0/1804773872 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc97008ace0 con 0x7fc988071030 2023-05-12T09:08:13.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.384+0000 7fc98659c700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc96806ace0 0x7fc96806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.385+0000 7fc98659c700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc96806ace0 0x7fc96806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc98806e790 tx=0x7fc978008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:13.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.389+0000 7fc97effd700 1 -- 172.21.15.116:0/1804773872 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc970055af0 con 0x7fc988071030 2023-05-12T09:08:13.588 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.585+0000 7fc98cdff700 1 -- 172.21.15.116:0/1804773872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc988151f50 con 0x7fc988071030 2023-05-12T09:08:13.589 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.586+0000 7fc97effd700 1 -- 172.21.15.116:0/1804773872 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7fc988151f50 con 0x7fc988071030 2023-05-12T09:08:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:13.590 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:13.591 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.588+0000 7fc98cdff700 1 -- 172.21.15.116:0/1804773872 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc96806ace0 msgr2=0x7fc96806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.592 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.588+0000 7fc98cdff700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc96806ace0 0x7fc96806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc98806e790 tx=0x7fc978008040 comp rx=0 tx=0).stop 2023-05-12T09:08:13.592 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.588+0000 7fc98cdff700 1 -- 172.21.15.116:0/1804773872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc988071030 msgr2=0x7fc98815aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.592 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.588+0000 7fc98cdff700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc988071030 0x7fc98815aab0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc970009b80 tx=0x7fc970004750 comp rx=0 tx=0).stop 2023-05-12T09:08:13.592 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.588+0000 7fc98cdff700 1 -- 172.21.15.116:0/1804773872 shutdown_connections 2023-05-12T09:08:13.592 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.588+0000 7fc98cdff700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc96806ace0 0x7fc96806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.592 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.588+0000 7fc98cdff700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc98815a5a0 0x7fc988154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.592 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.588+0000 7fc98cdff700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc98806a920 0x7fc9880c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.593 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.588+0000 7fc98cdff700 1 --2- 172.21.15.116:0/1804773872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc988071030 0x7fc98815aab0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.593 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.588+0000 7fc98cdff700 1 -- 172.21.15.116:0/1804773872 >> 172.21.15.116:0/1804773872 conn(0x7fc9880cf720 msgr2=0x7fc988156850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:13.593 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.589+0000 7fc98cdff700 1 -- 172.21.15.116:0/1804773872 shutdown_connections 2023-05-12T09:08:13.593 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.589+0000 7fc98cdff700 1 -- 172.21.15.116:0/1804773872 wait complete. 2023-05-12T09:08:13.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:13.610 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:13.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.796+0000 7f12115ff700 1 Processor -- start 2023-05-12T09:08:13.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.797+0000 7f12115ff700 1 -- start start 2023-05-12T09:08:13.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.798+0000 7f12115ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 0x7f120c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.798+0000 7f12115ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f120c160d40 0x7f120c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.798+0000 7f12115ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120c0cdc60 con 0x7f120c1601e0 2023-05-12T09:08:13.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.798+0000 7f12115ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120c0d02d0 con 0x7f120c160d40 2023-05-12T09:08:13.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.798+0000 7f12115ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0d0cb0 con 0x7f120c0b87a0 2023-05-12T09:08:13.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.798+0000 7f120affd700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 0x7f120c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.798+0000 7f1203fff700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f120c1601e0 0x7f120c160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:34336/0 (socket says 172.21.15.116:34336) 2023-05-12T09:08:13.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.798+0000 7f1203fff700 1 -- 172.21.15.116:0/3660572468 learned_addr learned my addr 172.21.15.116:0/3660572468 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:13.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.798+0000 7f120b7fe700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f120c160d40 0x7f120c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.799+0000 7f120b7fe700 1 -- 172.21.15.116:0/3660572468 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 msgr2=0x7f120c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:13.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.799+0000 7f120b7fe700 1 --2- 172.21.15.116:0/3660572468 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 0x7f120c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.799+0000 7f120b7fe700 1 -- 172.21.15.116:0/3660572468 >> v1:172.21.15.182:6789/0 conn(0x7f120c1601e0 legacy=0x7f120c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.799+0000 7f120b7fe700 1 -- 172.21.15.116:0/3660572468 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c0cd6a0 con 0x7f120c160d40 2023-05-12T09:08:13.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.799+0000 7f120affd700 1 --2- 172.21.15.116:0/3660572468 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 0x7f120c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:13.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.799+0000 7f120b7fe700 1 --2- 172.21.15.116:0/3660572468 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120c160d40 0x7f120c0d1100 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1204009d90 tx=0x7f120400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4079c55df3332e42 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:13.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.799+0000 7f120a7fc700 1 -- 172.21.15.116:0/3660572468 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400e070 con 0x7f120c160d40 2023-05-12T09:08:13.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.799+0000 7f120a7fc700 1 -- 172.21.15.116:0/3660572468 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120400bb20 con 0x7f120c160d40 2023-05-12T09:08:13.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.799+0000 7f120a7fc700 1 -- 172.21.15.116:0/3660572468 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204012430 con 0x7f120c160d40 2023-05-12T09:08:13.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.800+0000 7f12115ff700 1 -- 172.21.15.116:0/3660572468 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120c160d40 msgr2=0x7f120c0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.800+0000 7f12115ff700 1 --2- 172.21.15.116:0/3660572468 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120c160d40 0x7f120c0d1100 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1204009d90 tx=0x7f120400b330 comp rx=0 tx=0).stop 2023-05-12T09:08:13.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.800+0000 7f12115ff700 1 -- 172.21.15.116:0/3660572468 shutdown_connections 2023-05-12T09:08:13.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.800+0000 7f12115ff700 1 --2- 172.21.15.116:0/3660572468 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120c160d40 0x7f120c0d1100 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.800+0000 7f12115ff700 1 --2- 172.21.15.116:0/3660572468 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 0x7f120c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.800+0000 7f12115ff700 1 -- 172.21.15.116:0/3660572468 >> 172.21.15.116:0/3660572468 conn(0x7f120c071b10 msgr2=0x7f120c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:13.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.800+0000 7f12115ff700 1 -- 172.21.15.116:0/3660572468 shutdown_connections 2023-05-12T09:08:13.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.800+0000 7f12115ff700 1 -- 172.21.15.116:0/3660572468 wait complete. 2023-05-12T09:08:13.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.802+0000 7f12115ff700 1 Processor -- start 2023-05-12T09:08:13.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.802+0000 7f12115ff700 1 -- start start 2023-05-12T09:08:13.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f12115ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 0x7f120c1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f12115ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120c1601e0 0x7f120c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f12115ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f120c160d40 0x7f120c159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f12115ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0c70b0 con 0x7f120c160d40 2023-05-12T09:08:13.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f12115ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c15f950 con 0x7f120c1601e0 2023-05-12T09:08:13.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f12115ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c15f670 con 0x7f120c0b87a0 2023-05-12T09:08:13.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f120b7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f120c160d40 0x7f120c159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f120b7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f120c160d40 0x7f120c159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42948/0 (socket says 172.21.15.116:42948) 2023-05-12T09:08:13.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f120b7fe700 1 -- 172.21.15.116:0/3843457601 learned_addr learned my addr 172.21.15.116:0/3843457601 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:13.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f120affd700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 0x7f120c1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f1203fff700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120c1601e0 0x7f120c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f120b7fe700 1 -- 172.21.15.116:0/3843457601 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 msgr2=0x7f120c1504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f120b7fe700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 0x7f120c1504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f120b7fe700 1 -- 172.21.15.116:0/3843457601 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120c1601e0 msgr2=0x7f120c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:13.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f120b7fe700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120c1601e0 0x7f120c15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:13.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.803+0000 7f120b7fe700 1 -- 172.21.15.116:0/3843457601 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0094a0 con 0x7f120c160d40 2023-05-12T09:08:13.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.804+0000 7f120b7fe700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f120c160d40 0x7f120c159960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1204014040 tx=0x7f1204004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:13.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.804+0000 7f12037fe700 1 -- 172.21.15.116:0/3843457601 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204012430 con 0x7f120c160d40 2023-05-12T09:08:13.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.804+0000 7f12037fe700 1 -- 172.21.15.116:0/3843457601 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1204020070 con 0x7f120c160d40 2023-05-12T09:08:13.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.804+0000 7f12115ff700 1 -- 172.21.15.116:0/3843457601 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1204009a70 con 0x7f120c160d40 2023-05-12T09:08:13.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.804+0000 7f12037fe700 1 -- 172.21.15.116:0/3843457601 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204003ea0 con 0x7f120c160d40 2023-05-12T09:08:13.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.804+0000 7f12115ff700 1 -- 172.21.15.116:0/3843457601 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120c0d1640 con 0x7f120c160d40 2023-05-12T09:08:13.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.805+0000 7f12115ff700 1 -- 172.21.15.116:0/3843457601 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120c0cd980 con 0x7f120c160d40 2023-05-12T09:08:13.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.806+0000 7f12037fe700 1 -- 172.21.15.116:0/3843457601 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1204004040 con 0x7f120c160d40 2023-05-12T09:08:13.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.807+0000 7f12037fe700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11ec06ace0 0x7f11ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:13.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.807+0000 7f12037fe700 1 -- 172.21.15.116:0/3843457601 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1204022070 con 0x7f120c160d40 2023-05-12T09:08:13.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.807+0000 7f120affd700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11ec06ace0 0x7f11ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:13.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.808+0000 7f120affd700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11ec06ace0 0x7f11ec06d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f120c15fd30 tx=0x7f11fc009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:13.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:13.812+0000 7f12037fe700 1 -- 172.21.15.116:0/3843457601 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1204056190 con 0x7f120c160d40 2023-05-12T09:08:14.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.003+0000 7f12115ff700 1 -- 172.21.15.116:0/3843457601 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f120c0d17d0 con 0x7f120c160d40 2023-05-12T09:08:14.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.003+0000 7f12037fe700 1 -- 172.21.15.116:0/3843457601 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f120402c020 con 0x7f120c160d40 2023-05-12T09:08:14.006 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:14.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.005+0000 7f12115ff700 1 -- 172.21.15.116:0/3843457601 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11ec06ace0 msgr2=0x7f11ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.005+0000 7f12115ff700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11ec06ace0 0x7f11ec06d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f120c15fd30 tx=0x7f11fc009210 comp rx=0 tx=0).stop 2023-05-12T09:08:14.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.005+0000 7f12115ff700 1 -- 172.21.15.116:0/3843457601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f120c160d40 msgr2=0x7f120c159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.005+0000 7f12115ff700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f120c160d40 0x7f120c159960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1204014040 tx=0x7f1204004ad0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.005+0000 7f12115ff700 1 -- 172.21.15.116:0/3843457601 shutdown_connections 2023-05-12T09:08:14.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.006+0000 7f12115ff700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f120c160d40 0x7f120c159960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.006+0000 7f12115ff700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f11ec06ace0 0x7f11ec06d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.006+0000 7f12115ff700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f120c0b87a0 0x7f120c1504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.006+0000 7f12115ff700 1 --2- 172.21.15.116:0/3843457601 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f120c1601e0 0x7f120c15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.006+0000 7f12115ff700 1 -- 172.21.15.116:0/3843457601 >> 172.21.15.116:0/3843457601 conn(0x7f120c071b10 msgr2=0x7f120c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:14.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.006+0000 7f12115ff700 1 -- 172.21.15.116:0/3843457601 shutdown_connections 2023-05-12T09:08:14.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.006+0000 7f12115ff700 1 -- 172.21.15.116:0/3843457601 wait complete. 2023-05-12T09:08:14.025 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.211+0000 7fd090dff700 1 Processor -- start 2023-05-12T09:08:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.211+0000 7fd090dff700 1 -- start start 2023-05-12T09:08:14.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.212+0000 7fd090dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fd08c06b4f0 0x7fd08c06b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.212+0000 7fd090dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd08c0d0130 0x7fd08c0cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.212+0000 7fd090dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0b26f0 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.212+0000 7fd090dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c06be00 con 0x7fd08c0d0130 2023-05-12T09:08:14.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.212+0000 7fd090dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c0cf890 con 0x7fd08c06b4f0 2023-05-12T09:08:14.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.212+0000 7fd083fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd08c0d0130 0x7fd08c0cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.212+0000 7fd083fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd08c0d0130 0x7fd08c0cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42956/0 (socket says 172.21.15.116:42956) 2023-05-12T09:08:14.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.212+0000 7fd083fff700 1 -- 172.21.15.116:0/2670542646 learned_addr learned my addr 172.21.15.116:0/2670542646 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.213+0000 7fd083fff700 1 -- 172.21.15.116:0/2670542646 >> v2:172.21.15.182:3300/0 conn(0x7fd08c06b4f0 msgr2=0x7fd08c06b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.213+0000 7fd083fff700 1 --2- 172.21.15.116:0/2670542646 >> v2:172.21.15.182:3300/0 conn(0x7fd08c06b4f0 0x7fd08c06b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.213+0000 7fd083fff700 1 -- 172.21.15.116:0/2670542646 >> v1:172.21.15.182:6789/0 conn(0x7fd08c0cd7d0 legacy=0x7fd08c0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.213+0000 7fd083fff700 1 -- 172.21.15.116:0/2670542646 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0cfb60 con 0x7fd08c0d0130 2023-05-12T09:08:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.213+0000 7fd083fff700 1 --2- 172.21.15.116:0/2670542646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0d0130 0x7fd08c0cf350 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd0740098f0 tx=0x7fd074009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7e0349ac1ce6db server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.213+0000 7fd089d9b700 1 -- 172.21.15.116:0/2670542646 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074004230 con 0x7fd08c0d0130 2023-05-12T09:08:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.213+0000 7fd089d9b700 1 -- 172.21.15.116:0/2670542646 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd074004390 con 0x7fd08c0d0130 2023-05-12T09:08:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.213+0000 7fd089d9b700 1 -- 172.21.15.116:0/2670542646 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740036a0 con 0x7fd08c0d0130 2023-05-12T09:08:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.214+0000 7fd090dff700 1 -- 172.21.15.116:0/2670542646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0d0130 msgr2=0x7fd08c0cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.214+0000 7fd090dff700 1 --2- 172.21.15.116:0/2670542646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0d0130 0x7fd08c0cf350 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd0740098f0 tx=0x7fd074009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.214+0000 7fd090dff700 1 -- 172.21.15.116:0/2670542646 shutdown_connections 2023-05-12T09:08:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.214+0000 7fd090dff700 1 --2- 172.21.15.116:0/2670542646 >> v2:172.21.15.182:3300/0 conn(0x7fd08c06b4f0 0x7fd08c06b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.214+0000 7fd090dff700 1 --2- 172.21.15.116:0/2670542646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0d0130 0x7fd08c0cf350 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.214+0000 7fd090dff700 1 -- 172.21.15.116:0/2670542646 >> 172.21.15.116:0/2670542646 conn(0x7fd08c09a090 msgr2=0x7fd08c0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.214+0000 7fd090dff700 1 -- 172.21.15.116:0/2670542646 shutdown_connections 2023-05-12T09:08:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.214+0000 7fd090dff700 1 -- 172.21.15.116:0/2670542646 wait complete. 2023-05-12T09:08:14.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.215+0000 7fd090dff700 1 Processor -- start 2023-05-12T09:08:14.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.216+0000 7fd090dff700 1 -- start start 2023-05-12T09:08:14.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.216+0000 7fd090dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd08c06b4f0 0x7fd08c15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd090dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0cd7d0 0x7fd08c0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd090dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd08c0d0130 0x7fd08c0b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd090dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c09ab00 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd090dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0b16f0 con 0x7fd08c06b4f0 2023-05-12T09:08:14.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd090dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0c97b0 con 0x7fd08c0d0130 2023-05-12T09:08:14.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd083fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0cd7d0 0x7fd08c0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd083fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0cd7d0 0x7fd08c0b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42966/0 (socket says 172.21.15.116:42966) 2023-05-12T09:08:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd083fff700 1 -- 172.21.15.116:0/1954968922 learned_addr learned my addr 172.21.15.116:0/1954968922 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd08a59c700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd08c06b4f0 0x7fd08c15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd08ad9d700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd08c0d0130 0x7fd08c0b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd083fff700 1 -- 172.21.15.116:0/1954968922 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd08c0d0130 msgr2=0x7fd08c0b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd083fff700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd08c0d0130 0x7fd08c0b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd083fff700 1 -- 172.21.15.116:0/1954968922 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd08c06b4f0 msgr2=0x7fd08c15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd083fff700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd08c06b4f0 0x7fd08c15b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd083fff700 1 -- 172.21.15.116:0/1954968922 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd074009550 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd08ad9d700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd08c0d0130 0x7fd08c0b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.217+0000 7fd083fff700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0cd7d0 0x7fd08c0b6350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd074009130 tx=0x7fd074004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.218+0000 7fd082ffd700 1 -- 172.21.15.116:0/1954968922 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074011630 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.218+0000 7fd082ffd700 1 -- 172.21.15.116:0/1954968922 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07401f070 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.218+0000 7fd090dff700 1 -- 172.21.15.116:0/1954968922 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c0cb4b0 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.218+0000 7fd082ffd700 1 -- 172.21.15.116:0/1954968922 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740119d0 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.218+0000 7fd090dff700 1 -- 172.21.15.116:0/1954968922 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c0cfe40 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.219+0000 7fd090dff700 1 -- 172.21.15.116:0/1954968922 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c0cb790 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.220+0000 7fd082ffd700 1 -- 172.21.15.116:0/1954968922 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd074021070 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.221+0000 7fd082ffd700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd06c06ace0 0x7fd06c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.221+0000 7fd082ffd700 1 -- 172.21.15.116:0/1954968922 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd07408aea0 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.221+0000 7fd08a59c700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd06c06ace0 0x7fd06c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.222+0000 7fd08a59c700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd06c06ace0 0x7fd06c06d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd07c006fd0 tx=0x7fd07c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:14.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.226+0000 7fd082ffd700 1 -- 172.21.15.116:0/1954968922 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd074055c10 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.420+0000 7fd090dff700 1 -- 172.21.15.116:0/1954968922 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd08c06d0a0 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.420+0000 7fd082ffd700 1 -- 172.21.15.116:0/1954968922 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd074059230 con 0x7fd08c0cd7d0 2023-05-12T09:08:14.424 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:14.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 -- 172.21.15.116:0/1954968922 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd06c06ace0 msgr2=0x7fd06c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd06c06ace0 0x7fd06c06d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd07c006fd0 tx=0x7fd07c008040 comp rx=0 tx=0).stop 2023-05-12T09:08:14.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 -- 172.21.15.116:0/1954968922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0cd7d0 msgr2=0x7fd08c0b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0cd7d0 0x7fd08c0b6350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd074009130 tx=0x7fd074004750 comp rx=0 tx=0).stop 2023-05-12T09:08:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 -- 172.21.15.116:0/1954968922 shutdown_connections 2023-05-12T09:08:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd06c06ace0 0x7fd06c06d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd08c0d0130 0x7fd08c0b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd08c06b4f0 0x7fd08c15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 --2- 172.21.15.116:0/1954968922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd08c0cd7d0 0x7fd08c0b6350 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 -- 172.21.15.116:0/1954968922 >> 172.21.15.116:0/1954968922 conn(0x7fd08c09a090 msgr2=0x7fd08c06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 -- 172.21.15.116:0/1954968922 shutdown_connections 2023-05-12T09:08:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.423+0000 7fd090dff700 1 -- 172.21.15.116:0/1954968922 wait complete. 2023-05-12T09:08:14.443 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.631+0000 7f56e39ff700 1 Processor -- start 2023-05-12T09:08:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.632+0000 7f56e39ff700 1 -- start start 2023-05-12T09:08:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.633+0000 7f56e39ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f56dc0b87a0 0x7f56dc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.633+0000 7f56e39ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc0cdc60 con 0x7f56dc1601e0 2023-05-12T09:08:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.633+0000 7f56e39ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc0cd6a0 con 0x7f56dc160d40 2023-05-12T09:08:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.633+0000 7f56e39ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56dc0d02d0 con 0x7f56dc0b87a0 2023-05-12T09:08:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.633+0000 7f56e0f9a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f56dc1601e0 0x7f56dc160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42422/0 (socket says 172.21.15.116:42422) 2023-05-12T09:08:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.633+0000 7f56e0f9a700 1 -- 172.21.15.116:0/1554655290 learned_addr learned my addr 172.21.15.116:0/1554655290 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.633+0000 7f56e179b700 1 --2- 172.21.15.116:0/1554655290 >> v2:172.21.15.182:3300/0 conn(0x7f56dc0b87a0 0x7f56dc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.633+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903980358 0 0) 0x7f56dc0cdc60 con 0x7f56dc1601e0 2023-05-12T09:08:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.633+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c80035b0 con 0x7f56dc1601e0 2023-05-12T09:08:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203769019 0 0) 0x7f56dc0cd6a0 con 0x7f56dc160d40 2023-05-12T09:08:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56dc0cdc60 con 0x7f56dc160d40 2023-05-12T09:08:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2051506197 0 0) 0x7f56c80035b0 con 0x7f56dc1601e0 2023-05-12T09:08:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 >> v2:172.21.15.182:3300/0 conn(0x7f56dc0b87a0 msgr2=0x7f56dc0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 --2- 172.21.15.116:0/1554655290 >> v2:172.21.15.182:3300/0 conn(0x7f56dc0b87a0 0x7f56dc0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 >> v1:172.21.15.182:6789/0 conn(0x7f56dc160d40 legacy=0x7f56dc0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0cd980 con 0x7f56dc1601e0 2023-05-12T09:08:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f56cc001670 con 0x7f56dc1601e0 2023-05-12T09:08:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 >> v1:172.21.15.116:6789/0 conn(0x7f56dc1601e0 legacy=0x7f56dc160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56c8003be0 0x7f56c8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56c8004850 0x7f56c8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56c8005200 0x7f56c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0d02d0 con 0x7f56c8003be0 2023-05-12T09:08:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c800c0e0 con 0x7f56c8005200 2023-05-12T09:08:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c800c270 con 0x7f56c8004850 2023-05-12T09:08:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56e179b700 1 --2- 172.21.15.116:0/1554655290 >> v2:172.21.15.182:3300/0 conn(0x7f56dc0b87a0 0x7f56dc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56e179b700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56c8003be0 0x7f56c8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56e1f9c700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56c8005200 0x7f56c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56e0f9a700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56c8004850 0x7f56c8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56e179b700 1 -- 172.21.15.116:0/1554655290 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56c8004850 msgr2=0x7f56c8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.634+0000 7f56e179b700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56c8004850 0x7f56c8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.635+0000 7f56e179b700 1 -- 172.21.15.116:0/1554655290 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56c8005200 msgr2=0x7f56c800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.635+0000 7f56e179b700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56c8005200 0x7f56c800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.635+0000 7f56e179b700 1 -- 172.21.15.116:0/1554655290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80035b0 con 0x7f56c8003be0 2023-05-12T09:08:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.635+0000 7f56e1f9c700 1 -- 172.21.15.116:0/1554655290 reap_dead start 2023-05-12T09:08:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.635+0000 7f56e179b700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56c8003be0 0x7f56c8003fd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009ce0 tx=0x7f56c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff4ed367232db0e server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:14.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.635+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8004030 con 0x7f56c8003be0 2023-05-12T09:08:14.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.635+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d8004190 con 0x7f56c8003be0 2023-05-12T09:08:14.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.635+0000 7f56d3fff700 1 -- 172.21.15.116:0/1554655290 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8004520 con 0x7f56c8003be0 2023-05-12T09:08:14.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.635+0000 7f56e39ff700 1 -- 172.21.15.116:0/1554655290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56c8003be0 msgr2=0x7f56c8003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.635+0000 7f56e39ff700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56c8003be0 0x7f56c8003fd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009ce0 tx=0x7f56c8005880 comp rx=0 tx=0).stop 2023-05-12T09:08:14.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.636+0000 7f56e39ff700 1 -- 172.21.15.116:0/1554655290 shutdown_connections 2023-05-12T09:08:14.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.636+0000 7f56e39ff700 1 --2- 172.21.15.116:0/1554655290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56c8003be0 0x7f56c8003fd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.636+0000 7f56e39ff700 1 -- 172.21.15.116:0/1554655290 >> 172.21.15.116:0/1554655290 conn(0x7f56dc071b10 msgr2=0x7f56dc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.636+0000 7f56e39ff700 1 -- 172.21.15.116:0/1554655290 shutdown_connections 2023-05-12T09:08:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.636+0000 7f56e39ff700 1 -- 172.21.15.116:0/1554655290 wait complete. 2023-05-12T09:08:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.637+0000 7f56e39ff700 1 Processor -- start 2023-05-12T09:08:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.637+0000 7f56e39ff700 1 -- start start 2023-05-12T09:08:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.638+0000 7f56e39ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56c8003be0 0x7f56dc14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.638+0000 7f56e39ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56dc0d1c20 0x7f56dc0d2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.638+0000 7f56e39ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56dc0ca010 0x7f56dc0ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.638+0000 7f56e39ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0d25b0 con 0x7f56dc0ca010 2023-05-12T09:08:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.638+0000 7f56e39ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc14d830 con 0x7f56c8003be0 2023-05-12T09:08:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.638+0000 7f56e39ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0cadd0 con 0x7f56dc0d1c20 2023-05-12T09:08:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e1f9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56dc0ca010 0x7f56dc0ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e1f9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56dc0ca010 0x7f56dc0ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42970/0 (socket says 172.21.15.116:42970) 2023-05-12T09:08:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e1f9c700 1 -- 172.21.15.116:0/4227499772 learned_addr learned my addr 172.21.15.116:0/4227499772 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e179b700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56c8003be0 0x7f56dc14d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e0f9a700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56dc0d1c20 0x7f56dc0d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e1f9c700 1 -- 172.21.15.116:0/4227499772 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56dc0d1c20 msgr2=0x7f56dc0d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e1f9c700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56dc0d1c20 0x7f56dc0d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e1f9c700 1 -- 172.21.15.116:0/4227499772 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56c8003be0 msgr2=0x7f56dc14d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e1f9c700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56c8003be0 0x7f56dc14d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e1f9c700 1 -- 172.21.15.116:0/4227499772 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0cfd80 con 0x7f56dc0ca010 2023-05-12T09:08:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e0f9a700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56dc0d1c20 0x7f56dc0d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56e1f9c700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56dc0ca010 0x7f56dc0ca480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0b1d10 tx=0x7f56d400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.639+0000 7f56d1ffb700 1 -- 172.21.15.116:0/4227499772 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4003c10 con 0x7f56dc0ca010 2023-05-12T09:08:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.640+0000 7f56d1ffb700 1 -- 172.21.15.116:0/4227499772 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d4003d70 con 0x7f56dc0ca010 2023-05-12T09:08:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.640+0000 7f56e39ff700 1 -- 172.21.15.116:0/4227499772 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc0cfbf0 con 0x7f56dc0ca010 2023-05-12T09:08:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.640+0000 7f56d1ffb700 1 -- 172.21.15.116:0/4227499772 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400dbd0 con 0x7f56dc0ca010 2023-05-12T09:08:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.640+0000 7f56e39ff700 1 -- 172.21.15.116:0/4227499772 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc0cff10 con 0x7f56dc0ca010 2023-05-12T09:08:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.641+0000 7f56e39ff700 1 -- 172.21.15.116:0/4227499772 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc0b52f0 con 0x7f56dc0ca010 2023-05-12T09:08:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.642+0000 7f56d1ffb700 1 -- 172.21.15.116:0/4227499772 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56d400dd30 con 0x7f56dc0ca010 2023-05-12T09:08:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.642+0000 7f56d1ffb700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c006ace0 0x7f56c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.642+0000 7f56d1ffb700 1 -- 172.21.15.116:0/4227499772 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f56d4089b50 con 0x7f56dc0ca010 2023-05-12T09:08:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.643+0000 7f56e179b700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c006ace0 0x7f56c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.643+0000 7f56e179b700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c006ace0 0x7f56c006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f56d80090b0 tx=0x7f56d801d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.647+0000 7f56d1ffb700 1 -- 172.21.15.116:0/4227499772 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f56d4054850 con 0x7f56dc0ca010 2023-05-12T09:08:14.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.841+0000 7f56e39ff700 1 -- 172.21.15.116:0/4227499772 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56dc0b6f90 con 0x7f56dc0ca010 2023-05-12T09:08:14.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.841+0000 7f56d1ffb700 1 -- 172.21.15.116:0/4227499772 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56d4057e70 con 0x7f56dc0ca010 2023-05-12T09:08:14.844 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:14.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.843+0000 7f56e39ff700 1 -- 172.21.15.116:0/4227499772 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c006ace0 msgr2=0x7f56c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.843+0000 7f56e39ff700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c006ace0 0x7f56c006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f56d80090b0 tx=0x7f56d801d040 comp rx=0 tx=0).stop 2023-05-12T09:08:14.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.843+0000 7f56e39ff700 1 -- 172.21.15.116:0/4227499772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56dc0ca010 msgr2=0x7f56dc0ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:14.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.843+0000 7f56e39ff700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56dc0ca010 0x7f56dc0ca480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0b1d10 tx=0x7f56d400d430 comp rx=0 tx=0).stop 2023-05-12T09:08:14.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.843+0000 7f56e39ff700 1 -- 172.21.15.116:0/4227499772 shutdown_connections 2023-05-12T09:08:14.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.843+0000 7f56e39ff700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56dc0ca010 0x7f56dc0ca480 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.843+0000 7f56e39ff700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f56c8003be0 0x7f56dc14d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.843+0000 7f56e39ff700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f56c006ace0 0x7f56c006d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.843+0000 7f56e39ff700 1 --2- 172.21.15.116:0/4227499772 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f56dc0d1c20 0x7f56dc0d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:14.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.843+0000 7f56e39ff700 1 -- 172.21.15.116:0/4227499772 >> 172.21.15.116:0/4227499772 conn(0x7f56dc071b10 msgr2=0x7f56dc071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:14.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.844+0000 7f56e39ff700 1 -- 172.21.15.116:0/4227499772 shutdown_connections 2023-05-12T09:08:14.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:14.844+0000 7f56e39ff700 1 -- 172.21.15.116:0/4227499772 wait complete. 2023-05-12T09:08:14.864 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.048+0000 7f2b28dff700 1 Processor -- start 2023-05-12T09:08:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.048+0000 7f2b28dff700 1 -- start start 2023-05-12T09:08:15.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.049+0000 7f2b28dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f2b2406b4f0 0x7f2b2406b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.049+0000 7f2b28dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2b240d0130 0x7f2b240cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.049+0000 7f2b28dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b240b26f0 con 0x7f2b240cd7d0 2023-05-12T09:08:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.049+0000 7f2b28dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2406be00 con 0x7f2b240d0130 2023-05-12T09:08:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.049+0000 7f2b28dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b240cf890 con 0x7f2b2406b4f0 2023-05-12T09:08:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b21d9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2b240d0130 0x7f2b240cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b22d9d700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f2b240cd7d0 0x7f2b240cdc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42426/0 (socket says 172.21.15.116:42426) 2023-05-12T09:08:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b22d9d700 1 -- 172.21.15.116:0/2469736073 learned_addr learned my addr 172.21.15.116:0/2469736073 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b2259c700 1 --2- 172.21.15.116:0/2469736073 >> v2:172.21.15.182:3300/0 conn(0x7f2b2406b4f0 0x7f2b2406b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b21d9b700 1 -- 172.21.15.116:0/2469736073 >> v2:172.21.15.182:3300/0 conn(0x7f2b2406b4f0 msgr2=0x7f2b2406b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b21d9b700 1 --2- 172.21.15.116:0/2469736073 >> v2:172.21.15.182:3300/0 conn(0x7f2b2406b4f0 0x7f2b2406b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b21d9b700 1 -- 172.21.15.116:0/2469736073 >> v1:172.21.15.116:6789/0 conn(0x7f2b240cd7d0 legacy=0x7f2b240cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b21d9b700 1 -- 172.21.15.116:0/2469736073 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b240cfb60 con 0x7f2b240d0130 2023-05-12T09:08:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b2159a700 1 -- 172.21.15.116:0/2469736073 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292741948 0 0) 0x7f2b240b26f0 con 0x7f2b240cd7d0 2023-05-12T09:08:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b21d9b700 1 --2- 172.21.15.116:0/2469736073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b240d0130 0x7f2b240cf350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009840 tx=0x7f2b18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1017a0f8be379aa server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.050+0000 7f2b2159a700 1 -- 172.21.15.116:0/2469736073 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18011830 con 0x7f2b240d0130 2023-05-12T09:08:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.051+0000 7f2b2159a700 1 -- 172.21.15.116:0/2469736073 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b18011990 con 0x7f2b240d0130 2023-05-12T09:08:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.051+0000 7f2b2159a700 1 -- 172.21.15.116:0/2469736073 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18011d20 con 0x7f2b240d0130 2023-05-12T09:08:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.051+0000 7f2b28dff700 1 -- 172.21.15.116:0/2469736073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b240d0130 msgr2=0x7f2b240cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.051+0000 7f2b28dff700 1 --2- 172.21.15.116:0/2469736073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b240d0130 0x7f2b240cf350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009840 tx=0x7f2b18009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.051+0000 7f2b28dff700 1 -- 172.21.15.116:0/2469736073 shutdown_connections 2023-05-12T09:08:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.051+0000 7f2b28dff700 1 --2- 172.21.15.116:0/2469736073 >> v2:172.21.15.182:3300/0 conn(0x7f2b2406b4f0 0x7f2b2406b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.051+0000 7f2b28dff700 1 --2- 172.21.15.116:0/2469736073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b240d0130 0x7f2b240cf350 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.051+0000 7f2b28dff700 1 -- 172.21.15.116:0/2469736073 >> 172.21.15.116:0/2469736073 conn(0x7f2b2409a090 msgr2=0x7f2b240d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.051+0000 7f2b28dff700 1 -- 172.21.15.116:0/2469736073 shutdown_connections 2023-05-12T09:08:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.051+0000 7f2b28dff700 1 -- 172.21.15.116:0/2469736073 wait complete. 2023-05-12T09:08:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.053+0000 7f2b28dff700 1 Processor -- start 2023-05-12T09:08:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.053+0000 7f2b28dff700 1 -- start start 2023-05-12T09:08:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.054+0000 7f2b28dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b2406b4f0 0x7f2b240c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.054+0000 7f2b28dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2b240cd7d0 0x7f2b2406f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.054+0000 7f2b28dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2b240d0130 0x7f2b2406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.054+0000 7f2b28dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241f2b00 con 0x7f2b2406b4f0 2023-05-12T09:08:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.054+0000 7f2b28dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241f2de0 con 0x7f2b240d0130 2023-05-12T09:08:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.054+0000 7f2b28dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241f30c0 con 0x7f2b240cd7d0 2023-05-12T09:08:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.054+0000 7f2b2259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b2406b4f0 0x7f2b240c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.054+0000 7f2b2259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b2406b4f0 0x7f2b240c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42990/0 (socket says 172.21.15.116:42990) 2023-05-12T09:08:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.054+0000 7f2b2259c700 1 -- 172.21.15.116:0/4051493876 learned_addr learned my addr 172.21.15.116:0/4051493876 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b2259c700 1 -- 172.21.15.116:0/4051493876 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2b240cd7d0 msgr2=0x7f2b2406f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b2259c700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2b240cd7d0 0x7f2b2406f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b2259c700 1 -- 172.21.15.116:0/4051493876 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2b240d0130 msgr2=0x7f2b2406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b2259c700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2b240d0130 0x7f2b2406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b2259c700 1 -- 172.21.15.116:0/4051493876 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b180094a0 con 0x7f2b2406b4f0 2023-05-12T09:08:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b2259c700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b2406b4f0 0x7f2b240c6140 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400d800 tx=0x7f2b1400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b12ffd700 1 -- 172.21.15.116:0/4051493876 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b140125f0 con 0x7f2b2406b4f0 2023-05-12T09:08:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b12ffd700 1 -- 172.21.15.116:0/4051493876 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b14012750 con 0x7f2b2406b4f0 2023-05-12T09:08:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b28dff700 1 -- 172.21.15.116:0/4051493876 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b240cb4b0 con 0x7f2b2406b4f0 2023-05-12T09:08:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b12ffd700 1 -- 172.21.15.116:0/4051493876 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14012b00 con 0x7f2b2406b4f0 2023-05-12T09:08:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.055+0000 7f2b28dff700 1 -- 172.21.15.116:0/4051493876 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b240cfe40 con 0x7f2b2406b4f0 2023-05-12T09:08:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.056+0000 7f2b28dff700 1 -- 172.21.15.116:0/4051493876 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b240cb790 con 0x7f2b2406b4f0 2023-05-12T09:08:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.057+0000 7f2b12ffd700 1 -- 172.21.15.116:0/4051493876 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b14012c60 con 0x7f2b2406b4f0 2023-05-12T09:08:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.058+0000 7f2b12ffd700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2b0406ace0 0x7f2b0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.058+0000 7f2b12ffd700 1 -- 172.21.15.116:0/4051493876 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2b14089b90 con 0x7f2b2406b4f0 2023-05-12T09:08:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.058+0000 7f2b21d9b700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2b0406ace0 0x7f2b0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.059+0000 7f2b21d9b700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2b0406ace0 0x7f2b0406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b2415ca30 tx=0x7f2b18010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.062+0000 7f2b12ffd700 1 -- 172.21.15.116:0/4051493876 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2b14054910 con 0x7f2b2406b4f0 2023-05-12T09:08:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.255+0000 7f2b28dff700 1 -- 172.21.15.116:0/4051493876 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b24072370 con 0x7f2b2406b4f0 2023-05-12T09:08:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.256+0000 7f2b12ffd700 1 -- 172.21.15.116:0/4051493876 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b14057f30 con 0x7f2b2406b4f0 2023-05-12T09:08:15.259 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 -- 172.21.15.116:0/4051493876 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2b0406ace0 msgr2=0x7f2b0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2b0406ace0 0x7f2b0406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b2415ca30 tx=0x7f2b18010000 comp rx=0 tx=0).stop 2023-05-12T09:08:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 -- 172.21.15.116:0/4051493876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b2406b4f0 msgr2=0x7f2b240c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b2406b4f0 0x7f2b240c6140 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400d800 tx=0x7f2b1400dbc0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 -- 172.21.15.116:0/4051493876 shutdown_connections 2023-05-12T09:08:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2b240d0130 0x7f2b2406f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b2406b4f0 0x7f2b240c6140 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2b0406ace0 0x7f2b0406d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 --2- 172.21.15.116:0/4051493876 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2b240cd7d0 0x7f2b2406f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 -- 172.21.15.116:0/4051493876 >> 172.21.15.116:0/4051493876 conn(0x7f2b2409a090 msgr2=0x7f2b240707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:15.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 -- 172.21.15.116:0/4051493876 shutdown_connections 2023-05-12T09:08:15.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.258+0000 7f2b28dff700 1 -- 172.21.15.116:0/4051493876 wait complete. 2023-05-12T09:08:15.278 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:15.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.463+0000 7f0396dff700 1 Processor -- start 2023-05-12T09:08:15.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.464+0000 7f0396dff700 1 -- start start 2023-05-12T09:08:15.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.465+0000 7f0396dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f03900cd520 0x7f03900cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.465+0000 7f0396dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039015d660 con 0x7f03900cfe20 2023-05-12T09:08:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.465+0000 7f0396dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039015cd70 con 0x7f039015a140 2023-05-12T09:08:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.465+0000 7f0396dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03900d02a0 con 0x7f03900cd520 2023-05-12T09:08:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f039539c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f03900cfe20 0x7f03900b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42434/0 (socket says 172.21.15.116:42434) 2023-05-12T09:08:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f039539c700 1 -- 172.21.15.116:0/1381116941 learned_addr learned my addr 172.21.15.116:0/1381116941 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038ffff700 1 --2- 172.21.15.116:0/1381116941 >> v2:172.21.15.182:3300/0 conn(0x7f03900cd520 0x7f03900cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340359211 0 0) 0x7f039015d660 con 0x7f03900cfe20 2023-05-12T09:08:15.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03800035b0 con 0x7f03900cfe20 2023-05-12T09:08:15.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170487055 0 0) 0x7f039015cd70 con 0x7f039015a140 2023-05-12T09:08:15.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f039015d660 con 0x7f039015a140 2023-05-12T09:08:15.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3592873345 0 0) 0x7f03800035b0 con 0x7f03900cfe20 2023-05-12T09:08:15.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 >> v2:172.21.15.182:3300/0 conn(0x7f03900cd520 msgr2=0x7f03900cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:15.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 --2- 172.21.15.116:0/1381116941 >> v2:172.21.15.182:3300/0 conn(0x7f03900cd520 0x7f03900cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 >> v1:172.21.15.182:6789/0 conn(0x7f039015a140 legacy=0x7f0390160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039015d010 con 0x7f03900cfe20 2023-05-12T09:08:15.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f03880019f0 con 0x7f03900cfe20 2023-05-12T09:08:15.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 >> v1:172.21.15.116:6789/0 conn(0x7f03900cfe20 legacy=0x7f03900b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0380003b90 0x7f0380003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0380004850 0x7f0380004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0380005200 0x7f038000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900d02a0 con 0x7f0380004850 2023-05-12T09:08:15.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038000c060 con 0x7f0380003b90 2023-05-12T09:08:15.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.466+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038000c220 con 0x7f0380005200 2023-05-12T09:08:15.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f038ffff700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0380004850 0x7f0380004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f0394b9b700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0380003b90 0x7f0380003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f039539c700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0380005200 0x7f038000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f038ffff700 1 -- 172.21.15.116:0/1381116941 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0380005200 msgr2=0x7f038000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:15.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f038ffff700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0380005200 0x7f038000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f038ffff700 1 -- 172.21.15.116:0/1381116941 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0380003b90 msgr2=0x7f0380003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:15.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f038ffff700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0380003b90 0x7f0380003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f038ffff700 1 -- 172.21.15.116:0/1381116941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03800035b0 con 0x7f0380004850 2023-05-12T09:08:15.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f039539c700 1 -- 172.21.15.116:0/1381116941 reap_dead start 2023-05-12T09:08:15.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f038ffff700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0380004850 0x7f0380004cc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f037c009b60 tx=0x7f0380005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f675cbd985610850 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:15.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c00e6c0 con 0x7f0380004850 2023-05-12T09:08:15.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c00e820 con 0x7f0380004850 2023-05-12T09:08:15.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.467+0000 7f038f7fe700 1 -- 172.21.15.116:0/1381116941 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c00eb90 con 0x7f0380004850 2023-05-12T09:08:15.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.468+0000 7f0396dff700 1 -- 172.21.15.116:0/1381116941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0380004850 msgr2=0x7f0380004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.468+0000 7f0396dff700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0380004850 0x7f0380004cc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f037c009b60 tx=0x7f0380005880 comp rx=0 tx=0).stop 2023-05-12T09:08:15.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.468+0000 7f0396dff700 1 -- 172.21.15.116:0/1381116941 shutdown_connections 2023-05-12T09:08:15.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.468+0000 7f0396dff700 1 --2- 172.21.15.116:0/1381116941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0380004850 0x7f0380004cc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.468+0000 7f0396dff700 1 -- 172.21.15.116:0/1381116941 >> 172.21.15.116:0/1381116941 conn(0x7f0390071b10 msgr2=0x7f0390071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:15.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.468+0000 7f0396dff700 1 -- 172.21.15.116:0/1381116941 shutdown_connections 2023-05-12T09:08:15.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.468+0000 7f0396dff700 1 -- 172.21.15.116:0/1381116941 wait complete. 2023-05-12T09:08:15.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.470+0000 7f0396dff700 1 Processor -- start 2023-05-12T09:08:15.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.470+0000 7f0396dff700 1 -- start start 2023-05-12T09:08:15.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.471+0000 7f0396dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0380004850 0x7f03900cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.471+0000 7f0396dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f03900cca00 0x7f03900b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.471+0000 7f0396dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03900cf280 0x7f03900c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.471+0000 7f0396dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900cc5e0 con 0x7f03900cf280 2023-05-12T09:08:15.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.471+0000 7f0396dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039014e780 con 0x7f03900cca00 2023-05-12T09:08:15.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.471+0000 7f0396dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03900b6240 con 0x7f0380004850 2023-05-12T09:08:15.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.471+0000 7f039539c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03900cf280 0x7f03900c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f0394b9b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0380004850 0x7f03900cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f039539c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03900cf280 0x7f03900c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43012/0 (socket says 172.21.15.116:43012) 2023-05-12T09:08:15.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f039539c700 1 -- 172.21.15.116:0/3516011572 learned_addr learned my addr 172.21.15.116:0/3516011572 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:15.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f038ffff700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f03900cca00 0x7f03900b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f039539c700 1 -- 172.21.15.116:0/3516011572 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0380004850 msgr2=0x7f03900cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f039539c700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0380004850 0x7f03900cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f039539c700 1 -- 172.21.15.116:0/3516011572 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f03900cca00 msgr2=0x7f03900b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f039539c700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f03900cca00 0x7f03900b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f039539c700 1 -- 172.21.15.116:0/3516011572 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039015daf0 con 0x7f03900cf280 2023-05-12T09:08:15.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f038ffff700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f03900cca00 0x7f03900b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:15.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f039539c700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03900cf280 0x7f03900c88c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0388000f80 tx=0x7f038800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:15.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.472+0000 7f038d7fa700 1 -- 172.21.15.116:0/3516011572 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038800ec40 con 0x7f03900cf280 2023-05-12T09:08:15.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.473+0000 7f038d7fa700 1 -- 172.21.15.116:0/3516011572 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038800eda0 con 0x7f03900cf280 2023-05-12T09:08:15.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.473+0000 7f0396dff700 1 -- 172.21.15.116:0/3516011572 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039015d2f0 con 0x7f03900cf280 2023-05-12T09:08:15.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.473+0000 7f038d7fa700 1 -- 172.21.15.116:0/3516011572 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388013660 con 0x7f03900cf280 2023-05-12T09:08:15.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.473+0000 7f0396dff700 1 -- 172.21.15.116:0/3516011572 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03900cdb00 con 0x7f03900cf280 2023-05-12T09:08:15.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.474+0000 7f0396dff700 1 -- 172.21.15.116:0/3516011572 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03900cc720 con 0x7f03900cf280 2023-05-12T09:08:15.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.475+0000 7f038d7fa700 1 -- 172.21.15.116:0/3516011572 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03880137c0 con 0x7f03900cf280 2023-05-12T09:08:15.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.476+0000 7f038d7fa700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f037406ace0 0x7f037406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.476+0000 7f038d7fa700 1 -- 172.21.15.116:0/3516011572 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0388089c80 con 0x7f03900cf280 2023-05-12T09:08:15.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.476+0000 7f0394b9b700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f037406ace0 0x7f037406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.477+0000 7f0394b9b700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f037406ace0 0x7f037406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0390063fb0 tx=0x7f0384009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:15.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.480+0000 7f038d7fa700 1 -- 172.21.15.116:0/3516011572 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f03900cc720 con 0x7f03900cf280 2023-05-12T09:08:15.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.676+0000 7f0396dff700 1 -- 172.21.15.116:0/3516011572 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f03900cc720 con 0x7f03900cf280 2023-05-12T09:08:15.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.676+0000 7f038d7fa700 1 -- 172.21.15.116:0/3516011572 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f03900cc720 con 0x7f03900cf280 2023-05-12T09:08:15.680 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:15.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.678+0000 7f0396dff700 1 -- 172.21.15.116:0/3516011572 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f037406ace0 msgr2=0x7f037406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.678+0000 7f0396dff700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f037406ace0 0x7f037406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0390063fb0 tx=0x7f0384009040 comp rx=0 tx=0).stop 2023-05-12T09:08:15.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.678+0000 7f0396dff700 1 -- 172.21.15.116:0/3516011572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03900cf280 msgr2=0x7f03900c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.678+0000 7f0396dff700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03900cf280 0x7f03900c88c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0388000f80 tx=0x7f038800e440 comp rx=0 tx=0).stop 2023-05-12T09:08:15.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.679+0000 7f0396dff700 1 -- 172.21.15.116:0/3516011572 shutdown_connections 2023-05-12T09:08:15.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.679+0000 7f0396dff700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03900cf280 0x7f03900c88c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.679+0000 7f0396dff700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f037406ace0 0x7f037406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.679+0000 7f0396dff700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0380004850 0x7f03900cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.679+0000 7f0396dff700 1 --2- 172.21.15.116:0/3516011572 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f03900cca00 0x7f03900b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.679+0000 7f0396dff700 1 -- 172.21.15.116:0/3516011572 >> 172.21.15.116:0/3516011572 conn(0x7f0390071b10 msgr2=0x7f03901608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:15.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.679+0000 7f0396dff700 1 -- 172.21.15.116:0/3516011572 shutdown_connections 2023-05-12T09:08:15.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.679+0000 7f0396dff700 1 -- 172.21.15.116:0/3516011572 wait complete. 2023-05-12T09:08:15.699 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:15.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.880+0000 7f96301ff700 1 Processor -- start 2023-05-12T09:08:15.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.880+0000 7f96301ff700 1 -- start start 2023-05-12T09:08:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.881+0000 7f96301ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 0x7f96281608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.881+0000 7f96301ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f96280d1100 0x7f96280d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.881+0000 7f96301ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96280d0020 con 0x7f96280b87a0 2023-05-12T09:08:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.881+0000 7f96301ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96280d02d0 con 0x7f96280d1100 2023-05-12T09:08:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.881+0000 7f96301ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96280d0cb0 con 0x7f96280cfbf0 2023-05-12T09:08:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962d79a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 0x7f96281608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962d79a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 0x7f96281608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:44278/0 (socket says 172.21.15.116:44278) 2023-05-12T09:08:15.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962d79a700 1 -- 172.21.15.116:0/857619299 learned_addr learned my addr 172.21.15.116:0/857619299 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:15.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962e79c700 1 --2- 172.21.15.116:0/857619299 >> v2:172.21.15.182:3300/0 conn(0x7f96280d1100 0x7f96280d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962df9b700 1 --1- 172.21.15.116:0/857619299 >> v1:172.21.15.182:6789/0 conn(0x7f96280b87a0 0x7f96281601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:34364/0 (socket says 172.21.15.116:34364) 2023-05-12T09:08:15.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962cf99700 1 -- 172.21.15.116:0/857619299 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636345950 0 0) 0x7f96280d0020 con 0x7f96280b87a0 2023-05-12T09:08:15.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962cf99700 1 -- 172.21.15.116:0/857619299 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96140035b0 con 0x7f96280b87a0 2023-05-12T09:08:15.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962d79a700 1 -- 172.21.15.116:0/857619299 >> v2:172.21.15.182:3300/0 conn(0x7f96280d1100 msgr2=0x7f96280d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:15.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962d79a700 1 --2- 172.21.15.116:0/857619299 >> v2:172.21.15.182:3300/0 conn(0x7f96280d1100 0x7f96280d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962d79a700 1 -- 172.21.15.116:0/857619299 >> v1:172.21.15.182:6789/0 conn(0x7f96280b87a0 legacy=0x7f96281601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962d79a700 1 -- 172.21.15.116:0/857619299 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96280cdc60 con 0x7f96280cfbf0 2023-05-12T09:08:15.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.882+0000 7f962e79c700 1 --2- 172.21.15.116:0/857619299 >> v2:172.21.15.182:3300/0 conn(0x7f96280d1100 0x7f96280d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:15.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f962d79a700 1 --2- 172.21.15.116:0/857619299 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 0x7f96281608f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f96180098f0 tx=0x7f9618009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2f2c830d6a26a72 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:15.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f962cf99700 1 -- 172.21.15.116:0/857619299 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618011830 con 0x7f96280cfbf0 2023-05-12T09:08:15.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f962cf99700 1 -- 172.21.15.116:0/857619299 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9618011990 con 0x7f96280cfbf0 2023-05-12T09:08:15.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f962cf99700 1 -- 172.21.15.116:0/857619299 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618011d20 con 0x7f96280cfbf0 2023-05-12T09:08:15.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f96301ff700 1 -- 172.21.15.116:0/857619299 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 msgr2=0x7f96281608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f96301ff700 1 --2- 172.21.15.116:0/857619299 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 0x7f96281608f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f96180098f0 tx=0x7f9618009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:15.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f96301ff700 1 -- 172.21.15.116:0/857619299 shutdown_connections 2023-05-12T09:08:15.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f96301ff700 1 --2- 172.21.15.116:0/857619299 >> v2:172.21.15.182:3300/0 conn(0x7f96280d1100 0x7f96280d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f96301ff700 1 --2- 172.21.15.116:0/857619299 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 0x7f96281608f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f96301ff700 1 -- 172.21.15.116:0/857619299 >> 172.21.15.116:0/857619299 conn(0x7f9628071b10 msgr2=0x7f9628071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:15.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.883+0000 7f96301ff700 1 -- 172.21.15.116:0/857619299 shutdown_connections 2023-05-12T09:08:15.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.884+0000 7f96301ff700 1 -- 172.21.15.116:0/857619299 wait complete. 2023-05-12T09:08:15.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.885+0000 7f96301ff700 1 Processor -- start 2023-05-12T09:08:15.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.885+0000 7f96301ff700 1 -- start start 2023-05-12T09:08:15.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.886+0000 7f96301ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96280b87a0 0x7f96281516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.886+0000 7f96301ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 0x7f9628159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.886+0000 7f96301ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96280d1100 0x7f962815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.886+0000 7f96301ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962815f150 con 0x7f96280b87a0 2023-05-12T09:08:15.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.886+0000 7f96301ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962815cca0 con 0x7f96280d1100 2023-05-12T09:08:15.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.886+0000 7f96301ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962815dc70 con 0x7f96280cfbf0 2023-05-12T09:08:15.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.886+0000 7f962df9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96280b87a0 0x7f96281516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f962df9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96280b87a0 0x7f96281516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43024/0 (socket says 172.21.15.116:43024) 2023-05-12T09:08:15.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f962df9b700 1 -- 172.21.15.116:0/494700548 learned_addr learned my addr 172.21.15.116:0/494700548 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:15.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f962df9b700 1 -- 172.21.15.116:0/494700548 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 msgr2=0x7f9628159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f962df9b700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 0x7f9628159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f962df9b700 1 -- 172.21.15.116:0/494700548 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96280d1100 msgr2=0x7f962815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:15.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f962df9b700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96280d1100 0x7f962815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:15.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f962df9b700 1 -- 172.21.15.116:0/494700548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9620009a70 con 0x7f96280b87a0 2023-05-12T09:08:15.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f962df9b700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96280b87a0 0x7f96281516c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f962400c4d0 tx=0x7f962400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:15.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f961e7fc700 1 -- 172.21.15.116:0/494700548 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624005cb0 con 0x7f96280b87a0 2023-05-12T09:08:15.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f961e7fc700 1 -- 172.21.15.116:0/494700548 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9624005e10 con 0x7f96280b87a0 2023-05-12T09:08:15.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f961e7fc700 1 -- 172.21.15.116:0/494700548 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240072d0 con 0x7f96280b87a0 2023-05-12T09:08:15.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f96301ff700 1 -- 172.21.15.116:0/494700548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9618009550 con 0x7f96280b87a0 2023-05-12T09:08:15.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.887+0000 7f96301ff700 1 -- 172.21.15.116:0/494700548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96280cd980 con 0x7f96280b87a0 2023-05-12T09:08:15.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.888+0000 7f96301ff700 1 -- 172.21.15.116:0/494700548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96280cd6a0 con 0x7f96280b87a0 2023-05-12T09:08:15.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.889+0000 7f961e7fc700 1 -- 172.21.15.116:0/494700548 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9624007430 con 0x7f96280b87a0 2023-05-12T09:08:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.890+0000 7f961e7fc700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f960c06ace0 0x7f960c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.890+0000 7f961e7fc700 1 -- 172.21.15.116:0/494700548 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9624088aa0 con 0x7f96280b87a0 2023-05-12T09:08:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.890+0000 7f962d79a700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f960c06ace0 0x7f960c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.891+0000 7f962d79a700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f960c06ace0 0x7f960c06d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f962815cad0 tx=0x7f9618010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:15.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:15.895+0000 7f961e7fc700 1 -- 172.21.15.116:0/494700548 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9624053960 con 0x7f96280b87a0 2023-05-12T09:08:16.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.091+0000 7f96301ff700 1 -- 172.21.15.116:0/494700548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9628160e30 con 0x7f96280b87a0 2023-05-12T09:08:16.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.092+0000 7f961e7fc700 1 -- 172.21.15.116:0/494700548 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7f9624056f80 con 0x7f96280b87a0 2023-05-12T09:08:16.095 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:16.095 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:16.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 -- 172.21.15.116:0/494700548 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f960c06ace0 msgr2=0x7f960c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f960c06ace0 0x7f960c06d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f962815cad0 tx=0x7f9618010000 comp rx=0 tx=0).stop 2023-05-12T09:08:16.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 -- 172.21.15.116:0/494700548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96280b87a0 msgr2=0x7f96281516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96280b87a0 0x7f96281516c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f962400c4d0 tx=0x7f962400c890 comp rx=0 tx=0).stop 2023-05-12T09:08:16.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 -- 172.21.15.116:0/494700548 shutdown_connections 2023-05-12T09:08:16.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f96280d1100 0x7f962815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96280b87a0 0x7f96281516c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f960c06ace0 0x7f960c06d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 --2- 172.21.15.116:0/494700548 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f96280cfbf0 0x7f9628159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 -- 172.21.15.116:0/494700548 >> 172.21.15.116:0/494700548 conn(0x7f9628071b10 msgr2=0x7f96280cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:16.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 -- 172.21.15.116:0/494700548 shutdown_connections 2023-05-12T09:08:16.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.094+0000 7f96301ff700 1 -- 172.21.15.116:0/494700548 wait complete. 2023-05-12T09:08:16.114 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:16.115 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:16.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.300+0000 7fc8af9ff700 1 Processor -- start 2023-05-12T09:08:16.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.300+0000 7fc8af9ff700 1 -- start start 2023-05-12T09:08:16.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.301+0000 7fc8af9ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc8a80cfbf0 0x7fc8a81608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.301+0000 7fc8af9ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a80d0020 con 0x7fc8a80b87a0 2023-05-12T09:08:16.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.301+0000 7fc8af9ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a80cdc60 con 0x7fc8a80d1100 2023-05-12T09:08:16.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.301+0000 7fc8af9ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a80d02d0 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.301+0000 7fc8ad79b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc8a80b87a0 0x7fc8a81601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42450/0 (socket says 172.21.15.116:42450) 2023-05-12T09:08:16.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.301+0000 7fc8ad79b700 1 -- 172.21.15.116:0/884400947 learned_addr learned my addr 172.21.15.116:0/884400947 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:16.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.302+0000 7fc8acf9a700 1 --2- 172.21.15.116:0/884400947 >> v2:172.21.15.182:3300/0 conn(0x7fc8a80cfbf0 0x7fc8a81608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.302+0000 7fc89ffff700 1 -- 172.21.15.116:0/884400947 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660834518 0 0) 0x7fc8a80d0020 con 0x7fc8a80b87a0 2023-05-12T09:08:16.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.302+0000 7fc89ffff700 1 -- 172.21.15.116:0/884400947 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8940035b0 con 0x7fc8a80b87a0 2023-05-12T09:08:16.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.302+0000 7fc89ffff700 1 -- 172.21.15.116:0/884400947 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770325621 0 0) 0x7fc8a80cdc60 con 0x7fc8a80d1100 2023-05-12T09:08:16.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.302+0000 7fc89ffff700 1 -- 172.21.15.116:0/884400947 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a80d0020 con 0x7fc8a80d1100 2023-05-12T09:08:16.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.302+0000 7fc89ffff700 1 -- 172.21.15.116:0/884400947 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2080089084 0 0) 0x7fc8940035b0 con 0x7fc8a80b87a0 2023-05-12T09:08:16.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.302+0000 7fc8acf9a700 1 -- 172.21.15.116:0/884400947 >> v1:172.21.15.182:6789/0 conn(0x7fc8a80d1100 legacy=0x7fc8a80d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.302+0000 7fc8acf9a700 1 -- 172.21.15.116:0/884400947 >> v1:172.21.15.116:6789/0 conn(0x7fc8a80b87a0 legacy=0x7fc8a81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.302+0000 7fc8acf9a700 1 -- 172.21.15.116:0/884400947 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80cd6a0 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.302+0000 7fc8acf9a700 1 --2- 172.21.15.116:0/884400947 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8a80cfbf0 0x7fc8a81608f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc898009840 tx=0x7fc898009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca13aa63f9e3ccad server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:16.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.303+0000 7fc89ffff700 1 -- 172.21.15.116:0/884400947 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4001670 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.303+0000 7fc89ffff700 1 -- 172.21.15.116:0/884400947 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc898004030 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.303+0000 7fc89ffff700 1 -- 172.21.15.116:0/884400947 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980043c0 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.303+0000 7fc8af9ff700 1 -- 172.21.15.116:0/884400947 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8a80cfbf0 msgr2=0x7fc8a81608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.303+0000 7fc8af9ff700 1 --2- 172.21.15.116:0/884400947 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8a80cfbf0 0x7fc8a81608f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc898009840 tx=0x7fc898009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:16.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.303+0000 7fc8af9ff700 1 -- 172.21.15.116:0/884400947 shutdown_connections 2023-05-12T09:08:16.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.303+0000 7fc8af9ff700 1 --2- 172.21.15.116:0/884400947 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8a80cfbf0 0x7fc8a81608f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.303+0000 7fc8af9ff700 1 -- 172.21.15.116:0/884400947 >> 172.21.15.116:0/884400947 conn(0x7fc8a8071b10 msgr2=0x7fc8a8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:16.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.303+0000 7fc8af9ff700 1 -- 172.21.15.116:0/884400947 shutdown_connections 2023-05-12T09:08:16.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.303+0000 7fc8af9ff700 1 -- 172.21.15.116:0/884400947 wait complete. 2023-05-12T09:08:16.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.305+0000 7fc8af9ff700 1 Processor -- start 2023-05-12T09:08:16.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.305+0000 7fc8af9ff700 1 -- start start 2023-05-12T09:08:16.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.306+0000 7fc8af9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc8a80b87a0 0x7fc8a81e6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.306+0000 7fc8af9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a80cfbf0 0x7fc8a81e8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.306+0000 7fc8af9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8a80d1100 0x7fc8a80cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.306+0000 7fc8af9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a81e6760 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.306+0000 7fc8af9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a81e61a0 con 0x7fc8a80d1100 2023-05-12T09:08:16.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.306+0000 7fc8af9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a81e6480 con 0x7fc8a80b87a0 2023-05-12T09:08:16.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.306+0000 7fc8acf9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a80cfbf0 0x7fc8a81e8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.306+0000 7fc8acf9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a80cfbf0 0x7fc8a81e8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43028/0 (socket says 172.21.15.116:43028) 2023-05-12T09:08:16.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.306+0000 7fc8acf9a700 1 -- 172.21.15.116:0/4238908465 learned_addr learned my addr 172.21.15.116:0/4238908465 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:16.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8acf9a700 1 -- 172.21.15.116:0/4238908465 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc8a80b87a0 msgr2=0x7fc8a81e6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8ad79b700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc8a80b87a0 0x7fc8a81e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8acf9a700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc8a80b87a0 0x7fc8a81e6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8adf9c700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8a80d1100 0x7fc8a80cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8acf9a700 1 -- 172.21.15.116:0/4238908465 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8a80d1100 msgr2=0x7fc8a80cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8acf9a700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8a80d1100 0x7fc8a80cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8acf9a700 1 -- 172.21.15.116:0/4238908465 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980094a0 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8ad79b700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc8a80b87a0 0x7fc8a81e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:16.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8adf9c700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8a80d1100 0x7fc8a80cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:16.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8acf9a700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a80cfbf0 0x7fc8a81e8b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc8980090b0 tx=0x7fc898004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:16.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc89dffb700 1 -- 172.21.15.116:0/4238908465 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898011830 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc89dffb700 1 -- 172.21.15.116:0/4238908465 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89801f070 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc8af9ff700 1 -- 172.21.15.116:0/4238908465 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a8160e30 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.307+0000 7fc89dffb700 1 -- 172.21.15.116:0/4238908465 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898011bf0 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.308+0000 7fc8af9ff700 1 -- 172.21.15.116:0/4238908465 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a80cd980 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.309+0000 7fc8af9ff700 1 -- 172.21.15.116:0/4238908465 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a8160fc0 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.309+0000 7fc89dffb700 1 -- 172.21.15.116:0/4238908465 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc898011d50 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.311+0000 7fc89dffb700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc88c06ace0 0x7fc88c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.311+0000 7fc89dffb700 1 -- 172.21.15.116:0/4238908465 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc898021070 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.311+0000 7fc8ad79b700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc88c06ace0 0x7fc88c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.317 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.312+0000 7fc8ad79b700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc88c06ace0 0x7fc88c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40079b0 tx=0x7fc8a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:16.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.316+0000 7fc89dffb700 1 -- 172.21.15.116:0/4238908465 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc898059940 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.508+0000 7fc8af9ff700 1 -- 172.21.15.116:0/4238908465 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8a8072190 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.508+0000 7fc89dffb700 1 -- 172.21.15.116:0/4238908465 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc8980594d0 con 0x7fc8a80cfbf0 2023-05-12T09:08:16.512 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:16.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 -- 172.21.15.116:0/4238908465 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc88c06ace0 msgr2=0x7fc88c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc88c06ace0 0x7fc88c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40079b0 tx=0x7fc8a4009040 comp rx=0 tx=0).stop 2023-05-12T09:08:16.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 -- 172.21.15.116:0/4238908465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a80cfbf0 msgr2=0x7fc8a81e8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a80cfbf0 0x7fc8a81e8b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc8980090b0 tx=0x7fc898004750 comp rx=0 tx=0).stop 2023-05-12T09:08:16.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 -- 172.21.15.116:0/4238908465 shutdown_connections 2023-05-12T09:08:16.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8a80d1100 0x7fc8a80cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc88c06ace0 0x7fc88c06d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc8a80b87a0 0x7fc8a81e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 --2- 172.21.15.116:0/4238908465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a80cfbf0 0x7fc8a81e8b10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 -- 172.21.15.116:0/4238908465 >> 172.21.15.116:0/4238908465 conn(0x7fc8a8071b10 msgr2=0x7fc8a80b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:16.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 -- 172.21.15.116:0/4238908465 shutdown_connections 2023-05-12T09:08:16.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.511+0000 7fc8af9ff700 1 -- 172.21.15.116:0/4238908465 wait complete. 2023-05-12T09:08:16.531 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:16.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.716+0000 7f04ad1ff700 1 Processor -- start 2023-05-12T09:08:16.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.716+0000 7f04ad1ff700 1 -- start start 2023-05-12T09:08:16.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.717+0000 7f04ad1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a81589d0 0x7f04a80cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.717+0000 7f04ad1ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f04a80cd690 0x7f04a806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.717+0000 7f04ad1ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a80ca890 con 0x7f04a8158da0 2023-05-12T09:08:16.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.717+0000 7f04ad1ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a80ca5b0 con 0x7f04a80cd690 2023-05-12T09:08:16.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.717+0000 7f04ad1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80cc670 con 0x7f04a81589d0 2023-05-12T09:08:16.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.717+0000 7f04a6d9d700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a81589d0 0x7f04a80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.717+0000 7f04a659c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f04a80cd690 0x7f04a806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.717+0000 7f04a759e700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f04a8158da0 0x7f04a806a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:34380/0 (socket says 172.21.15.116:34380) 2023-05-12T09:08:16.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.718+0000 7f04a759e700 1 -- 172.21.15.116:0/2669993655 learned_addr learned my addr 172.21.15.116:0/2669993655 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:16.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.718+0000 7f04a5d9b700 1 -- 172.21.15.116:0/2669993655 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581312541 0 0) 0x7f04a80ca890 con 0x7f04a8158da0 2023-05-12T09:08:16.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.718+0000 7f04a5d9b700 1 -- 172.21.15.116:0/2669993655 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04900035b0 con 0x7f04a8158da0 2023-05-12T09:08:16.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.718+0000 7f04a6d9d700 1 -- 172.21.15.116:0/2669993655 >> v2:172.21.15.182:3300/0 conn(0x7f04a80cd690 msgr2=0x7f04a806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:16.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.718+0000 7f04a6d9d700 1 --2- 172.21.15.116:0/2669993655 >> v2:172.21.15.182:3300/0 conn(0x7f04a80cd690 0x7f04a806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.718+0000 7f04a6d9d700 1 -- 172.21.15.116:0/2669993655 >> v1:172.21.15.182:6789/0 conn(0x7f04a8158da0 legacy=0x7f04a806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.718+0000 7f04a6d9d700 1 -- 172.21.15.116:0/2669993655 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a80cc950 con 0x7f04a81589d0 2023-05-12T09:08:16.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.718+0000 7f04a659c700 1 --2- 172.21.15.116:0/2669993655 >> v2:172.21.15.182:3300/0 conn(0x7f04a80cd690 0x7f04a806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:16.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.718+0000 7f04a6d9d700 1 --2- 172.21.15.116:0/2669993655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a81589d0 0x7f04a80cd150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0498009840 tx=0x7f0498009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79ae41b3d7ffdf17 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:16.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04a5d9b700 1 -- 172.21.15.116:0/2669993655 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498011830 con 0x7f04a81589d0 2023-05-12T09:08:16.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04a5d9b700 1 -- 172.21.15.116:0/2669993655 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0498011990 con 0x7f04a81589d0 2023-05-12T09:08:16.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04a5d9b700 1 -- 172.21.15.116:0/2669993655 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498011d20 con 0x7f04a81589d0 2023-05-12T09:08:16.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04ad1ff700 1 -- 172.21.15.116:0/2669993655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a81589d0 msgr2=0x7f04a80cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04ad1ff700 1 --2- 172.21.15.116:0/2669993655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a81589d0 0x7f04a80cd150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0498009840 tx=0x7f0498009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:16.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04ad1ff700 1 -- 172.21.15.116:0/2669993655 shutdown_connections 2023-05-12T09:08:16.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04ad1ff700 1 --2- 172.21.15.116:0/2669993655 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a81589d0 0x7f04a80cd150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04ad1ff700 1 --2- 172.21.15.116:0/2669993655 >> v2:172.21.15.182:3300/0 conn(0x7f04a80cd690 0x7f04a806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04ad1ff700 1 -- 172.21.15.116:0/2669993655 >> 172.21.15.116:0/2669993655 conn(0x7f04a80cf720 msgr2=0x7f04a80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:16.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04ad1ff700 1 -- 172.21.15.116:0/2669993655 shutdown_connections 2023-05-12T09:08:16.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.719+0000 7f04ad1ff700 1 -- 172.21.15.116:0/2669993655 wait complete. 2023-05-12T09:08:16.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.721+0000 7f04ad1ff700 1 Processor -- start 2023-05-12T09:08:16.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.721+0000 7f04ad1ff700 1 -- start start 2023-05-12T09:08:16.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.722+0000 7f04ad1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a80cd690 0x7f04a814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.722+0000 7f04ad1ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04a81589d0 0x7f04a814a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.722+0000 7f04ad1ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04a8158da0 0x7f04a81591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.722+0000 7f04ad1ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a81edf80 con 0x7f04a8158da0 2023-05-12T09:08:16.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.722+0000 7f04ad1ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a814ea80 con 0x7f04a81589d0 2023-05-12T09:08:16.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.722+0000 7f04ad1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a814ed60 con 0x7f04a80cd690 2023-05-12T09:08:16.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.722+0000 7f04a759e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04a8158da0 0x7f04a81591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.722+0000 7f04a759e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04a8158da0 0x7f04a81591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43034/0 (socket says 172.21.15.116:43034) 2023-05-12T09:08:16.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.722+0000 7f04a759e700 1 -- 172.21.15.116:0/1408174035 learned_addr learned my addr 172.21.15.116:0/1408174035 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:16.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04a6d9d700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a80cd690 0x7f04a814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04a659c700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04a81589d0 0x7f04a814a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04a759e700 1 -- 172.21.15.116:0/1408174035 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a80cd690 msgr2=0x7f04a814e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04a759e700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a80cd690 0x7f04a814e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04a759e700 1 -- 172.21.15.116:0/1408174035 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04a81589d0 msgr2=0x7f04a814a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04a759e700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04a81589d0 0x7f04a814a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04a759e700 1 -- 172.21.15.116:0/1408174035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c00a5d0 con 0x7f04a8158da0 2023-05-12T09:08:16.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04a659c700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04a81589d0 0x7f04a814a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:16.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04a759e700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04a8158da0 0x7f04a81591f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f04a000ca70 tx=0x7f04a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:16.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f048f7fe700 1 -- 172.21.15.116:0/1408174035 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000aaa0 con 0x7f04a8158da0 2023-05-12T09:08:16.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f048f7fe700 1 -- 172.21.15.116:0/1408174035 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a000ac00 con 0x7f04a8158da0 2023-05-12T09:08:16.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04ad1ff700 1 -- 172.21.15.116:0/1408174035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04980094a0 con 0x7f04a8158da0 2023-05-12T09:08:16.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f048f7fe700 1 -- 172.21.15.116:0/1408174035 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0012400 con 0x7f04a8158da0 2023-05-12T09:08:16.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.723+0000 7f04ad1ff700 1 -- 172.21.15.116:0/1408174035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a806aaf0 con 0x7f04a8158da0 2023-05-12T09:08:16.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.724+0000 7f04ad1ff700 1 -- 172.21.15.116:0/1408174035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a80ccc30 con 0x7f04a8158da0 2023-05-12T09:08:16.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.725+0000 7f048f7fe700 1 -- 172.21.15.116:0/1408174035 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04a0012560 con 0x7f04a8158da0 2023-05-12T09:08:16.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.726+0000 7f048f7fe700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f049406ace0 0x7f049406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:16.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.726+0000 7f048f7fe700 1 -- 172.21.15.116:0/1408174035 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f04a0089400 con 0x7f04a8158da0 2023-05-12T09:08:16.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.726+0000 7f04a6d9d700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f049406ace0 0x7f049406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:16.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.727+0000 7f04a6d9d700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f049406ace0 0x7f049406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0498000c00 tx=0x7f0498008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:16.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.730+0000 7f048f7fe700 1 -- 172.21.15.116:0/1408174035 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f04a0054230 con 0x7f04a8158da0 2023-05-12T09:08:16.928 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.925+0000 7f04ad1ff700 1 -- 172.21.15.116:0/1408174035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04a806ac80 con 0x7f04a8158da0 2023-05-12T09:08:16.928 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.925+0000 7f048f7fe700 1 -- 172.21.15.116:0/1408174035 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04a0057850 con 0x7f04a8158da0 2023-05-12T09:08:16.928 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:16.930 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.927+0000 7f04ad1ff700 1 -- 172.21.15.116:0/1408174035 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f049406ace0 msgr2=0x7f049406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.927+0000 7f04ad1ff700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f049406ace0 0x7f049406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0498000c00 tx=0x7f0498008030 comp rx=0 tx=0).stop 2023-05-12T09:08:16.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.927+0000 7f04ad1ff700 1 -- 172.21.15.116:0/1408174035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04a8158da0 msgr2=0x7f04a81591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:16.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.927+0000 7f04ad1ff700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04a8158da0 0x7f04a81591f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f04a000ca70 tx=0x7f04a000ce30 comp rx=0 tx=0).stop 2023-05-12T09:08:16.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.927+0000 7f04ad1ff700 1 -- 172.21.15.116:0/1408174035 shutdown_connections 2023-05-12T09:08:16.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.927+0000 7f04ad1ff700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04a8158da0 0x7f04a81591f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.927+0000 7f04ad1ff700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f049406ace0 0x7f049406d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.928+0000 7f04ad1ff700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f04a80cd690 0x7f04a814e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.928+0000 7f04ad1ff700 1 --2- 172.21.15.116:0/1408174035 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f04a81589d0 0x7f04a814a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:16.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.928+0000 7f04ad1ff700 1 -- 172.21.15.116:0/1408174035 >> 172.21.15.116:0/1408174035 conn(0x7f04a80cf720 msgr2=0x7f04a80af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:16.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.928+0000 7f04ad1ff700 1 -- 172.21.15.116:0/1408174035 shutdown_connections 2023-05-12T09:08:16.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:16.928+0000 7f04ad1ff700 1 -- 172.21.15.116:0/1408174035 wait complete. 2023-05-12T09:08:16.948 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:17.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.132+0000 7fde0abff700 1 Processor -- start 2023-05-12T09:08:17.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.133+0000 7fde0abff700 1 -- start start 2023-05-12T09:08:17.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.134+0000 7fde0abff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fde040d2110 0x7fde04167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.134+0000 7fde0abff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde04161000 con 0x7fde040cfbf0 2023-05-12T09:08:17.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.134+0000 7fde0abff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde040d0020 con 0x7fde040b87a0 2023-05-12T09:08:17.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.134+0000 7fde0abff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde040d02d0 con 0x7fde040d2110 2023-05-12T09:08:17.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.134+0000 7fde03fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fde040cfbf0 0x7fde041608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42460/0 (socket says 172.21.15.116:42460) 2023-05-12T09:08:17.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.134+0000 7fde03fff700 1 -- 172.21.15.116:0/2845002156 learned_addr learned my addr 172.21.15.116:0/2845002156 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:17.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.134+0000 7fde0919c700 1 --2- 172.21.15.116:0/2845002156 >> v2:172.21.15.182:3300/0 conn(0x7fde040d2110 0x7fde04167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.134+0000 7fde037fe700 1 -- 172.21.15.116:0/2845002156 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366945214 0 0) 0x7fde04161000 con 0x7fde040cfbf0 2023-05-12T09:08:17.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.135+0000 7fde037fe700 1 -- 172.21.15.116:0/2845002156 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf40035b0 con 0x7fde040cfbf0 2023-05-12T09:08:17.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.135+0000 7fde037fe700 1 -- 172.21.15.116:0/2845002156 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94132894 0 0) 0x7fde040d0020 con 0x7fde040b87a0 2023-05-12T09:08:17.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.135+0000 7fde037fe700 1 -- 172.21.15.116:0/2845002156 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde04161000 con 0x7fde040b87a0 2023-05-12T09:08:17.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.135+0000 7fde0919c700 1 -- 172.21.15.116:0/2845002156 >> v1:172.21.15.182:6789/0 conn(0x7fde040b87a0 legacy=0x7fde041601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.135+0000 7fde0919c700 1 -- 172.21.15.116:0/2845002156 >> v1:172.21.15.116:6789/0 conn(0x7fde040cfbf0 legacy=0x7fde041608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.135+0000 7fde0919c700 1 -- 172.21.15.116:0/2845002156 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040cdc60 con 0x7fde040d2110 2023-05-12T09:08:17.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.135+0000 7fde0919c700 1 --2- 172.21.15.116:0/2845002156 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fde040d2110 0x7fde04167550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009d90 tx=0x7fddfc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af7e46ad58adf7db server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:17.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.135+0000 7fde037fe700 1 -- 172.21.15.116:0/2845002156 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00e070 con 0x7fde040d2110 2023-05-12T09:08:17.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.135+0000 7fde037fe700 1 -- 172.21.15.116:0/2845002156 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc00bb20 con 0x7fde040d2110 2023-05-12T09:08:17.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.135+0000 7fde037fe700 1 -- 172.21.15.116:0/2845002156 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc012430 con 0x7fde040d2110 2023-05-12T09:08:17.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.136+0000 7fde0abff700 1 -- 172.21.15.116:0/2845002156 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fde040d2110 msgr2=0x7fde04167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.136+0000 7fde0abff700 1 --2- 172.21.15.116:0/2845002156 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fde040d2110 0x7fde04167550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009d90 tx=0x7fddfc00b330 comp rx=0 tx=0).stop 2023-05-12T09:08:17.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.136+0000 7fde0abff700 1 -- 172.21.15.116:0/2845002156 shutdown_connections 2023-05-12T09:08:17.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.136+0000 7fde0abff700 1 --2- 172.21.15.116:0/2845002156 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fde040d2110 0x7fde04167550 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.136+0000 7fde0abff700 1 -- 172.21.15.116:0/2845002156 >> 172.21.15.116:0/2845002156 conn(0x7fde04071b10 msgr2=0x7fde04071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:17.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.136+0000 7fde0abff700 1 -- 172.21.15.116:0/2845002156 shutdown_connections 2023-05-12T09:08:17.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.136+0000 7fde0abff700 1 -- 172.21.15.116:0/2845002156 wait complete. 2023-05-12T09:08:17.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.138+0000 7fde0abff700 1 Processor -- start 2023-05-12T09:08:17.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.139+0000 7fde0abff700 1 -- start start 2023-05-12T09:08:17.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0abff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde040b87a0 0x7fde0414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0abff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fde040cfbf0 0x7fde041562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0abff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fde040d2110 0x7fde0414ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0abff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde04157300 con 0x7fde040b87a0 2023-05-12T09:08:17.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0abff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde041575e0 con 0x7fde040cfbf0 2023-05-12T09:08:17.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0abff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde04155530 con 0x7fde040d2110 2023-05-12T09:08:17.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0899b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde040b87a0 0x7fde0414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0899b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde040b87a0 0x7fde0414e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43046/0 (socket says 172.21.15.116:43046) 2023-05-12T09:08:17.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0899b700 1 -- 172.21.15.116:0/325278657 learned_addr learned my addr 172.21.15.116:0/325278657 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:17.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0919c700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fde040d2110 0x7fde0414ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde03fff700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fde040cfbf0 0x7fde041562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0899b700 1 -- 172.21.15.116:0/325278657 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fde040d2110 msgr2=0x7fde0414ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0899b700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fde040d2110 0x7fde0414ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0899b700 1 -- 172.21.15.116:0/325278657 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fde040cfbf0 msgr2=0x7fde041562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0899b700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fde040cfbf0 0x7fde041562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.140+0000 7fde0899b700 1 -- 172.21.15.116:0/325278657 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc009a70 con 0x7fde040b87a0 2023-05-12T09:08:17.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.141+0000 7fde0899b700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde040b87a0 0x7fde0414e390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fddf800c500 tx=0x7fddf800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:17.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.141+0000 7fde017fa700 1 -- 172.21.15.116:0/325278657 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80052d0 con 0x7fde040b87a0 2023-05-12T09:08:17.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.141+0000 7fde017fa700 1 -- 172.21.15.116:0/325278657 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf8005450 con 0x7fde040b87a0 2023-05-12T09:08:17.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.141+0000 7fde017fa700 1 -- 172.21.15.116:0/325278657 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80038c0 con 0x7fde040b87a0 2023-05-12T09:08:17.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.141+0000 7fde0abff700 1 -- 172.21.15.116:0/325278657 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde040cd980 con 0x7fde040b87a0 2023-05-12T09:08:17.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.141+0000 7fde0abff700 1 -- 172.21.15.116:0/325278657 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde040cd6a0 con 0x7fde040b87a0 2023-05-12T09:08:17.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.142+0000 7fde0abff700 1 -- 172.21.15.116:0/325278657 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde04167a90 con 0x7fde040b87a0 2023-05-12T09:08:17.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.143+0000 7fde017fa700 1 -- 172.21.15.116:0/325278657 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddf8003a20 con 0x7fde040b87a0 2023-05-12T09:08:17.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.144+0000 7fde017fa700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdde806ace0 0x7fdde806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.144+0000 7fde017fa700 1 -- 172.21.15.116:0/325278657 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fddf8088ca0 con 0x7fde040b87a0 2023-05-12T09:08:17.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.144+0000 7fde03fff700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdde806ace0 0x7fdde806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.145+0000 7fde03fff700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdde806ace0 0x7fdde806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde04157c10 tx=0x7fddf0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:17.151 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.148+0000 7fde017fa700 1 -- 172.21.15.116:0/325278657 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fddf8053a10 con 0x7fde040b87a0 2023-05-12T09:08:17.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.341+0000 7fde0abff700 1 -- 172.21.15.116:0/325278657 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde040b52f0 con 0x7fde040b87a0 2023-05-12T09:08:17.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.341+0000 7fde017fa700 1 -- 172.21.15.116:0/325278657 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fddf8057030 con 0x7fde040b87a0 2023-05-12T09:08:17.345 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:17.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.343+0000 7fde0abff700 1 -- 172.21.15.116:0/325278657 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdde806ace0 msgr2=0x7fdde806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.343+0000 7fde0abff700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdde806ace0 0x7fdde806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde04157c10 tx=0x7fddf0009040 comp rx=0 tx=0).stop 2023-05-12T09:08:17.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.343+0000 7fde0abff700 1 -- 172.21.15.116:0/325278657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde040b87a0 msgr2=0x7fde0414e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.343+0000 7fde0abff700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde040b87a0 0x7fde0414e390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fddf800c500 tx=0x7fddf800c8c0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.344+0000 7fde0abff700 1 -- 172.21.15.116:0/325278657 shutdown_connections 2023-05-12T09:08:17.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.344+0000 7fde0abff700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdde806ace0 0x7fdde806d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.344+0000 7fde0abff700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fde040d2110 0x7fde0414ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.344+0000 7fde0abff700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde040b87a0 0x7fde0414e390 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.344+0000 7fde0abff700 1 --2- 172.21.15.116:0/325278657 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fde040cfbf0 0x7fde041562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.344+0000 7fde0abff700 1 -- 172.21.15.116:0/325278657 >> 172.21.15.116:0/325278657 conn(0x7fde04071b10 msgr2=0x7fde04154920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:17.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.344+0000 7fde0abff700 1 -- 172.21.15.116:0/325278657 shutdown_connections 2023-05-12T09:08:17.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.344+0000 7fde0abff700 1 -- 172.21.15.116:0/325278657 wait complete. 2023-05-12T09:08:17.364 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:17.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.548+0000 7f4a265ff700 1 Processor -- start 2023-05-12T09:08:17.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.548+0000 7f4a265ff700 1 -- start start 2023-05-12T09:08:17.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.549+0000 7f4a265ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 0x7f4a200cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.549+0000 7f4a265ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4a201601e0 0x7f4a20160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.549+0000 7f4a265ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a20160ff0 con 0x7f4a20160b70 2023-05-12T09:08:17.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.549+0000 7f4a265ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a200d02d0 con 0x7f4a201601e0 2023-05-12T09:08:17.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.549+0000 7f4a265ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200d0cb0 con 0x7f4a200b87a0 2023-05-12T09:08:17.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.550+0000 7f4a1f7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4a201601e0 0x7f4a20160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.550+0000 7f4a24b9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f4a20160b70 0x7f4a200d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42476/0 (socket says 172.21.15.116:42476) 2023-05-12T09:08:17.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.550+0000 7f4a1f7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4a201601e0 0x7f4a20160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43056/0 (socket says 172.21.15.116:43056) 2023-05-12T09:08:17.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.550+0000 7f4a24b9c700 1 -- 172.21.15.116:0/2970117375 learned_addr learned my addr 172.21.15.116:0/2970117375 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:17.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.550+0000 7f4a1ffff700 1 --2- 172.21.15.116:0/2970117375 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 0x7f4a200cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.550+0000 7f4a1f7fe700 1 -- 172.21.15.116:0/2970117375 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 msgr2=0x7f4a200cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:17.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.550+0000 7f4a1f7fe700 1 --2- 172.21.15.116:0/2970117375 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 0x7f4a200cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.550+0000 7f4a1f7fe700 1 -- 172.21.15.116:0/2970117375 >> v1:172.21.15.116:6789/0 conn(0x7f4a20160b70 legacy=0x7f4a200d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.550+0000 7f4a1f7fe700 1 -- 172.21.15.116:0/2970117375 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200cdc60 con 0x7f4a201601e0 2023-05-12T09:08:17.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.550+0000 7f4a1effd700 1 -- 172.21.15.116:0/2970117375 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464295652 0 0) 0x7f4a20160ff0 con 0x7f4a20160b70 2023-05-12T09:08:17.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a1f7fe700 1 --2- 172.21.15.116:0/2970117375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 0x7f4a20160630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009840 tx=0x7f4a14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0fe43c1e65088e server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:17.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a1effd700 1 -- 172.21.15.116:0/2970117375 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14011830 con 0x7f4a201601e0 2023-05-12T09:08:17.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a1effd700 1 -- 172.21.15.116:0/2970117375 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a14011990 con 0x7f4a201601e0 2023-05-12T09:08:17.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a1effd700 1 -- 172.21.15.116:0/2970117375 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14011d20 con 0x7f4a201601e0 2023-05-12T09:08:17.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a265ff700 1 -- 172.21.15.116:0/2970117375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 msgr2=0x7f4a20160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a265ff700 1 --2- 172.21.15.116:0/2970117375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 0x7f4a20160630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009840 tx=0x7f4a14009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:17.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a265ff700 1 -- 172.21.15.116:0/2970117375 shutdown_connections 2023-05-12T09:08:17.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a265ff700 1 --2- 172.21.15.116:0/2970117375 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 0x7f4a200cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a265ff700 1 --2- 172.21.15.116:0/2970117375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 0x7f4a20160630 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a265ff700 1 -- 172.21.15.116:0/2970117375 >> 172.21.15.116:0/2970117375 conn(0x7f4a20071b10 msgr2=0x7f4a20071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:17.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.551+0000 7f4a265ff700 1 -- 172.21.15.116:0/2970117375 shutdown_connections 2023-05-12T09:08:17.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.552+0000 7f4a265ff700 1 -- 172.21.15.116:0/2970117375 wait complete. 2023-05-12T09:08:17.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.554+0000 7f4a265ff700 1 Processor -- start 2023-05-12T09:08:17.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.554+0000 7f4a265ff700 1 -- start start 2023-05-12T09:08:17.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.555+0000 7f4a265ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 0x7f4a201501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.555+0000 7f4a265ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 0x7f4a200d2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.555+0000 7f4a265ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4a20160b70 0x7f4a200d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.555+0000 7f4a265ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200c7650 con 0x7f4a201601e0 2023-05-12T09:08:17.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.555+0000 7f4a265ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200c6a80 con 0x7f4a20160b70 2023-05-12T09:08:17.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.555+0000 7f4a265ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200c6d20 con 0x7f4a200b87a0 2023-05-12T09:08:17.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.555+0000 7f4a1f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 0x7f4a200d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.555+0000 7f4a1f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 0x7f4a200d2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43058/0 (socket says 172.21.15.116:43058) 2023-05-12T09:08:17.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.555+0000 7f4a1f7fe700 1 -- 172.21.15.116:0/1679939497 learned_addr learned my addr 172.21.15.116:0/1679939497 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:17.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1ffff700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 0x7f4a201501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a24b9c700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4a20160b70 0x7f4a200d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1f7fe700 1 -- 172.21.15.116:0/1679939497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 msgr2=0x7f4a201501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1f7fe700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 0x7f4a201501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1f7fe700 1 -- 172.21.15.116:0/1679939497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4a20160b70 msgr2=0x7f4a200d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1f7fe700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4a20160b70 0x7f4a200d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1f7fe700 1 -- 172.21.15.116:0/1679939497 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140094a0 con 0x7f4a201601e0 2023-05-12T09:08:17.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1ffff700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 0x7f4a201501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:17.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a24b9c700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4a20160b70 0x7f4a200d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:17.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1f7fe700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 0x7f4a200d2550 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009fd0 tx=0x7f4a14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:17.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1cff9700 1 -- 172.21.15.116:0/1679939497 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a140036a0 con 0x7f4a201601e0 2023-05-12T09:08:17.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1cff9700 1 -- 172.21.15.116:0/1679939497 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1401f070 con 0x7f4a201601e0 2023-05-12T09:08:17.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a1cff9700 1 -- 172.21.15.116:0/1679939497 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14003a60 con 0x7f4a201601e0 2023-05-12T09:08:17.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.556+0000 7f4a265ff700 1 -- 172.21.15.116:0/1679939497 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a200cd980 con 0x7f4a201601e0 2023-05-12T09:08:17.564 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.557+0000 7f4a265ff700 1 -- 172.21.15.116:0/1679939497 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a200cd6a0 con 0x7f4a201601e0 2023-05-12T09:08:17.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.557+0000 7f4a265ff700 1 -- 172.21.15.116:0/1679939497 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a200d2110 con 0x7f4a201601e0 2023-05-12T09:08:17.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.558+0000 7f4a1cff9700 1 -- 172.21.15.116:0/1679939497 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a14003bc0 con 0x7f4a201601e0 2023-05-12T09:08:17.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.559+0000 7f4a1cff9700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4a0c06ace0 0x7f4a0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.559+0000 7f4a1cff9700 1 -- 172.21.15.116:0/1679939497 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4a14021070 con 0x7f4a201601e0 2023-05-12T09:08:17.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.559+0000 7f4a1ffff700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4a0c06ace0 0x7f4a0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.560+0000 7f4a1ffff700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4a0c06ace0 0x7f4a0c06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009c30 tx=0x7f4a10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:17.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.563+0000 7f4a1cff9700 1 -- 172.21.15.116:0/1679939497 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4a14055e70 con 0x7f4a201601e0 2023-05-12T09:08:17.764 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.761+0000 7f4a265ff700 1 -- 172.21.15.116:0/1679939497 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a20074430 con 0x7f4a201601e0 2023-05-12T09:08:17.764 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.761+0000 7f4a1cff9700 1 -- 172.21.15.116:0/1679939497 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a14059490 con 0x7f4a201601e0 2023-05-12T09:08:17.765 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:17.766 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.763+0000 7f4a265ff700 1 -- 172.21.15.116:0/1679939497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4a0c06ace0 msgr2=0x7f4a0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.763+0000 7f4a265ff700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4a0c06ace0 0x7f4a0c06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009c30 tx=0x7f4a10008040 comp rx=0 tx=0).stop 2023-05-12T09:08:17.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.763+0000 7f4a265ff700 1 -- 172.21.15.116:0/1679939497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 msgr2=0x7f4a200d2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.763+0000 7f4a265ff700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 0x7f4a200d2550 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009fd0 tx=0x7f4a14004750 comp rx=0 tx=0).stop 2023-05-12T09:08:17.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.763+0000 7f4a265ff700 1 -- 172.21.15.116:0/1679939497 shutdown_connections 2023-05-12T09:08:17.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.764+0000 7f4a265ff700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4a20160b70 0x7f4a200d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.767 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.764+0000 7f4a265ff700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4a0c06ace0 0x7f4a0c06d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.764+0000 7f4a265ff700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4a200b87a0 0x7f4a201501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.764+0000 7f4a265ff700 1 --2- 172.21.15.116:0/1679939497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a201601e0 0x7f4a200d2550 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.764+0000 7f4a265ff700 1 -- 172.21.15.116:0/1679939497 >> 172.21.15.116:0/1679939497 conn(0x7f4a20071b10 msgr2=0x7f4a200b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:17.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.764+0000 7f4a265ff700 1 -- 172.21.15.116:0/1679939497 shutdown_connections 2023-05-12T09:08:17.768 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.764+0000 7f4a265ff700 1 -- 172.21.15.116:0/1679939497 wait complete. 2023-05-12T09:08:17.783 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:17.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.968+0000 7f0714dff700 1 Processor -- start 2023-05-12T09:08:17.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.968+0000 7f0714dff700 1 -- start start 2023-05-12T09:08:17.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.969+0000 7f0714dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07100b87a0 0x7f07100cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.969+0000 7f0714dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07100cdc60 con 0x7f07101601e0 2023-05-12T09:08:17.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.969+0000 7f0714dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07100cd6a0 con 0x7f0710160d40 2023-05-12T09:08:17.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.969+0000 7f0714dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07100d02d0 con 0x7f07100b87a0 2023-05-12T09:08:17.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.969+0000 7f0707fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f07101601e0 0x7f0710160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42478/0 (socket says 172.21.15.116:42478) 2023-05-12T09:08:17.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.969+0000 7f0707fff700 1 -- 172.21.15.116:0/2746218601 learned_addr learned my addr 172.21.15.116:0/2746218601 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:17.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.970+0000 7f070e59c700 1 --2- 172.21.15.116:0/2746218601 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07100b87a0 0x7f07100cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.970+0000 7f070dd9b700 1 -- 172.21.15.116:0/2746218601 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706021157 0 0) 0x7f07100cdc60 con 0x7f07101601e0 2023-05-12T09:08:17.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.970+0000 7f070dd9b700 1 -- 172.21.15.116:0/2746218601 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06fc0035b0 con 0x7f07101601e0 2023-05-12T09:08:17.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.970+0000 7f070dd9b700 1 -- 172.21.15.116:0/2746218601 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640821854 0 0) 0x7f07100cd6a0 con 0x7f0710160d40 2023-05-12T09:08:17.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.970+0000 7f070dd9b700 1 -- 172.21.15.116:0/2746218601 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07100cdc60 con 0x7f0710160d40 2023-05-12T09:08:17.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.970+0000 7f070e59c700 1 -- 172.21.15.116:0/2746218601 >> v1:172.21.15.182:6789/0 conn(0x7f0710160d40 legacy=0x7f07100d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.970+0000 7f070e59c700 1 -- 172.21.15.116:0/2746218601 >> v1:172.21.15.116:6789/0 conn(0x7f07101601e0 legacy=0x7f0710160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.970+0000 7f070e59c700 1 -- 172.21.15.116:0/2746218601 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100cd980 con 0x7f07100b87a0 2023-05-12T09:08:17.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.970+0000 7f070e59c700 1 --2- 172.21.15.116:0/2746218601 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07100b87a0 0x7f07100cfbf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0700009870 tx=0x7f0700009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ced2f2e1bb582cd server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:17.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.971+0000 7f070dd9b700 1 -- 172.21.15.116:0/2746218601 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700011830 con 0x7f07100b87a0 2023-05-12T09:08:17.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.971+0000 7f070dd9b700 1 -- 172.21.15.116:0/2746218601 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0700011990 con 0x7f07100b87a0 2023-05-12T09:08:17.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.971+0000 7f070dd9b700 1 -- 172.21.15.116:0/2746218601 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700011d20 con 0x7f07100b87a0 2023-05-12T09:08:17.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.971+0000 7f0714dff700 1 -- 172.21.15.116:0/2746218601 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07100b87a0 msgr2=0x7f07100cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.971+0000 7f0714dff700 1 --2- 172.21.15.116:0/2746218601 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07100b87a0 0x7f07100cfbf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0700009870 tx=0x7f0700009b80 comp rx=0 tx=0).stop 2023-05-12T09:08:17.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.971+0000 7f0714dff700 1 -- 172.21.15.116:0/2746218601 shutdown_connections 2023-05-12T09:08:17.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.971+0000 7f0714dff700 1 --2- 172.21.15.116:0/2746218601 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07100b87a0 0x7f07100cfbf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.971+0000 7f0714dff700 1 -- 172.21.15.116:0/2746218601 >> 172.21.15.116:0/2746218601 conn(0x7f0710071b10 msgr2=0x7f0710071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:17.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.971+0000 7f0714dff700 1 -- 172.21.15.116:0/2746218601 shutdown_connections 2023-05-12T09:08:17.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.971+0000 7f0714dff700 1 -- 172.21.15.116:0/2746218601 wait complete. 2023-05-12T09:08:17.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.973+0000 7f0714dff700 1 Processor -- start 2023-05-12T09:08:17.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.973+0000 7f0714dff700 1 -- start start 2023-05-12T09:08:17.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f0714dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07100b87a0 0x7f07101541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f0714dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07101601e0 0x7f07100c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f0714dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0710160d40 0x7f0710159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f0714dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071015da90 con 0x7f07100b87a0 2023-05-12T09:08:17.979 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f0714dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071015ce80 con 0x7f0710160d40 2023-05-12T09:08:17.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f0714dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071015d160 con 0x7f07101601e0 2023-05-12T09:08:17.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f070e59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07100b87a0 0x7f07101541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f070e59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07100b87a0 0x7f07101541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43066/0 (socket says 172.21.15.116:43066) 2023-05-12T09:08:17.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f070e59c700 1 -- 172.21.15.116:0/844334002 learned_addr learned my addr 172.21.15.116:0/844334002 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:17.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f0707fff700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07101601e0 0x7f07100c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.974+0000 7f070ed9d700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0710160d40 0x7f0710159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f070e59c700 1 -- 172.21.15.116:0/844334002 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07101601e0 msgr2=0x7f07100c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f070e59c700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07101601e0 0x7f07100c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f070e59c700 1 -- 172.21.15.116:0/844334002 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0710160d40 msgr2=0x7f0710159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f070e59c700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0710160d40 0x7f0710159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f070e59c700 1 -- 172.21.15.116:0/844334002 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07000094a0 con 0x7f07100b87a0 2023-05-12T09:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f070e59c700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07100b87a0 0x7f07101541a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f07000090b0 tx=0x7f0700004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f0706ffd700 1 -- 172.21.15.116:0/844334002 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070001a760 con 0x7f07100b87a0 2023-05-12T09:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f0706ffd700 1 -- 172.21.15.116:0/844334002 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070001a8c0 con 0x7f07100b87a0 2023-05-12T09:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f0714dff700 1 -- 172.21.15.116:0/844334002 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07100d19a0 con 0x7f07100b87a0 2023-05-12T09:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f0706ffd700 1 -- 172.21.15.116:0/844334002 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070001ac30 con 0x7f07100b87a0 2023-05-12T09:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.975+0000 7f0714dff700 1 -- 172.21.15.116:0/844334002 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07100d1810 con 0x7f07100b87a0 2023-05-12T09:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.976+0000 7f0714dff700 1 -- 172.21.15.116:0/844334002 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07100d1b30 con 0x7f07100b87a0 2023-05-12T09:08:17.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.977+0000 7f0706ffd700 1 -- 172.21.15.116:0/844334002 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0700022070 con 0x7f07100b87a0 2023-05-12T09:08:17.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.978+0000 7f0706ffd700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06f006ace0 0x7f06f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:17.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.978+0000 7f0706ffd700 1 -- 172.21.15.116:0/844334002 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f070008a3f0 con 0x7f07100b87a0 2023-05-12T09:08:17.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.978+0000 7f0707fff700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06f006ace0 0x7f06f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:17.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.979+0000 7f0707fff700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06f006ace0 0x7f06f006d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f07101f5ec0 tx=0x7f06f8007e00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:17.985 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:17.982+0000 7f0706ffd700 1 -- 172.21.15.116:0/844334002 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0700055210 con 0x7f07100b87a0 2023-05-12T09:08:18.179 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.176+0000 7f0714dff700 1 -- 172.21.15.116:0/844334002 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f07100ce6d0 con 0x7f07100b87a0 2023-05-12T09:08:18.180 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.177+0000 7f0706ffd700 1 -- 172.21.15.116:0/844334002 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f07000150a0 con 0x7f07100b87a0 2023-05-12T09:08:18.180 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:18.182 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 -- 172.21.15.116:0/844334002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06f006ace0 msgr2=0x7f06f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:18.182 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06f006ace0 0x7f06f006d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f07101f5ec0 tx=0x7f06f8007e00 comp rx=0 tx=0).stop 2023-05-12T09:08:18.182 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 -- 172.21.15.116:0/844334002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07100b87a0 msgr2=0x7f07101541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:18.182 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07100b87a0 0x7f07101541a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f07000090b0 tx=0x7f0700004750 comp rx=0 tx=0).stop 2023-05-12T09:08:18.183 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 -- 172.21.15.116:0/844334002 shutdown_connections 2023-05-12T09:08:18.183 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0710160d40 0x7f0710159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:18.183 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07100b87a0 0x7f07101541a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:18.183 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06f006ace0 0x7f06f006d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:18.183 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 --2- 172.21.15.116:0/844334002 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f07101601e0 0x7f07100c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:18.183 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 -- 172.21.15.116:0/844334002 >> 172.21.15.116:0/844334002 conn(0x7f0710071b10 msgr2=0x7f07100b6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:18.183 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 -- 172.21.15.116:0/844334002 shutdown_connections 2023-05-12T09:08:18.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.179+0000 7f0714dff700 1 -- 172.21.15.116:0/844334002 wait complete. 2023-05-12T09:08:18.233 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-12T09:08:18.234 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-05-12T09:08:18.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.417+0000 7fbe425ff700 1 Processor -- start 2023-05-12T09:08:18.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.417+0000 7fbe425ff700 1 -- start start 2023-05-12T09:08:18.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.418+0000 7fbe425ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe3c15a140 0x7fbe3c0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:18.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.418+0000 7fbe425ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbe3c160ba0 0x7fbe3c0cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:18.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.418+0000 7fbe425ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3c15d660 con 0x7fbe3c0cfe20 2023-05-12T09:08:18.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.418+0000 7fbe425ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3c0d02a0 con 0x7fbe3c160ba0 2023-05-12T09:08:18.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.418+0000 7fbe425ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c15cd70 con 0x7fbe3c15a140 2023-05-12T09:08:18.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.418+0000 7fbe3b7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbe3c160ba0 0x7fbe3c0cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:18.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe40b9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fbe3c0cfe20 0x7fbe3c0b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42484/0 (socket says 172.21.15.116:42484) 2023-05-12T09:08:18.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe40b9c700 1 -- 172.21.15.116:0/3462902796 learned_addr learned my addr 172.21.15.116:0/3462902796 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:18.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe3bfff700 1 --2- 172.21.15.116:0/3462902796 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe3c15a140 0x7fbe3c0cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:18.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe3affd700 1 -- 172.21.15.116:0/3462902796 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291937197 0 0) 0x7fbe3c15d660 con 0x7fbe3c0cfe20 2023-05-12T09:08:18.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe3b7fe700 1 -- 172.21.15.116:0/3462902796 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe3c15a140 msgr2=0x7fbe3c0cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:18.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe3b7fe700 1 --2- 172.21.15.116:0/3462902796 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe3c15a140 0x7fbe3c0cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:18.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe3b7fe700 1 -- 172.21.15.116:0/3462902796 >> v1:172.21.15.116:6789/0 conn(0x7fbe3c0cfe20 legacy=0x7fbe3c0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:18.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe3b7fe700 1 -- 172.21.15.116:0/3462902796 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c15d010 con 0x7fbe3c160ba0 2023-05-12T09:08:18.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe3b7fe700 1 --2- 172.21.15.116:0/3462902796 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 0x7fbe3c0cf8e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009840 tx=0x7fbe30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ee0f5edcaf7faa server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:18.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe3affd700 1 -- 172.21.15.116:0/3462902796 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30011830 con 0x7fbe3c160ba0 2023-05-12T09:08:18.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.419+0000 7fbe3affd700 1 -- 172.21.15.116:0/3462902796 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe30011990 con 0x7fbe3c160ba0 2023-05-12T09:08:18.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.420+0000 7fbe3affd700 1 -- 172.21.15.116:0/3462902796 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30011d20 con 0x7fbe3c160ba0 2023-05-12T09:08:18.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.420+0000 7fbe425ff700 1 -- 172.21.15.116:0/3462902796 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 msgr2=0x7fbe3c0cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:18.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.420+0000 7fbe425ff700 1 --2- 172.21.15.116:0/3462902796 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 0x7fbe3c0cf8e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009840 tx=0x7fbe30009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:18.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.420+0000 7fbe425ff700 1 -- 172.21.15.116:0/3462902796 shutdown_connections 2023-05-12T09:08:18.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.420+0000 7fbe425ff700 1 --2- 172.21.15.116:0/3462902796 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe3c15a140 0x7fbe3c0cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:18.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.420+0000 7fbe425ff700 1 --2- 172.21.15.116:0/3462902796 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 0x7fbe3c0cf8e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:18.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.420+0000 7fbe425ff700 1 -- 172.21.15.116:0/3462902796 >> 172.21.15.116:0/3462902796 conn(0x7fbe3c071b10 msgr2=0x7fbe3c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:18.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.420+0000 7fbe425ff700 1 -- 172.21.15.116:0/3462902796 shutdown_connections 2023-05-12T09:08:18.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.420+0000 7fbe425ff700 1 -- 172.21.15.116:0/3462902796 wait complete. 2023-05-12T09:08:18.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.422+0000 7fbe425ff700 1 Processor -- start 2023-05-12T09:08:18.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.422+0000 7fbe425ff700 1 -- start start 2023-05-12T09:08:18.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe425ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe3c0cfe20 0x7fbe3c14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:18.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe425ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe3c15a140 0x7fbe3c1e7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:18.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe425ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 0x7fbe3c15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:18.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe425ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c1e5cc0 con 0x7fbe3c160ba0 2023-05-12T09:08:18.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe425ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c1e6560 con 0x7fbe3c0cfe20 2023-05-12T09:08:18.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe425ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c1e7fd0 con 0x7fbe3c15a140 2023-05-12T09:08:18.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe40b9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 0x7fbe3c15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:18.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe40b9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 0x7fbe3c15dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43084/0 (socket says 172.21.15.116:43084) 2023-05-12T09:08:18.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe40b9c700 1 -- 172.21.15.116:0/1743705752 learned_addr learned my addr 172.21.15.116:0/1743705752 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:18.429 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe3bfff700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe3c0cfe20 0x7fbe3c14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:18.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.423+0000 7fbe3b7fe700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe3c15a140 0x7fbe3c1e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:18.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe40b9c700 1 -- 172.21.15.116:0/1743705752 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe3c15a140 msgr2=0x7fbe3c1e7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:18.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe40b9c700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe3c15a140 0x7fbe3c1e7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:18.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe40b9c700 1 -- 172.21.15.116:0/1743705752 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe3c0cfe20 msgr2=0x7fbe3c14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:18.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe40b9c700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe3c0cfe20 0x7fbe3c14d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:18.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe40b9c700 1 -- 172.21.15.116:0/1743705752 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe300094a0 con 0x7fbe3c160ba0 2023-05-12T09:08:18.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe40b9c700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 0x7fbe3c15dc80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400cc70 tx=0x7fbe3400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:18.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe38ff9700 1 -- 172.21.15.116:0/1743705752 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3400ab70 con 0x7fbe3c160ba0 2023-05-12T09:08:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe38ff9700 1 -- 172.21.15.116:0/1743705752 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3400acf0 con 0x7fbe3c160ba0 2023-05-12T09:08:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe425ff700 1 -- 172.21.15.116:0/1743705752 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3c15daf0 con 0x7fbe3c160ba0 2023-05-12T09:08:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe38ff9700 1 -- 172.21.15.116:0/1743705752 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34007310 con 0x7fbe3c160ba0 2023-05-12T09:08:18.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.424+0000 7fbe425ff700 1 -- 172.21.15.116:0/1743705752 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3c15d2f0 con 0x7fbe3c160ba0 2023-05-12T09:08:18.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.425+0000 7fbe425ff700 1 -- 172.21.15.116:0/1743705752 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3c0cdb00 con 0x7fbe3c160ba0 2023-05-12T09:08:18.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.426+0000 7fbe38ff9700 1 -- 172.21.15.116:0/1743705752 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe34007470 con 0x7fbe3c160ba0 2023-05-12T09:08:18.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.428+0000 7fbe38ff9700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe2806ace0 0x7fbe2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:18.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.428+0000 7fbe38ff9700 1 -- 172.21.15.116:0/1743705752 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbe340896b0 con 0x7fbe3c160ba0 2023-05-12T09:08:18.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.428+0000 7fbe3bfff700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe2806ace0 0x7fbe2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:18.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.428+0000 7fbe3bfff700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe2806ace0 0x7fbe2806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0ccf10 tx=0x7fbe2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:18.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.432+0000 7fbe38ff9700 1 -- 172.21.15.116:0/1743705752 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbe34054390 con 0x7fbe3c160ba0 2023-05-12T09:08:18.715 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:18.712+0000 7fbe425ff700 1 -- 172.21.15.116:0/1743705752 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fbe3c1e66f0 con 0x7fbe3c160ba0 2023-05-12T09:08:19.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.680+0000 7fbe38ff9700 1 -- 172.21.15.116:0/1743705752 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v80) v1 ==== 147+0+0 (secure 0 0 0) 0x7fbe3400ae60 con 0x7fbe3c160ba0 2023-05-12T09:08:19.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 -- 172.21.15.116:0/1743705752 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe2806ace0 msgr2=0x7fbe2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:19.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe2806ace0 0x7fbe2806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0ccf10 tx=0x7fbe2c008040 comp rx=0 tx=0).stop 2023-05-12T09:08:19.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 -- 172.21.15.116:0/1743705752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 msgr2=0x7fbe3c15dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:19.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 0x7fbe3c15dc80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400cc70 tx=0x7fbe3400cf80 comp rx=0 tx=0).stop 2023-05-12T09:08:19.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 -- 172.21.15.116:0/1743705752 shutdown_connections 2023-05-12T09:08:19.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe3c160ba0 0x7fbe3c15dc80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:19.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe3c0cfe20 0x7fbe3c14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:19.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe2806ace0 0x7fbe2806d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:19.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 --2- 172.21.15.116:0/1743705752 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe3c15a140 0x7fbe3c1e7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:19.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 -- 172.21.15.116:0/1743705752 >> 172.21.15.116:0/1743705752 conn(0x7fbe3c071b10 msgr2=0x7fbe3c0b83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:19.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 -- 172.21.15.116:0/1743705752 shutdown_connections 2023-05-12T09:08:19.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.683+0000 7fbe425ff700 1 -- 172.21.15.116:0/1743705752 wait complete. 2023-05-12T09:08:19.706 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-12T09:08:19.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.894+0000 7fb67f1ff700 1 Processor -- start 2023-05-12T09:08:19.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.894+0000 7fb67f1ff700 1 -- start start 2023-05-12T09:08:19.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.895+0000 7fb67f1ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb6780adf70 0x7fb6780cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:19.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.895+0000 7fb67f1ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780cc9e0 con 0x7fb6780cd760 2023-05-12T09:08:19.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.895+0000 7fb67f1ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67815de20 con 0x7fb67815cf10 2023-05-12T09:08:19.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.895+0000 7fb67f1ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67815d860 con 0x7fb6780adf70 2023-05-12T09:08:19.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.895+0000 7fb677fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb6780adf70 0x7fb6780cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:19.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.895+0000 7fb67cf9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb6780cd760 0x7fb6780cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42500/0 (socket says 172.21.15.116:42500) 2023-05-12T09:08:19.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.895+0000 7fb67cf9b700 1 -- 172.21.15.116:0/2982625853 learned_addr learned my addr 172.21.15.116:0/2982625853 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:19.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.896+0000 7fb677fff700 1 -- 172.21.15.116:0/2982625853 >> v1:172.21.15.182:6789/0 conn(0x7fb67815cf10 legacy=0x7fb67806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:19.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.896+0000 7fb677fff700 1 -- 172.21.15.116:0/2982625853 >> v1:172.21.15.116:6789/0 conn(0x7fb6780cd760 legacy=0x7fb6780cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:19.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.896+0000 7fb677fff700 1 -- 172.21.15.116:0/2982625853 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67815db40 con 0x7fb6780adf70 2023-05-12T09:08:19.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.896+0000 7fb6777fe700 1 -- 172.21.15.116:0/2982625853 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625825721 0 0) 0x7fb6780cc9e0 con 0x7fb6780cd760 2023-05-12T09:08:19.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.896+0000 7fb677fff700 1 --2- 172.21.15.116:0/2982625853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6780adf70 0x7fb6780cce70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb664009820 tx=0x7fb664009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf170793858bbdfc server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:19.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.896+0000 7fb6777fe700 1 -- 172.21.15.116:0/2982625853 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664005e30 con 0x7fb6780adf70 2023-05-12T09:08:19.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.896+0000 7fb6777fe700 1 -- 172.21.15.116:0/2982625853 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb664004030 con 0x7fb6780adf70 2023-05-12T09:08:19.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.896+0000 7fb6777fe700 1 -- 172.21.15.116:0/2982625853 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640043e0 con 0x7fb6780adf70 2023-05-12T09:08:19.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.897+0000 7fb67f1ff700 1 -- 172.21.15.116:0/2982625853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6780adf70 msgr2=0x7fb6780cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:19.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.897+0000 7fb67f1ff700 1 --2- 172.21.15.116:0/2982625853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6780adf70 0x7fb6780cce70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb664009820 tx=0x7fb664009b30 comp rx=0 tx=0).stop 2023-05-12T09:08:19.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.897+0000 7fb67f1ff700 1 -- 172.21.15.116:0/2982625853 shutdown_connections 2023-05-12T09:08:19.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.897+0000 7fb67f1ff700 1 --2- 172.21.15.116:0/2982625853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6780adf70 0x7fb6780cce70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:19.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.897+0000 7fb67f1ff700 1 -- 172.21.15.116:0/2982625853 >> 172.21.15.116:0/2982625853 conn(0x7fb6780cf720 msgr2=0x7fb6780cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:19.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.897+0000 7fb67f1ff700 1 -- 172.21.15.116:0/2982625853 shutdown_connections 2023-05-12T09:08:19.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.897+0000 7fb67f1ff700 1 -- 172.21.15.116:0/2982625853 wait complete. 2023-05-12T09:08:19.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.898+0000 7fb67f1ff700 1 Processor -- start 2023-05-12T09:08:19.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.899+0000 7fb67f1ff700 1 -- start start 2023-05-12T09:08:19.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.899+0000 7fb67f1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6780adf70 0x7fb6780c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:19.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.899+0000 7fb67f1ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6780cd760 0x7fb6780b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:19.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.899+0000 7fb67f1ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67815cf10 0x7fb6780b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:19.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.899+0000 7fb67f1ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780afcb0 con 0x7fb67815cf10 2023-05-12T09:08:19.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.899+0000 7fb67f1ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780c4460 con 0x7fb6780cd760 2023-05-12T09:08:19.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.899+0000 7fb67f1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780c4740 con 0x7fb6780adf70 2023-05-12T09:08:19.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb67d79c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67815cf10 0x7fb6780b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:19.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb67d79c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67815cf10 0x7fb6780b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43100/0 (socket says 172.21.15.116:43100) 2023-05-12T09:08:19.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb67d79c700 1 -- 172.21.15.116:0/760345699 learned_addr learned my addr 172.21.15.116:0/760345699 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:19.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb67cf9b700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6780adf70 0x7fb6780c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:19.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb677fff700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6780cd760 0x7fb6780b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:19.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb67d79c700 1 -- 172.21.15.116:0/760345699 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6780adf70 msgr2=0x7fb6780c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:19.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb67d79c700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6780adf70 0x7fb6780c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:19.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb67d79c700 1 -- 172.21.15.116:0/760345699 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6780cd760 msgr2=0x7fb6780b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:19.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb67d79c700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6780cd760 0x7fb6780b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:19.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb67d79c700 1 -- 172.21.15.116:0/760345699 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664009430 con 0x7fb67815cf10 2023-05-12T09:08:19.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.900+0000 7fb67d79c700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67815cf10 0x7fb6780b3990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb67000b990 tx=0x7fb67000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:19.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.901+0000 7fb6757fa700 1 -- 172.21.15.116:0/760345699 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000c9d0 con 0x7fb67815cf10 2023-05-12T09:08:19.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.901+0000 7fb6757fa700 1 -- 172.21.15.116:0/760345699 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67000cb30 con 0x7fb67815cf10 2023-05-12T09:08:19.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.901+0000 7fb67f1ff700 1 -- 172.21.15.116:0/760345699 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb678071600 con 0x7fb67815cf10 2023-05-12T09:08:19.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.901+0000 7fb6757fa700 1 -- 172.21.15.116:0/760345699 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670014440 con 0x7fb67815cf10 2023-05-12T09:08:19.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.901+0000 7fb67f1ff700 1 -- 172.21.15.116:0/760345699 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6780cc670 con 0x7fb67815cf10 2023-05-12T09:08:19.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.902+0000 7fb67f1ff700 1 -- 172.21.15.116:0/760345699 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6780cd3b0 con 0x7fb67815cf10 2023-05-12T09:08:19.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.903+0000 7fb6757fa700 1 -- 172.21.15.116:0/760345699 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb670006d50 con 0x7fb67815cf10 2023-05-12T09:08:19.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.905+0000 7fb6757fa700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb65c06ace0 0x7fb65c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:19.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.905+0000 7fb6757fa700 1 -- 172.21.15.116:0/760345699 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb670089250 con 0x7fb67815cf10 2023-05-12T09:08:19.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.905+0000 7fb67cf9b700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb65c06ace0 0x7fb65c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:19.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.905+0000 7fb67cf9b700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb65c06ace0 0x7fb65c06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000f60 tx=0x7fb66c007be0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:19.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:19.909+0000 7fb6757fa700 1 -- 172.21.15.116:0/760345699 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb670054060 con 0x7fb67815cf10 2023-05-12T09:08:20.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.102+0000 7fb67f1ff700 1 -- 172.21.15.116:0/760345699 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb678071b50 con 0x7fb67815cf10 2023-05-12T09:08:20.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.106+0000 7fb6757fa700 1 -- 172.21.15.116:0/760345699 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb670057680 con 0x7fb67815cf10 2023-05-12T09:08:20.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 -- 172.21.15.116:0/760345699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb65c06ace0 msgr2=0x7fb65c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:20.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb65c06ace0 0x7fb65c06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000f60 tx=0x7fb66c007be0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 -- 172.21.15.116:0/760345699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67815cf10 msgr2=0x7fb6780b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:20.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67815cf10 0x7fb6780b3990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb67000b990 tx=0x7fb67000bd50 comp rx=0 tx=0).stop 2023-05-12T09:08:20.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 -- 172.21.15.116:0/760345699 shutdown_connections 2023-05-12T09:08:20.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67815cf10 0x7fb6780b3990 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb65c06ace0 0x7fb65c06d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb6780adf70 0x7fb6780c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 --2- 172.21.15.116:0/760345699 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb6780cd760 0x7fb6780b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 -- 172.21.15.116:0/760345699 >> 172.21.15.116:0/760345699 conn(0x7fb6780cf720 msgr2=0x7fb678159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:20.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.108+0000 7fb67f1ff700 1 -- 172.21.15.116:0/760345699 shutdown_connections 2023-05-12T09:08:20.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.109+0000 7fb67f1ff700 1 -- 172.21.15.116:0/760345699 wait complete. 2023-05-12T09:08:20.128 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-12T09:08:20.128 DEBUG:teuthology.orchestra.run.smithi116:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-12T09:08:20.218 DEBUG:teuthology.orchestra.run.smithi182:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-12T09:08:20.326 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-12T09:08:20.326 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:08:20.326 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:20.368 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:08:20.368 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:20.448 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:20.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.674+0000 7fd5047ff700 1 Processor -- start 2023-05-12T09:08:20.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.674+0000 7fd5047ff700 1 -- start start 2023-05-12T09:08:20.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.675+0000 7fd5047ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fd4fc0adf70 0x7fd4fc0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:20.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.675+0000 7fd5047ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd4fc15cf10 0x7fd4fc06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:20.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.675+0000 7fd5047ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc0cc9e0 con 0x7fd4fc0cd760 2023-05-12T09:08:20.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.675+0000 7fd5047ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc15de20 con 0x7fd4fc15cf10 2023-05-12T09:08:20.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.675+0000 7fd5047ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc15d860 con 0x7fd4fc0adf70 2023-05-12T09:08:20.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.675+0000 7fd502d9c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd4fc15cf10 0x7fd4fc06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:20.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.675+0000 7fd50259b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd4fc0cd760 0x7fd4fc0cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42504/0 (socket says 172.21.15.116:42504) 2023-05-12T09:08:20.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.675+0000 7fd50259b700 1 -- 172.21.15.116:0/2819892052 learned_addr learned my addr 172.21.15.116:0/2819892052 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:20.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd501d9a700 1 --2- 172.21.15.116:0/2819892052 >> v2:172.21.15.182:3300/0 conn(0x7fd4fc0adf70 0x7fd4fc0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:20.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd501599700 1 -- 172.21.15.116:0/2819892052 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286972606 0 0) 0x7fd4fc0cc9e0 con 0x7fd4fc0cd760 2023-05-12T09:08:20.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd502d9c700 1 -- 172.21.15.116:0/2819892052 >> v2:172.21.15.182:3300/0 conn(0x7fd4fc0adf70 msgr2=0x7fd4fc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:20.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd502d9c700 1 --2- 172.21.15.116:0/2819892052 >> v2:172.21.15.182:3300/0 conn(0x7fd4fc0adf70 0x7fd4fc0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd502d9c700 1 -- 172.21.15.116:0/2819892052 >> v1:172.21.15.116:6789/0 conn(0x7fd4fc0cd760 legacy=0x7fd4fc0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:20.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd502d9c700 1 -- 172.21.15.116:0/2819892052 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc15db40 con 0x7fd4fc15cf10 2023-05-12T09:08:20.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd501d9a700 1 --2- 172.21.15.116:0/2819892052 >> v2:172.21.15.182:3300/0 conn(0x7fd4fc0adf70 0x7fd4fc0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:20.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd502d9c700 1 --2- 172.21.15.116:0/2819892052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc15cf10 0x7fd4fc06c6c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0ae4c0 tx=0x7fd4f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596ddd7492160381 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:20.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd501599700 1 -- 172.21.15.116:0/2819892052 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400e070 con 0x7fd4fc15cf10 2023-05-12T09:08:20.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd501599700 1 -- 172.21.15.116:0/2819892052 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400bbd0 con 0x7fd4fc15cf10 2023-05-12T09:08:20.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.676+0000 7fd501599700 1 -- 172.21.15.116:0/2819892052 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4012430 con 0x7fd4fc15cf10 2023-05-12T09:08:20.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.677+0000 7fd5047ff700 1 -- 172.21.15.116:0/2819892052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc15cf10 msgr2=0x7fd4fc06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:20.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.677+0000 7fd5047ff700 1 --2- 172.21.15.116:0/2819892052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc15cf10 0x7fd4fc06c6c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0ae4c0 tx=0x7fd4f400b330 comp rx=0 tx=0).stop 2023-05-12T09:08:20.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.677+0000 7fd5047ff700 1 -- 172.21.15.116:0/2819892052 shutdown_connections 2023-05-12T09:08:20.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.677+0000 7fd5047ff700 1 --2- 172.21.15.116:0/2819892052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc15cf10 0x7fd4fc06c6c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.677+0000 7fd5047ff700 1 --2- 172.21.15.116:0/2819892052 >> v2:172.21.15.182:3300/0 conn(0x7fd4fc0adf70 0x7fd4fc0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.677+0000 7fd5047ff700 1 -- 172.21.15.116:0/2819892052 >> 172.21.15.116:0/2819892052 conn(0x7fd4fc0cf720 msgr2=0x7fd4fc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:20.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.677+0000 7fd5047ff700 1 -- 172.21.15.116:0/2819892052 shutdown_connections 2023-05-12T09:08:20.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.677+0000 7fd5047ff700 1 -- 172.21.15.116:0/2819892052 wait complete. 2023-05-12T09:08:20.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.679+0000 7fd5047ff700 1 Processor -- start 2023-05-12T09:08:20.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.680+0000 7fd5047ff700 1 -- start start 2023-05-12T09:08:20.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd5047ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd4fc0adf70 0x7fd4fc14cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd5047ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc0cd760 0x7fd4fc15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd5047ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd4fc15cf10 0x7fd4fc0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd5047ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc15b530 con 0x7fd4fc0cd760 2023-05-12T09:08:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd5047ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc15b810 con 0x7fd4fc15cf10 2023-05-12T09:08:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd5047ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0ab8b0 con 0x7fd4fc0adf70 2023-05-12T09:08:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd501d9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc0cd760 0x7fd4fc15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd50259b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd4fc0adf70 0x7fd4fc14cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd501d9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc0cd760 0x7fd4fc15aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43120/0 (socket says 172.21.15.116:43120) 2023-05-12T09:08:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd501d9a700 1 -- 172.21.15.116:0/4188924926 learned_addr learned my addr 172.21.15.116:0/4188924926 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd502d9c700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd4fc15cf10 0x7fd4fc0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd501d9a700 1 -- 172.21.15.116:0/4188924926 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd4fc0adf70 msgr2=0x7fd4fc14cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.681+0000 7fd501d9a700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd4fc0adf70 0x7fd4fc14cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.682+0000 7fd501d9a700 1 -- 172.21.15.116:0/4188924926 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd4fc15cf10 msgr2=0x7fd4fc0b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.682+0000 7fd501d9a700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd4fc15cf10 0x7fd4fc0b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.682+0000 7fd501d9a700 1 -- 172.21.15.116:0/4188924926 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4009a70 con 0x7fd4fc0cd760 2023-05-12T09:08:20.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.682+0000 7fd501d9a700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc0cd760 0x7fd4fc15aa70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00e7f0 tx=0x7fd4ec00eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:20.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.682+0000 7fd4f2ffd700 1 -- 172.21.15.116:0/4188924926 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec005c20 con 0x7fd4fc0cd760 2023-05-12T09:08:20.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.682+0000 7fd4f2ffd700 1 -- 172.21.15.116:0/4188924926 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec005d80 con 0x7fd4fc0cd760 2023-05-12T09:08:20.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.682+0000 7fd5047ff700 1 -- 172.21.15.116:0/4188924926 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc071600 con 0x7fd4fc0cd760 2023-05-12T09:08:20.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.682+0000 7fd4f2ffd700 1 -- 172.21.15.116:0/4188924926 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec006270 con 0x7fd4fc0cd760 2023-05-12T09:08:20.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.682+0000 7fd5047ff700 1 -- 172.21.15.116:0/4188924926 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc0cc670 con 0x7fd4fc0cd760 2023-05-12T09:08:20.689 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.683+0000 7fd5047ff700 1 -- 172.21.15.116:0/4188924926 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc0cd3b0 con 0x7fd4fc0cd760 2023-05-12T09:08:20.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.684+0000 7fd4f2ffd700 1 -- 172.21.15.116:0/4188924926 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4ec0063d0 con 0x7fd4fc0cd760 2023-05-12T09:08:20.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.686+0000 7fd4f2ffd700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd4e006ace0 0x7fd4e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:20.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.686+0000 7fd4f2ffd700 1 -- 172.21.15.116:0/4188924926 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd4ec089210 con 0x7fd4fc0cd760 2023-05-12T09:08:20.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.686+0000 7fd50259b700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd4e006ace0 0x7fd4e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:20.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.686+0000 7fd50259b700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd4e006ace0 0x7fd4e006d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007fd0 tx=0x7fd4f8007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:20.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.690+0000 7fd4f2ffd700 1 -- 172.21.15.116:0/4188924926 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd4ec053ef0 con 0x7fd4fc0cd760 2023-05-12T09:08:20.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.885+0000 7fd5047ff700 1 -- 172.21.15.116:0/4188924926 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4fc071b50 con 0x7fd4fc0cd760 2023-05-12T09:08:20.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.886+0000 7fd4f2ffd700 1 -- 172.21.15.116:0/4188924926 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7fd4ec020090 con 0x7fd4fc0cd760 2023-05-12T09:08:20.890 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:20.890 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:20.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 -- 172.21.15.116:0/4188924926 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd4e006ace0 msgr2=0x7fd4e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:20.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd4e006ace0 0x7fd4e006d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007fd0 tx=0x7fd4f8007de0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 -- 172.21.15.116:0/4188924926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc0cd760 msgr2=0x7fd4fc15aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:20.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc0cd760 0x7fd4fc15aa70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00e7f0 tx=0x7fd4ec00eb00 comp rx=0 tx=0).stop 2023-05-12T09:08:20.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 -- 172.21.15.116:0/4188924926 shutdown_connections 2023-05-12T09:08:20.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd4fc15cf10 0x7fd4fc0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd4e006ace0 0x7fd4e006d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd4fc0adf70 0x7fd4fc14cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 --2- 172.21.15.116:0/4188924926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4fc0cd760 0x7fd4fc15aa70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:20.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 -- 172.21.15.116:0/4188924926 >> 172.21.15.116:0/4188924926 conn(0x7fd4fc0cf720 msgr2=0x7fd4fc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:20.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 -- 172.21.15.116:0/4188924926 shutdown_connections 2023-05-12T09:08:20.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:20.889+0000 7fd5047ff700 1 -- 172.21.15.116:0/4188924926 wait complete. 2023-05-12T09:08:20.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:20.910 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:21.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.095+0000 7f1ebf9ff700 1 Processor -- start 2023-05-12T09:08:21.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.096+0000 7f1ebf9ff700 1 -- start start 2023-05-12T09:08:21.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.097+0000 7f1ebf9ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f1eb80cff50 0x7f1eb8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.097+0000 7f1ebf9ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb80cd520 con 0x7f1eb815c590 2023-05-12T09:08:21.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.097+0000 7f1ebf9ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb80d2640 con 0x7f1eb80cf010 2023-05-12T09:08:21.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.097+0000 7f1ebf9ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb81610d0 con 0x7f1eb80cff50 2023-05-12T09:08:21.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.097+0000 7f1ebd79b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1eb815c590 0x7f1eb80cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:42510/0 (socket says 172.21.15.116:42510) 2023-05-12T09:08:21.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.097+0000 7f1ebd79b700 1 -- 172.21.15.116:0/2069473870 learned_addr learned my addr 172.21.15.116:0/2069473870 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:21.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.097+0000 7f1ebdf9c700 1 --2- 172.21.15.116:0/2069473870 >> v2:172.21.15.182:3300/0 conn(0x7f1eb80cff50 0x7f1eb8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.097+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838996683 0 0) 0x7f1eb80cd520 con 0x7f1eb815c590 2023-05-12T09:08:21.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.097+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea40035b0 con 0x7f1eb815c590 2023-05-12T09:08:21.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1385712761 0 0) 0x7f1ea40035b0 con 0x7f1eb815c590 2023-05-12T09:08:21.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 >> v2:172.21.15.182:3300/0 conn(0x7f1eb80cff50 msgr2=0x7f1eb8160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:21.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 --2- 172.21.15.116:0/2069473870 >> v2:172.21.15.182:3300/0 conn(0x7f1eb80cff50 0x7f1eb8160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 >> v1:172.21.15.182:6789/0 conn(0x7f1eb80cf010 legacy=0x7f1eb80d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80b23c0 con 0x7f1eb815c590 2023-05-12T09:08:21.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f1eb4001670 con 0x7f1eb815c590 2023-05-12T09:08:21.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 >> v1:172.21.15.116:6789/0 conn(0x7f1eb815c590 legacy=0x7f1eb80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1ea4003a00 0x7f1ea4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ea4004850 0x7f1ea4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4005200 0x7f1ea400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb81610d0 con 0x7f1ea4004850 2023-05-12T09:08:21.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea400c080 con 0x7f1ea4005200 2023-05-12T09:08:21.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea400c240 con 0x7f1ea4003a00 2023-05-12T09:08:21.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1ebcf9a700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ea4004850 0x7f1ea4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1ebd79b700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1ea4003a00 0x7f1ea4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.098+0000 7f1ebdf9c700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4005200 0x7f1ea400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1ebcf9a700 1 -- 172.21.15.116:0/2069473870 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1ea4003a00 msgr2=0x7f1ea4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:21.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1ebcf9a700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1ea4003a00 0x7f1ea4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1ebcf9a700 1 -- 172.21.15.116:0/2069473870 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4005200 msgr2=0x7f1ea400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:21.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1ebcf9a700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4005200 0x7f1ea400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1ebcf9a700 1 -- 172.21.15.116:0/2069473870 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40035b0 con 0x7f1ea4004850 2023-05-12T09:08:21.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1ebdf9c700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4005200 0x7f1ea400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:21.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1ebdf9c700 1 -- 172.21.15.116:0/2069473870 reap_dead start 2023-05-12T09:08:21.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1ebcf9a700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ea4004850 0x7f1ea4004cc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80017c0 tx=0x7f1ea4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad830a93364d06a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:21.108 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea80052d0 con 0x7f1ea4004850 2023-05-12T09:08:21.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea8005430 con 0x7f1ea4004850 2023-05-12T09:08:21.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1eaffff700 1 -- 172.21.15.116:0/2069473870 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea80038c0 con 0x7f1ea4004850 2023-05-12T09:08:21.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/2069473870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ea4004850 msgr2=0x7f1ea4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.099+0000 7f1ebf9ff700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ea4004850 0x7f1ea4004cc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80017c0 tx=0x7f1ea4005880 comp rx=0 tx=0).stop 2023-05-12T09:08:21.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.100+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/2069473870 shutdown_connections 2023-05-12T09:08:21.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.100+0000 7f1ebf9ff700 1 --2- 172.21.15.116:0/2069473870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ea4004850 0x7f1ea4004cc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.100+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/2069473870 >> 172.21.15.116:0/2069473870 conn(0x7f1eb8071b10 msgr2=0x7f1eb8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:21.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.100+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/2069473870 shutdown_connections 2023-05-12T09:08:21.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.100+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/2069473870 wait complete. 2023-05-12T09:08:21.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.101+0000 7f1ebf9ff700 1 Processor -- start 2023-05-12T09:08:21.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.101+0000 7f1ebf9ff700 1 -- start start 2023-05-12T09:08:21.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.102+0000 7f1ebf9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4004850 0x7f1eb815f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.102+0000 7f1ebf9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb815e4c0 0x7f1eb815a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.102+0000 7f1ebf9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1eb815b010 0x7f1eb80b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.102+0000 7f1ebf9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb815fab0 con 0x7f1eb815e4c0 2023-05-12T09:08:21.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.102+0000 7f1ebf9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb815f810 con 0x7f1ea4004850 2023-05-12T09:08:21.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.102+0000 7f1ebf9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb815d700 con 0x7f1eb815b010 2023-05-12T09:08:21.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebcf9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb815e4c0 0x7f1eb815a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebcf9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb815e4c0 0x7f1eb815a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43126/0 (socket says 172.21.15.116:43126) 2023-05-12T09:08:21.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebcf9a700 1 -- 172.21.15.116:0/39232198 learned_addr learned my addr 172.21.15.116:0/39232198 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:21.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebdf9c700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1eb815b010 0x7f1eb80b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebd79b700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4004850 0x7f1eb815f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebcf9a700 1 -- 172.21.15.116:0/39232198 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1eb815b010 msgr2=0x7f1eb80b7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebcf9a700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1eb815b010 0x7f1eb80b7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebcf9a700 1 -- 172.21.15.116:0/39232198 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4004850 msgr2=0x7f1eb815f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebcf9a700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4004850 0x7f1eb815f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebcf9a700 1 -- 172.21.15.116:0/39232198 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80cd770 con 0x7f1eb815e4c0 2023-05-12T09:08:21.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebdf9c700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1eb815b010 0x7f1eb80b7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:21.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebd79b700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4004850 0x7f1eb815f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:21.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1ebcf9a700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb815e4c0 0x7f1eb815a770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8015040 tx=0x7f1ea8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:21.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.103+0000 7f1eadffb700 1 -- 172.21.15.116:0/39232198 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8001290 con 0x7f1eb815e4c0 2023-05-12T09:08:21.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.104+0000 7f1eadffb700 1 -- 172.21.15.116:0/39232198 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea801d480 con 0x7f1eb815e4c0 2023-05-12T09:08:21.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.104+0000 7f1eadffb700 1 -- 172.21.15.116:0/39232198 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea801d830 con 0x7f1eb815e4c0 2023-05-12T09:08:21.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.104+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/39232198 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb80cf560 con 0x7f1eb815e4c0 2023-05-12T09:08:21.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.104+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/39232198 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb815c960 con 0x7f1eb815e4c0 2023-05-12T09:08:21.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.105+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/39232198 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb80cda40 con 0x7f1eb815e4c0 2023-05-12T09:08:21.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.105+0000 7f1eadffb700 1 -- 172.21.15.116:0/39232198 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ea8019040 con 0x7f1eb815e4c0 2023-05-12T09:08:21.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.106+0000 7f1eadffb700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1e9c06ace0 0x7f1e9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.106+0000 7f1eadffb700 1 -- 172.21.15.116:0/39232198 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1ea808a3e0 con 0x7f1eb815e4c0 2023-05-12T09:08:21.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.107+0000 7f1ebd79b700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1e9c06ace0 0x7f1e9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.107+0000 7f1ebd79b700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1e9c06ace0 0x7f1e9c06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4000c00 tx=0x7f1eb4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:21.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.111+0000 7f1eadffb700 1 -- 172.21.15.116:0/39232198 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1ea8055150 con 0x7f1eb815e4c0 2023-05-12T09:08:21.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.307+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/39232198 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1eb815fab0 con 0x7f1eb815e4c0 2023-05-12T09:08:21.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.308+0000 7f1eadffb700 1 -- 172.21.15.116:0/39232198 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ea8058770 con 0x7f1eb815e4c0 2023-05-12T09:08:21.311 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:21.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.310+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/39232198 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1e9c06ace0 msgr2=0x7f1e9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.310+0000 7f1ebf9ff700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1e9c06ace0 0x7f1e9c06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4000c00 tx=0x7f1eb4009040 comp rx=0 tx=0).stop 2023-05-12T09:08:21.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.310+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/39232198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb815e4c0 msgr2=0x7f1eb815a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.310+0000 7f1ebf9ff700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb815e4c0 0x7f1eb815a770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8015040 tx=0x7f1ea8001120 comp rx=0 tx=0).stop 2023-05-12T09:08:21.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.311+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/39232198 shutdown_connections 2023-05-12T09:08:21.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.311+0000 7f1ebf9ff700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1e9c06ace0 0x7f1e9c06d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.311+0000 7f1ebf9ff700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1eb815b010 0x7f1eb80b7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.311+0000 7f1ebf9ff700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1ea4004850 0x7f1eb815f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.311+0000 7f1ebf9ff700 1 --2- 172.21.15.116:0/39232198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb815e4c0 0x7f1eb815a770 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.311+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/39232198 >> 172.21.15.116:0/39232198 conn(0x7f1eb8071b10 msgr2=0x7f1eb80b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:21.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.311+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/39232198 shutdown_connections 2023-05-12T09:08:21.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.311+0000 7f1ebf9ff700 1 -- 172.21.15.116:0/39232198 wait complete. 2023-05-12T09:08:21.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:21.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.516+0000 7fab0cfff700 1 Processor -- start 2023-05-12T09:08:21.519 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.516+0000 7fab0cfff700 1 -- start start 2023-05-12T09:08:21.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.517+0000 7fab0cfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fab081589d0 0x7fab080cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.518+0000 7fab0cfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fab080cd690 0x7fab0806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.521 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.518+0000 7fab0cfff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fab08158da0 0x7fab0806cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.518+0000 7fab0cfff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab080ca890 con 0x7fab081589d0 2023-05-12T09:08:21.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.518+0000 7fab0cfff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab080ca5b0 con 0x7fab08158da0 2023-05-12T09:08:21.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.518+0000 7fab0cfff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab080cc670 con 0x7fab080cd690 2023-05-12T09:08:21.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.518+0000 7fab0659c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fab081589d0 0x7fab080cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.518+0000 7fab0659c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fab081589d0 0x7fab080cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43128/0 (socket says 172.21.15.116:43128) 2023-05-12T09:08:21.522 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.518+0000 7fab0659c700 1 -- 172.21.15.116:0/3288889415 learned_addr learned my addr 172.21.15.116:0/3288889415 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:21.523 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.518+0000 7faafffff700 1 --2- 172.21.15.116:0/3288889415 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fab080cd690 0x7fab0806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.518+0000 7fab06d9d700 1 --2- 172.21.15.116:0/3288889415 >> v2:172.21.15.182:3300/0 conn(0x7fab08158da0 0x7fab0806cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.519+0000 7fab0659c700 1 -- 172.21.15.116:0/3288889415 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fab080cd690 msgr2=0x7fab0806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:21.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.519+0000 7fab0659c700 1 --2- 172.21.15.116:0/3288889415 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fab080cd690 0x7fab0806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.519+0000 7fab0659c700 1 -- 172.21.15.116:0/3288889415 >> v2:172.21.15.182:3300/0 conn(0x7fab08158da0 msgr2=0x7fab0806cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:21.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.519+0000 7fab0659c700 1 --2- 172.21.15.116:0/3288889415 >> v2:172.21.15.182:3300/0 conn(0x7fab08158da0 0x7fab0806cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.524 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.519+0000 7fab0659c700 1 -- 172.21.15.116:0/3288889415 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080cc950 con 0x7fab081589d0 2023-05-12T09:08:21.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.519+0000 7fab0659c700 1 --2- 172.21.15.116:0/3288889415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab081589d0 0x7fab080cd150 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab0806b530 tx=0x7faaf8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc4967e3fd7b135 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:21.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.519+0000 7fab05d9b700 1 -- 172.21.15.116:0/3288889415 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8011830 con 0x7fab081589d0 2023-05-12T09:08:21.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.519+0000 7fab05d9b700 1 -- 172.21.15.116:0/3288889415 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf8011990 con 0x7fab081589d0 2023-05-12T09:08:21.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.519+0000 7fab05d9b700 1 -- 172.21.15.116:0/3288889415 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8011d20 con 0x7fab081589d0 2023-05-12T09:08:21.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.520+0000 7fab0cfff700 1 -- 172.21.15.116:0/3288889415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab081589d0 msgr2=0x7fab080cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.520+0000 7fab0cfff700 1 --2- 172.21.15.116:0/3288889415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab081589d0 0x7fab080cd150 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab0806b530 tx=0x7faaf8009bd0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.525 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.520+0000 7fab0cfff700 1 -- 172.21.15.116:0/3288889415 shutdown_connections 2023-05-12T09:08:21.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.520+0000 7fab0cfff700 1 --2- 172.21.15.116:0/3288889415 >> v2:172.21.15.182:3300/0 conn(0x7fab08158da0 0x7fab0806cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.520+0000 7fab0cfff700 1 --2- 172.21.15.116:0/3288889415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab081589d0 0x7fab080cd150 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.520+0000 7fab0cfff700 1 --2- 172.21.15.116:0/3288889415 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fab080cd690 0x7fab0806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.520+0000 7fab0cfff700 1 -- 172.21.15.116:0/3288889415 >> 172.21.15.116:0/3288889415 conn(0x7fab080cf720 msgr2=0x7fab080cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:21.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.520+0000 7fab0cfff700 1 -- 172.21.15.116:0/3288889415 shutdown_connections 2023-05-12T09:08:21.526 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.520+0000 7fab0cfff700 1 -- 172.21.15.116:0/3288889415 wait complete. 2023-05-12T09:08:21.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.521+0000 7fab0cfff700 1 Processor -- start 2023-05-12T09:08:21.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.522+0000 7fab0cfff700 1 -- start start 2023-05-12T09:08:21.528 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.522+0000 7fab0cfff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fab080cd690 0x7fab08159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.522+0000 7fab0cfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fab081589d0 0x7fab080c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.522+0000 7fab0cfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab08158da0 0x7fab081462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.522+0000 7fab0cfff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0815bc10 con 0x7fab08158da0 2023-05-12T09:08:21.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.522+0000 7fab0cfff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0815bef0 con 0x7fab080cd690 2023-05-12T09:08:21.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.522+0000 7fab0cfff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab08159c00 con 0x7fab081589d0 2023-05-12T09:08:21.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab06d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab08158da0 0x7fab081462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab06d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab08158da0 0x7fab081462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43132/0 (socket says 172.21.15.116:43132) 2023-05-12T09:08:21.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab06d9d700 1 -- 172.21.15.116:0/4284711338 learned_addr learned my addr 172.21.15.116:0/4284711338 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:21.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7faafffff700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fab081589d0 0x7fab080c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab0659c700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fab080cd690 0x7fab08159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab06d9d700 1 -- 172.21.15.116:0/4284711338 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fab081589d0 msgr2=0x7fab080c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab06d9d700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fab081589d0 0x7fab080c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab06d9d700 1 -- 172.21.15.116:0/4284711338 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fab080cd690 msgr2=0x7fab08159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab06d9d700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fab080cd690 0x7fab08159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab06d9d700 1 -- 172.21.15.116:0/4284711338 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf8009550 con 0x7fab08158da0 2023-05-12T09:08:21.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab0659c700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fab080cd690 0x7fab08159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:21.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.523+0000 7fab06d9d700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab08158da0 0x7fab081462c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fab0000efc0 tx=0x7fab00009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:21.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.524+0000 7faafeffd700 1 -- 172.21.15.116:0/4284711338 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00009b20 con 0x7fab08158da0 2023-05-12T09:08:21.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.524+0000 7faafeffd700 1 -- 172.21.15.116:0/4284711338 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0000f040 con 0x7fab08158da0 2023-05-12T09:08:21.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.524+0000 7fab0cfff700 1 -- 172.21.15.116:0/4284711338 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab080cbc20 con 0x7fab08158da0 2023-05-12T09:08:21.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.524+0000 7faafeffd700 1 -- 172.21.15.116:0/4284711338 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0000cd40 con 0x7fab08158da0 2023-05-12T09:08:21.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.524+0000 7fab0cfff700 1 -- 172.21.15.116:0/4284711338 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab080ccc30 con 0x7fab08158da0 2023-05-12T09:08:21.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.525+0000 7fab0cfff700 1 -- 172.21.15.116:0/4284711338 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab080cbdb0 con 0x7fab08158da0 2023-05-12T09:08:21.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.526+0000 7faafeffd700 1 -- 172.21.15.116:0/4284711338 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab00014480 con 0x7fab08158da0 2023-05-12T09:08:21.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.526+0000 7faafeffd700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faae806ad10 0x7faae806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.527+0000 7faafeffd700 1 -- 172.21.15.116:0/4284711338 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fab0008a190 con 0x7fab08158da0 2023-05-12T09:08:21.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.527+0000 7fab0659c700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faae806ad10 0x7faae806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.527+0000 7fab0659c700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faae806ad10 0x7faae806d1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009c10 tx=0x7faaf8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:21.534 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.531+0000 7faafeffd700 1 -- 172.21.15.116:0/4284711338 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fab00054f00 con 0x7fab08158da0 2023-05-12T09:08:21.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.726+0000 7fab0cfff700 1 -- 172.21.15.116:0/4284711338 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab080b4a10 con 0x7fab08158da0 2023-05-12T09:08:21.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.727+0000 7faafeffd700 1 -- 172.21.15.116:0/4284711338 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab00058520 con 0x7fab08158da0 2023-05-12T09:08:21.730 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:21.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 -- 172.21.15.116:0/4284711338 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faae806ad10 msgr2=0x7faae806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faae806ad10 0x7faae806d1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009c10 tx=0x7faaf8008030 comp rx=0 tx=0).stop 2023-05-12T09:08:21.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 -- 172.21.15.116:0/4284711338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab08158da0 msgr2=0x7fab081462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab08158da0 0x7fab081462c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fab0000efc0 tx=0x7fab00009f60 comp rx=0 tx=0).stop 2023-05-12T09:08:21.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 -- 172.21.15.116:0/4284711338 shutdown_connections 2023-05-12T09:08:21.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab08158da0 0x7fab081462c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fab080cd690 0x7fab08159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faae806ad10 0x7faae806d1c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 --2- 172.21.15.116:0/4284711338 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fab081589d0 0x7fab080c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 -- 172.21.15.116:0/4284711338 >> 172.21.15.116:0/4284711338 conn(0x7fab080cf720 msgr2=0x7fab080ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:21.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 -- 172.21.15.116:0/4284711338 shutdown_connections 2023-05-12T09:08:21.734 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.729+0000 7fab0cfff700 1 -- 172.21.15.116:0/4284711338 wait complete. 2023-05-12T09:08:21.750 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:21.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.934+0000 7fc8903ff700 1 Processor -- start 2023-05-12T09:08:21.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.934+0000 7fc8903ff700 1 -- start start 2023-05-12T09:08:21.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.935+0000 7fc8903ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc8880b87a0 0x7fc8880cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.935+0000 7fc8903ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc888160d40 0x7fc8880d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.935+0000 7fc8903ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880cdc60 con 0x7fc8881601e0 2023-05-12T09:08:21.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.935+0000 7fc8903ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880d02d0 con 0x7fc888160d40 2023-05-12T09:08:21.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.935+0000 7fc8903ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880d0cb0 con 0x7fc8880b87a0 2023-05-12T09:08:21.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.935+0000 7fc88d99a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc8881601e0 0x7fc888160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36494/0 (socket says 172.21.15.116:36494) 2023-05-12T09:08:21.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.935+0000 7fc88d99a700 1 -- 172.21.15.116:0/1811010478 learned_addr learned my addr 172.21.15.116:0/1811010478 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:21.940 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.936+0000 7fc88e99c700 1 --2- 172.21.15.116:0/1811010478 >> v2:172.21.15.116:3300/0 conn(0x7fc888160d40 0x7fc8880d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.936+0000 7fc88e19b700 1 --2- 172.21.15.116:0/1811010478 >> v2:172.21.15.182:3300/0 conn(0x7fc8880b87a0 0x7fc8880cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.936+0000 7fc88d199700 1 -- 172.21.15.116:0/1811010478 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931792603 0 0) 0x7fc8880cdc60 con 0x7fc8881601e0 2023-05-12T09:08:21.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.936+0000 7fc88d199700 1 -- 172.21.15.116:0/1811010478 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8740035b0 con 0x7fc8881601e0 2023-05-12T09:08:21.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.936+0000 7fc88e99c700 1 -- 172.21.15.116:0/1811010478 >> v2:172.21.15.182:3300/0 conn(0x7fc8880b87a0 msgr2=0x7fc8880cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:21.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.936+0000 7fc88e99c700 1 --2- 172.21.15.116:0/1811010478 >> v2:172.21.15.182:3300/0 conn(0x7fc8880b87a0 0x7fc8880cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.936+0000 7fc88e99c700 1 -- 172.21.15.116:0/1811010478 >> v1:172.21.15.116:6789/0 conn(0x7fc8881601e0 legacy=0x7fc888160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.936+0000 7fc88e99c700 1 -- 172.21.15.116:0/1811010478 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880cd6a0 con 0x7fc888160d40 2023-05-12T09:08:21.942 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.936+0000 7fc88e99c700 1 --2- 172.21.15.116:0/1811010478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc888160d40 0x7fc8880d1100 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc8880b4ac0 tx=0x7fc88000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b7493587745086 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:21.942 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.936+0000 7fc88d199700 1 -- 172.21.15.116:0/1811010478 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000e070 con 0x7fc888160d40 2023-05-12T09:08:21.942 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.937+0000 7fc88d199700 1 -- 172.21.15.116:0/1811010478 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88000bae0 con 0x7fc888160d40 2023-05-12T09:08:21.942 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.937+0000 7fc88d199700 1 -- 172.21.15.116:0/1811010478 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000be90 con 0x7fc888160d40 2023-05-12T09:08:21.942 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.937+0000 7fc8903ff700 1 -- 172.21.15.116:0/1811010478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc888160d40 msgr2=0x7fc8880d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.942 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.937+0000 7fc8903ff700 1 --2- 172.21.15.116:0/1811010478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc888160d40 0x7fc8880d1100 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc8880b4ac0 tx=0x7fc88000b330 comp rx=0 tx=0).stop 2023-05-12T09:08:21.942 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.937+0000 7fc8903ff700 1 -- 172.21.15.116:0/1811010478 shutdown_connections 2023-05-12T09:08:21.943 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.937+0000 7fc8903ff700 1 --2- 172.21.15.116:0/1811010478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc888160d40 0x7fc8880d1100 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.943 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.937+0000 7fc8903ff700 1 --2- 172.21.15.116:0/1811010478 >> v2:172.21.15.182:3300/0 conn(0x7fc8880b87a0 0x7fc8880cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.943 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.937+0000 7fc8903ff700 1 -- 172.21.15.116:0/1811010478 >> 172.21.15.116:0/1811010478 conn(0x7fc888071b10 msgr2=0x7fc888071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:21.943 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.937+0000 7fc8903ff700 1 -- 172.21.15.116:0/1811010478 shutdown_connections 2023-05-12T09:08:21.943 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.937+0000 7fc8903ff700 1 -- 172.21.15.116:0/1811010478 wait complete. 2023-05-12T09:08:21.944 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.939+0000 7fc8903ff700 1 Processor -- start 2023-05-12T09:08:21.945 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.939+0000 7fc8903ff700 1 -- start start 2023-05-12T09:08:21.945 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc8903ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8880b87a0 0x7fc888150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.945 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc8903ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8881601e0 0x7fc8880cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.945 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc8903ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc888160d40 0x7fc88815d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.945 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc8903ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888151910 con 0x7fc8881601e0 2023-05-12T09:08:21.945 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc8903ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880cb410 con 0x7fc8880b87a0 2023-05-12T09:08:21.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc8903ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880cb6f0 con 0x7fc888160d40 2023-05-12T09:08:21.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc88d99a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8881601e0 0x7fc8880cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc88e19b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8880b87a0 0x7fc888150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc88d99a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8881601e0 0x7fc8880cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39130/0 (socket says 172.21.15.116:39130) 2023-05-12T09:08:21.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc88d99a700 1 -- 172.21.15.116:0/416910765 learned_addr learned my addr 172.21.15.116:0/416910765 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:21.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.940+0000 7fc88e99c700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc888160d40 0x7fc88815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc88d99a700 1 -- 172.21.15.116:0/416910765 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc888160d40 msgr2=0x7fc88815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc88d99a700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc888160d40 0x7fc88815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc88d99a700 1 -- 172.21.15.116:0/416910765 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8880b87a0 msgr2=0x7fc888150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:21.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc88d99a700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8880b87a0 0x7fc888150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:21.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc88d99a700 1 -- 172.21.15.116:0/416910765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc880009a70 con 0x7fc8881601e0 2023-05-12T09:08:21.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc88d99a700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8881601e0 0x7fc8880cc790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc87800c700 tx=0x7fc87800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:21.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc87effd700 1 -- 172.21.15.116:0/416910765 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878005d70 con 0x7fc8881601e0 2023-05-12T09:08:21.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc87effd700 1 -- 172.21.15.116:0/416910765 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8780070d0 con 0x7fc8881601e0 2023-05-12T09:08:21.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc8903ff700 1 -- 172.21.15.116:0/416910765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8880d1640 con 0x7fc8881601e0 2023-05-12T09:08:21.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc87effd700 1 -- 172.21.15.116:0/416910765 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878007460 con 0x7fc8881601e0 2023-05-12T09:08:21.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.941+0000 7fc8903ff700 1 -- 172.21.15.116:0/416910765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8880cd980 con 0x7fc8881601e0 2023-05-12T09:08:21.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.942+0000 7fc8903ff700 1 -- 172.21.15.116:0/416910765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8880d17d0 con 0x7fc8881601e0 2023-05-12T09:08:21.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.943+0000 7fc87effd700 1 -- 172.21.15.116:0/416910765 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8780075c0 con 0x7fc8881601e0 2023-05-12T09:08:21.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.944+0000 7fc87effd700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc86c06ace0 0x7fc86c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:21.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.944+0000 7fc87effd700 1 -- 172.21.15.116:0/416910765 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc878088cc0 con 0x7fc8881601e0 2023-05-12T09:08:21.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.945+0000 7fc88e19b700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc86c06ace0 0x7fc86c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:21.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.945+0000 7fc88e19b700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc86c06ace0 0x7fc86c06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc884009be0 tx=0x7fc884009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:21.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:21.949+0000 7fc87effd700 1 -- 172.21.15.116:0/416910765 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc8780539b0 con 0x7fc8881601e0 2023-05-12T09:08:22.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.143+0000 7fc8903ff700 1 -- 172.21.15.116:0/416910765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc888074430 con 0x7fc8881601e0 2023-05-12T09:08:22.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.143+0000 7fc87effd700 1 -- 172.21.15.116:0/416910765 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc878017020 con 0x7fc8881601e0 2023-05-12T09:08:22.147 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:22.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 -- 172.21.15.116:0/416910765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc86c06ace0 msgr2=0x7fc86c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc86c06ace0 0x7fc86c06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc884009be0 tx=0x7fc884009210 comp rx=0 tx=0).stop 2023-05-12T09:08:22.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 -- 172.21.15.116:0/416910765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8881601e0 msgr2=0x7fc8880cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8881601e0 0x7fc8880cc790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc87800c700 tx=0x7fc87800ca10 comp rx=0 tx=0).stop 2023-05-12T09:08:22.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 -- 172.21.15.116:0/416910765 shutdown_connections 2023-05-12T09:08:22.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc86c06ace0 0x7fc86c06d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc888160d40 0x7fc88815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc8880b87a0 0x7fc888150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 --2- 172.21.15.116:0/416910765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8881601e0 0x7fc8880cc790 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.150 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 -- 172.21.15.116:0/416910765 >> 172.21.15.116:0/416910765 conn(0x7fc888071b10 msgr2=0x7fc8880cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:22.151 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 -- 172.21.15.116:0/416910765 shutdown_connections 2023-05-12T09:08:22.151 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.146+0000 7fc8903ff700 1 -- 172.21.15.116:0/416910765 wait complete. 2023-05-12T09:08:22.166 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.349+0000 7fa69c3ff700 1 Processor -- start 2023-05-12T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.350+0000 7fa69c3ff700 1 -- start start 2023-05-12T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.351+0000 7fa69c3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa69415c590 0x7fa694160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.351+0000 7fa69c3ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa6940cf010 0x7fa6940cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.351+0000 7fa69c3ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6940cd520 con 0x7fa6940cfd80 2023-05-12T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.351+0000 7fa69c3ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6940d2640 con 0x7fa6940cf010 2023-05-12T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.351+0000 7fa69c3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6941610d0 con 0x7fa69415c590 2023-05-12T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.351+0000 7fa69999a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa6940cf010 0x7fa6940cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.351+0000 7fa69999a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa6940cf010 0x7fa6940cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39140/0 (socket says 172.21.15.116:39140) 2023-05-12T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.351+0000 7fa69999a700 1 -- 172.21.15.116:0/1160352635 learned_addr learned my addr 172.21.15.116:0/1160352635 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.351+0000 7fa69a19b700 1 --2- 172.21.15.116:0/1160352635 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa69415c590 0x7fa694160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.352+0000 7fa69999a700 1 -- 172.21.15.116:0/1160352635 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa69415c590 msgr2=0x7fa694160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.352+0000 7fa69999a700 1 --2- 172.21.15.116:0/1160352635 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa69415c590 0x7fa694160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.352+0000 7fa69999a700 1 -- 172.21.15.116:0/1160352635 >> v1:172.21.15.182:6789/0 conn(0x7fa6940cfd80 legacy=0x7fa6940d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.352+0000 7fa69999a700 1 -- 172.21.15.116:0/1160352635 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940d0200 con 0x7fa6940cf010 2023-05-12T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.352+0000 7fa69999a700 1 --2- 172.21.15.116:0/1160352635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6940cf010 0x7fa6940cf840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa6840098f0 tx=0x7fa684009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e0ca8e66a2e5bd server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.352+0000 7fa699199700 1 -- 172.21.15.116:0/1160352635 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684011830 con 0x7fa6940cf010 2023-05-12T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.352+0000 7fa699199700 1 -- 172.21.15.116:0/1160352635 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa684011990 con 0x7fa6940cf010 2023-05-12T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.352+0000 7fa699199700 1 -- 172.21.15.116:0/1160352635 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684011d20 con 0x7fa6940cf010 2023-05-12T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.353+0000 7fa69c3ff700 1 -- 172.21.15.116:0/1160352635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6940cf010 msgr2=0x7fa6940cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.353+0000 7fa69c3ff700 1 --2- 172.21.15.116:0/1160352635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6940cf010 0x7fa6940cf840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa6840098f0 tx=0x7fa684009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.353+0000 7fa69c3ff700 1 -- 172.21.15.116:0/1160352635 shutdown_connections 2023-05-12T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.353+0000 7fa69c3ff700 1 --2- 172.21.15.116:0/1160352635 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa69415c590 0x7fa694160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.353+0000 7fa69c3ff700 1 --2- 172.21.15.116:0/1160352635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6940cf010 0x7fa6940cf840 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.353+0000 7fa69c3ff700 1 -- 172.21.15.116:0/1160352635 >> 172.21.15.116:0/1160352635 conn(0x7fa694071b10 msgr2=0x7fa694071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.353+0000 7fa69c3ff700 1 -- 172.21.15.116:0/1160352635 shutdown_connections 2023-05-12T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.353+0000 7fa69c3ff700 1 -- 172.21.15.116:0/1160352635 wait complete. 2023-05-12T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.354+0000 7fa69c3ff700 1 Processor -- start 2023-05-12T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.355+0000 7fa69c3ff700 1 -- start start 2023-05-12T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.355+0000 7fa69c3ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa6940cf010 0x7fa694158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.355+0000 7fa69c3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa6940cfd80 0x7fa6940b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.355+0000 7fa69c3ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa69415c590 0x7fa694152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.355+0000 7fa69c3ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940b6650 con 0x7fa69415c590 2023-05-12T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.355+0000 7fa69c3ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940b7490 con 0x7fa6940cf010 2023-05-12T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69c3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940b6880 con 0x7fa6940cfd80 2023-05-12T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69a99c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa69415c590 0x7fa694152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69a99c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa69415c590 0x7fa694152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39144/0 (socket says 172.21.15.116:39144) 2023-05-12T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69a99c700 1 -- 172.21.15.116:0/4247671116 learned_addr learned my addr 172.21.15.116:0/4247671116 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69999a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa6940cfd80 0x7fa6940b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69a19b700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa6940cf010 0x7fa694158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69a99c700 1 -- 172.21.15.116:0/4247671116 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa6940cfd80 msgr2=0x7fa6940b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69a99c700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa6940cfd80 0x7fa6940b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69a99c700 1 -- 172.21.15.116:0/4247671116 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa6940cf010 msgr2=0x7fa694158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69a99c700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa6940cf010 0x7fa694158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.356+0000 7fa69a99c700 1 -- 172.21.15.116:0/4247671116 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684009550 con 0x7fa69415c590 2023-05-12T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.357+0000 7fa69a99c700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa69415c590 0x7fa694152360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00cc50 tx=0x7fa68c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.357+0000 7fa68affd700 1 -- 172.21.15.116:0/4247671116 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c003c00 con 0x7fa69415c590 2023-05-12T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.357+0000 7fa68affd700 1 -- 172.21.15.116:0/4247671116 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c003d60 con 0x7fa69415c590 2023-05-12T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.357+0000 7fa69c3ff700 1 -- 172.21.15.116:0/4247671116 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6940cf560 con 0x7fa69415c590 2023-05-12T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.357+0000 7fa68affd700 1 -- 172.21.15.116:0/4247671116 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c00aab0 con 0x7fa69415c590 2023-05-12T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.357+0000 7fa69c3ff700 1 -- 172.21.15.116:0/4247671116 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6940b23c0 con 0x7fa69415c590 2023-05-12T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.358+0000 7fa69c3ff700 1 -- 172.21.15.116:0/4247671116 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6940cd770 con 0x7fa69415c590 2023-05-12T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.359+0000 7fa68affd700 1 -- 172.21.15.116:0/4247671116 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa68c00ac10 con 0x7fa69415c590 2023-05-12T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.360+0000 7fa68affd700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa67806ace0 0x7fa67806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.360+0000 7fa68affd700 1 -- 172.21.15.116:0/4247671116 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa68c0897c0 con 0x7fa69415c590 2023-05-12T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.360+0000 7fa69a19b700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa67806ace0 0x7fa67806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.360+0000 7fa69a19b700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa67806ace0 0x7fa67806d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa690009b20 tx=0x7fa690009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.364+0000 7fa68affd700 1 -- 172.21.15.116:0/4247671116 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa68c0544a0 con 0x7fa69415c590 2023-05-12T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.559+0000 7fa69c3ff700 1 -- 172.21.15.116:0/4247671116 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6940b51f0 con 0x7fa69415c590 2023-05-12T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.559+0000 7fa68affd700 1 -- 172.21.15.116:0/4247671116 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa68c057ac0 con 0x7fa69415c590 2023-05-12T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 -- 172.21.15.116:0/4247671116 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa67806ace0 msgr2=0x7fa67806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa67806ace0 0x7fa67806d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa690009b20 tx=0x7fa690009210 comp rx=0 tx=0).stop 2023-05-12T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 -- 172.21.15.116:0/4247671116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa69415c590 msgr2=0x7fa694152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa69415c590 0x7fa694152360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00cc50 tx=0x7fa68c00cf60 comp rx=0 tx=0).stop 2023-05-12T09:08:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 -- 172.21.15.116:0/4247671116 shutdown_connections 2023-05-12T09:08:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa69415c590 0x7fa694152360 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa6940cf010 0x7fa694158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa67806ace0 0x7fa67806d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.566 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 --2- 172.21.15.116:0/4247671116 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa6940cfd80 0x7fa6940b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 -- 172.21.15.116:0/4247671116 >> 172.21.15.116:0/4247671116 conn(0x7fa694071b10 msgr2=0x7fa6940d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:22.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 -- 172.21.15.116:0/4247671116 shutdown_connections 2023-05-12T09:08:22.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.562+0000 7fa69c3ff700 1 -- 172.21.15.116:0/4247671116 wait complete. 2023-05-12T09:08:22.583 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:22.773 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.770+0000 7f62e79ff700 1 Processor -- start 2023-05-12T09:08:22.774 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.770+0000 7f62e79ff700 1 -- start start 2023-05-12T09:08:22.775 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.772+0000 7f62e79ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f62e00cf010 0x7f62e0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.772+0000 7f62e79ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f62e00cff50 0x7f62e00d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.772+0000 7f62e79ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e00cd520 con 0x7f62e015c590 2023-05-12T09:08:22.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.772+0000 7f62e79ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00d2640 con 0x7f62e00cf010 2023-05-12T09:08:22.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.772+0000 7f62e79ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e01610d0 con 0x7f62e00cff50 2023-05-12T09:08:22.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.772+0000 7f62e4f9a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f62e00cf010 0x7f62e0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.772+0000 7f62e4f9a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f62e00cf010 0x7f62e0160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39152/0 (socket says 172.21.15.116:39152) 2023-05-12T09:08:22.776 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.772+0000 7f62e4f9a700 1 -- 172.21.15.116:0/11382014 learned_addr learned my addr 172.21.15.116:0/11382014 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:22.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.773+0000 7f62e5f9c700 1 --2- 172.21.15.116:0/11382014 >> v2:172.21.15.182:3300/0 conn(0x7f62e00cff50 0x7f62e00d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.773+0000 7f62e4f9a700 1 -- 172.21.15.116:0/11382014 >> v2:172.21.15.182:3300/0 conn(0x7f62e00cff50 msgr2=0x7f62e00d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:22.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.773+0000 7f62e4f9a700 1 --2- 172.21.15.116:0/11382014 >> v2:172.21.15.182:3300/0 conn(0x7f62e00cff50 0x7f62e00d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.773+0000 7f62e4f9a700 1 -- 172.21.15.116:0/11382014 >> v1:172.21.15.182:6789/0 conn(0x7f62e015c590 legacy=0x7f62e00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.773+0000 7f62e4f9a700 1 -- 172.21.15.116:0/11382014 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00b23c0 con 0x7f62e00cf010 2023-05-12T09:08:22.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.773+0000 7f62e5f9c700 1 --2- 172.21.15.116:0/11382014 >> v2:172.21.15.182:3300/0 conn(0x7f62e00cff50 0x7f62e00d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:22.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.773+0000 7f62e4f9a700 1 --2- 172.21.15.116:0/11382014 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cf010 0x7f62e0160b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f62e00b20b0 tx=0x7f62d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66443c267aad597 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:22.778 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.773+0000 7f62d7fff700 1 -- 172.21.15.116:0/11382014 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d000b870 con 0x7f62e00cf010 2023-05-12T09:08:22.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.773+0000 7f62d7fff700 1 -- 172.21.15.116:0/11382014 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d000b9d0 con 0x7f62e00cf010 2023-05-12T09:08:22.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.773+0000 7f62d7fff700 1 -- 172.21.15.116:0/11382014 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d000bd60 con 0x7f62e00cf010 2023-05-12T09:08:22.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.774+0000 7f62e79ff700 1 -- 172.21.15.116:0/11382014 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cf010 msgr2=0x7f62e0160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.774+0000 7f62e79ff700 1 --2- 172.21.15.116:0/11382014 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cf010 0x7f62e0160b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f62e00b20b0 tx=0x7f62d0009bd0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.774+0000 7f62e79ff700 1 -- 172.21.15.116:0/11382014 shutdown_connections 2023-05-12T09:08:22.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.774+0000 7f62e79ff700 1 --2- 172.21.15.116:0/11382014 >> v2:172.21.15.182:3300/0 conn(0x7f62e00cff50 0x7f62e00d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.779 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.774+0000 7f62e79ff700 1 --2- 172.21.15.116:0/11382014 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cf010 0x7f62e0160b90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.774+0000 7f62e79ff700 1 -- 172.21.15.116:0/11382014 >> 172.21.15.116:0/11382014 conn(0x7f62e0071b10 msgr2=0x7f62e0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:22.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.774+0000 7f62e79ff700 1 -- 172.21.15.116:0/11382014 shutdown_connections 2023-05-12T09:08:22.780 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.774+0000 7f62e79ff700 1 -- 172.21.15.116:0/11382014 wait complete. 2023-05-12T09:08:22.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.776+0000 7f62e79ff700 1 Processor -- start 2023-05-12T09:08:22.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.777+0000 7f62e79ff700 1 -- start start 2023-05-12T09:08:22.781 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e79ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62e00cf010 0x7f62e0157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e79ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cff50 0x7f62e01569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e79ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62e015c590 0x7f62e00cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e79ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e01e7610 con 0x7f62e00cff50 2023-05-12T09:08:22.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e79ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e01f2cd0 con 0x7f62e00cf010 2023-05-12T09:08:22.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e79ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0157340 con 0x7f62e015c590 2023-05-12T09:08:22.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e4f9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cff50 0x7f62e01569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.782 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e4f9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cff50 0x7f62e01569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39170/0 (socket says 172.21.15.116:39170) 2023-05-12T09:08:22.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e4f9a700 1 -- 172.21.15.116:0/3339874978 learned_addr learned my addr 172.21.15.116:0/3339874978 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:22.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e579b700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62e00cf010 0x7f62e0157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e5f9c700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62e015c590 0x7f62e00cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e4f9a700 1 -- 172.21.15.116:0/3339874978 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62e015c590 msgr2=0x7f62e00cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e4f9a700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62e015c590 0x7f62e00cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e4f9a700 1 -- 172.21.15.116:0/3339874978 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62e00cf010 msgr2=0x7f62e0157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e4f9a700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62e00cf010 0x7f62e0157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.783 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e4f9a700 1 -- 172.21.15.116:0/3339874978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d0009550 con 0x7f62e00cff50 2023-05-12T09:08:22.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e579b700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62e00cf010 0x7f62e0157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:22.784 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.778+0000 7f62e5f9c700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62e015c590 0x7f62e00cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:22.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.779+0000 7f62e4f9a700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cff50 0x7f62e01569f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f62d0014040 tx=0x7f62d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:22.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.779+0000 7f62d5ffb700 1 -- 172.21.15.116:0/3339874978 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0004520 con 0x7f62e00cff50 2023-05-12T09:08:22.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.779+0000 7f62d5ffb700 1 -- 172.21.15.116:0/3339874978 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d001e070 con 0x7f62e00cff50 2023-05-12T09:08:22.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.779+0000 7f62e79ff700 1 -- 172.21.15.116:0/3339874978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e00cd770 con 0x7f62e00cff50 2023-05-12T09:08:22.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.779+0000 7f62d5ffb700 1 -- 172.21.15.116:0/3339874978 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d00038a0 con 0x7f62e00cff50 2023-05-12T09:08:22.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.779+0000 7f62e79ff700 1 -- 172.21.15.116:0/3339874978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e00cf560 con 0x7f62e00cff50 2023-05-12T09:08:22.785 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.780+0000 7f62e79ff700 1 -- 172.21.15.116:0/3339874978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e015c960 con 0x7f62e00cff50 2023-05-12T09:08:22.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.781+0000 7f62d5ffb700 1 -- 172.21.15.116:0/3339874978 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62d0003a00 con 0x7f62e00cff50 2023-05-12T09:08:22.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.782+0000 7f62d5ffb700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f62c406ace0 0x7f62c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:22.786 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.783+0000 7f62d5ffb700 1 -- 172.21.15.116:0/3339874978 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f62d0020070 con 0x7f62e00cff50 2023-05-12T09:08:22.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.783+0000 7f62e579b700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f62c406ace0 0x7f62c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:22.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.783+0000 7f62e579b700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f62c406ace0 0x7f62c406d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f62e00b41c0 tx=0x7f62dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:22.790 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.787+0000 7f62d5ffb700 1 -- 172.21.15.116:0/3339874978 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f62d0055b10 con 0x7f62e00cff50 2023-05-12T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.981+0000 7f62e79ff700 1 -- 172.21.15.116:0/3339874978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f62e00b51f0 con 0x7f62e00cff50 2023-05-12T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.981+0000 7f62d5ffb700 1 -- 172.21.15.116:0/3339874978 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f62d00150a0 con 0x7f62e00cff50 2023-05-12T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.983+0000 7f62e79ff700 1 -- 172.21.15.116:0/3339874978 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f62c406ace0 msgr2=0x7f62c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.983+0000 7f62e79ff700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f62c406ace0 0x7f62c406d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f62e00b41c0 tx=0x7f62dc009040 comp rx=0 tx=0).stop 2023-05-12T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.984+0000 7f62e79ff700 1 -- 172.21.15.116:0/3339874978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cff50 msgr2=0x7f62e01569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.984+0000 7f62e79ff700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cff50 0x7f62e01569f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f62d0014040 tx=0x7f62d0004750 comp rx=0 tx=0).stop 2023-05-12T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.984+0000 7f62e79ff700 1 -- 172.21.15.116:0/3339874978 shutdown_connections 2023-05-12T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.984+0000 7f62e79ff700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f62c406ace0 0x7f62c406d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.984+0000 7f62e79ff700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62e015c590 0x7f62e00cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.984+0000 7f62e79ff700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62e00cf010 0x7f62e0157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.984+0000 7f62e79ff700 1 --2- 172.21.15.116:0/3339874978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00cff50 0x7f62e01569f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.984+0000 7f62e79ff700 1 -- 172.21.15.116:0/3339874978 >> 172.21.15.116:0/3339874978 conn(0x7f62e0071b10 msgr2=0x7f62e00b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.984+0000 7f62e79ff700 1 -- 172.21.15.116:0/3339874978 shutdown_connections 2023-05-12T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:22.984+0000 7f62e79ff700 1 -- 172.21.15.116:0/3339874978 wait complete. 2023-05-12T09:08:23.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-12T09:08:23.189 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.185+0000 7f74fabff700 1 Processor -- start 2023-05-12T09:08:23.189 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.186+0000 7f74fabff700 1 -- start start 2023-05-12T09:08:23.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.187+0000 7f74fabff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 0x7f74f40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.187+0000 7f74fabff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f74f4160d40 0x7f74f40d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.187+0000 7f74fabff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f40cdc60 con 0x7f74f41601e0 2023-05-12T09:08:23.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.187+0000 7f74fabff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f40d02d0 con 0x7f74f4160d40 2023-05-12T09:08:23.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.187+0000 7f74fabff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f40d0cb0 con 0x7f74f40b87a0 2023-05-12T09:08:23.191 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.187+0000 7f74f899b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 0x7f74f40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.188+0000 7f74f899b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 0x7f74f40cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:44802/0 (socket says 172.21.15.116:44802) 2023-05-12T09:08:23.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.187+0000 7f74f919c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f74f4160d40 0x7f74f40d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.188+0000 7f74f899b700 1 -- 172.21.15.116:0/3599753813 learned_addr learned my addr 172.21.15.116:0/3599753813 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:23.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.188+0000 7f74f3fff700 1 --1- 172.21.15.116:0/3599753813 >> v1:172.21.15.182:6789/0 conn(0x7f74f41601e0 0x7f74f4160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:55548/0 (socket says 172.21.15.116:55548) 2023-05-12T09:08:23.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.188+0000 7f74f899b700 1 -- 172.21.15.116:0/3599753813 >> v2:172.21.15.182:3300/0 conn(0x7f74f4160d40 msgr2=0x7f74f40d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:23.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.188+0000 7f74f899b700 1 --2- 172.21.15.116:0/3599753813 >> v2:172.21.15.182:3300/0 conn(0x7f74f4160d40 0x7f74f40d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.193 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.188+0000 7f74f899b700 1 -- 172.21.15.116:0/3599753813 >> v1:172.21.15.182:6789/0 conn(0x7f74f41601e0 legacy=0x7f74f4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.193 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.188+0000 7f74f899b700 1 -- 172.21.15.116:0/3599753813 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f40cd6a0 con 0x7f74f40b87a0 2023-05-12T09:08:23.193 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.188+0000 7f74f899b700 1 --2- 172.21.15.116:0/3599753813 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 0x7f74f40cfbf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098f0 tx=0x7f74e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f128801f6f7cbf server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:23.193 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74f37fe700 1 -- 172.21.15.116:0/3599753813 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011830 con 0x7f74f40b87a0 2023-05-12T09:08:23.193 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74f37fe700 1 -- 172.21.15.116:0/3599753813 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e8011990 con 0x7f74f40b87a0 2023-05-12T09:08:23.193 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74f37fe700 1 -- 172.21.15.116:0/3599753813 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011d20 con 0x7f74f40b87a0 2023-05-12T09:08:23.194 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74fabff700 1 -- 172.21.15.116:0/3599753813 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 msgr2=0x7f74f40cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.194 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74fabff700 1 --2- 172.21.15.116:0/3599753813 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 0x7f74f40cfbf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098f0 tx=0x7f74e8009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:23.195 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74fabff700 1 -- 172.21.15.116:0/3599753813 shutdown_connections 2023-05-12T09:08:23.195 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74fabff700 1 --2- 172.21.15.116:0/3599753813 >> v2:172.21.15.182:3300/0 conn(0x7f74f4160d40 0x7f74f40d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.195 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74fabff700 1 --2- 172.21.15.116:0/3599753813 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 0x7f74f40cfbf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.195 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74fabff700 1 -- 172.21.15.116:0/3599753813 >> 172.21.15.116:0/3599753813 conn(0x7f74f4071b10 msgr2=0x7f74f4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:23.195 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74fabff700 1 -- 172.21.15.116:0/3599753813 shutdown_connections 2023-05-12T09:08:23.196 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.189+0000 7f74fabff700 1 -- 172.21.15.116:0/3599753813 wait complete. 2023-05-12T09:08:23.196 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.191+0000 7f74fabff700 1 Processor -- start 2023-05-12T09:08:23.196 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.191+0000 7f74fabff700 1 -- start start 2023-05-12T09:08:23.197 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74fabff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 0x7f74f41e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.198 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74fabff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74f41601e0 0x7f74f41506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.198 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74fabff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f4160d40 0x7f74f4159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.198 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74fabff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f41e6740 con 0x7f74f4160d40 2023-05-12T09:08:23.198 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74fabff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f4151730 con 0x7f74f41601e0 2023-05-12T09:08:23.198 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74fabff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f415d8b0 con 0x7f74f40b87a0 2023-05-12T09:08:23.198 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74f919c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f4160d40 0x7f74f4159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.199 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74f919c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f4160d40 0x7f74f4159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39172/0 (socket says 172.21.15.116:39172) 2023-05-12T09:08:23.199 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74f919c700 1 -- 172.21.15.116:0/297665228 learned_addr learned my addr 172.21.15.116:0/297665228 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:23.199 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74f899b700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 0x7f74f41e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.199 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.192+0000 7f74f3fff700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74f41601e0 0x7f74f41506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.199 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74f919c700 1 -- 172.21.15.116:0/297665228 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 msgr2=0x7f74f41e6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.199 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74f919c700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 0x7f74f41e6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74f919c700 1 -- 172.21.15.116:0/297665228 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74f41601e0 msgr2=0x7f74f41506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74f919c700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74f41601e0 0x7f74f41506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74f919c700 1 -- 172.21.15.116:0/297665228 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e8009550 con 0x7f74f4160d40 2023-05-12T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74f919c700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f4160d40 0x7f74f4159a60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009d30 tx=0x7f74ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74f17fa700 1 -- 172.21.15.116:0/297665228 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00cc90 con 0x7f74f4160d40 2023-05-12T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74f17fa700 1 -- 172.21.15.116:0/297665228 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec00f040 con 0x7f74f4160d40 2023-05-12T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74fabff700 1 -- 172.21.15.116:0/297665228 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f40d1640 con 0x7f74f4160d40 2023-05-12T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74f17fa700 1 -- 172.21.15.116:0/297665228 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec009e80 con 0x7f74f4160d40 2023-05-12T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.193+0000 7f74fabff700 1 -- 172.21.15.116:0/297665228 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f40cd980 con 0x7f74f4160d40 2023-05-12T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.194+0000 7f74fabff700 1 -- 172.21.15.116:0/297665228 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f40d17d0 con 0x7f74f4160d40 2023-05-12T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.195+0000 7f74f17fa700 1 -- 172.21.15.116:0/297665228 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74ec014480 con 0x7f74f4160d40 2023-05-12T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.196+0000 7f74f17fa700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74d806ace0 0x7f74d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.196+0000 7f74f17fa700 1 -- 172.21.15.116:0/297665228 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f74ec089f60 con 0x7f74f4160d40 2023-05-12T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.196+0000 7f74f899b700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74d806ace0 0x7f74d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.197+0000 7f74f899b700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74d806ace0 0x7f74d806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009c40 tx=0x7f74e8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.200+0000 7f74f17fa700 1 -- 172.21.15.116:0/297665228 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f74ec054c40 con 0x7f74f4160d40 2023-05-12T09:08:23.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.409+0000 7f74fabff700 1 -- 172.21.15.116:0/297665228 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f74f415da20 con 0x7f74f4160d40 2023-05-12T09:08:23.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.410+0000 7f74f17fa700 1 -- 172.21.15.116:0/297665228 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f74ec018080 con 0x7f74f4160d40 2023-05-12T09:08:23.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 -- 172.21.15.116:0/297665228 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74d806ace0 msgr2=0x7f74d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74d806ace0 0x7f74d806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009c40 tx=0x7f74e8008030 comp rx=0 tx=0).stop 2023-05-12T09:08:23.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 -- 172.21.15.116:0/297665228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f4160d40 msgr2=0x7f74f4159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f4160d40 0x7f74f4159a60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009d30 tx=0x7f74ec00c3a0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 -- 172.21.15.116:0/297665228 shutdown_connections 2023-05-12T09:08:23.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f4160d40 0x7f74f4159a60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74d806ace0 0x7f74d806d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74f40b87a0 0x7f74f41e6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 --2- 172.21.15.116:0/297665228 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74f41601e0 0x7f74f41506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 -- 172.21.15.116:0/297665228 >> 172.21.15.116:0/297665228 conn(0x7f74f4071b10 msgr2=0x7f74f40b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:23.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 -- 172.21.15.116:0/297665228 shutdown_connections 2023-05-12T09:08:23.417 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.412+0000 7f74fabff700 1 -- 172.21.15.116:0/297665228 wait complete. 2023-05-12T09:08:23.417 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2023-05-12T09:08:23.432 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:08:23.432 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:23.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:23.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.697+0000 7f764e9ff700 1 Processor -- start 2023-05-12T09:08:23.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.697+0000 7f764e9ff700 1 -- start start 2023-05-12T09:08:23.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.698+0000 7f764e9ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f76480cd760 0x7f76480cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.698+0000 7f764e9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f764815cf10 0x7f764806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.698+0000 7f764e9ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76480cc9e0 con 0x7f76480adf70 2023-05-12T09:08:23.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.698+0000 7f764e9ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76480cd580 con 0x7f76480cd760 2023-05-12T09:08:23.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.698+0000 7f764e9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764815de20 con 0x7f764815cf10 2023-05-12T09:08:23.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f76477fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f76480adf70 0x7f76480cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36508/0 (socket says 172.21.15.116:36508) 2023-05-12T09:08:23.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f76477fe700 1 -- 172.21.15.116:0/2026174040 learned_addr learned my addr 172.21.15.116:0/2026174040 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:23.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f7647fff700 1 --2- 172.21.15.116:0/2026174040 >> v2:172.21.15.182:3300/0 conn(0x7f76480cd760 0x7f76480cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f764cf9c700 1 --2- 172.21.15.116:0/2026174040 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f764815cf10 0x7f764806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f7646ffd700 1 -- 172.21.15.116:0/2026174040 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066243731 0 0) 0x7f76480cc9e0 con 0x7f76480adf70 2023-05-12T09:08:23.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f7646ffd700 1 -- 172.21.15.116:0/2026174040 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76300035b0 con 0x7f76480adf70 2023-05-12T09:08:23.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f7646ffd700 1 -- 172.21.15.116:0/2026174040 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2637409147 0 0) 0x7f76300035b0 con 0x7f76480adf70 2023-05-12T09:08:23.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f764cf9c700 1 -- 172.21.15.116:0/2026174040 >> v2:172.21.15.182:3300/0 conn(0x7f76480cd760 msgr2=0x7f76480cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:23.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f764cf9c700 1 --2- 172.21.15.116:0/2026174040 >> v2:172.21.15.182:3300/0 conn(0x7f76480cd760 0x7f76480cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f764cf9c700 1 -- 172.21.15.116:0/2026174040 >> v1:172.21.15.116:6789/0 conn(0x7f76480adf70 legacy=0x7f76480cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f764cf9c700 1 -- 172.21.15.116:0/2026174040 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76480ce070 con 0x7f764815cf10 2023-05-12T09:08:23.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.699+0000 7f7647fff700 1 --2- 172.21.15.116:0/2026174040 >> v2:172.21.15.182:3300/0 conn(0x7f76480cd760 0x7f76480cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:23.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.700+0000 7f764cf9c700 1 --2- 172.21.15.116:0/2026174040 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f764815cf10 0x7f764806c6c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7640009d90 tx=0x7f764000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a8f472d5ee3fa9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:23.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.700+0000 7f7646ffd700 1 -- 172.21.15.116:0/2026174040 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764000e070 con 0x7f764815cf10 2023-05-12T09:08:23.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.700+0000 7f7646ffd700 1 -- 172.21.15.116:0/2026174040 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7640003a20 con 0x7f764815cf10 2023-05-12T09:08:23.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.700+0000 7f7646ffd700 1 -- 172.21.15.116:0/2026174040 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c005120 con 0x7f764815cf10 2023-05-12T09:08:23.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.701+0000 7f764e9ff700 1 -- 172.21.15.116:0/2026174040 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f764815cf10 msgr2=0x7f764806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.701+0000 7f764e9ff700 1 --2- 172.21.15.116:0/2026174040 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f764815cf10 0x7f764806c6c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7640009d90 tx=0x7f764000b330 comp rx=0 tx=0).stop 2023-05-12T09:08:23.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.701+0000 7f764e9ff700 1 -- 172.21.15.116:0/2026174040 shutdown_connections 2023-05-12T09:08:23.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.701+0000 7f764e9ff700 1 --2- 172.21.15.116:0/2026174040 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f764815cf10 0x7f764806c6c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.701+0000 7f764e9ff700 1 --2- 172.21.15.116:0/2026174040 >> v2:172.21.15.182:3300/0 conn(0x7f76480cd760 0x7f76480cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.701+0000 7f764e9ff700 1 -- 172.21.15.116:0/2026174040 >> 172.21.15.116:0/2026174040 conn(0x7f76480cf720 msgr2=0x7f76480cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:23.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.701+0000 7f764e9ff700 1 -- 172.21.15.116:0/2026174040 shutdown_connections 2023-05-12T09:08:23.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.701+0000 7f764e9ff700 1 -- 172.21.15.116:0/2026174040 wait complete. 2023-05-12T09:08:23.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.702+0000 7f764e9ff700 1 Processor -- start 2023-05-12T09:08:23.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.703+0000 7f764e9ff700 1 -- start start 2023-05-12T09:08:23.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.703+0000 7f764e9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76480adf70 0x7f76480c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f764e9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76480cd760 0x7f7648150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f764e9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f764815cf10 0x7f76480c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f764e9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76480b0e50 con 0x7f76480cd760 2023-05-12T09:08:23.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f764e9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76480b2350 con 0x7f764815cf10 2023-05-12T09:08:23.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f764e9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76480b2630 con 0x7f76480adf70 2023-05-12T09:08:23.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f76477fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76480cd760 0x7f7648150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f7647fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76480adf70 0x7f76480c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f76477fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76480cd760 0x7f7648150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39186/0 (socket says 172.21.15.116:39186) 2023-05-12T09:08:23.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f76477fe700 1 -- 172.21.15.116:0/3830638832 learned_addr learned my addr 172.21.15.116:0/3830638832 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:23.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f764cf9c700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f764815cf10 0x7f76480c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f76477fe700 1 -- 172.21.15.116:0/3830638832 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76480adf70 msgr2=0x7f76480c2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f76477fe700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76480adf70 0x7f76480c2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f76477fe700 1 -- 172.21.15.116:0/3830638832 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f764815cf10 msgr2=0x7f76480c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f76477fe700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f764815cf10 0x7f76480c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f76477fe700 1 -- 172.21.15.116:0/3830638832 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380094a0 con 0x7f76480cd760 2023-05-12T09:08:23.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.704+0000 7f76477fe700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76480cd760 0x7f7648150b00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c550 tx=0x7f763c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:23.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.705+0000 7f7644ff9700 1 -- 172.21.15.116:0/3830638832 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c007230 con 0x7f76480cd760 2023-05-12T09:08:23.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.705+0000 7f7644ff9700 1 -- 172.21.15.116:0/3830638832 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c0055f0 con 0x7f76480cd760 2023-05-12T09:08:23.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.705+0000 7f7644ff9700 1 -- 172.21.15.116:0/3830638832 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0059a0 con 0x7f76480cd760 2023-05-12T09:08:23.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.705+0000 7f764e9ff700 1 -- 172.21.15.116:0/3830638832 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7640009a70 con 0x7f76480cd760 2023-05-12T09:08:23.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.705+0000 7f764e9ff700 1 -- 172.21.15.116:0/3830638832 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764815db40 con 0x7f76480cd760 2023-05-12T09:08:23.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.706+0000 7f764e9ff700 1 -- 172.21.15.116:0/3830638832 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764815d860 con 0x7f76480cd760 2023-05-12T09:08:23.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.707+0000 7f7644ff9700 1 -- 172.21.15.116:0/3830638832 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f763c005b00 con 0x7f76480cd760 2023-05-12T09:08:23.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.708+0000 7f7644ff9700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f763406ace0 0x7f763406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:23.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.708+0000 7f7644ff9700 1 -- 172.21.15.116:0/3830638832 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f763c088d60 con 0x7f76480cd760 2023-05-12T09:08:23.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.708+0000 7f7647fff700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f763406ace0 0x7f763406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:23.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.709+0000 7f7647fff700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f763406ace0 0x7f763406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f76480c8500 tx=0x7f7638009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:23.715 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.712+0000 7f7644ff9700 1 -- 172.21.15.116:0/3830638832 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f763c053a40 con 0x7f76480cd760 2023-05-12T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.908+0000 7f764e9ff700 1 -- 172.21.15.116:0/3830638832 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76480cc670 con 0x7f76480cd760 2023-05-12T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.909+0000 7f7644ff9700 1 -- 172.21.15.116:0/3830638832 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7f763c017020 con 0x7f76480cd760 2023-05-12T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 -- 172.21.15.116:0/3830638832 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f763406ace0 msgr2=0x7f763406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f763406ace0 0x7f763406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f76480c8500 tx=0x7f7638009210 comp rx=0 tx=0).stop 2023-05-12T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 -- 172.21.15.116:0/3830638832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76480cd760 msgr2=0x7f7648150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76480cd760 0x7f7648150b00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c550 tx=0x7f763c00c860 comp rx=0 tx=0).stop 2023-05-12T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 -- 172.21.15.116:0/3830638832 shutdown_connections 2023-05-12T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f764815cf10 0x7f76480c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f763406ace0 0x7f763406d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76480adf70 0x7f76480c2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 --2- 172.21.15.116:0/3830638832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76480cd760 0x7f7648150b00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 -- 172.21.15.116:0/3830638832 >> 172.21.15.116:0/3830638832 conn(0x7f76480cf720 msgr2=0x7f764806a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 -- 172.21.15.116:0/3830638832 shutdown_connections 2023-05-12T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:23.911+0000 7f764e9ff700 1 -- 172.21.15.116:0/3830638832 wait complete. 2023-05-12T09:08:23.932 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:23.932 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:24.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.117+0000 7f0d671ff700 1 Processor -- start 2023-05-12T09:08:24.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.117+0000 7f0d671ff700 1 -- start start 2023-05-12T09:08:24.121 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.118+0000 7f0d671ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0d6015a440 0x7f0d6006b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.121 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.118+0000 7f0d671ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d600b3120 0x7f0d600b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.121 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.118+0000 7f0d671ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6006a3e0 con 0x7f0d600b1640 2023-05-12T09:08:24.121 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.118+0000 7f0d671ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600b2020 con 0x7f0d6015a440 2023-05-12T09:08:24.122 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.118+0000 7f0d671ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6006a6c0 con 0x7f0d600b3120 2023-05-12T09:08:24.122 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.119+0000 7f0d64f9b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0d6015a440 0x7f0d6006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.123 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.119+0000 7f0d6579c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d600b3120 0x7f0d600b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.123 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.119+0000 7f0d64f9b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0d6015a440 0x7f0d6006b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:35762/0 (socket says 172.21.15.116:35762) 2023-05-12T09:08:24.123 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.119+0000 7f0d64f9b700 1 -- 172.21.15.116:0/724601349 learned_addr learned my addr 172.21.15.116:0/724601349 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:24.123 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.119+0000 7f0d64f9b700 1 -- 172.21.15.116:0/724601349 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d600b3120 msgr2=0x7f0d600b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:24.123 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.119+0000 7f0d64f9b700 1 --2- 172.21.15.116:0/724601349 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d600b3120 0x7f0d600b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.123 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.119+0000 7f0d64f9b700 1 -- 172.21.15.116:0/724601349 >> v1:172.21.15.182:6789/0 conn(0x7f0d600b1640 legacy=0x7f0d600b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.123 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.119+0000 7f0d64f9b700 1 -- 172.21.15.116:0/724601349 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6006a9a0 con 0x7f0d6015a440 2023-05-12T09:08:24.124 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.120+0000 7f0d64f9b700 1 --2- 172.21.15.116:0/724601349 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d6015a440 0x7f0d6006b460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0d540098f0 tx=0x7f0d54009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3e25efc960e1451 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:24.125 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.120+0000 7f0d5f7fe700 1 -- 172.21.15.116:0/724601349 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54011830 con 0x7f0d6015a440 2023-05-12T09:08:24.125 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.120+0000 7f0d5f7fe700 1 -- 172.21.15.116:0/724601349 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d54011990 con 0x7f0d6015a440 2023-05-12T09:08:24.125 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.120+0000 7f0d5f7fe700 1 -- 172.21.15.116:0/724601349 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54011d20 con 0x7f0d6015a440 2023-05-12T09:08:24.125 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.121+0000 7f0d671ff700 1 -- 172.21.15.116:0/724601349 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d6015a440 msgr2=0x7f0d6006b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.125 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.121+0000 7f0d671ff700 1 --2- 172.21.15.116:0/724601349 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d6015a440 0x7f0d6006b460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0d540098f0 tx=0x7f0d54009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:24.125 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.121+0000 7f0d671ff700 1 -- 172.21.15.116:0/724601349 shutdown_connections 2023-05-12T09:08:24.125 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.121+0000 7f0d671ff700 1 --2- 172.21.15.116:0/724601349 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d600b3120 0x7f0d600b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.126 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.121+0000 7f0d671ff700 1 --2- 172.21.15.116:0/724601349 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d6015a440 0x7f0d6006b460 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.126 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.121+0000 7f0d671ff700 1 -- 172.21.15.116:0/724601349 >> 172.21.15.116:0/724601349 conn(0x7f0d6006e980 msgr2=0x7f0d600cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:24.126 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.121+0000 7f0d671ff700 1 -- 172.21.15.116:0/724601349 shutdown_connections 2023-05-12T09:08:24.126 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.121+0000 7f0d671ff700 1 -- 172.21.15.116:0/724601349 wait complete. 2023-05-12T09:08:24.127 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.123+0000 7f0d671ff700 1 Processor -- start 2023-05-12T09:08:24.128 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.123+0000 7f0d671ff700 1 -- start start 2023-05-12T09:08:24.128 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d671ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d600b1640 0x7f0d600c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.128 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d671ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d600b3120 0x7f0d6015bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.128 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d671ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d6015a440 0x7f0d600c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.128 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d671ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6014dd80 con 0x7f0d600b3120 2023-05-12T09:08:24.128 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d671ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600c69d0 con 0x7f0d600b1640 2023-05-12T09:08:24.129 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d671ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600c6720 con 0x7f0d6015a440 2023-05-12T09:08:24.129 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d5ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d600b3120 0x7f0d6015bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.129 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d5ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d600b3120 0x7f0d6015bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39200/0 (socket says 172.21.15.116:39200) 2023-05-12T09:08:24.129 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d5ffff700 1 -- 172.21.15.116:0/468253436 learned_addr learned my addr 172.21.15.116:0/468253436 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:24.129 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d64f9b700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d600b1640 0x7f0d600c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.129 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d6579c700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d6015a440 0x7f0d600c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.129 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d5ffff700 1 -- 172.21.15.116:0/468253436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d6015a440 msgr2=0x7f0d600c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.130 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d5ffff700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d6015a440 0x7f0d600c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.130 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d5ffff700 1 -- 172.21.15.116:0/468253436 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d600b1640 msgr2=0x7f0d600c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.130 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d5ffff700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d600b1640 0x7f0d600c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.130 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.124+0000 7f0d5ffff700 1 -- 172.21.15.116:0/468253436 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54009550 con 0x7f0d600b3120 2023-05-12T09:08:24.130 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.125+0000 7f0d5ffff700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d600b3120 0x7f0d6015bb70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c450 tx=0x7f0d4c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:24.131 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.125+0000 7f0d5d7fa700 1 -- 172.21.15.116:0/468253436 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0052d0 con 0x7f0d600b3120 2023-05-12T09:08:24.131 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.125+0000 7f0d5d7fa700 1 -- 172.21.15.116:0/468253436 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c005430 con 0x7f0d600b3120 2023-05-12T09:08:24.131 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.125+0000 7f0d5d7fa700 1 -- 172.21.15.116:0/468253436 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0038c0 con 0x7f0d600b3120 2023-05-12T09:08:24.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.125+0000 7f0d671ff700 1 -- 172.21.15.116:0/468253436 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6006af60 con 0x7f0d600b3120 2023-05-12T09:08:24.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.125+0000 7f0d671ff700 1 -- 172.21.15.116:0/468253436 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6006ac80 con 0x7f0d600b3120 2023-05-12T09:08:24.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.126+0000 7f0d671ff700 1 -- 172.21.15.116:0/468253436 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6015a810 con 0x7f0d600b3120 2023-05-12T09:08:24.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.127+0000 7f0d5d7fa700 1 -- 172.21.15.116:0/468253436 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d4c003a20 con 0x7f0d600b3120 2023-05-12T09:08:24.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.128+0000 7f0d5d7fa700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d4406ace0 0x7f0d4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.128+0000 7f0d5d7fa700 1 -- 172.21.15.116:0/468253436 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d4c088b70 con 0x7f0d600b3120 2023-05-12T09:08:24.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.128+0000 7f0d64f9b700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d4406ace0 0x7f0d4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.129+0000 7f0d64f9b700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d4406ace0 0x7f0d4406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009c40 tx=0x7f0d54008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:24.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.133+0000 7f0d5d7fa700 1 -- 172.21.15.116:0/468253436 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0d4c053850 con 0x7f0d600b3120 2023-05-12T09:08:24.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.324+0000 7f0d671ff700 1 -- 172.21.15.116:0/468253436 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d6015c580 con 0x7f0d600b3120 2023-05-12T09:08:24.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.325+0000 7f0d5d7fa700 1 -- 172.21.15.116:0/468253436 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0d4c00ce60 con 0x7f0d600b3120 2023-05-12T09:08:24.328 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:24.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 -- 172.21.15.116:0/468253436 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d4406ace0 msgr2=0x7f0d4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d4406ace0 0x7f0d4406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009c40 tx=0x7f0d54008030 comp rx=0 tx=0).stop 2023-05-12T09:08:24.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 -- 172.21.15.116:0/468253436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d600b3120 msgr2=0x7f0d6015bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d600b3120 0x7f0d6015bb70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c450 tx=0x7f0d4c00c760 comp rx=0 tx=0).stop 2023-05-12T09:08:24.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 -- 172.21.15.116:0/468253436 shutdown_connections 2023-05-12T09:08:24.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0d4406ace0 0x7f0d4406d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0d6015a440 0x7f0d600c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0d600b1640 0x7f0d600c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 --2- 172.21.15.116:0/468253436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d600b3120 0x7f0d6015bb70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 -- 172.21.15.116:0/468253436 >> 172.21.15.116:0/468253436 conn(0x7f0d6006e980 msgr2=0x7f0d60159410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:24.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 -- 172.21.15.116:0/468253436 shutdown_connections 2023-05-12T09:08:24.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.327+0000 7f0d671ff700 1 -- 172.21.15.116:0/468253436 wait complete. 2023-05-12T09:08:24.347 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:24.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.530+0000 7f5be7dff700 1 Processor -- start 2023-05-12T09:08:24.534 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.530+0000 7f5be7dff700 1 -- start start 2023-05-12T09:08:24.534 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.531+0000 7f5be7dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f5be00ca210 0x7f5be00b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be7dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5be00b1b80 0x7f5be006b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be7dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be006a5f0 con 0x7f5be00cd790 2023-05-12T09:08:24.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be7dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be00ca6b0 con 0x7f5be00b1b80 2023-05-12T09:08:24.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be7dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be006a840 con 0x7f5be00ca210 2023-05-12T09:08:24.536 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be5b9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f5be00cd790 0x7f5be00cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36514/0 (socket says 172.21.15.116:36514) 2023-05-12T09:08:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be639c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5be00b1b80 0x7f5be006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be5b9b700 1 -- 172.21.15.116:0/924842559 learned_addr learned my addr 172.21.15.116:0/924842559 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be539a700 1 --2- 172.21.15.116:0/924842559 >> v2:172.21.15.182:3300/0 conn(0x7f5be00ca210 0x7f5be00b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be639c700 1 -- 172.21.15.116:0/924842559 >> v2:172.21.15.182:3300/0 conn(0x7f5be00ca210 msgr2=0x7f5be00b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be639c700 1 --2- 172.21.15.116:0/924842559 >> v2:172.21.15.182:3300/0 conn(0x7f5be00ca210 0x7f5be00b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be639c700 1 -- 172.21.15.116:0/924842559 >> v1:172.21.15.116:6789/0 conn(0x7f5be00cd790 legacy=0x7f5be00cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be639c700 1 -- 172.21.15.116:0/924842559 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be006ab20 con 0x7f5be00b1b80 2023-05-12T09:08:24.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.532+0000 7f5be4b99700 1 -- 172.21.15.116:0/924842559 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447365446 0 0) 0x7f5be006a5f0 con 0x7f5be00cd790 2023-05-12T09:08:24.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.533+0000 7f5be639c700 1 --2- 172.21.15.116:0/924842559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00b1b80 0x7f5be006b600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009d90 tx=0x7f5bd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8460bd07c4edc29 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:24.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.533+0000 7f5be4b99700 1 -- 172.21.15.116:0/924842559 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800e070 con 0x7f5be00b1b80 2023-05-12T09:08:24.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.533+0000 7f5be4b99700 1 -- 172.21.15.116:0/924842559 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800bae0 con 0x7f5be00b1b80 2023-05-12T09:08:24.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.533+0000 7f5be4b99700 1 -- 172.21.15.116:0/924842559 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800be90 con 0x7f5be00b1b80 2023-05-12T09:08:24.538 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.533+0000 7f5be7dff700 1 -- 172.21.15.116:0/924842559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00b1b80 msgr2=0x7f5be006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.533+0000 7f5be7dff700 1 --2- 172.21.15.116:0/924842559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00b1b80 0x7f5be006b600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009d90 tx=0x7f5bd800b330 comp rx=0 tx=0).stop 2023-05-12T09:08:24.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.533+0000 7f5be7dff700 1 -- 172.21.15.116:0/924842559 shutdown_connections 2023-05-12T09:08:24.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.533+0000 7f5be7dff700 1 --2- 172.21.15.116:0/924842559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00b1b80 0x7f5be006b600 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.533+0000 7f5be7dff700 1 --2- 172.21.15.116:0/924842559 >> v2:172.21.15.182:3300/0 conn(0x7f5be00ca210 0x7f5be00b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.533+0000 7f5be7dff700 1 -- 172.21.15.116:0/924842559 >> 172.21.15.116:0/924842559 conn(0x7f5be006e980 msgr2=0x7f5be00cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:24.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.534+0000 7f5be7dff700 1 -- 172.21.15.116:0/924842559 shutdown_connections 2023-05-12T09:08:24.539 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.534+0000 7f5be7dff700 1 -- 172.21.15.116:0/924842559 wait complete. 2023-05-12T09:08:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.535+0000 7f5be7dff700 1 Processor -- start 2023-05-12T09:08:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.535+0000 7f5be7dff700 1 -- start start 2023-05-12T09:08:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.536+0000 7f5be7dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5be00b1b80 0x7f5be0154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.536+0000 7f5be7dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5be00ca210 0x7f5be00af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.536+0000 7f5be7dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00cd790 0x7f5be00afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.536+0000 7f5be7dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00b1840 con 0x7f5be00cd790 2023-05-12T09:08:24.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.536+0000 7f5be7dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0154990 con 0x7f5be00b1b80 2023-05-12T09:08:24.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.536+0000 7f5be7dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00c6c90 con 0x7f5be00ca210 2023-05-12T09:08:24.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be639c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00cd790 0x7f5be00afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be539a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5be00ca210 0x7f5be00af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be5b9b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5be00b1b80 0x7f5be0154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.542 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be639c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00cd790 0x7f5be00afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39226/0 (socket says 172.21.15.116:39226) 2023-05-12T09:08:24.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be639c700 1 -- 172.21.15.116:0/2564953435 learned_addr learned my addr 172.21.15.116:0/2564953435 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:24.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be539a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5be00ca210 0x7f5be00af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:44858/0 (socket says 172.21.15.116:44858) 2023-05-12T09:08:24.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be639c700 1 -- 172.21.15.116:0/2564953435 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5be00ca210 msgr2=0x7f5be00af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be639c700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5be00ca210 0x7f5be00af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be639c700 1 -- 172.21.15.116:0/2564953435 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5be00b1b80 msgr2=0x7f5be0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be639c700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5be00b1b80 0x7f5be0154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.543 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be639c700 1 -- 172.21.15.116:0/2564953435 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8009a70 con 0x7f5be00cd790 2023-05-12T09:08:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.537+0000 7f5be639c700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00cd790 0x7f5be00afb60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8014040 tx=0x7f5bd8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.538+0000 7f5bd67fc700 1 -- 172.21.15.116:0/2564953435 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8004550 con 0x7f5be00cd790 2023-05-12T09:08:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.538+0000 7f5bd67fc700 1 -- 172.21.15.116:0/2564953435 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8020070 con 0x7f5be00cd790 2023-05-12T09:08:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.538+0000 7f5be7dff700 1 -- 172.21.15.116:0/2564953435 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be006b0e0 con 0x7f5be00cd790 2023-05-12T09:08:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.538+0000 7f5bd67fc700 1 -- 172.21.15.116:0/2564953435 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80048d0 con 0x7f5be00cd790 2023-05-12T09:08:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.538+0000 7f5be7dff700 1 -- 172.21.15.116:0/2564953435 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be006ae00 con 0x7f5be00cd790 2023-05-12T09:08:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.539+0000 7f5be7dff700 1 -- 172.21.15.116:0/2564953435 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be00b2000 con 0x7f5be00cd790 2023-05-12T09:08:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.540+0000 7f5bd67fc700 1 -- 172.21.15.116:0/2564953435 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5bd8027480 con 0x7f5be00cd790 2023-05-12T09:08:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.541+0000 7f5bd67fc700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bc406ace0 0x7f5bc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.541+0000 7f5bd67fc700 1 -- 172.21.15.116:0/2564953435 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5bd8022070 con 0x7f5be00cd790 2023-05-12T09:08:24.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.541+0000 7f5be5b9b700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bc406ace0 0x7f5bc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.542+0000 7f5be5b9b700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bc406ace0 0x7f5bc406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007fd0 tx=0x7f5bdc007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:24.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.546+0000 7f5bd67fc700 1 -- 172.21.15.116:0/2564953435 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5bd805a3f0 con 0x7f5be00cd790 2023-05-12T09:08:24.745 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.742+0000 7f5be7dff700 1 -- 172.21.15.116:0/2564953435 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5be006c510 con 0x7f5be00cd790 2023-05-12T09:08:24.745 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.742+0000 7f5bd67fc700 1 -- 172.21.15.116:0/2564953435 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bd8059f80 con 0x7f5be00cd790 2023-05-12T09:08:24.746 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:24.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 -- 172.21.15.116:0/2564953435 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bc406ace0 msgr2=0x7f5bc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bc406ace0 0x7f5bc406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007fd0 tx=0x7f5bdc007de0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 -- 172.21.15.116:0/2564953435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00cd790 msgr2=0x7f5be00afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00cd790 0x7f5be00afb60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8014040 tx=0x7f5bd8004ad0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 -- 172.21.15.116:0/2564953435 shutdown_connections 2023-05-12T09:08:24.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5be00cd790 0x7f5be00afb60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5be00b1b80 0x7f5be0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5bc406ace0 0x7f5bc406d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 --2- 172.21.15.116:0/2564953435 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5be00ca210 0x7f5be00af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 -- 172.21.15.116:0/2564953435 >> 172.21.15.116:0/2564953435 conn(0x7f5be006e980 msgr2=0x7f5be00cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 -- 172.21.15.116:0/2564953435 shutdown_connections 2023-05-12T09:08:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.745+0000 7f5be7dff700 1 -- 172.21.15.116:0/2564953435 wait complete. 2023-05-12T09:08:24.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:24.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.951+0000 7fbe851ff700 1 Processor -- start 2023-05-12T09:08:24.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.951+0000 7fbe851ff700 1 -- start start 2023-05-12T09:08:24.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.952+0000 7fbe851ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe800b87a0 0x7fbe800cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.952+0000 7fbe851ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe800cdc60 con 0x7fbe801601e0 2023-05-12T09:08:24.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.952+0000 7fbe851ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe800cd6a0 con 0x7fbe80160d40 2023-05-12T09:08:24.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.952+0000 7fbe851ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe800d02d0 con 0x7fbe800b87a0 2023-05-12T09:08:24.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7e59c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fbe801601e0 0x7fbe80160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36520/0 (socket says 172.21.15.116:36520) 2023-05-12T09:08:24.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7e59c700 1 -- 172.21.15.116:0/2908854959 learned_addr learned my addr 172.21.15.116:0/2908854959 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:24.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7ed9d700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe800b87a0 0x7fbe800cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409953821 0 0) 0x7fbe800cdc60 con 0x7fbe801601e0 2023-05-12T09:08:24.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe680035b0 con 0x7fbe801601e0 2023-05-12T09:08:24.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2349327603 0 0) 0x7fbe680035b0 con 0x7fbe801601e0 2023-05-12T09:08:24.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe800b87a0 msgr2=0x7fbe800cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:24.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe800b87a0 0x7fbe800cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 >> v1:172.21.15.182:6789/0 conn(0x7fbe80160d40 legacy=0x7fbe800d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe800cd980 con 0x7fbe801601e0 2023-05-12T09:08:24.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7fbe74001670 con 0x7fbe801601e0 2023-05-12T09:08:24.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7ed9d700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe800b87a0 0x7fbe800cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:24.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 >> v1:172.21.15.116:6789/0 conn(0x7fbe801601e0 legacy=0x7fbe80160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe68003a30 0x7fbe68003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe68004850 0x7fbe68004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe800b87a0 0x7fbe68005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe800d02d0 con 0x7fbe68004850 2023-05-12T09:08:24.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6800bac0 con 0x7fbe68003a30 2023-05-12T09:08:24.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.953+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6800bc30 con 0x7fbe800b87a0 2023-05-12T09:08:24.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7e59c700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe68004850 0x7fbe68004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7ed9d700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe68003a30 0x7fbe68003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7f59e700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe800b87a0 0x7fbe68005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7e59c700 1 -- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe800b87a0 msgr2=0x7fbe68005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:24.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7e59c700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe800b87a0 0x7fbe68005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7e59c700 1 -- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe68003a30 msgr2=0x7fbe68003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:24.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7e59c700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe68003a30 0x7fbe68003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7e59c700 1 -- 172.21.15.116:0/2908854959 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe700094a0 con 0x7fbe68004850 2023-05-12T09:08:24.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7e59c700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe68004850 0x7fbe68004cc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400c240 tx=0x7fbe68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3180912519a7fde server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:24.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74007c10 con 0x7fbe68004850 2023-05-12T09:08:24.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7400ce00 con 0x7fbe68004850 2023-05-12T09:08:24.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.954+0000 7fbe7dd9b700 1 -- 172.21.15.116:0/2908854959 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74005ba0 con 0x7fbe68004850 2023-05-12T09:08:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.955+0000 7fbe851ff700 1 -- 172.21.15.116:0/2908854959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe68004850 msgr2=0x7fbe68004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.955+0000 7fbe851ff700 1 --2- 172.21.15.116:0/2908854959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe68004850 0x7fbe68004cc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400c240 tx=0x7fbe68005880 comp rx=0 tx=0).stop 2023-05-12T09:08:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.955+0000 7fbe7f59e700 1 -- 172.21.15.116:0/2908854959 reap_dead start 2023-05-12T09:08:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.955+0000 7fbe851ff700 1 -- 172.21.15.116:0/2908854959 shutdown_connections 2023-05-12T09:08:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.955+0000 7fbe851ff700 1 -- 172.21.15.116:0/2908854959 >> 172.21.15.116:0/2908854959 conn(0x7fbe80071b10 msgr2=0x7fbe80071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.955+0000 7fbe851ff700 1 -- 172.21.15.116:0/2908854959 shutdown_connections 2023-05-12T09:08:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.955+0000 7fbe851ff700 1 -- 172.21.15.116:0/2908854959 wait complete. 2023-05-12T09:08:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.957+0000 7fbe851ff700 1 Processor -- start 2023-05-12T09:08:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.957+0000 7fbe851ff700 1 -- start start 2023-05-12T09:08:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.958+0000 7fbe851ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe68004850 0x7fbe80149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.958+0000 7fbe851ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe8014a460 0x7fbe8015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.958+0000 7fbe851ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe800d2780 0x7fbe800d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.958+0000 7fbe851ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe800d3140 con 0x7fbe8014a460 2023-05-12T09:08:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.958+0000 7fbe851ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8015d610 con 0x7fbe800d2780 2023-05-12T09:08:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.958+0000 7fbe851ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8015d8f0 con 0x7fbe68004850 2023-05-12T09:08:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.958+0000 7fbe7e59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe8014a460 0x7fbe8015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe7e59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe8014a460 0x7fbe8015cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39250/0 (socket says 172.21.15.116:39250) 2023-05-12T09:08:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe7e59c700 1 -- 172.21.15.116:0/1457452388 learned_addr learned my addr 172.21.15.116:0/1457452388 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe7ed9d700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe68004850 0x7fbe80149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe7f59e700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe800d2780 0x7fbe800d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe7e59c700 1 -- 172.21.15.116:0/1457452388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe68004850 msgr2=0x7fbe80149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe7e59c700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe68004850 0x7fbe80149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe7e59c700 1 -- 172.21.15.116:0/1457452388 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe800d2780 msgr2=0x7fbe800d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:24.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe7e59c700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe800d2780 0x7fbe800d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:24.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe7e59c700 1 -- 172.21.15.116:0/1457452388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe800cfd80 con 0x7fbe8014a460 2023-05-12T09:08:24.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe7e59c700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe8014a460 0x7fbe8015cca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe68004760 tx=0x7fbe74001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:24.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe677fe700 1 -- 172.21.15.116:0/1457452388 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74001630 con 0x7fbe8014a460 2023-05-12T09:08:24.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe677fe700 1 -- 172.21.15.116:0/1457452388 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe740070d0 con 0x7fbe8014a460 2023-05-12T09:08:24.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.959+0000 7fbe677fe700 1 -- 172.21.15.116:0/1457452388 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740074a0 con 0x7fbe8014a460 2023-05-12T09:08:24.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.960+0000 7fbe851ff700 1 -- 172.21.15.116:0/1457452388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe800cfbf0 con 0x7fbe8014a460 2023-05-12T09:08:24.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.960+0000 7fbe851ff700 1 -- 172.21.15.116:0/1457452388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe800cff10 con 0x7fbe8014a460 2023-05-12T09:08:24.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.961+0000 7fbe851ff700 1 -- 172.21.15.116:0/1457452388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe800b52f0 con 0x7fbe8014a460 2023-05-12T09:08:24.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.962+0000 7fbe677fe700 1 -- 172.21.15.116:0/1457452388 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe74019030 con 0x7fbe8014a460 2023-05-12T09:08:24.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.963+0000 7fbe677fe700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe6c06ace0 0x7fbe6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:24.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.963+0000 7fbe677fe700 1 -- 172.21.15.116:0/1457452388 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbe7408a1d0 con 0x7fbe8014a460 2023-05-12T09:08:24.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.963+0000 7fbe7ed9d700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe6c06ace0 0x7fbe6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:24.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.964+0000 7fbe7ed9d700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe6c06ace0 0x7fbe6c06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009de0 tx=0x7fbe70009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:24.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:24.967+0000 7fbe677fe700 1 -- 172.21.15.116:0/1457452388 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbe74054ff0 con 0x7fbe8014a460 2023-05-12T09:08:25.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.161+0000 7fbe851ff700 1 -- 172.21.15.116:0/1457452388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe800b21e0 con 0x7fbe8014a460 2023-05-12T09:08:25.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.161+0000 7fbe677fe700 1 -- 172.21.15.116:0/1457452388 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe74058610 con 0x7fbe8014a460 2023-05-12T09:08:25.165 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:25.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.163+0000 7fbe851ff700 1 -- 172.21.15.116:0/1457452388 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe6c06ace0 msgr2=0x7fbe6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.163+0000 7fbe851ff700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe6c06ace0 0x7fbe6c06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009de0 tx=0x7fbe70009210 comp rx=0 tx=0).stop 2023-05-12T09:08:25.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.163+0000 7fbe851ff700 1 -- 172.21.15.116:0/1457452388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe8014a460 msgr2=0x7fbe8015cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.163+0000 7fbe851ff700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe8014a460 0x7fbe8015cca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe68004760 tx=0x7fbe74001a00 comp rx=0 tx=0).stop 2023-05-12T09:08:25.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.164+0000 7fbe851ff700 1 -- 172.21.15.116:0/1457452388 shutdown_connections 2023-05-12T09:08:25.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.164+0000 7fbe851ff700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbe800d2780 0x7fbe800d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.164+0000 7fbe851ff700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbe6c06ace0 0x7fbe6c06d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.164+0000 7fbe851ff700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbe68004850 0x7fbe80149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.164+0000 7fbe851ff700 1 --2- 172.21.15.116:0/1457452388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe8014a460 0x7fbe8015cca0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.164+0000 7fbe851ff700 1 -- 172.21.15.116:0/1457452388 >> 172.21.15.116:0/1457452388 conn(0x7fbe80071b10 msgr2=0x7fbe800b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:25.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.164+0000 7fbe851ff700 1 -- 172.21.15.116:0/1457452388 shutdown_connections 2023-05-12T09:08:25.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.164+0000 7fbe851ff700 1 -- 172.21.15.116:0/1457452388 wait complete. 2023-05-12T09:08:25.184 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:25.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.373+0000 7f4ecd7ff700 1 Processor -- start 2023-05-12T09:08:25.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.373+0000 7f4ecd7ff700 1 -- start start 2023-05-12T09:08:25.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ecd7ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4ec80b87a0 0x7f4ec80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ecd7ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f4ec8160d40 0x7f4ec80d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ecd7ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec80cdc60 con 0x7f4ec81601e0 2023-05-12T09:08:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ecd7ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec80d02d0 con 0x7f4ec80b87a0 2023-05-12T09:08:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ecd7ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec80d0cb0 con 0x7f4ec8160d40 2023-05-12T09:08:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ec6ffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4ec80b87a0 0x7f4ec80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ec6ffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4ec80b87a0 0x7f4ec80cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39258/0 (socket says 172.21.15.116:39258) 2023-05-12T09:08:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ec6ffd700 1 -- 172.21.15.116:0/2717365358 learned_addr learned my addr 172.21.15.116:0/2717365358 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ec77fe700 1 --2- 172.21.15.116:0/2717365358 >> v2:172.21.15.182:3300/0 conn(0x7f4ec8160d40 0x7f4ec80d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ec6ffd700 1 -- 172.21.15.116:0/2717365358 >> v2:172.21.15.182:3300/0 conn(0x7f4ec8160d40 msgr2=0x7f4ec80d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ec6ffd700 1 --2- 172.21.15.116:0/2717365358 >> v2:172.21.15.182:3300/0 conn(0x7f4ec8160d40 0x7f4ec80d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ec6ffd700 1 -- 172.21.15.116:0/2717365358 >> v1:172.21.15.182:6789/0 conn(0x7f4ec81601e0 legacy=0x7f4ec8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.375+0000 7f4ec6ffd700 1 -- 172.21.15.116:0/2717365358 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80cd6a0 con 0x7f4ec80b87a0 2023-05-12T09:08:25.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.376+0000 7f4ec6ffd700 1 --2- 172.21.15.116:0/2717365358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 0x7f4ec80cfbf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80d0820 tx=0x7f4eb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d48c585141d7d51 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:25.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.376+0000 7f4ec67fc700 1 -- 172.21.15.116:0/2717365358 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8011830 con 0x7f4ec80b87a0 2023-05-12T09:08:25.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.376+0000 7f4ec67fc700 1 -- 172.21.15.116:0/2717365358 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb8011990 con 0x7f4ec80b87a0 2023-05-12T09:08:25.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.376+0000 7f4ec67fc700 1 -- 172.21.15.116:0/2717365358 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8011d20 con 0x7f4ec80b87a0 2023-05-12T09:08:25.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.376+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/2717365358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 msgr2=0x7f4ec80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.376+0000 7f4ecd7ff700 1 --2- 172.21.15.116:0/2717365358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 0x7f4ec80cfbf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80d0820 tx=0x7f4eb8009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:25.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.377+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/2717365358 shutdown_connections 2023-05-12T09:08:25.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.377+0000 7f4ecd7ff700 1 --2- 172.21.15.116:0/2717365358 >> v2:172.21.15.182:3300/0 conn(0x7f4ec8160d40 0x7f4ec80d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.377+0000 7f4ecd7ff700 1 --2- 172.21.15.116:0/2717365358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 0x7f4ec80cfbf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.377+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/2717365358 >> 172.21.15.116:0/2717365358 conn(0x7f4ec8071b10 msgr2=0x7f4ec8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:25.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.377+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/2717365358 shutdown_connections 2023-05-12T09:08:25.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.377+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/2717365358 wait complete. 2023-05-12T09:08:25.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.378+0000 7f4ecd7ff700 1 Processor -- start 2023-05-12T09:08:25.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.378+0000 7f4ecd7ff700 1 -- start start 2023-05-12T09:08:25.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.379+0000 7f4ecd7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 0x7f4ec8151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.379+0000 7f4ecd7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4ec81601e0 0x7f4ec80c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.379+0000 7f4ecd7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4ec8160d40 0x7f4ec80d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.379+0000 7f4ecd7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81517c0 con 0x7f4ec80b87a0 2023-05-12T09:08:25.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.379+0000 7f4ecd7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80c8670 con 0x7f4ec8160d40 2023-05-12T09:08:25.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.379+0000 7f4ecd7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80c8950 con 0x7f4ec81601e0 2023-05-12T09:08:25.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec6ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 0x7f4ec8151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec6ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 0x7f4ec8151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39274/0 (socket says 172.21.15.116:39274) 2023-05-12T09:08:25.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec6ffd700 1 -- 172.21.15.116:0/3770241979 learned_addr learned my addr 172.21.15.116:0/3770241979 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:25.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec6ffd700 1 -- 172.21.15.116:0/3770241979 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4ec81601e0 msgr2=0x7f4ec80c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec77fe700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4ec8160d40 0x7f4ec80d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ebffff700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4ec81601e0 0x7f4ec80c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec6ffd700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4ec81601e0 0x7f4ec80c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec6ffd700 1 -- 172.21.15.116:0/3770241979 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4ec8160d40 msgr2=0x7f4ec80d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec6ffd700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4ec8160d40 0x7f4ec80d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec6ffd700 1 -- 172.21.15.116:0/3770241979 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb8009550 con 0x7f4ec80b87a0 2023-05-12T09:08:25.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec77fe700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4ec8160d40 0x7f4ec80d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:25.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ebffff700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4ec81601e0 0x7f4ec80c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:25.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ec6ffd700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 0x7f4ec8151280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009c40 tx=0x7f4eb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:25.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.380+0000 7f4ebf7fe700 1 -- 172.21.15.116:0/3770241979 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8004480 con 0x7f4ec80b87a0 2023-05-12T09:08:25.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.381+0000 7f4ebf7fe700 1 -- 172.21.15.116:0/3770241979 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb801f070 con 0x7f4ec80b87a0 2023-05-12T09:08:25.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.381+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/3770241979 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec80d1640 con 0x7f4ec80b87a0 2023-05-12T09:08:25.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.381+0000 7f4ebf7fe700 1 -- 172.21.15.116:0/3770241979 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80038a0 con 0x7f4ec80b87a0 2023-05-12T09:08:25.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.381+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/3770241979 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec80cd980 con 0x7f4ec80b87a0 2023-05-12T09:08:25.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.382+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/3770241979 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec80d17d0 con 0x7f4ec80b87a0 2023-05-12T09:08:25.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.383+0000 7f4ebf7fe700 1 -- 172.21.15.116:0/3770241979 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4eb8021030 con 0x7f4ec80b87a0 2023-05-12T09:08:25.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.383+0000 7f4ebf7fe700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4ea806ace0 0x7f4ea806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.383+0000 7f4ebf7fe700 1 -- 172.21.15.116:0/3770241979 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4eb808aca0 con 0x7f4ec80b87a0 2023-05-12T09:08:25.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.384+0000 7f4ebffff700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4ea806ace0 0x7f4ea806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.384+0000 7f4ebffff700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4ea806ace0 0x7f4ea806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0000f60 tx=0x7f4eb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:25.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.388+0000 7f4ebf7fe700 1 -- 172.21.15.116:0/3770241979 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4eb8055a10 con 0x7f4ec80b87a0 2023-05-12T09:08:25.585 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.582+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/3770241979 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ec8074430 con 0x7f4ec80b87a0 2023-05-12T09:08:25.586 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.583+0000 7f4ebf7fe700 1 -- 172.21.15.116:0/3770241979 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4eb8059030 con 0x7f4ec80b87a0 2023-05-12T09:08:25.586 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:25.589 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/3770241979 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4ea806ace0 msgr2=0x7f4ea806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.589 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4ea806ace0 0x7f4ea806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0000f60 tx=0x7f4eb0009040 comp rx=0 tx=0).stop 2023-05-12T09:08:25.589 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/3770241979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 msgr2=0x7f4ec8151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.589 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 0x7f4ec8151280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009c40 tx=0x7f4eb8004750 comp rx=0 tx=0).stop 2023-05-12T09:08:25.589 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/3770241979 shutdown_connections 2023-05-12T09:08:25.590 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4ec8160d40 0x7f4ec80d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.590 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ec80b87a0 0x7f4ec8151280 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.590 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4ea806ace0 0x7f4ea806d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.590 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 --2- 172.21.15.116:0/3770241979 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f4ec81601e0 0x7f4ec80c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.590 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/3770241979 >> 172.21.15.116:0/3770241979 conn(0x7f4ec8071b10 msgr2=0x7f4ec8071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:25.590 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/3770241979 shutdown_connections 2023-05-12T09:08:25.590 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.585+0000 7f4ecd7ff700 1 -- 172.21.15.116:0/3770241979 wait complete. 2023-05-12T09:08:25.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:25.796 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.793+0000 7f75e93ff700 1 Processor -- start 2023-05-12T09:08:25.797 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.793+0000 7f75e93ff700 1 -- start start 2023-05-12T09:08:25.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.794+0000 7f75e93ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f75e40b87a0 0x7f75e40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.794+0000 7f75e93ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e40cdc60 con 0x7f75e4160d40 2023-05-12T09:08:25.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.794+0000 7f75e93ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e40cd6a0 con 0x7f75e41601e0 2023-05-12T09:08:25.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.794+0000 7f75e93ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e40d02d0 con 0x7f75e40b87a0 2023-05-12T09:08:25.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e37fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f75e4160d40 0x7f75e40d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36526/0 (socket says 172.21.15.116:36526) 2023-05-12T09:08:25.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e37fe700 1 -- 172.21.15.116:0/187122490 learned_addr learned my addr 172.21.15.116:0/187122490 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:25.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e2ffd700 1 --2- 172.21.15.116:0/187122490 >> v2:172.21.15.182:3300/0 conn(0x7f75e40b87a0 0x7f75e40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788916195 0 0) 0x7f75e40cdc60 con 0x7f75e4160d40 2023-05-12T09:08:25.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d00035b0 con 0x7f75e4160d40 2023-05-12T09:08:25.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311720004 0 0) 0x7f75e40cd6a0 con 0x7f75e41601e0 2023-05-12T09:08:25.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e40cdc60 con 0x7f75e41601e0 2023-05-12T09:08:25.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1181883501 0 0) 0x7f75d00035b0 con 0x7f75e4160d40 2023-05-12T09:08:25.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 >> v2:172.21.15.182:3300/0 conn(0x7f75e40b87a0 msgr2=0x7f75e40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:25.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 --2- 172.21.15.116:0/187122490 >> v2:172.21.15.182:3300/0 conn(0x7f75e40b87a0 0x7f75e40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 >> v1:172.21.15.182:6789/0 conn(0x7f75e41601e0 legacy=0x7f75e4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e40cd980 con 0x7f75e4160d40 2023-05-12T09:08:25.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f75dc001670 con 0x7f75e4160d40 2023-05-12T09:08:25.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 >> v1:172.21.15.116:6789/0 conn(0x7f75e4160d40 legacy=0x7f75e40d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75d0003b90 0x7f75d0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.795+0000 7f75e27fc700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75d0004850 0x7f75d0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e27fc700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75d0005200 0x7f75d000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e40d02d0 con 0x7f75d0005200 2023-05-12T09:08:25.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d000c060 con 0x7f75d0004850 2023-05-12T09:08:25.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d000c220 con 0x7f75d0003b90 2023-05-12T09:08:25.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e37fe700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75d0005200 0x7f75d000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75da7fc700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75d0004850 0x7f75d0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e2ffd700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75d0003b90 0x7f75d0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e37fe700 1 -- 172.21.15.116:0/187122490 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75d0003b90 msgr2=0x7f75d0003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:25.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e37fe700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75d0003b90 0x7f75d0003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e37fe700 1 -- 172.21.15.116:0/187122490 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75d0004850 msgr2=0x7f75d0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:25.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e37fe700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75d0004850 0x7f75d0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e37fe700 1 -- 172.21.15.116:0/187122490 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d00035b0 con 0x7f75d0005200 2023-05-12T09:08:25.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e37fe700 1 -- 172.21.15.116:0/187122490 reap_dead start 2023-05-12T09:08:25.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.796+0000 7f75e37fe700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75d0005200 0x7f75d000ba10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00c210 tx=0x7f75d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a046f1a2a22ab211 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:25.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.797+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00cd50 con 0x7f75d0005200 2023-05-12T09:08:25.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.797+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc005960 con 0x7f75d0005200 2023-05-12T09:08:25.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.797+0000 7f75e27fc700 1 -- 172.21.15.116:0/187122490 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc005d10 con 0x7f75d0005200 2023-05-12T09:08:25.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.797+0000 7f75e93ff700 1 -- 172.21.15.116:0/187122490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75d0005200 msgr2=0x7f75d000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.797+0000 7f75e93ff700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75d0005200 0x7f75d000ba10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00c210 tx=0x7f75d0005880 comp rx=0 tx=0).stop 2023-05-12T09:08:25.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.797+0000 7f75e93ff700 1 -- 172.21.15.116:0/187122490 shutdown_connections 2023-05-12T09:08:25.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.797+0000 7f75e93ff700 1 --2- 172.21.15.116:0/187122490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75d0005200 0x7f75d000ba10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.797+0000 7f75e93ff700 1 -- 172.21.15.116:0/187122490 >> 172.21.15.116:0/187122490 conn(0x7f75e4071b10 msgr2=0x7f75e4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:25.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.797+0000 7f75e93ff700 1 -- 172.21.15.116:0/187122490 shutdown_connections 2023-05-12T09:08:25.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.797+0000 7f75e93ff700 1 -- 172.21.15.116:0/187122490 wait complete. 2023-05-12T09:08:25.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.799+0000 7f75e93ff700 1 Processor -- start 2023-05-12T09:08:25.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.799+0000 7f75e93ff700 1 -- start start 2023-05-12T09:08:25.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.800+0000 7f75e93ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75d0005200 0x7f75e41513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.800+0000 7f75e93ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75e40c8bc0 0x7f75e40c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.800+0000 7f75e93ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75e40c69e0 0x7f75e40c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.800+0000 7f75e93ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e40c7fb0 con 0x7f75e40c69e0 2023-05-12T09:08:25.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.800+0000 7f75e93ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e4152cb0 con 0x7f75d0005200 2023-05-12T09:08:25.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.800+0000 7f75e93ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e40c9570 con 0x7f75e40c8bc0 2023-05-12T09:08:25.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.800+0000 7f75e37fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75e40c69e0 0x7f75e40c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.800+0000 7f75e37fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75e40c69e0 0x7f75e40c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39298/0 (socket says 172.21.15.116:39298) 2023-05-12T09:08:25.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.800+0000 7f75e37fe700 1 -- 172.21.15.116:0/1697228620 learned_addr learned my addr 172.21.15.116:0/1697228620 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:25.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75da7fc700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75e40c8bc0 0x7f75e40c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75e37fe700 1 -- 172.21.15.116:0/1697228620 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75e40c8bc0 msgr2=0x7f75e40c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75e2ffd700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75d0005200 0x7f75e41513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75e37fe700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75e40c8bc0 0x7f75e40c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75e37fe700 1 -- 172.21.15.116:0/1697228620 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75d0005200 msgr2=0x7f75e41513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:25.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75e37fe700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75d0005200 0x7f75e41513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:25.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75e37fe700 1 -- 172.21.15.116:0/1697228620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e40cfd80 con 0x7f75e40c69e0 2023-05-12T09:08:25.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75da7fc700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75e40c8bc0 0x7f75e40c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:25.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75e2ffd700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75d0005200 0x7f75e41513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:25.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75e37fe700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75e40c69e0 0x7f75e40c6e50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f75e4160140 tx=0x7f75dc001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:25.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75dbfff700 1 -- 172.21.15.116:0/1697228620 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc020070 con 0x7f75e40c69e0 2023-05-12T09:08:25.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75dbfff700 1 -- 172.21.15.116:0/1697228620 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc000ed0 con 0x7f75e40c69e0 2023-05-12T09:08:25.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75e93ff700 1 -- 172.21.15.116:0/1697228620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e40cfbf0 con 0x7f75e40c69e0 2023-05-12T09:08:25.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75dbfff700 1 -- 172.21.15.116:0/1697228620 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc004ab0 con 0x7f75e40c69e0 2023-05-12T09:08:25.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.801+0000 7f75e93ff700 1 -- 172.21.15.116:0/1697228620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e40cff10 con 0x7f75e40c69e0 2023-05-12T09:08:25.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.802+0000 7f75e93ff700 1 -- 172.21.15.116:0/1697228620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e4151900 con 0x7f75e40c69e0 2023-05-12T09:08:25.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.803+0000 7f75dbfff700 1 -- 172.21.15.116:0/1697228620 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f75dc004c10 con 0x7f75e40c69e0 2023-05-12T09:08:25.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.804+0000 7f75dbfff700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75c406ace0 0x7f75c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:25.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.804+0000 7f75dbfff700 1 -- 172.21.15.116:0/1697228620 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f75dc089a40 con 0x7f75e40c69e0 2023-05-12T09:08:25.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.805+0000 7f75e2ffd700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75c406ace0 0x7f75c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:25.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.805+0000 7f75e2ffd700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75c406ace0 0x7f75c406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75d4007440 tx=0x7f75d400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:25.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:25.809+0000 7f75dbfff700 1 -- 172.21.15.116:0/1697228620 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f75dc0547b0 con 0x7f75e40c69e0 2023-05-12T09:08:26.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.002+0000 7f75e93ff700 1 -- 172.21.15.116:0/1697228620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f75e40c9f80 con 0x7f75e40c69e0 2023-05-12T09:08:26.006 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.003+0000 7f75dbfff700 1 -- 172.21.15.116:0/1697228620 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f75dc087e60 con 0x7f75e40c69e0 2023-05-12T09:08:26.006 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:26.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 -- 172.21.15.116:0/1697228620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75c406ace0 msgr2=0x7f75c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.008 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75c406ace0 0x7f75c406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75d4007440 tx=0x7f75d400b040 comp rx=0 tx=0).stop 2023-05-12T09:08:26.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 -- 172.21.15.116:0/1697228620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75e40c69e0 msgr2=0x7f75e40c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75e40c69e0 0x7f75e40c6e50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f75e4160140 tx=0x7f75dc001980 comp rx=0 tx=0).stop 2023-05-12T09:08:26.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 -- 172.21.15.116:0/1697228620 shutdown_connections 2023-05-12T09:08:26.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75e40c69e0 0x7f75e40c6e50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f75d0005200 0x7f75e41513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75c406ace0 0x7f75c406d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.009 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 --2- 172.21.15.116:0/1697228620 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f75e40c8bc0 0x7f75e40c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 -- 172.21.15.116:0/1697228620 >> 172.21.15.116:0/1697228620 conn(0x7f75e4071b10 msgr2=0x7f75e4160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:26.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 -- 172.21.15.116:0/1697228620 shutdown_connections 2023-05-12T09:08:26.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.005+0000 7f75e93ff700 1 -- 172.21.15.116:0/1697228620 wait complete. 2023-05-12T09:08:26.025 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-12T09:08:26.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.208+0000 7fed387ff700 1 Processor -- start 2023-05-12T09:08:26.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.208+0000 7fed387ff700 1 -- start start 2023-05-12T09:08:26.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.209+0000 7fed387ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fed3015a140 0x7fed300cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.209+0000 7fed387ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed30160ba0 0x7fed300cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.209+0000 7fed387ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3015d660 con 0x7fed300cfe20 2023-05-12T09:08:26.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.209+0000 7fed387ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed300d02a0 con 0x7fed3015a140 2023-05-12T09:08:26.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.209+0000 7fed387ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3015cd70 con 0x7fed30160ba0 2023-05-12T09:08:26.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.209+0000 7fed36d9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fed300cfe20 0x7fed300b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36536/0 (socket says 172.21.15.116:36536) 2023-05-12T09:08:26.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.209+0000 7fed36d9c700 1 -- 172.21.15.116:0/1877487932 learned_addr learned my addr 172.21.15.116:0/1877487932 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:26.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35d9a700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed30160ba0 0x7fed300cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed3659b700 1 --2- 172.21.15.116:0/1877487932 >> v2:172.21.15.182:3300/0 conn(0x7fed3015a140 0x7fed300cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008198917 0 0) 0x7fed3015d660 con 0x7fed300cfe20 2023-05-12T09:08:26.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed1c0035b0 con 0x7fed300cfe20 2023-05-12T09:08:26.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1779301609 0 0) 0x7fed1c0035b0 con 0x7fed300cfe20 2023-05-12T09:08:26.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed30160ba0 msgr2=0x7fed300cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:26.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed30160ba0 0x7fed300cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 >> v2:172.21.15.182:3300/0 conn(0x7fed3015a140 msgr2=0x7fed300cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:26.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 --2- 172.21.15.116:0/1877487932 >> v2:172.21.15.182:3300/0 conn(0x7fed3015a140 0x7fed300cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3015d010 con 0x7fed300cfe20 2023-05-12T09:08:26.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7fed280019f0 con 0x7fed300cfe20 2023-05-12T09:08:26.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 >> v1:172.21.15.116:6789/0 conn(0x7fed300cfe20 legacy=0x7fed300b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed30160ba0 0x7fed1c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed1c003f80 0x7fed1c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed1c004d90 0x7fed1c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed300d02a0 con 0x7fed1c003f80 2023-05-12T09:08:26.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3015cd70 con 0x7fed1c004d90 2023-05-12T09:08:26.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c00ba10 con 0x7fed30160ba0 2023-05-12T09:08:26.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.210+0000 7fed35d9a700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed1c003f80 0x7fed1c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed3659b700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed30160ba0 0x7fed1c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed36d9c700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed1c004d90 0x7fed1c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed35d9a700 1 -- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed30160ba0 msgr2=0x7fed1c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:26.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed35d9a700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed30160ba0 0x7fed1c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed35d9a700 1 -- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed1c004d90 msgr2=0x7fed1c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:26.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed35d9a700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed1c004d90 0x7fed1c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed35d9a700 1 -- 172.21.15.116:0/1877487932 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c0035b0 con 0x7fed1c003f80 2023-05-12T09:08:26.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed35d9a700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed1c003f80 0x7fed1c004850 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fed20009b60 tx=0x7fed1c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5f2fd11cfc7847 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:26.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000e6c0 con 0x7fed1c003f80 2023-05-12T09:08:26.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2000e820 con 0x7fed1c003f80 2023-05-12T09:08:26.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.211+0000 7fed35599700 1 -- 172.21.15.116:0/1877487932 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000eb90 con 0x7fed1c003f80 2023-05-12T09:08:26.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.212+0000 7fed387ff700 1 -- 172.21.15.116:0/1877487932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed1c003f80 msgr2=0x7fed1c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.212+0000 7fed387ff700 1 --2- 172.21.15.116:0/1877487932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed1c003f80 0x7fed1c004850 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fed20009b60 tx=0x7fed1c005880 comp rx=0 tx=0).stop 2023-05-12T09:08:26.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.212+0000 7fed36d9c700 1 -- 172.21.15.116:0/1877487932 reap_dead start 2023-05-12T09:08:26.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.212+0000 7fed387ff700 1 -- 172.21.15.116:0/1877487932 shutdown_connections 2023-05-12T09:08:26.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.212+0000 7fed387ff700 1 -- 172.21.15.116:0/1877487932 >> 172.21.15.116:0/1877487932 conn(0x7fed30071b10 msgr2=0x7fed30071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:26.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.212+0000 7fed387ff700 1 -- 172.21.15.116:0/1877487932 shutdown_connections 2023-05-12T09:08:26.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.212+0000 7fed387ff700 1 -- 172.21.15.116:0/1877487932 wait complete. 2023-05-12T09:08:26.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.214+0000 7fed387ff700 1 Processor -- start 2023-05-12T09:08:26.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.214+0000 7fed387ff700 1 -- start start 2023-05-12T09:08:26.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed387ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed1c003f80 0x7fed300cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed387ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed301e6aa0 0x7fed301e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed387ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed300b7580 0x7fed300b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed387ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed301e7450 con 0x7fed300b7580 2023-05-12T09:08:26.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed387ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed300b7f30 con 0x7fed1c003f80 2023-05-12T09:08:26.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed387ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed300cc110 con 0x7fed301e6aa0 2023-05-12T09:08:26.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed36d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed300b7580 0x7fed300b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed36d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed300b7580 0x7fed300b79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39320/0 (socket says 172.21.15.116:39320) 2023-05-12T09:08:26.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed36d9c700 1 -- 172.21.15.116:0/2095297090 learned_addr learned my addr 172.21.15.116:0/2095297090 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:26.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed3659b700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed1c003f80 0x7fed300cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed35d9a700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed301e6aa0 0x7fed301e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed36d9c700 1 -- 172.21.15.116:0/2095297090 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed301e6aa0 msgr2=0x7fed301e6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed36d9c700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed301e6aa0 0x7fed301e6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed36d9c700 1 -- 172.21.15.116:0/2095297090 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed1c003f80 msgr2=0x7fed300cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed36d9c700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed1c003f80 0x7fed300cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed36d9c700 1 -- 172.21.15.116:0/2095297090 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3015daf0 con 0x7fed300b7580 2023-05-12T09:08:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed35d9a700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed301e6aa0 0x7fed301e6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.215+0000 7fed3659b700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed1c003f80 0x7fed300cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.216+0000 7fed36d9c700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed300b7580 0x7fed300b79f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fed28001a00 tx=0x7fed28001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.216+0000 7fed26ffd700 1 -- 172.21.15.116:0/2095297090 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2800ad80 con 0x7fed300b7580 2023-05-12T09:08:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.216+0000 7fed26ffd700 1 -- 172.21.15.116:0/2095297090 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed280133f0 con 0x7fed300b7580 2023-05-12T09:08:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.216+0000 7fed387ff700 1 -- 172.21.15.116:0/2095297090 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3015d2f0 con 0x7fed300b7580 2023-05-12T09:08:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.216+0000 7fed26ffd700 1 -- 172.21.15.116:0/2095297090 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28013760 con 0x7fed300b7580 2023-05-12T09:08:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.216+0000 7fed387ff700 1 -- 172.21.15.116:0/2095297090 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed300cdb00 con 0x7fed300b7580 2023-05-12T09:08:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.217+0000 7fed387ff700 1 -- 172.21.15.116:0/2095297090 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed300d3af0 con 0x7fed300b7580 2023-05-12T09:08:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.218+0000 7fed26ffd700 1 -- 172.21.15.116:0/2095297090 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed280138c0 con 0x7fed300b7580 2023-05-12T09:08:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.219+0000 7fed26ffd700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed1406ace0 0x7fed1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.219+0000 7fed26ffd700 1 -- 172.21.15.116:0/2095297090 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fed2808a1e0 con 0x7fed300b7580 2023-05-12T09:08:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.219+0000 7fed3659b700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed1406ace0 0x7fed1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.220+0000 7fed3659b700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed1406ace0 0x7fed1406d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009c60 tx=0x7fed2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:26.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.223+0000 7fed26ffd700 1 -- 172.21.15.116:0/2095297090 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fed28054ec0 con 0x7fed300b7580 2023-05-12T09:08:26.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.430+0000 7fed387ff700 1 -- 172.21.15.116:0/2095297090 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fed300b8b30 con 0x7fed300b7580 2023-05-12T09:08:26.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.431+0000 7fed26ffd700 1 -- 172.21.15.116:0/2095297090 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fed280584e0 con 0x7fed300b7580 2023-05-12T09:08:26.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 -- 172.21.15.116:0/2095297090 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed1406ace0 msgr2=0x7fed1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed1406ace0 0x7fed1406d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009c60 tx=0x7fed2c008040 comp rx=0 tx=0).stop 2023-05-12T09:08:26.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 -- 172.21.15.116:0/2095297090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed300b7580 msgr2=0x7fed300b79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed300b7580 0x7fed300b79f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fed28001a00 tx=0x7fed28001ae0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 -- 172.21.15.116:0/2095297090 shutdown_connections 2023-05-12T09:08:26.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed300b7580 0x7fed300b79f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed1c003f80 0x7fed300cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed1406ace0 0x7fed1406d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 --2- 172.21.15.116:0/2095297090 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed301e6aa0 0x7fed301e6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 -- 172.21.15.116:0/2095297090 >> 172.21.15.116:0/2095297090 conn(0x7fed30071b10 msgr2=0x7fed3015a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:26.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 -- 172.21.15.116:0/2095297090 shutdown_connections 2023-05-12T09:08:26.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.433+0000 7fed387ff700 1 -- 172.21.15.116:0/2095297090 wait complete. 2023-05-12T09:08:26.438 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2023-05-12T09:08:26.453 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi116.front.sepia.ceph.com... 2023-05-12T09:08:26.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:26.454 DEBUG:teuthology.orchestra.run.smithi116:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-05-12T09:08:26.517 INFO:teuthology.orchestra.run:waiting for 300 2023-05-12T09:08:26.518 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T09:08:26.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:26.518 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-12T09:08:26.560 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:08:26.561 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:26.610 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:08:26.611 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:26.654 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:26.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.836+0000 7f429ddff700 1 Processor -- start 2023-05-12T09:08:26.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.836+0000 7f429ddff700 1 -- start start 2023-05-12T09:08:26.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.837+0000 7f429ddff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42980cfbf0 0x7f42981608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.837+0000 7f429ddff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f42980d1100 0x7f42980d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.837+0000 7f429ddff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980d0020 con 0x7f42980b87a0 2023-05-12T09:08:26.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.837+0000 7f429ddff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42980d02d0 con 0x7f42980d1100 2023-05-12T09:08:26.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.837+0000 7f429ddff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980d0cb0 con 0x7f42980cfbf0 2023-05-12T09:08:26.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.837+0000 7f4297fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f42980d1100 0x7f42980d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.837+0000 7f4297fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f42980d1100 0x7f42980d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39336/0 (socket says 172.21.15.116:39336) 2023-05-12T09:08:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.837+0000 7f4297fff700 1 -- 172.21.15.116:0/2905462474 learned_addr learned my addr 172.21.15.116:0/2905462474 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.838+0000 7f4296ffd700 1 --2- 172.21.15.116:0/2905462474 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42980cfbf0 0x7f42981608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.838+0000 7f4297fff700 1 -- 172.21.15.116:0/2905462474 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42980cfbf0 msgr2=0x7f42981608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.838+0000 7f4297fff700 1 --2- 172.21.15.116:0/2905462474 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42980cfbf0 0x7f42981608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.838+0000 7f4297fff700 1 -- 172.21.15.116:0/2905462474 >> v1:172.21.15.182:6789/0 conn(0x7f42980b87a0 legacy=0x7f42981601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.838+0000 7f4297fff700 1 -- 172.21.15.116:0/2905462474 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980cdc60 con 0x7f42980d1100 2023-05-12T09:08:26.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.838+0000 7f4297fff700 1 --2- 172.21.15.116:0/2905462474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980d1100 0x7f42980d1580 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4290009e50 tx=0x7f429000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba908664e28f54c1 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:26.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.838+0000 7f42967fc700 1 -- 172.21.15.116:0/2905462474 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000e070 con 0x7f42980d1100 2023-05-12T09:08:26.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.838+0000 7f42967fc700 1 -- 172.21.15.116:0/2905462474 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429000b910 con 0x7f42980d1100 2023-05-12T09:08:26.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.838+0000 7f42967fc700 1 -- 172.21.15.116:0/2905462474 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000bcc0 con 0x7f42980d1100 2023-05-12T09:08:26.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.839+0000 7f429ddff700 1 -- 172.21.15.116:0/2905462474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980d1100 msgr2=0x7f42980d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.839+0000 7f429ddff700 1 --2- 172.21.15.116:0/2905462474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980d1100 0x7f42980d1580 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4290009e50 tx=0x7f429000b330 comp rx=0 tx=0).stop 2023-05-12T09:08:26.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.839+0000 7f429ddff700 1 -- 172.21.15.116:0/2905462474 shutdown_connections 2023-05-12T09:08:26.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.839+0000 7f429ddff700 1 --2- 172.21.15.116:0/2905462474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980d1100 0x7f42980d1580 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.839+0000 7f429ddff700 1 --2- 172.21.15.116:0/2905462474 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42980cfbf0 0x7f42981608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.839+0000 7f429ddff700 1 -- 172.21.15.116:0/2905462474 >> 172.21.15.116:0/2905462474 conn(0x7f4298071b10 msgr2=0x7f4298071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:26.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.839+0000 7f429ddff700 1 -- 172.21.15.116:0/2905462474 shutdown_connections 2023-05-12T09:08:26.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.839+0000 7f429ddff700 1 -- 172.21.15.116:0/2905462474 wait complete. 2023-05-12T09:08:26.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.841+0000 7f429ddff700 1 Processor -- start 2023-05-12T09:08:26.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.841+0000 7f429ddff700 1 -- start start 2023-05-12T09:08:26.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f429ddff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980b87a0 0x7f42980c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f429ddff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42980cfbf0 0x7f42980c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f429ddff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42980d1100 0x7f4298144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f429ddff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4298144ea0 con 0x7f42980b87a0 2023-05-12T09:08:26.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f429ddff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980c7080 con 0x7f42980d1100 2023-05-12T09:08:26.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f429ddff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980c7360 con 0x7f42980cfbf0 2023-05-12T09:08:26.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f42977fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980b87a0 0x7f42980c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f42977fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980b87a0 0x7f42980c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39340/0 (socket says 172.21.15.116:39340) 2023-05-12T09:08:26.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f42977fe700 1 -- 172.21.15.116:0/2654923587 learned_addr learned my addr 172.21.15.116:0/2654923587 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:26.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f4296ffd700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42980cfbf0 0x7f42980c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f4297fff700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42980d1100 0x7f4298144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f42977fe700 1 -- 172.21.15.116:0/2654923587 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42980cfbf0 msgr2=0x7f42980c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f42977fe700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42980cfbf0 0x7f42980c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f42977fe700 1 -- 172.21.15.116:0/2654923587 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42980d1100 msgr2=0x7f4298144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:26.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f42977fe700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42980d1100 0x7f4298144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:26.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.842+0000 7f42977fe700 1 -- 172.21.15.116:0/2654923587 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4290009b30 con 0x7f42980b87a0 2023-05-12T09:08:26.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.843+0000 7f42977fe700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980b87a0 0x7f42980c69c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f428800c450 tx=0x7f428800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:26.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.843+0000 7f427ffff700 1 -- 172.21.15.116:0/2654923587 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42880052d0 con 0x7f42980b87a0 2023-05-12T09:08:26.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.843+0000 7f427ffff700 1 -- 172.21.15.116:0/2654923587 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4288005430 con 0x7f42980b87a0 2023-05-12T09:08:26.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.843+0000 7f427ffff700 1 -- 172.21.15.116:0/2654923587 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42880038c0 con 0x7f42980b87a0 2023-05-12T09:08:26.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.843+0000 7f429ddff700 1 -- 172.21.15.116:0/2654923587 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42980cd980 con 0x7f42980b87a0 2023-05-12T09:08:26.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.843+0000 7f429ddff700 1 -- 172.21.15.116:0/2654923587 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42980cd6a0 con 0x7f42980b87a0 2023-05-12T09:08:26.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.844+0000 7f429ddff700 1 -- 172.21.15.116:0/2654923587 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4298160e30 con 0x7f42980b87a0 2023-05-12T09:08:26.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.845+0000 7f427ffff700 1 -- 172.21.15.116:0/2654923587 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4288003a20 con 0x7f42980b87a0 2023-05-12T09:08:26.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.846+0000 7f427ffff700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f428406ace0 0x7f428406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:26.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.846+0000 7f427ffff700 1 -- 172.21.15.116:0/2654923587 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4288088af0 con 0x7f42980b87a0 2023-05-12T09:08:26.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.846+0000 7f4296ffd700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f428406ace0 0x7f428406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:26.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.847+0000 7f4296ffd700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f428406ace0 0x7f428406d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4298156020 tx=0x7f428c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:26.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:26.850+0000 7f427ffff700 1 -- 172.21.15.116:0/2654923587 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4288053850 con 0x7f42980b87a0 2023-05-12T09:08:27.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.045+0000 7f429ddff700 1 -- 172.21.15.116:0/2654923587 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4298074430 con 0x7f42980b87a0 2023-05-12T09:08:27.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.047+0000 7f427ffff700 1 -- 172.21.15.116:0/2654923587 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7f428800ce60 con 0x7f42980b87a0 2023-05-12T09:08:27.050 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:27.050 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:27.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 -- 172.21.15.116:0/2654923587 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f428406ace0 msgr2=0x7f428406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f428406ace0 0x7f428406d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4298156020 tx=0x7f428c009210 comp rx=0 tx=0).stop 2023-05-12T09:08:27.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 -- 172.21.15.116:0/2654923587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980b87a0 msgr2=0x7f42980c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980b87a0 0x7f42980c69c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f428800c450 tx=0x7f428800c760 comp rx=0 tx=0).stop 2023-05-12T09:08:27.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 -- 172.21.15.116:0/2654923587 shutdown_connections 2023-05-12T09:08:27.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f42980d1100 0x7f4298144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42980b87a0 0x7f42980c69c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f428406ace0 0x7f428406d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 --2- 172.21.15.116:0/2654923587 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f42980cfbf0 0x7f42980c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 -- 172.21.15.116:0/2654923587 >> 172.21.15.116:0/2654923587 conn(0x7f4298071b10 msgr2=0x7f42980b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:27.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 -- 172.21.15.116:0/2654923587 shutdown_connections 2023-05-12T09:08:27.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.049+0000 7f429ddff700 1 -- 172.21.15.116:0/2654923587 wait complete. 2023-05-12T09:08:27.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:27.071 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:27.259 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.256+0000 7f40a87ff700 1 Processor -- start 2023-05-12T09:08:27.260 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.256+0000 7f40a87ff700 1 -- start start 2023-05-12T09:08:27.260 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.257+0000 7f40a87ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00d2110 0x7f40a0167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.258+0000 7f40a87ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a0161000 con 0x7f40a00b87a0 2023-05-12T09:08:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.258+0000 7f40a87ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a00d0020 con 0x7f40a00cfbf0 2023-05-12T09:08:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.258+0000 7f40a87ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00d02d0 con 0x7f40a00d2110 2023-05-12T09:08:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.258+0000 7f40a659b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f40a00b87a0 0x7f40a01601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36546/0 (socket says 172.21.15.116:36546) 2023-05-12T09:08:27.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.258+0000 7f40a659b700 1 -- 172.21.15.116:0/3747270199 learned_addr learned my addr 172.21.15.116:0/3747270199 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:27.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.258+0000 7f40a6d9c700 1 --2- 172.21.15.116:0/3747270199 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00d2110 0x7f40a0167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.258+0000 7f40a5599700 1 -- 172.21.15.116:0/3747270199 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079806388 0 0) 0x7f40a0161000 con 0x7f40a00b87a0 2023-05-12T09:08:27.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.258+0000 7f40a5599700 1 -- 172.21.15.116:0/3747270199 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f408c0035b0 con 0x7f40a00b87a0 2023-05-12T09:08:27.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.258+0000 7f40a5599700 1 -- 172.21.15.116:0/3747270199 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037744219 0 0) 0x7f40a00d0020 con 0x7f40a00cfbf0 2023-05-12T09:08:27.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.258+0000 7f40a5599700 1 -- 172.21.15.116:0/3747270199 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40a0161000 con 0x7f40a00cfbf0 2023-05-12T09:08:27.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.259+0000 7f40a5599700 1 -- 172.21.15.116:0/3747270199 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3988474733 0 0) 0x7f408c0035b0 con 0x7f40a00b87a0 2023-05-12T09:08:27.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.259+0000 7f40a6d9c700 1 -- 172.21.15.116:0/3747270199 >> v1:172.21.15.182:6789/0 conn(0x7f40a00cfbf0 legacy=0x7f40a01608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.259+0000 7f40a6d9c700 1 -- 172.21.15.116:0/3747270199 >> v1:172.21.15.116:6789/0 conn(0x7f40a00b87a0 legacy=0x7f40a01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.259+0000 7f40a6d9c700 1 -- 172.21.15.116:0/3747270199 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a00cdc60 con 0x7f40a00d2110 2023-05-12T09:08:27.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.259+0000 7f40a6d9c700 1 --2- 172.21.15.116:0/3747270199 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00d2110 0x7f40a0167550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4098009dc0 tx=0x7f409800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edeebec072a36b57 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:27.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.259+0000 7f40a5599700 1 -- 172.21.15.116:0/3747270199 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800e070 con 0x7f40a00d2110 2023-05-12T09:08:27.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.259+0000 7f40a5599700 1 -- 172.21.15.116:0/3747270199 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4098003a20 con 0x7f40a00d2110 2023-05-12T09:08:27.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.259+0000 7f40a5599700 1 -- 172.21.15.116:0/3747270199 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c001670 con 0x7f40a00d2110 2023-05-12T09:08:27.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.260+0000 7f40a87ff700 1 -- 172.21.15.116:0/3747270199 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00d2110 msgr2=0x7f40a0167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.260+0000 7f40a87ff700 1 --2- 172.21.15.116:0/3747270199 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00d2110 0x7f40a0167550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4098009dc0 tx=0x7f409800b330 comp rx=0 tx=0).stop 2023-05-12T09:08:27.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.260+0000 7f40a87ff700 1 -- 172.21.15.116:0/3747270199 shutdown_connections 2023-05-12T09:08:27.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.260+0000 7f40a87ff700 1 --2- 172.21.15.116:0/3747270199 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00d2110 0x7f40a0167550 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.260+0000 7f40a87ff700 1 -- 172.21.15.116:0/3747270199 >> 172.21.15.116:0/3747270199 conn(0x7f40a0071b10 msgr2=0x7f40a0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:27.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.260+0000 7f40a87ff700 1 -- 172.21.15.116:0/3747270199 shutdown_connections 2023-05-12T09:08:27.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.260+0000 7f40a87ff700 1 -- 172.21.15.116:0/3747270199 wait complete. 2023-05-12T09:08:27.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.262+0000 7f40a87ff700 1 Processor -- start 2023-05-12T09:08:27.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.262+0000 7f40a87ff700 1 -- start start 2023-05-12T09:08:27.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a87ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f40a00b87a0 0x7f40a015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a87ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00cfbf0 0x7f40a00b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a87ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40a00d2110 0x7f40a00c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a87ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a015de90 con 0x7f40a00d2110 2023-05-12T09:08:27.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a87ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a015e170 con 0x7f40a00b87a0 2023-05-12T09:08:27.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a87ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a015e450 con 0x7f40a00cfbf0 2023-05-12T09:08:27.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a6d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40a00d2110 0x7f40a00c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a6d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40a00d2110 0x7f40a00c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39352/0 (socket says 172.21.15.116:39352) 2023-05-12T09:08:27.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a6d9c700 1 -- 172.21.15.116:0/783773025 learned_addr learned my addr 172.21.15.116:0/783773025 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:27.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a659b700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f40a00b87a0 0x7f40a015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a5d9a700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00cfbf0 0x7f40a00b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a6d9c700 1 -- 172.21.15.116:0/783773025 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00cfbf0 msgr2=0x7f40a00b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a6d9c700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00cfbf0 0x7f40a00b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a6d9c700 1 -- 172.21.15.116:0/783773025 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f40a00b87a0 msgr2=0x7f40a015ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a6d9c700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f40a00b87a0 0x7f40a015ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a6d9c700 1 -- 172.21.15.116:0/783773025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098009a70 con 0x7f40a00d2110 2023-05-12T09:08:27.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.263+0000 7f40a5d9a700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00cfbf0 0x7f40a00b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:27.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.264+0000 7f40a6d9c700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40a00d2110 0x7f40a00c8a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4098009d90 tx=0x7f4098004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:27.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.264+0000 7f4096ffd700 1 -- 172.21.15.116:0/783773025 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098004340 con 0x7f40a00d2110 2023-05-12T09:08:27.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.264+0000 7f4096ffd700 1 -- 172.21.15.116:0/783773025 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40980044c0 con 0x7f40a00d2110 2023-05-12T09:08:27.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.264+0000 7f40a87ff700 1 -- 172.21.15.116:0/783773025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a00cd980 con 0x7f40a00d2110 2023-05-12T09:08:27.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.264+0000 7f4096ffd700 1 -- 172.21.15.116:0/783773025 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098004870 con 0x7f40a00d2110 2023-05-12T09:08:27.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.264+0000 7f40a87ff700 1 -- 172.21.15.116:0/783773025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a00cd6a0 con 0x7f40a00d2110 2023-05-12T09:08:27.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.265+0000 7f40a87ff700 1 -- 172.21.15.116:0/783773025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a0167a90 con 0x7f40a00d2110 2023-05-12T09:08:27.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.266+0000 7f4096ffd700 1 -- 172.21.15.116:0/783773025 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f409801c460 con 0x7f40a00d2110 2023-05-12T09:08:27.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.267+0000 7f4096ffd700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f408406ace0 0x7f408406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.267+0000 7f4096ffd700 1 -- 172.21.15.116:0/783773025 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f409808ae30 con 0x7f40a00d2110 2023-05-12T09:08:27.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.267+0000 7f40a659b700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f408406ace0 0x7f408406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.267+0000 7f40a659b700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f408406ace0 0x7f408406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f409c001380 tx=0x7f409c000f10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:27.274 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.271+0000 7f4096ffd700 1 -- 172.21.15.116:0/783773025 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4098055b20 con 0x7f40a00d2110 2023-05-12T09:08:27.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.461+0000 7f40a87ff700 1 -- 172.21.15.116:0/783773025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f40a00b52f0 con 0x7f40a00d2110 2023-05-12T09:08:27.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.462+0000 7f4096ffd700 1 -- 172.21.15.116:0/783773025 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4098059140 con 0x7f40a00d2110 2023-05-12T09:08:27.466 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:27.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 -- 172.21.15.116:0/783773025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f408406ace0 msgr2=0x7f408406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f408406ace0 0x7f408406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f409c001380 tx=0x7f409c000f10 comp rx=0 tx=0).stop 2023-05-12T09:08:27.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 -- 172.21.15.116:0/783773025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40a00d2110 msgr2=0x7f40a00c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40a00d2110 0x7f40a00c8a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4098009d90 tx=0x7f4098004ad0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 -- 172.21.15.116:0/783773025 shutdown_connections 2023-05-12T09:08:27.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40a00d2110 0x7f40a00c8a50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f40a00b87a0 0x7f40a015ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f408406ace0 0x7f408406d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 --2- 172.21.15.116:0/783773025 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f40a00cfbf0 0x7f40a00b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 -- 172.21.15.116:0/783773025 >> 172.21.15.116:0/783773025 conn(0x7f40a0071b10 msgr2=0x7f40a00b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:27.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.464+0000 7f40a87ff700 1 -- 172.21.15.116:0/783773025 shutdown_connections 2023-05-12T09:08:27.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.465+0000 7f40a87ff700 1 -- 172.21.15.116:0/783773025 wait complete. 2023-05-12T09:08:27.484 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:27.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.669+0000 7f326c3ff700 1 Processor -- start 2023-05-12T09:08:27.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.669+0000 7f326c3ff700 1 -- start start 2023-05-12T09:08:27.673 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.670+0000 7f326c3ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f32640d0130 0x7f32640cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.670+0000 7f326c3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640cbf90 0x7f32640cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.670+0000 7f326c3ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32640b26f0 con 0x7f326406b4f0 2023-05-12T09:08:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.670+0000 7f326c3ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640cf890 con 0x7f32640d0130 2023-05-12T09:08:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f326c3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32640cfb60 con 0x7f32640cbf90 2023-05-12T09:08:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f326999a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f32640d0130 0x7f32640cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.674 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f326999a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f32640d0130 0x7f32640cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39364/0 (socket says 172.21.15.116:39364) 2023-05-12T09:08:27.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f326999a700 1 -- 172.21.15.116:0/3001924308 learned_addr learned my addr 172.21.15.116:0/3001924308 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:27.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f326a99c700 1 --2- 172.21.15.116:0/3001924308 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640cbf90 0x7f32640cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f326999a700 1 -- 172.21.15.116:0/3001924308 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640cbf90 msgr2=0x7f32640cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:27.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f326999a700 1 --2- 172.21.15.116:0/3001924308 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640cbf90 0x7f32640cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f326999a700 1 -- 172.21.15.116:0/3001924308 >> v1:172.21.15.182:6789/0 conn(0x7f326406b4f0 legacy=0x7f326406b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f326999a700 1 -- 172.21.15.116:0/3001924308 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640cfe40 con 0x7f32640d0130 2023-05-12T09:08:27.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f3269199700 1 -- 172.21.15.116:0/3001924308 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057008693 0 0) 0x7f32640b26f0 con 0x7f326406b4f0 2023-05-12T09:08:27.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.671+0000 7f326a99c700 1 --2- 172.21.15.116:0/3001924308 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640cbf90 0x7f32640cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:27.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f326999a700 1 --2- 172.21.15.116:0/3001924308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32640d0130 0x7f32640cf350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3254009920 tx=0x7f3254009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15303d324f42df7c server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:27.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f3269199700 1 -- 172.21.15.116:0/3001924308 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400ba20 con 0x7f32640d0130 2023-05-12T09:08:27.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f3269199700 1 -- 172.21.15.116:0/3001924308 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325400bb80 con 0x7f32640d0130 2023-05-12T09:08:27.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f3269199700 1 -- 172.21.15.116:0/3001924308 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254009e70 con 0x7f32640d0130 2023-05-12T09:08:27.677 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f326c3ff700 1 -- 172.21.15.116:0/3001924308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32640d0130 msgr2=0x7f32640cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f326c3ff700 1 --2- 172.21.15.116:0/3001924308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32640d0130 0x7f32640cf350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3254009920 tx=0x7f3254009c30 comp rx=0 tx=0).stop 2023-05-12T09:08:27.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f326c3ff700 1 -- 172.21.15.116:0/3001924308 shutdown_connections 2023-05-12T09:08:27.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f326c3ff700 1 --2- 172.21.15.116:0/3001924308 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640cbf90 0x7f32640cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f326c3ff700 1 --2- 172.21.15.116:0/3001924308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32640d0130 0x7f32640cf350 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f326c3ff700 1 -- 172.21.15.116:0/3001924308 >> 172.21.15.116:0/3001924308 conn(0x7f326409a090 msgr2=0x7f32640d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:27.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.672+0000 7f326c3ff700 1 -- 172.21.15.116:0/3001924308 shutdown_connections 2023-05-12T09:08:27.678 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.673+0000 7f326c3ff700 1 -- 172.21.15.116:0/3001924308 wait complete. 2023-05-12T09:08:27.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.675+0000 7f326c3ff700 1 Processor -- start 2023-05-12T09:08:27.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.675+0000 7f326c3ff700 1 -- start start 2023-05-12T09:08:27.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.676+0000 7f326c3ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326406b4f0 0x7f32640c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.676+0000 7f326c3ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32640cbf90 0x7f326415a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.680 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.676+0000 7f326c3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640d0130 0x7f32640af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.676+0000 7f326c3ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640c7cd0 con 0x7f326406b4f0 2023-05-12T09:08:27.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.676+0000 7f326c3ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640c5de0 con 0x7f32640cbf90 2023-05-12T09:08:27.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.676+0000 7f326c3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32640c60c0 con 0x7f32640d0130 2023-05-12T09:08:27.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.676+0000 7f326a19b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326406b4f0 0x7f32640c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.676+0000 7f326a19b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326406b4f0 0x7f32640c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39376/0 (socket says 172.21.15.116:39376) 2023-05-12T09:08:27.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.676+0000 7f326a19b700 1 -- 172.21.15.116:0/3521408506 learned_addr learned my addr 172.21.15.116:0/3521408506 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:27.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326a99c700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640d0130 0x7f32640af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326999a700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32640cbf90 0x7f326415a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326a19b700 1 -- 172.21.15.116:0/3521408506 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640d0130 msgr2=0x7f32640af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326a19b700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640d0130 0x7f32640af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326a19b700 1 -- 172.21.15.116:0/3521408506 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32640cbf90 msgr2=0x7f326415a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326a19b700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32640cbf90 0x7f326415a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326a19b700 1 -- 172.21.15.116:0/3521408506 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3254009550 con 0x7f326406b4f0 2023-05-12T09:08:27.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326999a700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32640cbf90 0x7f326415a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:27.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326a99c700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640d0130 0x7f32640af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:27.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326a19b700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326406b4f0 0x7f32640c7790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f32600011e0 tx=0x7f326000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:27.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f325affd700 1 -- 172.21.15.116:0/3521408506 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600054e0 con 0x7f326406b4f0 2023-05-12T09:08:27.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f325affd700 1 -- 172.21.15.116:0/3521408506 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3260003680 con 0x7f326406b4f0 2023-05-12T09:08:27.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326c3ff700 1 -- 172.21.15.116:0/3521408506 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32640cb790 con 0x7f326406b4f0 2023-05-12T09:08:27.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f325affd700 1 -- 172.21.15.116:0/3521408506 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260003a30 con 0x7f326406b4f0 2023-05-12T09:08:27.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.677+0000 7f326c3ff700 1 -- 172.21.15.116:0/3521408506 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32640cb4b0 con 0x7f326406b4f0 2023-05-12T09:08:27.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.678+0000 7f326c3ff700 1 -- 172.21.15.116:0/3521408506 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32640cba70 con 0x7f326406b4f0 2023-05-12T09:08:27.684 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.679+0000 7f325affd700 1 -- 172.21.15.116:0/3521408506 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3260003b90 con 0x7f326406b4f0 2023-05-12T09:08:27.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.680+0000 7f325affd700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f324806ace0 0x7f324806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:27.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.680+0000 7f325affd700 1 -- 172.21.15.116:0/3521408506 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3260088dc0 con 0x7f326406b4f0 2023-05-12T09:08:27.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.681+0000 7f326999a700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f324806ace0 0x7f324806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:27.685 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.681+0000 7f326999a700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f324806ace0 0x7f324806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f32640c4b70 tx=0x7f3254008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:27.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.684+0000 7f325affd700 1 -- 172.21.15.116:0/3521408506 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3260053aa0 con 0x7f326406b4f0 2023-05-12T09:08:27.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.879+0000 7f326c3ff700 1 -- 172.21.15.116:0/3521408506 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3264074430 con 0x7f326406b4f0 2023-05-12T09:08:27.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.879+0000 7f325affd700 1 -- 172.21.15.116:0/3521408506 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3260017020 con 0x7f326406b4f0 2023-05-12T09:08:27.883 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:27.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 -- 172.21.15.116:0/3521408506 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f324806ace0 msgr2=0x7f324806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f324806ace0 0x7f324806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f32640c4b70 tx=0x7f3254008030 comp rx=0 tx=0).stop 2023-05-12T09:08:27.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 -- 172.21.15.116:0/3521408506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326406b4f0 msgr2=0x7f32640c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:27.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326406b4f0 0x7f32640c7790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f32600011e0 tx=0x7f326000cae0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 -- 172.21.15.116:0/3521408506 shutdown_connections 2023-05-12T09:08:27.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f324806ace0 0x7f324806d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f32640d0130 0x7f32640af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326406b4f0 0x7f32640c7790 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 --2- 172.21.15.116:0/3521408506 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32640cbf90 0x7f326415a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:27.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 -- 172.21.15.116:0/3521408506 >> 172.21.15.116:0/3521408506 conn(0x7f326409a090 msgr2=0x7f326406f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:27.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 -- 172.21.15.116:0/3521408506 shutdown_connections 2023-05-12T09:08:27.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:27.882+0000 7f326c3ff700 1 -- 172.21.15.116:0/3521408506 wait complete. 2023-05-12T09:08:27.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:28.089 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.086+0000 7fc065bff700 1 Processor -- start 2023-05-12T09:08:28.089 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.086+0000 7fc065bff700 1 -- start start 2023-05-12T09:08:28.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc065bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc06015c590 0x7fc060160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc065bff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc0600cf010 0x7fc0600cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc065bff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0600cd520 con 0x7fc0600cfd80 2023-05-12T09:08:28.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc065bff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0600d2640 con 0x7fc0600cf010 2023-05-12T09:08:28.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc065bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0601610d0 con 0x7fc06015c590 2023-05-12T09:08:28.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc05effd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc0600cf010 0x7fc0600cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc05effd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc0600cf010 0x7fc0600cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39390/0 (socket says 172.21.15.116:39390) 2023-05-12T09:08:28.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc05effd700 1 -- 172.21.15.116:0/1746588926 learned_addr learned my addr 172.21.15.116:0/1746588926 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:28.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc05f7fe700 1 --2- 172.21.15.116:0/1746588926 >> v2:172.21.15.182:3300/0 conn(0x7fc06015c590 0x7fc060160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc05effd700 1 -- 172.21.15.116:0/1746588926 >> v2:172.21.15.182:3300/0 conn(0x7fc06015c590 msgr2=0x7fc060160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:28.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc05effd700 1 --2- 172.21.15.116:0/1746588926 >> v2:172.21.15.182:3300/0 conn(0x7fc06015c590 0x7fc060160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc05effd700 1 -- 172.21.15.116:0/1746588926 >> v1:172.21.15.182:6789/0 conn(0x7fc0600cfd80 legacy=0x7fc0600d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:28.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.088+0000 7fc05effd700 1 -- 172.21.15.116:0/1746588926 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0600b23c0 con 0x7fc0600cf010 2023-05-12T09:08:28.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.089+0000 7fc05effd700 1 --2- 172.21.15.116:0/1746588926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0600cf010 0x7fc0600cf840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc0600d0a50 tx=0x7fc054009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3f5f8c0239431 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:28.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.089+0000 7fc05e7fc700 1 -- 172.21.15.116:0/1746588926 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054004230 con 0x7fc0600cf010 2023-05-12T09:08:28.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.089+0000 7fc05e7fc700 1 -- 172.21.15.116:0/1746588926 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054004390 con 0x7fc0600cf010 2023-05-12T09:08:28.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.089+0000 7fc05e7fc700 1 -- 172.21.15.116:0/1746588926 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0540036a0 con 0x7fc0600cf010 2023-05-12T09:08:28.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.089+0000 7fc065bff700 1 -- 172.21.15.116:0/1746588926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0600cf010 msgr2=0x7fc0600cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.089+0000 7fc065bff700 1 --2- 172.21.15.116:0/1746588926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0600cf010 0x7fc0600cf840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc0600d0a50 tx=0x7fc054009bd0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.090+0000 7fc065bff700 1 -- 172.21.15.116:0/1746588926 shutdown_connections 2023-05-12T09:08:28.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.090+0000 7fc065bff700 1 --2- 172.21.15.116:0/1746588926 >> v2:172.21.15.182:3300/0 conn(0x7fc06015c590 0x7fc060160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.090+0000 7fc065bff700 1 --2- 172.21.15.116:0/1746588926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0600cf010 0x7fc0600cf840 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.090+0000 7fc065bff700 1 -- 172.21.15.116:0/1746588926 >> 172.21.15.116:0/1746588926 conn(0x7fc060071b10 msgr2=0x7fc060071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:28.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.090+0000 7fc065bff700 1 -- 172.21.15.116:0/1746588926 shutdown_connections 2023-05-12T09:08:28.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.090+0000 7fc065bff700 1 -- 172.21.15.116:0/1746588926 wait complete. 2023-05-12T09:08:28.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.092+0000 7fc065bff700 1 Processor -- start 2023-05-12T09:08:28.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.092+0000 7fc065bff700 1 -- start start 2023-05-12T09:08:28.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.093+0000 7fc065bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc0600cf010 0x7fc0601f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.093+0000 7fc065bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc0600cfd80 0x7fc0600b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.093+0000 7fc065bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc06015c590 0x7fc0600b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.093+0000 7fc065bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0600c7c40 con 0x7fc06015c590 2023-05-12T09:08:28.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.093+0000 7fc065bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0601e7810 con 0x7fc0600cfd80 2023-05-12T09:08:28.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.093+0000 7fc065bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0601e7af0 con 0x7fc0600cf010 2023-05-12T09:08:28.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc06015c590 0x7fc0600b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc06015c590 0x7fc0600b7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39404/0 (socket says 172.21.15.116:39404) 2023-05-12T09:08:28.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05ffff700 1 -- 172.21.15.116:0/1800508738 learned_addr learned my addr 172.21.15.116:0/1800508738 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:28.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05f7fe700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc0600cf010 0x7fc0601f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05effd700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc0600cfd80 0x7fc0600b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05ffff700 1 -- 172.21.15.116:0/1800508738 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc0600cf010 msgr2=0x7fc0601f1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05ffff700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc0600cf010 0x7fc0601f1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05ffff700 1 -- 172.21.15.116:0/1800508738 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc0600cfd80 msgr2=0x7fc0600b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05ffff700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc0600cfd80 0x7fc0600b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05ffff700 1 -- 172.21.15.116:0/1800508738 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054009550 con 0x7fc06015c590 2023-05-12T09:08:28.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.094+0000 7fc05ffff700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc06015c590 0x7fc0600b7ba0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc05800cc10 tx=0x7fc05800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:28.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.095+0000 7fc047fff700 1 -- 172.21.15.116:0/1800508738 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05800aa60 con 0x7fc06015c590 2023-05-12T09:08:28.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.095+0000 7fc047fff700 1 -- 172.21.15.116:0/1800508738 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05800abc0 con 0x7fc06015c590 2023-05-12T09:08:28.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.095+0000 7fc065bff700 1 -- 172.21.15.116:0/1800508738 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0600cd770 con 0x7fc06015c590 2023-05-12T09:08:28.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.095+0000 7fc047fff700 1 -- 172.21.15.116:0/1800508738 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc058012420 con 0x7fc06015c590 2023-05-12T09:08:28.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.095+0000 7fc065bff700 1 -- 172.21.15.116:0/1800508738 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0600cf560 con 0x7fc06015c590 2023-05-12T09:08:28.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.096+0000 7fc065bff700 1 -- 172.21.15.116:0/1800508738 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0600d01a0 con 0x7fc06015c590 2023-05-12T09:08:28.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.097+0000 7fc047fff700 1 -- 172.21.15.116:0/1800508738 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc058012580 con 0x7fc06015c590 2023-05-12T09:08:28.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.098+0000 7fc047fff700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc04c06ace0 0x7fc04c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.098+0000 7fc047fff700 1 -- 172.21.15.116:0/1800508738 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc0580899c0 con 0x7fc06015c590 2023-05-12T09:08:28.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.098+0000 7fc05f7fe700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc04c06ace0 0x7fc04c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.098+0000 7fc05f7fe700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc04c06ace0 0x7fc04c06d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc0600d2ce0 tx=0x7fc050008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:28.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.102+0000 7fc047fff700 1 -- 172.21.15.116:0/1800508738 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc0580547d0 con 0x7fc06015c590 2023-05-12T09:08:28.297 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.295+0000 7fc065bff700 1 -- 172.21.15.116:0/1800508738 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0600b51f0 con 0x7fc06015c590 2023-05-12T09:08:28.298 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.295+0000 7fc047fff700 1 -- 172.21.15.116:0/1800508738 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc058057df0 con 0x7fc06015c590 2023-05-12T09:08:28.298 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:28.300 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 -- 172.21.15.116:0/1800508738 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc04c06ace0 msgr2=0x7fc04c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc04c06ace0 0x7fc04c06d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc0600d2ce0 tx=0x7fc050008040 comp rx=0 tx=0).stop 2023-05-12T09:08:28.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 -- 172.21.15.116:0/1800508738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc06015c590 msgr2=0x7fc0600b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc06015c590 0x7fc0600b7ba0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc05800cc10 tx=0x7fc05800cf20 comp rx=0 tx=0).stop 2023-05-12T09:08:28.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 -- 172.21.15.116:0/1800508738 shutdown_connections 2023-05-12T09:08:28.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc06015c590 0x7fc0600b7ba0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc04c06ace0 0x7fc04c06d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc0600cf010 0x7fc0601f1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 --2- 172.21.15.116:0/1800508738 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc0600cfd80 0x7fc0600b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 -- 172.21.15.116:0/1800508738 >> 172.21.15.116:0/1800508738 conn(0x7fc060071b10 msgr2=0x7fc0600b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:28.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.297+0000 7fc065bff700 1 -- 172.21.15.116:0/1800508738 shutdown_connections 2023-05-12T09:08:28.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.298+0000 7fc065bff700 1 -- 172.21.15.116:0/1800508738 wait complete. 2023-05-12T09:08:28.317 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:28.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.501+0000 7f70049ff700 1 Processor -- start 2023-05-12T09:08:28.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.501+0000 7f70049ff700 1 -- start start 2023-05-12T09:08:28.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.502+0000 7f70049ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f70000b87a0 0x7f70000cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f70049ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7000160d40 0x7f70000d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f70049ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70000cdc60 con 0x7f70001601e0 2023-05-12T09:08:28.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f70049ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70000d02d0 con 0x7f70000b87a0 2023-05-12T09:08:28.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f70049ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70000d0cb0 con 0x7f7000160d40 2023-05-12T09:08:28.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f6ff7fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f70001601e0 0x7f7000160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36548/0 (socket says 172.21.15.116:36548) 2023-05-12T09:08:28.506 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f6ff7fff700 1 -- 172.21.15.116:0/245924235 learned_addr learned my addr 172.21.15.116:0/245924235 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:28.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f6ffe59c700 1 --2- 172.21.15.116:0/245924235 >> v2:172.21.15.182:3300/0 conn(0x7f70000b87a0 0x7f70000cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f6ffed9d700 1 --2- 172.21.15.116:0/245924235 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7000160d40 0x7f70000d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f6ffdd9b700 1 -- 172.21.15.116:0/245924235 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607812113 0 0) 0x7f70000cdc60 con 0x7f70001601e0 2023-05-12T09:08:28.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f6ffdd9b700 1 -- 172.21.15.116:0/245924235 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fec0035b0 con 0x7f70001601e0 2023-05-12T09:08:28.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f6ffe59c700 1 -- 172.21.15.116:0/245924235 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7000160d40 msgr2=0x7f70000d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:28.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f6ffe59c700 1 --2- 172.21.15.116:0/245924235 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7000160d40 0x7f70000d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f6ffe59c700 1 -- 172.21.15.116:0/245924235 >> v1:172.21.15.116:6789/0 conn(0x7f70001601e0 legacy=0x7f7000160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.503+0000 7f6ffe59c700 1 -- 172.21.15.116:0/245924235 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000cd6a0 con 0x7f70000b87a0 2023-05-12T09:08:28.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.504+0000 7f6ffe59c700 1 --2- 172.21.15.116:0/245924235 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70000b87a0 0x7f70000cfbf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009840 tx=0x7f6ff0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7732c256ee2074a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:28.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.504+0000 7f6ffdd9b700 1 -- 172.21.15.116:0/245924235 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0011830 con 0x7f70000b87a0 2023-05-12T09:08:28.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.504+0000 7f6ffdd9b700 1 -- 172.21.15.116:0/245924235 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff0011990 con 0x7f70000b87a0 2023-05-12T09:08:28.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.504+0000 7f6ffdd9b700 1 -- 172.21.15.116:0/245924235 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0011d20 con 0x7f70000b87a0 2023-05-12T09:08:28.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.504+0000 7f70049ff700 1 -- 172.21.15.116:0/245924235 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70000b87a0 msgr2=0x7f70000cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.504+0000 7f70049ff700 1 --2- 172.21.15.116:0/245924235 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70000b87a0 0x7f70000cfbf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009840 tx=0x7f6ff0009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:28.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.505+0000 7f70049ff700 1 -- 172.21.15.116:0/245924235 shutdown_connections 2023-05-12T09:08:28.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.505+0000 7f70049ff700 1 --2- 172.21.15.116:0/245924235 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7000160d40 0x7f70000d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.505+0000 7f70049ff700 1 --2- 172.21.15.116:0/245924235 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70000b87a0 0x7f70000cfbf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.505+0000 7f70049ff700 1 -- 172.21.15.116:0/245924235 >> 172.21.15.116:0/245924235 conn(0x7f7000071b10 msgr2=0x7f7000071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:28.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.505+0000 7f70049ff700 1 -- 172.21.15.116:0/245924235 shutdown_connections 2023-05-12T09:08:28.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.505+0000 7f70049ff700 1 -- 172.21.15.116:0/245924235 wait complete. 2023-05-12T09:08:28.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.506+0000 7f70049ff700 1 Processor -- start 2023-05-12T09:08:28.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.506+0000 7f70049ff700 1 -- start start 2023-05-12T09:08:28.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.507+0000 7f70049ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70000b87a0 0x7f70001544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.512 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.507+0000 7f70049ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70001601e0 0x7f700015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.507+0000 7f70049ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7000160d40 0x7f700015e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.507+0000 7f70049ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70000c7520 con 0x7f70000b87a0 2023-05-12T09:08:28.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.507+0000 7f70049ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7000154a30 con 0x7f70001601e0 2023-05-12T09:08:28.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.507+0000 7f70049ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70000c7940 con 0x7f7000160d40 2023-05-12T09:08:28.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ffe59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70000b87a0 0x7f70001544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ffe59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70000b87a0 0x7f70001544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39410/0 (socket says 172.21.15.116:39410) 2023-05-12T09:08:28.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ffe59c700 1 -- 172.21.15.116:0/620859294 learned_addr learned my addr 172.21.15.116:0/620859294 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:28.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ffe59c700 1 -- 172.21.15.116:0/620859294 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7000160d40 msgr2=0x7f700015e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ffe59c700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7000160d40 0x7f700015e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ffe59c700 1 -- 172.21.15.116:0/620859294 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70001601e0 msgr2=0x7f700015dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ffe59c700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70001601e0 0x7f700015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ffe59c700 1 -- 172.21.15.116:0/620859294 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff00094a0 con 0x7f70000b87a0 2023-05-12T09:08:28.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ffe59c700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70000b87a0 0x7f70001544f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ff00090b0 tx=0x7f6ff0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:28.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ff6ffd700 1 -- 172.21.15.116:0/620859294 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00036a0 con 0x7f70000b87a0 2023-05-12T09:08:28.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ff6ffd700 1 -- 172.21.15.116:0/620859294 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff001f070 con 0x7f70000b87a0 2023-05-12T09:08:28.514 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f70049ff700 1 -- 172.21.15.116:0/620859294 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70000d1640 con 0x7f70000b87a0 2023-05-12T09:08:28.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.508+0000 7f6ff6ffd700 1 -- 172.21.15.116:0/620859294 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0003a20 con 0x7f70000b87a0 2023-05-12T09:08:28.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.509+0000 7f70049ff700 1 -- 172.21.15.116:0/620859294 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70000cd980 con 0x7f70000b87a0 2023-05-12T09:08:28.515 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.510+0000 7f70049ff700 1 -- 172.21.15.116:0/620859294 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70000d17d0 con 0x7f70000b87a0 2023-05-12T09:08:28.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.510+0000 7f6ff6ffd700 1 -- 172.21.15.116:0/620859294 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ff0003b80 con 0x7f70000b87a0 2023-05-12T09:08:28.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.511+0000 7f6ff6ffd700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6fe006ace0 0x7f6fe006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.511+0000 7f6ff6ffd700 1 -- 172.21.15.116:0/620859294 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6ff0021070 con 0x7f70000b87a0 2023-05-12T09:08:28.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.511+0000 7f6ff7fff700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6fe006ace0 0x7f6fe006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.512+0000 7f6ff7fff700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6fe006ace0 0x7f6fe006d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f700015a470 tx=0x7f6fe80079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:28.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.516+0000 7f6ff6ffd700 1 -- 172.21.15.116:0/620859294 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6ff0055df0 con 0x7f70000b87a0 2023-05-12T09:08:28.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.716+0000 7f70049ff700 1 -- 172.21.15.116:0/620859294 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70000c7660 con 0x7f70000b87a0 2023-05-12T09:08:28.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.716+0000 7f6ff6ffd700 1 -- 172.21.15.116:0/620859294 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70000c7660 con 0x7f70000b87a0 2023-05-12T09:08:28.720 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:28.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 -- 172.21.15.116:0/620859294 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6fe006ace0 msgr2=0x7f6fe006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6fe006ace0 0x7f6fe006d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f700015a470 tx=0x7f6fe80079c0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 -- 172.21.15.116:0/620859294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70000b87a0 msgr2=0x7f70001544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70000b87a0 0x7f70001544f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ff00090b0 tx=0x7f6ff0004750 comp rx=0 tx=0).stop 2023-05-12T09:08:28.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 -- 172.21.15.116:0/620859294 shutdown_connections 2023-05-12T09:08:28.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6fe006ace0 0x7f6fe006d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7000160d40 0x7f700015e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70000b87a0 0x7f70001544f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 --2- 172.21.15.116:0/620859294 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f70001601e0 0x7f700015dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 -- 172.21.15.116:0/620859294 >> 172.21.15.116:0/620859294 conn(0x7f7000071b10 msgr2=0x7f7000160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:28.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 -- 172.21.15.116:0/620859294 shutdown_connections 2023-05-12T09:08:28.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.719+0000 7f70049ff700 1 -- 172.21.15.116:0/620859294 wait complete. 2023-05-12T09:08:28.739 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:28.926 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.923+0000 7f2f73dff700 1 Processor -- start 2023-05-12T09:08:28.927 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.923+0000 7f2f73dff700 1 -- start start 2023-05-12T09:08:28.927 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.925+0000 7f2f73dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f2f6c06b4f0 0x7f2f6c06b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.928 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.925+0000 7f2f73dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c0b26f0 con 0x7f2f6c0d0130 2023-05-12T09:08:28.928 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.925+0000 7f2f73dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c06be00 con 0x7f2f6c0cbf90 2023-05-12T09:08:28.928 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.925+0000 7f2f73dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c0cfb60 con 0x7f2f6c06b4f0 2023-05-12T09:08:28.928 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.925+0000 7f2f7139a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f2f6c0d0130 0x7f2f6c0cf350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36564/0 (socket says 172.21.15.116:36564) 2023-05-12T09:08:28.928 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.925+0000 7f2f7139a700 1 -- 172.21.15.116:0/2830444423 learned_addr learned my addr 172.21.15.116:0/2830444423 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:28.930 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.925+0000 7f2f71b9b700 1 --2- 172.21.15.116:0/2830444423 >> v2:172.21.15.182:3300/0 conn(0x7f2f6c06b4f0 0x7f2f6c06b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.925+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915906793 0 0) 0x7f2f6c0b26f0 con 0x7f2f6c0d0130 2023-05-12T09:08:28.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.925+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f580035b0 con 0x7f2f6c0d0130 2023-05-12T09:08:28.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196711481 0 0) 0x7f2f6c06be00 con 0x7f2f6c0cbf90 2023-05-12T09:08:28.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f6c0b26f0 con 0x7f2f6c0cbf90 2023-05-12T09:08:28.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2265288450 0 0) 0x7f2f580035b0 con 0x7f2f6c0d0130 2023-05-12T09:08:28.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 >> v2:172.21.15.182:3300/0 conn(0x7f2f6c06b4f0 msgr2=0x7f2f6c06b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:28.931 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 --2- 172.21.15.116:0/2830444423 >> v2:172.21.15.182:3300/0 conn(0x7f2f6c06b4f0 0x7f2f6c06b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 >> v1:172.21.15.182:6789/0 conn(0x7f2f6c0cbf90 legacy=0x7f2f6c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0cfe40 con 0x7f2f6c0d0130 2023-05-12T09:08:28.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f2f5c001670 con 0x7f2f6c0d0130 2023-05-12T09:08:28.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 >> v1:172.21.15.116:6789/0 conn(0x7f2f6c0d0130 legacy=0x7f2f6c0cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58003be0 0x7f2f58003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2f58004850 0x7f2f58004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2f580052c0 0x7f2f5800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0cfb60 con 0x7f2f58003be0 2023-05-12T09:08:28.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5800c200 con 0x7f2f58004850 2023-05-12T09:08:28.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5800c3c0 con 0x7f2f580052c0 2023-05-12T09:08:28.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f71b9b700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58003be0 0x7f2f58003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f7139a700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2f58004850 0x7f2f58004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.934 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f7239c700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2f580052c0 0x7f2f5800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.934 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f71b9b700 1 -- 172.21.15.116:0/2830444423 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2f580052c0 msgr2=0x7f2f5800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:28.934 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f71b9b700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2f580052c0 0x7f2f5800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.934 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f71b9b700 1 -- 172.21.15.116:0/2830444423 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2f58004850 msgr2=0x7f2f58004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:28.934 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f71b9b700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2f58004850 0x7f2f58004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.934 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f71b9b700 1 -- 172.21.15.116:0/2830444423 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580035b0 con 0x7f2f58003be0 2023-05-12T09:08:28.934 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.926+0000 7f2f7239c700 1 -- 172.21.15.116:0/2830444423 reap_dead start 2023-05-12T09:08:28.934 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.927+0000 7f2f71b9b700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58003be0 0x7f2f58003fd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009b60 tx=0x7f2f58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1129d5c2de7ae6a0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:28.935 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.927+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800e6c0 con 0x7f2f58003be0 2023-05-12T09:08:28.935 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.927+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6800e820 con 0x7f2f58003be0 2023-05-12T09:08:28.935 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.927+0000 7f2f70b99700 1 -- 172.21.15.116:0/2830444423 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800eb90 con 0x7f2f58003be0 2023-05-12T09:08:28.935 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.927+0000 7f2f73dff700 1 -- 172.21.15.116:0/2830444423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58003be0 msgr2=0x7f2f58003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.935 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.927+0000 7f2f73dff700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58003be0 0x7f2f58003fd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009b60 tx=0x7f2f58005880 comp rx=0 tx=0).stop 2023-05-12T09:08:28.935 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.927+0000 7f2f73dff700 1 -- 172.21.15.116:0/2830444423 shutdown_connections 2023-05-12T09:08:28.935 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.927+0000 7f2f73dff700 1 --2- 172.21.15.116:0/2830444423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58003be0 0x7f2f58003fd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.936 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.927+0000 7f2f73dff700 1 -- 172.21.15.116:0/2830444423 >> 172.21.15.116:0/2830444423 conn(0x7f2f6c09a090 msgr2=0x7f2f6c0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:28.936 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.928+0000 7f2f73dff700 1 -- 172.21.15.116:0/2830444423 shutdown_connections 2023-05-12T09:08:28.936 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.928+0000 7f2f73dff700 1 -- 172.21.15.116:0/2830444423 wait complete. 2023-05-12T09:08:28.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.929+0000 7f2f73dff700 1 Processor -- start 2023-05-12T09:08:28.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.929+0000 7f2f73dff700 1 -- start start 2023-05-12T09:08:28.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.930+0000 7f2f73dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2f58003be0 0x7f2f6c1f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.930+0000 7f2f73dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2f6c0b54d0 0x7f2f6c0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.930+0000 7f2f73dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f6c1f1b70 0x7f2f6c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.930+0000 7f2f73dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c5940 con 0x7f2f6c1f1b70 2023-05-12T09:08:28.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.930+0000 7f2f73dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c158ba0 con 0x7f2f58003be0 2023-05-12T09:08:28.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.930+0000 7f2f73dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c1f6860 con 0x7f2f6c0b54d0 2023-05-12T09:08:28.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.930+0000 7f2f7239c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f6c1f1b70 0x7f2f6c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f7239c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f6c1f1b70 0x7f2f6c15b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39426/0 (socket says 172.21.15.116:39426) 2023-05-12T09:08:28.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f7239c700 1 -- 172.21.15.116:0/589994283 learned_addr learned my addr 172.21.15.116:0/589994283 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:28.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f7139a700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2f6c0b54d0 0x7f2f6c0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f71b9b700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2f58003be0 0x7f2f6c1f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f7239c700 1 -- 172.21.15.116:0/589994283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2f6c0b54d0 msgr2=0x7f2f6c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.940 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f7239c700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2f6c0b54d0 0x7f2f6c0c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.940 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f7239c700 1 -- 172.21.15.116:0/589994283 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2f58003be0 msgr2=0x7f2f6c1f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:28.940 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f7239c700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2f58003be0 0x7f2f6c1f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:28.940 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f7239c700 1 -- 172.21.15.116:0/589994283 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0cb790 con 0x7f2f6c1f1b70 2023-05-12T09:08:28.940 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f7239c700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f6c1f1b70 0x7f2f6c15b7c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c072650 tx=0x7f2f6400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:28.940 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f627fc700 1 -- 172.21.15.116:0/589994283 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64003c10 con 0x7f2f6c1f1b70 2023-05-12T09:08:28.940 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f627fc700 1 -- 172.21.15.116:0/589994283 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f64003d90 con 0x7f2f6c1f1b70 2023-05-12T09:08:28.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f73dff700 1 -- 172.21.15.116:0/589994283 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c0cb4b0 con 0x7f2f6c1f1b70 2023-05-12T09:08:28.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.931+0000 7f2f627fc700 1 -- 172.21.15.116:0/589994283 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64005310 con 0x7f2f6c1f1b70 2023-05-12T09:08:28.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.932+0000 7f2f73dff700 1 -- 172.21.15.116:0/589994283 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c0cba70 con 0x7f2f6c1f1b70 2023-05-12T09:08:28.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.933+0000 7f2f73dff700 1 -- 172.21.15.116:0/589994283 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c0c5a80 con 0x7f2f6c1f1b70 2023-05-12T09:08:28.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.933+0000 7f2f627fc700 1 -- 172.21.15.116:0/589994283 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f64005470 con 0x7f2f6c1f1b70 2023-05-12T09:08:28.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.934+0000 7f2f627fc700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2f5006ace0 0x7f2f5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:28.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.934+0000 7f2f627fc700 1 -- 172.21.15.116:0/589994283 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2f640896c0 con 0x7f2f6c1f1b70 2023-05-12T09:08:28.941 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.935+0000 7f2f71b9b700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2f5006ace0 0x7f2f5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:28.942 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.935+0000 7f2f71b9b700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2f5006ace0 0x7f2f5006d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f680090b0 tx=0x7f2f6801f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:28.942 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:28.939+0000 7f2f627fc700 1 -- 172.21.15.116:0/589994283 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2f6c0c5a80 con 0x7f2f6c1f1b70 2023-05-12T09:08:29.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.134+0000 7f2f73dff700 1 -- 172.21.15.116:0/589994283 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2f6c0c5a80 con 0x7f2f6c1f1b70 2023-05-12T09:08:29.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.135+0000 7f2f627fc700 1 -- 172.21.15.116:0/589994283 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2f6c0c5a80 con 0x7f2f6c1f1b70 2023-05-12T09:08:29.138 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:29.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 -- 172.21.15.116:0/589994283 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2f5006ace0 msgr2=0x7f2f5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2f5006ace0 0x7f2f5006d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f680090b0 tx=0x7f2f6801f040 comp rx=0 tx=0).stop 2023-05-12T09:08:29.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 -- 172.21.15.116:0/589994283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f6c1f1b70 msgr2=0x7f2f6c15b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f6c1f1b70 0x7f2f6c15b7c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c072650 tx=0x7f2f6400ee70 comp rx=0 tx=0).stop 2023-05-12T09:08:29.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 -- 172.21.15.116:0/589994283 shutdown_connections 2023-05-12T09:08:29.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f6c1f1b70 0x7f2f6c15b7c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2f58003be0 0x7f2f6c1f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2f5006ace0 0x7f2f5006d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 --2- 172.21.15.116:0/589994283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2f6c0b54d0 0x7f2f6c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 -- 172.21.15.116:0/589994283 >> 172.21.15.116:0/589994283 conn(0x7f2f6c09a090 msgr2=0x7f2f6c06fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:29.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 -- 172.21.15.116:0/589994283 shutdown_connections 2023-05-12T09:08:29.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.137+0000 7f2f73dff700 1 -- 172.21.15.116:0/589994283 wait complete. 2023-05-12T09:08:29.157 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-12T09:08:29.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.339+0000 7f1c191ff700 1 Processor -- start 2023-05-12T09:08:29.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.339+0000 7f1c191ff700 1 -- start start 2023-05-12T09:08:29.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.340+0000 7f1c191ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f1c140b87a0 0x7f1c140cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.340+0000 7f1c191ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c140d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.340+0000 7f1c191ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c140cdc60 con 0x7f1c141601e0 2023-05-12T09:08:29.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.340+0000 7f1c191ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c140d02d0 con 0x7f1c140b87a0 2023-05-12T09:08:29.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.340+0000 7f1c191ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140d0cb0 con 0x7f1c14160d40 2023-05-12T09:08:29.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.341+0000 7f1c1359e700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c140d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.341+0000 7f1c0bfff700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f1c141601e0 0x7f1c14160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:55620/0 (socket says 172.21.15.116:55620) 2023-05-12T09:08:29.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.341+0000 7f1c1359e700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c140d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:45000/0 (socket says 172.21.15.116:45000) 2023-05-12T09:08:29.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.341+0000 7f1c12d9d700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f1c140b87a0 0x7f1c140cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.341+0000 7f1c0bfff700 1 -- 172.21.15.116:0/3548744518 learned_addr learned my addr 172.21.15.116:0/3548744518 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:29.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.341+0000 7f1c1359e700 1 -- 172.21.15.116:0/3548744518 >> v2:172.21.15.182:3300/0 conn(0x7f1c140b87a0 msgr2=0x7f1c140cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:29.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.341+0000 7f1c1359e700 1 --2- 172.21.15.116:0/3548744518 >> v2:172.21.15.182:3300/0 conn(0x7f1c140b87a0 0x7f1c140cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.341+0000 7f1c1359e700 1 -- 172.21.15.116:0/3548744518 >> v1:172.21.15.182:6789/0 conn(0x7f1c141601e0 legacy=0x7f1c14160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.341+0000 7f1c1259c700 1 -- 172.21.15.116:0/3548744518 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416072756 0 0) 0x7f1c140cdc60 con 0x7f1c141601e0 2023-05-12T09:08:29.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.341+0000 7f1c1359e700 1 -- 172.21.15.116:0/3548744518 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140cd6a0 con 0x7f1c14160d40 2023-05-12T09:08:29.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.342+0000 7f1c1359e700 1 --2- 172.21.15.116:0/3548744518 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c140d1100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009d90 tx=0x7f1c0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=733f440a301c8759 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:29.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.342+0000 7f1c1259c700 1 -- 172.21.15.116:0/3548744518 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00e070 con 0x7f1c14160d40 2023-05-12T09:08:29.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.342+0000 7f1c1259c700 1 -- 172.21.15.116:0/3548744518 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c00bb20 con 0x7f1c14160d40 2023-05-12T09:08:29.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.342+0000 7f1c1259c700 1 -- 172.21.15.116:0/3548744518 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c012430 con 0x7f1c14160d40 2023-05-12T09:08:29.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.342+0000 7f1c191ff700 1 -- 172.21.15.116:0/3548744518 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 msgr2=0x7f1c140d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.342+0000 7f1c191ff700 1 --2- 172.21.15.116:0/3548744518 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c140d1100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009d90 tx=0x7f1c0c00b330 comp rx=0 tx=0).stop 2023-05-12T09:08:29.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.343+0000 7f1c191ff700 1 -- 172.21.15.116:0/3548744518 shutdown_connections 2023-05-12T09:08:29.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.343+0000 7f1c191ff700 1 --2- 172.21.15.116:0/3548744518 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c140d1100 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.343+0000 7f1c191ff700 1 --2- 172.21.15.116:0/3548744518 >> v2:172.21.15.182:3300/0 conn(0x7f1c140b87a0 0x7f1c140cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.343+0000 7f1c191ff700 1 -- 172.21.15.116:0/3548744518 >> 172.21.15.116:0/3548744518 conn(0x7f1c14071b10 msgr2=0x7f1c14071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:29.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.343+0000 7f1c191ff700 1 -- 172.21.15.116:0/3548744518 shutdown_connections 2023-05-12T09:08:29.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.343+0000 7f1c191ff700 1 -- 172.21.15.116:0/3548744518 wait complete. 2023-05-12T09:08:29.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.344+0000 7f1c191ff700 1 Processor -- start 2023-05-12T09:08:29.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.344+0000 7f1c191ff700 1 -- start start 2023-05-12T09:08:29.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.345+0000 7f1c191ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1c140b87a0 0x7f1c140c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.345+0000 7f1c191ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c141601e0 0x7f1c14151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.345+0000 7f1c191ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c1415f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.345+0000 7f1c191ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c14151970 con 0x7f1c141601e0 2023-05-12T09:08:29.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.345+0000 7f1c191ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140ca560 con 0x7f1c140b87a0 2023-05-12T09:08:29.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.345+0000 7f1c191ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140ca840 con 0x7f1c14160d40 2023-05-12T09:08:29.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c0bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c141601e0 0x7f1c14151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c0bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c141601e0 0x7f1c14151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39430/0 (socket says 172.21.15.116:39430) 2023-05-12T09:08:29.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c0bfff700 1 -- 172.21.15.116:0/1812441904 learned_addr learned my addr 172.21.15.116:0/1812441904 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:29.353 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c12d9d700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1c140b87a0 0x7f1c140c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.353 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c1359e700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c1415f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.353 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c0bfff700 1 -- 172.21.15.116:0/1812441904 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 msgr2=0x7f1c1415f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.353 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c0bfff700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c1415f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.353 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c0bfff700 1 -- 172.21.15.116:0/1812441904 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1c140b87a0 msgr2=0x7f1c140c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.353 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c0bfff700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1c140b87a0 0x7f1c140c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.353 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c0bfff700 1 -- 172.21.15.116:0/1812441904 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c009a70 con 0x7f1c141601e0 2023-05-12T09:08:29.353 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c1359e700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c1415f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:29.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.346+0000 7f1c0bfff700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c141601e0 0x7f1c14151430 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0011e0 tx=0x7f1bfc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:29.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.347+0000 7f1c0b7fe700 1 -- 172.21.15.116:0/1812441904 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc004c80 con 0x7f1c141601e0 2023-05-12T09:08:29.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.347+0000 7f1c0b7fe700 1 -- 172.21.15.116:0/1812441904 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc004de0 con 0x7f1c141601e0 2023-05-12T09:08:29.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.347+0000 7f1c191ff700 1 -- 172.21.15.116:0/1812441904 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c140d1640 con 0x7f1c141601e0 2023-05-12T09:08:29.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.347+0000 7f1c0b7fe700 1 -- 172.21.15.116:0/1812441904 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc007310 con 0x7f1c141601e0 2023-05-12T09:08:29.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.347+0000 7f1c191ff700 1 -- 172.21.15.116:0/1812441904 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c140cd980 con 0x7f1c141601e0 2023-05-12T09:08:29.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.348+0000 7f1c191ff700 1 -- 172.21.15.116:0/1812441904 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c140d17d0 con 0x7f1c141601e0 2023-05-12T09:08:29.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.349+0000 7f1c0b7fe700 1 -- 172.21.15.116:0/1812441904 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1bfc007470 con 0x7f1c141601e0 2023-05-12T09:08:29.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.349+0000 7f1c0b7fe700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1bf406ace0 0x7f1bf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.350+0000 7f1c0b7fe700 1 -- 172.21.15.116:0/1812441904 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1bfc089630 con 0x7f1c141601e0 2023-05-12T09:08:29.355 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.350+0000 7f1c12d9d700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1bf406ace0 0x7f1bf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.356 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.350+0000 7f1c12d9d700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1bf406ace0 0x7f1bf406d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009be0 tx=0x7f1c04009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:29.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.354+0000 7f1c0b7fe700 1 -- 172.21.15.116:0/1812441904 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1bfc054280 con 0x7f1c141601e0 2023-05-12T09:08:29.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.562+0000 7f1c191ff700 1 -- 172.21.15.116:0/1812441904 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1c14074430 con 0x7f1c141601e0 2023-05-12T09:08:29.565 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.562+0000 7f1c0b7fe700 1 -- 172.21.15.116:0/1812441904 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1bfc0578a0 con 0x7f1c141601e0 2023-05-12T09:08:29.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.564+0000 7f1c191ff700 1 -- 172.21.15.116:0/1812441904 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1bf406ace0 msgr2=0x7f1bf406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.564+0000 7f1c191ff700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1bf406ace0 0x7f1bf406d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009be0 tx=0x7f1c04009210 comp rx=0 tx=0).stop 2023-05-12T09:08:29.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.564+0000 7f1c191ff700 1 -- 172.21.15.116:0/1812441904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c141601e0 msgr2=0x7f1c14151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.564+0000 7f1c191ff700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c141601e0 0x7f1c14151430 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0011e0 tx=0x7f1bfc00ca30 comp rx=0 tx=0).stop 2023-05-12T09:08:29.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.565+0000 7f1c191ff700 1 -- 172.21.15.116:0/1812441904 shutdown_connections 2023-05-12T09:08:29.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.565+0000 7f1c191ff700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1bf406ace0 0x7f1bf406d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.565+0000 7f1c191ff700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1c14160d40 0x7f1c1415f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.565+0000 7f1c191ff700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1c140b87a0 0x7f1c140c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.565+0000 7f1c191ff700 1 --2- 172.21.15.116:0/1812441904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c141601e0 0x7f1c14151430 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.565+0000 7f1c191ff700 1 -- 172.21.15.116:0/1812441904 >> 172.21.15.116:0/1812441904 conn(0x7f1c14071b10 msgr2=0x7f1c140b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:29.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.565+0000 7f1c191ff700 1 -- 172.21.15.116:0/1812441904 shutdown_connections 2023-05-12T09:08:29.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.565+0000 7f1c191ff700 1 -- 172.21.15.116:0/1812441904 wait complete. 2023-05-12T09:08:29.571 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2023-05-12T09:08:29.585 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:08:29.585 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:29.632 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:29.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.814+0000 7f345e9ff700 1 Processor -- start 2023-05-12T09:08:29.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.814+0000 7f345e9ff700 1 -- start start 2023-05-12T09:08:29.818 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.815+0000 7f345e9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34580adf70 0x7f34580cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.818 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.815+0000 7f345e9ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f345815cf10 0x7f345806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.815+0000 7f345e9ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34580cc9e0 con 0x7f34580cd760 2023-05-12T09:08:29.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.815+0000 7f345e9ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345815de20 con 0x7f345815cf10 2023-05-12T09:08:29.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.815+0000 7f345e9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345815d860 con 0x7f34580adf70 2023-05-12T09:08:29.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.815+0000 7f3457fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f34580cd760 0x7f34580cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36578/0 (socket says 172.21.15.116:36578) 2023-05-12T09:08:29.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.815+0000 7f3457fff700 1 -- 172.21.15.116:0/2719138217 learned_addr learned my addr 172.21.15.116:0/2719138217 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:29.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.816+0000 7f345cf9c700 1 --2- 172.21.15.116:0/2719138217 >> v2:172.21.15.116:3300/0 conn(0x7f345815cf10 0x7f345806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.816+0000 7f34577fe700 1 --2- 172.21.15.116:0/2719138217 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34580adf70 0x7f34580cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.816+0000 7f3456ffd700 1 -- 172.21.15.116:0/2719138217 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532459276 0 0) 0x7f34580cc9e0 con 0x7f34580cd760 2023-05-12T09:08:29.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.816+0000 7f3456ffd700 1 -- 172.21.15.116:0/2719138217 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34400057c0 con 0x7f34580cd760 2023-05-12T09:08:29.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.816+0000 7f345cf9c700 1 -- 172.21.15.116:0/2719138217 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34580adf70 msgr2=0x7f34580cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:29.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.816+0000 7f345cf9c700 1 --2- 172.21.15.116:0/2719138217 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34580adf70 0x7f34580cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.816+0000 7f345cf9c700 1 -- 172.21.15.116:0/2719138217 >> v1:172.21.15.116:6789/0 conn(0x7f34580cd760 legacy=0x7f34580cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.816+0000 7f345cf9c700 1 -- 172.21.15.116:0/2719138217 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345815db40 con 0x7f345815cf10 2023-05-12T09:08:29.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.816+0000 7f345cf9c700 1 --2- 172.21.15.116:0/2719138217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 0x7f345806c6c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3450009d90 tx=0x7f345000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a00078c47e0d980 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:29.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f3456ffd700 1 -- 172.21.15.116:0/2719138217 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345000e070 con 0x7f345815cf10 2023-05-12T09:08:29.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f3456ffd700 1 -- 172.21.15.116:0/2719138217 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345000bb20 con 0x7f345815cf10 2023-05-12T09:08:29.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f3456ffd700 1 -- 172.21.15.116:0/2719138217 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450012430 con 0x7f345815cf10 2023-05-12T09:08:29.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f345e9ff700 1 -- 172.21.15.116:0/2719138217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 msgr2=0x7f345806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f345e9ff700 1 --2- 172.21.15.116:0/2719138217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 0x7f345806c6c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3450009d90 tx=0x7f345000b330 comp rx=0 tx=0).stop 2023-05-12T09:08:29.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f345e9ff700 1 -- 172.21.15.116:0/2719138217 shutdown_connections 2023-05-12T09:08:29.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f345e9ff700 1 --2- 172.21.15.116:0/2719138217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 0x7f345806c6c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f345e9ff700 1 --2- 172.21.15.116:0/2719138217 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34580adf70 0x7f34580cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f345e9ff700 1 -- 172.21.15.116:0/2719138217 >> 172.21.15.116:0/2719138217 conn(0x7f34580cf720 msgr2=0x7f34580cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:29.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f345e9ff700 1 -- 172.21.15.116:0/2719138217 shutdown_connections 2023-05-12T09:08:29.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.817+0000 7f345e9ff700 1 -- 172.21.15.116:0/2719138217 wait complete. 2023-05-12T09:08:29.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.819+0000 7f345e9ff700 1 Processor -- start 2023-05-12T09:08:29.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.819+0000 7f345e9ff700 1 -- start start 2023-05-12T09:08:29.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.820+0000 7f345e9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34580adf70 0x7f34580ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.820+0000 7f345e9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34580cd760 0x7f345814be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.820+0000 7f345e9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 0x7f345815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.820+0000 7f345e9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580b3540 con 0x7f345815cf10 2023-05-12T09:08:29.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.820+0000 7f345e9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580b1e60 con 0x7f34580adf70 2023-05-12T09:08:29.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.820+0000 7f345e9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34580b2140 con 0x7f34580cd760 2023-05-12T09:08:29.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.820+0000 7f345cf9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 0x7f345815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.820+0000 7f345cf9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 0x7f345815b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39450/0 (socket says 172.21.15.116:39450) 2023-05-12T09:08:29.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.820+0000 7f345cf9c700 1 -- 172.21.15.116:0/2756447414 learned_addr learned my addr 172.21.15.116:0/2756447414 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:29.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f3457fff700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34580adf70 0x7f34580ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f34577fe700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34580cd760 0x7f345814be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f345cf9c700 1 -- 172.21.15.116:0/2756447414 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34580cd760 msgr2=0x7f345814be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f345cf9c700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34580cd760 0x7f345814be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f345cf9c700 1 -- 172.21.15.116:0/2756447414 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34580adf70 msgr2=0x7f34580ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:29.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f345cf9c700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34580adf70 0x7f34580ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:29.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f345cf9c700 1 -- 172.21.15.116:0/2756447414 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3450009a70 con 0x7f345815cf10 2023-05-12T09:08:29.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f345cf9c700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 0x7f345815b5e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f345000b370 tx=0x7f3450004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:29.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f3454ff9700 1 -- 172.21.15.116:0/2756447414 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450012430 con 0x7f345815cf10 2023-05-12T09:08:29.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f3454ff9700 1 -- 172.21.15.116:0/2756447414 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3450020070 con 0x7f345815cf10 2023-05-12T09:08:29.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f3454ff9700 1 -- 172.21.15.116:0/2756447414 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450004280 con 0x7f345815cf10 2023-05-12T09:08:29.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f345e9ff700 1 -- 172.21.15.116:0/2756447414 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3458071600 con 0x7f345815cf10 2023-05-12T09:08:29.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.821+0000 7f345e9ff700 1 -- 172.21.15.116:0/2756447414 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34580cc670 con 0x7f345815cf10 2023-05-12T09:08:29.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.822+0000 7f345e9ff700 1 -- 172.21.15.116:0/2756447414 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34580cd3b0 con 0x7f345815cf10 2023-05-12T09:08:29.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.823+0000 7f3454ff9700 1 -- 172.21.15.116:0/2756447414 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34500043e0 con 0x7f345815cf10 2023-05-12T09:08:29.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.824+0000 7f3454ff9700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f344406ad10 0x7f344406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:29.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.824+0000 7f3454ff9700 1 -- 172.21.15.116:0/2756447414 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3450022070 con 0x7f345815cf10 2023-05-12T09:08:29.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.824+0000 7f3457fff700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f344406ad10 0x7f344406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:29.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.825+0000 7f3457fff700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f344406ad10 0x7f344406d1c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f34480011e0 tx=0x7f3448009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:29.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:29.828+0000 7f3454ff9700 1 -- 172.21.15.116:0/2756447414 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f34500561d0 con 0x7f345815cf10 2023-05-12T09:08:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.026+0000 7f345e9ff700 1 -- 172.21.15.116:0/2756447414 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3458071b50 con 0x7f345815cf10 2023-05-12T09:08:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.027+0000 7f3454ff9700 1 -- 172.21.15.116:0/2756447414 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7f34500597f0 con 0x7f345815cf10 2023-05-12T09:08:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:30.031 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:30.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 -- 172.21.15.116:0/2756447414 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f344406ad10 msgr2=0x7f344406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f344406ad10 0x7f344406d1c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f34480011e0 tx=0x7f3448009040 comp rx=0 tx=0).stop 2023-05-12T09:08:30.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 -- 172.21.15.116:0/2756447414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 msgr2=0x7f345815b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 0x7f345815b5e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f345000b370 tx=0x7f3450004ad0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 -- 172.21.15.116:0/2756447414 shutdown_connections 2023-05-12T09:08:30.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f345815cf10 0x7f345815b5e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f34580adf70 0x7f34580ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f344406ad10 0x7f344406d1c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 --2- 172.21.15.116:0/2756447414 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f34580cd760 0x7f345814be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 -- 172.21.15.116:0/2756447414 >> 172.21.15.116:0/2756447414 conn(0x7f34580cf720 msgr2=0x7f34580cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:30.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 -- 172.21.15.116:0/2756447414 shutdown_connections 2023-05-12T09:08:30.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.030+0000 7f345e9ff700 1 -- 172.21.15.116:0/2756447414 wait complete. 2023-05-12T09:08:30.050 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:30.052 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:30.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.237+0000 7f2dd85ff700 1 Processor -- start 2023-05-12T09:08:30.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.237+0000 7f2dd85ff700 1 -- start start 2023-05-12T09:08:30.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.238+0000 7f2dd85ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2dd00cd760 0x7f2dd00cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.238+0000 7f2dd85ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f2dd015cf10 0x7f2dd006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.238+0000 7f2dd85ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd00cc9e0 con 0x7f2dd00adf70 2023-05-12T09:08:30.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.238+0000 7f2dd85ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd00cd580 con 0x7f2dd00cd760 2023-05-12T09:08:30.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.238+0000 7f2dd85ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd015de20 con 0x7f2dd015cf10 2023-05-12T09:08:30.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd639b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2dd00cd760 0x7f2dd00cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd5b9a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f2dd00adf70 0x7f2dd00cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36590/0 (socket says 172.21.15.116:36590) 2023-05-12T09:08:30.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd5b9a700 1 -- 172.21.15.116:0/1998622514 learned_addr learned my addr 172.21.15.116:0/1998622514 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:30.243 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd6b9c700 1 --2- 172.21.15.116:0/1998622514 >> v2:172.21.15.182:3300/0 conn(0x7f2dd015cf10 0x7f2dd006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd639b700 1 -- 172.21.15.116:0/1998622514 >> v2:172.21.15.182:3300/0 conn(0x7f2dd015cf10 msgr2=0x7f2dd006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:30.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd639b700 1 --2- 172.21.15.116:0/1998622514 >> v2:172.21.15.182:3300/0 conn(0x7f2dd015cf10 0x7f2dd006c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd639b700 1 -- 172.21.15.116:0/1998622514 >> v1:172.21.15.116:6789/0 conn(0x7f2dd00adf70 legacy=0x7f2dd00cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd639b700 1 -- 172.21.15.116:0/1998622514 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd00ce070 con 0x7f2dd00cd760 2023-05-12T09:08:30.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd5399700 1 -- 172.21.15.116:0/1998622514 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691904815 0 0) 0x7f2dd00cc9e0 con 0x7f2dd00adf70 2023-05-12T09:08:30.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd639b700 1 --2- 172.21.15.116:0/1998622514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 0x7f2dd00cdb30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0072030 tx=0x7f2dcc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e124db86f1030eb server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:30.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.239+0000 7f2dd5399700 1 -- 172.21.15.116:0/1998622514 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc011830 con 0x7f2dd00cd760 2023-05-12T09:08:30.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.240+0000 7f2dd5399700 1 -- 172.21.15.116:0/1998622514 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc011990 con 0x7f2dd00cd760 2023-05-12T09:08:30.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.240+0000 7f2dd5399700 1 -- 172.21.15.116:0/1998622514 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc011d20 con 0x7f2dd00cd760 2023-05-12T09:08:30.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.240+0000 7f2dd85ff700 1 -- 172.21.15.116:0/1998622514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 msgr2=0x7f2dd00cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.240+0000 7f2dd85ff700 1 --2- 172.21.15.116:0/1998622514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 0x7f2dd00cdb30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0072030 tx=0x7f2dcc009b20 comp rx=0 tx=0).stop 2023-05-12T09:08:30.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.240+0000 7f2dd85ff700 1 -- 172.21.15.116:0/1998622514 shutdown_connections 2023-05-12T09:08:30.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.240+0000 7f2dd85ff700 1 --2- 172.21.15.116:0/1998622514 >> v2:172.21.15.182:3300/0 conn(0x7f2dd015cf10 0x7f2dd006c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.245 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.240+0000 7f2dd85ff700 1 --2- 172.21.15.116:0/1998622514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 0x7f2dd00cdb30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.240+0000 7f2dd85ff700 1 -- 172.21.15.116:0/1998622514 >> 172.21.15.116:0/1998622514 conn(0x7f2dd00cf720 msgr2=0x7f2dd00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:30.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.240+0000 7f2dd85ff700 1 -- 172.21.15.116:0/1998622514 shutdown_connections 2023-05-12T09:08:30.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.240+0000 7f2dd85ff700 1 -- 172.21.15.116:0/1998622514 wait complete. 2023-05-12T09:08:30.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.242+0000 7f2dd85ff700 1 Processor -- start 2023-05-12T09:08:30.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.242+0000 7f2dd85ff700 1 -- start start 2023-05-12T09:08:30.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd85ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2dd00adf70 0x7f2dd014cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd85ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 0x7f2dd00ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd85ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2dd015cf10 0x7f2dd00ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd85ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00c2530 con 0x7f2dd00cd760 2023-05-12T09:08:30.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd85ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00c7f30 con 0x7f2dd00adf70 2023-05-12T09:08:30.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd85ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00c8210 con 0x7f2dd015cf10 2023-05-12T09:08:30.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd5b9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 0x7f2dd00ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd5b9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 0x7f2dd00ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39464/0 (socket says 172.21.15.116:39464) 2023-05-12T09:08:30.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd5b9a700 1 -- 172.21.15.116:0/2418080905 learned_addr learned my addr 172.21.15.116:0/2418080905 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:30.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd6b9c700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2dd015cf10 0x7f2dd00ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd639b700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2dd00adf70 0x7f2dd014cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd5b9a700 1 -- 172.21.15.116:0/2418080905 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2dd015cf10 msgr2=0x7f2dd00ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd5b9a700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2dd015cf10 0x7f2dd00ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd5b9a700 1 -- 172.21.15.116:0/2418080905 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2dd00adf70 msgr2=0x7f2dd014cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd5b9a700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2dd00adf70 0x7f2dd014cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.243+0000 7f2dd5b9a700 1 -- 172.21.15.116:0/2418080905 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc0094a0 con 0x7f2dd00cd760 2023-05-12T09:08:30.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.244+0000 7f2dd5b9a700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 0x7f2dd00ac860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000c700 tx=0x7f2dc000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:30.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.244+0000 7f2dc6ffd700 1 -- 172.21.15.116:0/2418080905 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00074e0 con 0x7f2dd00cd760 2023-05-12T09:08:30.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.244+0000 7f2dc6ffd700 1 -- 172.21.15.116:0/2418080905 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0007640 con 0x7f2dd00cd760 2023-05-12T09:08:30.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.244+0000 7f2dd85ff700 1 -- 172.21.15.116:0/2418080905 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd015db40 con 0x7f2dd00cd760 2023-05-12T09:08:30.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.244+0000 7f2dc6ffd700 1 -- 172.21.15.116:0/2418080905 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0005a30 con 0x7f2dd00cd760 2023-05-12T09:08:30.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.244+0000 7f2dd85ff700 1 -- 172.21.15.116:0/2418080905 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd015d860 con 0x7f2dd00cd760 2023-05-12T09:08:30.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.245+0000 7f2dd85ff700 1 -- 172.21.15.116:0/2418080905 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd00cc670 con 0x7f2dd00cd760 2023-05-12T09:08:30.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.246+0000 7f2dc6ffd700 1 -- 172.21.15.116:0/2418080905 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2dc0005b90 con 0x7f2dd00cd760 2023-05-12T09:08:30.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.247+0000 7f2dc6ffd700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2db406ace0 0x7f2db406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.247+0000 7f2dc6ffd700 1 -- 172.21.15.116:0/2418080905 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2dc0088c80 con 0x7f2dd00cd760 2023-05-12T09:08:30.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.247+0000 7f2dd639b700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2db406ace0 0x7f2db406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.248+0000 7f2dd639b700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2db406ace0 0x7f2db406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0090b0 tx=0x7f2dcc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:30.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.251+0000 7f2dc6ffd700 1 -- 172.21.15.116:0/2418080905 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2dc0053a20 con 0x7f2dd00cd760 2023-05-12T09:08:30.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.443+0000 7f2dd85ff700 1 -- 172.21.15.116:0/2418080905 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2dd00c2670 con 0x7f2dd00cd760 2023-05-12T09:08:30.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.443+0000 7f2dc6ffd700 1 -- 172.21.15.116:0/2418080905 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2dc0057040 con 0x7f2dd00cd760 2023-05-12T09:08:30.447 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:30.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.445+0000 7f2dd85ff700 1 -- 172.21.15.116:0/2418080905 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2db406ace0 msgr2=0x7f2db406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.445+0000 7f2dd85ff700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2db406ace0 0x7f2db406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0090b0 tx=0x7f2dcc008030 comp rx=0 tx=0).stop 2023-05-12T09:08:30.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.445+0000 7f2dd85ff700 1 -- 172.21.15.116:0/2418080905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 msgr2=0x7f2dd00ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.445+0000 7f2dd85ff700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 0x7f2dd00ac860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000c700 tx=0x7f2dc000cac0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.446+0000 7f2dd85ff700 1 -- 172.21.15.116:0/2418080905 shutdown_connections 2023-05-12T09:08:30.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.446+0000 7f2dd85ff700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2db406ace0 0x7f2db406d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.446+0000 7f2dd85ff700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2dd015cf10 0x7f2dd00ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.446+0000 7f2dd85ff700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2dd00adf70 0x7f2dd014cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.446+0000 7f2dd85ff700 1 --2- 172.21.15.116:0/2418080905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd00cd760 0x7f2dd00ac860 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.446+0000 7f2dd85ff700 1 -- 172.21.15.116:0/2418080905 >> 172.21.15.116:0/2418080905 conn(0x7f2dd00cf720 msgr2=0x7f2dd00c4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:30.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.446+0000 7f2dd85ff700 1 -- 172.21.15.116:0/2418080905 shutdown_connections 2023-05-12T09:08:30.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.446+0000 7f2dd85ff700 1 -- 172.21.15.116:0/2418080905 wait complete. 2023-05-12T09:08:30.465 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.654+0000 7fbaf03ff700 1 Processor -- start 2023-05-12T09:08:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.654+0000 7fbaf03ff700 1 -- start start 2023-05-12T09:08:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.655+0000 7fbaf03ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80cfbf0 0x7fbae81608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.655+0000 7fbaf03ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fbae80d1100 0x7fbae80d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.655+0000 7fbaf03ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae80d0020 con 0x7fbae80b87a0 2023-05-12T09:08:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.655+0000 7fbaf03ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae80d02d0 con 0x7fbae80d1100 2023-05-12T09:08:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.655+0000 7fbaf03ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80d0cb0 con 0x7fbae80cfbf0 2023-05-12T09:08:30.660 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.656+0000 7fbaed99a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80cfbf0 0x7fbae81608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.660 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.656+0000 7fbaed99a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80cfbf0 0x7fbae81608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:45044/0 (socket says 172.21.15.116:45044) 2023-05-12T09:08:30.660 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.656+0000 7fbaed99a700 1 -- 172.21.15.116:0/3451609654 learned_addr learned my addr 172.21.15.116:0/3451609654 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:30.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.656+0000 7fbaee99c700 1 --2- 172.21.15.116:0/3451609654 >> v2:172.21.15.182:3300/0 conn(0x7fbae80d1100 0x7fbae80d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.656+0000 7fbaed199700 1 -- 172.21.15.116:0/3451609654 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585398520 0 0) 0x7fbae80d0020 con 0x7fbae80b87a0 2023-05-12T09:08:30.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.656+0000 7fbaed199700 1 -- 172.21.15.116:0/3451609654 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad40035b0 con 0x7fbae80b87a0 2023-05-12T09:08:30.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.656+0000 7fbaed99a700 1 -- 172.21.15.116:0/3451609654 >> v2:172.21.15.182:3300/0 conn(0x7fbae80d1100 msgr2=0x7fbae80d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:30.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.656+0000 7fbaed99a700 1 --2- 172.21.15.116:0/3451609654 >> v2:172.21.15.182:3300/0 conn(0x7fbae80d1100 0x7fbae80d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.656+0000 7fbaed99a700 1 -- 172.21.15.116:0/3451609654 >> v1:172.21.15.182:6789/0 conn(0x7fbae80b87a0 legacy=0x7fbae81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.661 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.656+0000 7fbaed99a700 1 -- 172.21.15.116:0/3451609654 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae80cdc60 con 0x7fbae80cfbf0 2023-05-12T09:08:30.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.657+0000 7fbaee99c700 1 --2- 172.21.15.116:0/3451609654 >> v2:172.21.15.182:3300/0 conn(0x7fbae80d1100 0x7fbae80d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:30.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.657+0000 7fbaed99a700 1 --2- 172.21.15.116:0/3451609654 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80cfbf0 0x7fbae81608f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbad80098f0 tx=0x7fbad8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61cfca831ab33f71 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:30.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.657+0000 7fbaed199700 1 -- 172.21.15.116:0/3451609654 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8011830 con 0x7fbae80cfbf0 2023-05-12T09:08:30.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.657+0000 7fbaed199700 1 -- 172.21.15.116:0/3451609654 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad8011990 con 0x7fbae80cfbf0 2023-05-12T09:08:30.662 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.657+0000 7fbaed199700 1 -- 172.21.15.116:0/3451609654 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8011d20 con 0x7fbae80cfbf0 2023-05-12T09:08:30.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.658+0000 7fbaf03ff700 1 -- 172.21.15.116:0/3451609654 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80cfbf0 msgr2=0x7fbae81608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.658+0000 7fbaf03ff700 1 --2- 172.21.15.116:0/3451609654 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80cfbf0 0x7fbae81608f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbad80098f0 tx=0x7fbad8009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:30.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.658+0000 7fbaf03ff700 1 -- 172.21.15.116:0/3451609654 shutdown_connections 2023-05-12T09:08:30.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.658+0000 7fbaf03ff700 1 --2- 172.21.15.116:0/3451609654 >> v2:172.21.15.182:3300/0 conn(0x7fbae80d1100 0x7fbae80d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.658+0000 7fbaf03ff700 1 --2- 172.21.15.116:0/3451609654 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80cfbf0 0x7fbae81608f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.658+0000 7fbaf03ff700 1 -- 172.21.15.116:0/3451609654 >> 172.21.15.116:0/3451609654 conn(0x7fbae8071b10 msgr2=0x7fbae8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:30.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.658+0000 7fbaf03ff700 1 -- 172.21.15.116:0/3451609654 shutdown_connections 2023-05-12T09:08:30.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.658+0000 7fbaf03ff700 1 -- 172.21.15.116:0/3451609654 wait complete. 2023-05-12T09:08:30.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.659+0000 7fbaf03ff700 1 Processor -- start 2023-05-12T09:08:30.664 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.660+0000 7fbaf03ff700 1 -- start start 2023-05-12T09:08:30.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.660+0000 7fbaf03ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80b87a0 0x7fbae815f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.666 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaf03ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbae80cfbf0 0x7fbae80c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.666 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaf03ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbae80d1100 0x7fbae814a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.666 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaf03ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80c6f20 con 0x7fbae80cfbf0 2023-05-12T09:08:30.666 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaf03ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80c71f0 con 0x7fbae80d1100 2023-05-12T09:08:30.666 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaf03ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80c74d0 con 0x7fbae80b87a0 2023-05-12T09:08:30.666 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaed99a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbae80cfbf0 0x7fbae80c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.666 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaed99a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbae80cfbf0 0x7fbae80c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39468/0 (socket says 172.21.15.116:39468) 2023-05-12T09:08:30.667 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaed99a700 1 -- 172.21.15.116:0/838589398 learned_addr learned my addr 172.21.15.116:0/838589398 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:30.667 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaee19b700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80b87a0 0x7fbae815f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.667 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaee99c700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbae80d1100 0x7fbae814a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.667 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaed99a700 1 -- 172.21.15.116:0/838589398 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80b87a0 msgr2=0x7fbae815f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.667 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaed99a700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80b87a0 0x7fbae815f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.667 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaed99a700 1 -- 172.21.15.116:0/838589398 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbae80d1100 msgr2=0x7fbae814a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.667 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaed99a700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbae80d1100 0x7fbae814a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.661+0000 7fbaed99a700 1 -- 172.21.15.116:0/838589398 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0009a70 con 0x7fbae80cfbf0 2023-05-12T09:08:30.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.662+0000 7fbaed99a700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbae80cfbf0 0x7fbae80c69e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009c40 tx=0x7fbad8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:30.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.662+0000 7fbadeffd700 1 -- 172.21.15.116:0/838589398 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8004450 con 0x7fbae80cfbf0 2023-05-12T09:08:30.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.662+0000 7fbadeffd700 1 -- 172.21.15.116:0/838589398 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad801e070 con 0x7fbae80cfbf0 2023-05-12T09:08:30.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.662+0000 7fbaf03ff700 1 -- 172.21.15.116:0/838589398 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad8009550 con 0x7fbae80cfbf0 2023-05-12T09:08:30.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.662+0000 7fbadeffd700 1 -- 172.21.15.116:0/838589398 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad80038e0 con 0x7fbae80cfbf0 2023-05-12T09:08:30.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.662+0000 7fbaf03ff700 1 -- 172.21.15.116:0/838589398 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae80cd980 con 0x7fbae80cfbf0 2023-05-12T09:08:30.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.663+0000 7fbaf03ff700 1 -- 172.21.15.116:0/838589398 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae80cd6a0 con 0x7fbae80cfbf0 2023-05-12T09:08:30.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.664+0000 7fbadeffd700 1 -- 172.21.15.116:0/838589398 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbad8003a40 con 0x7fbae80cfbf0 2023-05-12T09:08:30.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.665+0000 7fbadeffd700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbacc06ace0 0x7fbacc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:30.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.665+0000 7fbadeffd700 1 -- 172.21.15.116:0/838589398 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbad808a570 con 0x7fbae80cfbf0 2023-05-12T09:08:30.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.665+0000 7fbaee19b700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbacc06ace0 0x7fbacc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:30.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.665+0000 7fbaee19b700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbacc06ace0 0x7fbacc06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbae40011e0 tx=0x7fbae4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:30.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.669+0000 7fbadeffd700 1 -- 172.21.15.116:0/838589398 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbad80552e0 con 0x7fbae80cfbf0 2023-05-12T09:08:30.866 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.863+0000 7fbaf03ff700 1 -- 172.21.15.116:0/838589398 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbae8160e30 con 0x7fbae80cfbf0 2023-05-12T09:08:30.866 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.863+0000 7fbadeffd700 1 -- 172.21.15.116:0/838589398 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbad80045b0 con 0x7fbae80cfbf0 2023-05-12T09:08:30.867 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:30.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 -- 172.21.15.116:0/838589398 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbacc06ace0 msgr2=0x7fbacc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbacc06ace0 0x7fbacc06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbae40011e0 tx=0x7fbae4009040 comp rx=0 tx=0).stop 2023-05-12T09:08:30.869 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 -- 172.21.15.116:0/838589398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbae80cfbf0 msgr2=0x7fbae80c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:30.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbae80cfbf0 0x7fbae80c69e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009c40 tx=0x7fbad8004750 comp rx=0 tx=0).stop 2023-05-12T09:08:30.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 -- 172.21.15.116:0/838589398 shutdown_connections 2023-05-12T09:08:30.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbae80d1100 0x7fbae814a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbacc06ace0 0x7fbacc06d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbae80b87a0 0x7fbae815f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 --2- 172.21.15.116:0/838589398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbae80cfbf0 0x7fbae80c69e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:30.870 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 -- 172.21.15.116:0/838589398 >> 172.21.15.116:0/838589398 conn(0x7fbae8071b10 msgr2=0x7fbae80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:30.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 -- 172.21.15.116:0/838589398 shutdown_connections 2023-05-12T09:08:30.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:30.866+0000 7fbaf03ff700 1 -- 172.21.15.116:0/838589398 wait complete. 2023-05-12T09:08:30.886 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:31.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.071+0000 7fd5f9dff700 1 Processor -- start 2023-05-12T09:08:31.074 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.071+0000 7fd5f9dff700 1 -- start start 2023-05-12T09:08:31.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.072+0000 7fd5f9dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd5f415a5a0 0x7fd5f406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.072+0000 7fd5f9dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fd5f406a920 0x7fd5f4070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.072+0000 7fd5f9dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f40cb280 con 0x7fd5f4071030 2023-05-12T09:08:31.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.072+0000 7fd5f9dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f406adc0 con 0x7fd5f415a5a0 2023-05-12T09:08:31.075 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.072+0000 7fd5f9dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f415a970 con 0x7fd5f406a920 2023-05-12T09:08:31.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.072+0000 7fd5f37fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd5f415a5a0 0x7fd5f406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.072+0000 7fd5f3fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd5f4071030 0x7fd5f415dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36594/0 (socket says 172.21.15.116:36594) 2023-05-12T09:08:31.076 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.072+0000 7fd5f3fff700 1 -- 172.21.15.116:0/3864173515 learned_addr learned my addr 172.21.15.116:0/3864173515 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:31.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.072+0000 7fd5f2ffd700 1 --2- 172.21.15.116:0/3864173515 >> v2:172.21.15.182:3300/0 conn(0x7fd5f406a920 0x7fd5f4070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.077 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.073+0000 7fd5f37fe700 1 -- 172.21.15.116:0/3864173515 >> v2:172.21.15.182:3300/0 conn(0x7fd5f406a920 msgr2=0x7fd5f4070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:31.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.073+0000 7fd5f37fe700 1 --2- 172.21.15.116:0/3864173515 >> v2:172.21.15.182:3300/0 conn(0x7fd5f406a920 0x7fd5f4070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.073+0000 7fd5f37fe700 1 -- 172.21.15.116:0/3864173515 >> v1:172.21.15.116:6789/0 conn(0x7fd5f4071030 legacy=0x7fd5f415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.073+0000 7fd5f37fe700 1 -- 172.21.15.116:0/3864173515 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f4071470 con 0x7fd5f415a5a0 2023-05-12T09:08:31.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.073+0000 7fd5f27fc700 1 -- 172.21.15.116:0/3864173515 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639071551 0 0) 0x7fd5ec001490 con 0x7fd5f4071030 2023-05-12T09:08:31.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.073+0000 7fd5f37fe700 1 --2- 172.21.15.116:0/3864173515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 0x7fd5f406a3e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd5f406f0c0 tx=0x7fd5e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7888d994df1f8db server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:31.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.073+0000 7fd5f27fc700 1 -- 172.21.15.116:0/3864173515 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011830 con 0x7fd5f415a5a0 2023-05-12T09:08:31.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.073+0000 7fd5f27fc700 1 -- 172.21.15.116:0/3864173515 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e4011990 con 0x7fd5f415a5a0 2023-05-12T09:08:31.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.073+0000 7fd5f27fc700 1 -- 172.21.15.116:0/3864173515 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011d20 con 0x7fd5f415a5a0 2023-05-12T09:08:31.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.074+0000 7fd5f9dff700 1 -- 172.21.15.116:0/3864173515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 msgr2=0x7fd5f406a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.074+0000 7fd5f9dff700 1 --2- 172.21.15.116:0/3864173515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 0x7fd5f406a3e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd5f406f0c0 tx=0x7fd5e4009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:31.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.074+0000 7fd5f9dff700 1 -- 172.21.15.116:0/3864173515 shutdown_connections 2023-05-12T09:08:31.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.074+0000 7fd5f9dff700 1 --2- 172.21.15.116:0/3864173515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 0x7fd5f406a3e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.074+0000 7fd5f9dff700 1 --2- 172.21.15.116:0/3864173515 >> v2:172.21.15.182:3300/0 conn(0x7fd5f406a920 0x7fd5f4070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.074+0000 7fd5f9dff700 1 -- 172.21.15.116:0/3864173515 >> 172.21.15.116:0/3864173515 conn(0x7fd5f40cf720 msgr2=0x7fd5f40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:31.079 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.074+0000 7fd5f9dff700 1 -- 172.21.15.116:0/3864173515 shutdown_connections 2023-05-12T09:08:31.080 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.074+0000 7fd5f9dff700 1 -- 172.21.15.116:0/3864173515 wait complete. 2023-05-12T09:08:31.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.075+0000 7fd5f9dff700 1 Processor -- start 2023-05-12T09:08:31.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.076+0000 7fd5f9dff700 1 -- start start 2023-05-12T09:08:31.081 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.076+0000 7fd5f9dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd5f406a920 0x7fd5f4155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.076+0000 7fd5f9dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd5f4071030 0x7fd5f415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.076+0000 7fd5f9dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 0x7fd5f415cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.076+0000 7fd5f9dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f41580c0 con 0x7fd5f415a5a0 2023-05-12T09:08:31.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.076+0000 7fd5f9dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4157440 con 0x7fd5f406a920 2023-05-12T09:08:31.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.076+0000 7fd5f9dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4157720 con 0x7fd5f4071030 2023-05-12T09:08:31.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f3fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 0x7fd5f415cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f3fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 0x7fd5f415cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39490/0 (socket says 172.21.15.116:39490) 2023-05-12T09:08:31.082 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f3fff700 1 -- 172.21.15.116:0/1710831019 learned_addr learned my addr 172.21.15.116:0/1710831019 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:31.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f2ffd700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd5f4071030 0x7fd5f415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f37fe700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd5f406a920 0x7fd5f4155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f3fff700 1 -- 172.21.15.116:0/1710831019 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd5f4071030 msgr2=0x7fd5f415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f3fff700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd5f4071030 0x7fd5f415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f3fff700 1 -- 172.21.15.116:0/1710831019 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd5f406a920 msgr2=0x7fd5f4155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f3fff700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd5f406a920 0x7fd5f4155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f3fff700 1 -- 172.21.15.116:0/1710831019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e40094a0 con 0x7fd5f415a5a0 2023-05-12T09:08:31.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.077+0000 7fd5f3fff700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 0x7fd5f415cb10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00cca0 tx=0x7fd5ec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:31.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.078+0000 7fd5dbfff700 1 -- 172.21.15.116:0/1710831019 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00cea0 con 0x7fd5f415a5a0 2023-05-12T09:08:31.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.078+0000 7fd5dbfff700 1 -- 172.21.15.116:0/1710831019 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00ada0 con 0x7fd5f415a5a0 2023-05-12T09:08:31.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.078+0000 7fd5f9dff700 1 -- 172.21.15.116:0/1710831019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f40719e0 con 0x7fd5f415a5a0 2023-05-12T09:08:31.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.078+0000 7fd5dbfff700 1 -- 172.21.15.116:0/1710831019 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec007310 con 0x7fd5f415a5a0 2023-05-12T09:08:31.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.078+0000 7fd5f9dff700 1 -- 172.21.15.116:0/1710831019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f4071700 con 0x7fd5f415a5a0 2023-05-12T09:08:31.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.079+0000 7fd5f9dff700 1 -- 172.21.15.116:0/1710831019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f406c6c0 con 0x7fd5f415a5a0 2023-05-12T09:08:31.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.080+0000 7fd5dbfff700 1 -- 172.21.15.116:0/1710831019 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd5ec007470 con 0x7fd5f415a5a0 2023-05-12T09:08:31.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.081+0000 7fd5dbfff700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd5e006ace0 0x7fd5e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.085 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.081+0000 7fd5dbfff700 1 -- 172.21.15.116:0/1710831019 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd5ec089250 con 0x7fd5f415a5a0 2023-05-12T09:08:31.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.081+0000 7fd5f37fe700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd5e006ace0 0x7fd5e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.082+0000 7fd5f37fe700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd5e006ace0 0x7fd5e006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40097c0 tx=0x7fd5e401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:31.088 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.086+0000 7fd5dbfff700 1 -- 172.21.15.116:0/1710831019 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd5ec053f40 con 0x7fd5f415a5a0 2023-05-12T09:08:31.284 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.281+0000 7fd5f9dff700 1 -- 172.21.15.116:0/1710831019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5f4158200 con 0x7fd5f415a5a0 2023-05-12T09:08:31.285 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.281+0000 7fd5dbfff700 1 -- 172.21.15.116:0/1710831019 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5f4158200 con 0x7fd5f415a5a0 2023-05-12T09:08:31.285 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:31.287 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 -- 172.21.15.116:0/1710831019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd5e006ace0 msgr2=0x7fd5e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.287 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd5e006ace0 0x7fd5e006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40097c0 tx=0x7fd5e401c040 comp rx=0 tx=0).stop 2023-05-12T09:08:31.287 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 -- 172.21.15.116:0/1710831019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 msgr2=0x7fd5f415cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.287 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 0x7fd5f415cb10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00cca0 tx=0x7fd5ec00a340 comp rx=0 tx=0).stop 2023-05-12T09:08:31.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 -- 172.21.15.116:0/1710831019 shutdown_connections 2023-05-12T09:08:31.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5f415a5a0 0x7fd5f415cb10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd5f406a920 0x7fd5f4155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd5e006ace0 0x7fd5e006d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 --2- 172.21.15.116:0/1710831019 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd5f4071030 0x7fd5f415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 -- 172.21.15.116:0/1710831019 >> 172.21.15.116:0/1710831019 conn(0x7fd5f40cf720 msgr2=0x7fd5f406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:31.288 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 -- 172.21.15.116:0/1710831019 shutdown_connections 2023-05-12T09:08:31.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.284+0000 7fd5f9dff700 1 -- 172.21.15.116:0/1710831019 wait complete. 2023-05-12T09:08:31.304 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:31.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.488+0000 7fd18efff700 1 Processor -- start 2023-05-12T09:08:31.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.488+0000 7fd18efff700 1 -- start start 2023-05-12T09:08:31.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.489+0000 7fd18efff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 0x7fd1880cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.489+0000 7fd18efff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fd1881601e0 0x7fd188160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.489+0000 7fd18efff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd188160ff0 con 0x7fd188160b70 2023-05-12T09:08:31.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.489+0000 7fd18efff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1880d02d0 con 0x7fd1881601e0 2023-05-12T09:08:31.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.489+0000 7fd18efff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880d0cb0 con 0x7fd1880b87a0 2023-05-12T09:08:31.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.489+0000 7fd18d59c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd188160b70 0x7fd1880d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36602/0 (socket says 172.21.15.116:36602) 2023-05-12T09:08:31.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.489+0000 7fd18d59c700 1 -- 172.21.15.116:0/3063718965 learned_addr learned my addr 172.21.15.116:0/3063718965 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:31.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.489+0000 7fd18cd9b700 1 --2- 172.21.15.116:0/3063718965 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 0x7fd1880cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.489+0000 7fd187fff700 1 --2- 172.21.15.116:0/3063718965 >> v2:172.21.15.182:3300/0 conn(0x7fd1881601e0 0x7fd188160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd1877fe700 1 -- 172.21.15.116:0/3063718965 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434121700 0 0) 0x7fd188160ff0 con 0x7fd188160b70 2023-05-12T09:08:31.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd1877fe700 1 -- 172.21.15.116:0/3063718965 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1780035b0 con 0x7fd188160b70 2023-05-12T09:08:31.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd18cd9b700 1 -- 172.21.15.116:0/3063718965 >> v2:172.21.15.182:3300/0 conn(0x7fd1881601e0 msgr2=0x7fd188160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:31.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd18cd9b700 1 --2- 172.21.15.116:0/3063718965 >> v2:172.21.15.182:3300/0 conn(0x7fd1881601e0 0x7fd188160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd1877fe700 1 -- 172.21.15.116:0/3063718965 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726149741 0 0) 0x7fd1780035b0 con 0x7fd188160b70 2023-05-12T09:08:31.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd18cd9b700 1 -- 172.21.15.116:0/3063718965 >> v1:172.21.15.116:6789/0 conn(0x7fd188160b70 legacy=0x7fd1880d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd18cd9b700 1 -- 172.21.15.116:0/3063718965 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1880cdc60 con 0x7fd1880b87a0 2023-05-12T09:08:31.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd18cd9b700 1 --2- 172.21.15.116:0/3063718965 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 0x7fd1880cfbf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009840 tx=0x7fd17c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33b6bd5675b6b6d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:31.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd1877fe700 1 -- 172.21.15.116:0/3063718965 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800019f0 con 0x7fd1880b87a0 2023-05-12T09:08:31.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd1877fe700 1 -- 172.21.15.116:0/3063718965 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c004030 con 0x7fd1880b87a0 2023-05-12T09:08:31.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.490+0000 7fd1877fe700 1 -- 172.21.15.116:0/3063718965 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c0043a0 con 0x7fd1880b87a0 2023-05-12T09:08:31.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.491+0000 7fd18efff700 1 -- 172.21.15.116:0/3063718965 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 msgr2=0x7fd1880cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.491+0000 7fd18efff700 1 --2- 172.21.15.116:0/3063718965 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 0x7fd1880cfbf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009840 tx=0x7fd17c009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:31.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.491+0000 7fd18efff700 1 -- 172.21.15.116:0/3063718965 shutdown_connections 2023-05-12T09:08:31.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.491+0000 7fd18efff700 1 --2- 172.21.15.116:0/3063718965 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 0x7fd1880cfbf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.491+0000 7fd18efff700 1 --2- 172.21.15.116:0/3063718965 >> v2:172.21.15.182:3300/0 conn(0x7fd1881601e0 0x7fd188160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.491+0000 7fd18efff700 1 -- 172.21.15.116:0/3063718965 >> 172.21.15.116:0/3063718965 conn(0x7fd188071b10 msgr2=0x7fd188071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:31.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.491+0000 7fd18efff700 1 -- 172.21.15.116:0/3063718965 shutdown_connections 2023-05-12T09:08:31.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.491+0000 7fd18efff700 1 -- 172.21.15.116:0/3063718965 wait complete. 2023-05-12T09:08:31.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.493+0000 7fd18efff700 1 Processor -- start 2023-05-12T09:08:31.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.493+0000 7fd18efff700 1 -- start start 2023-05-12T09:08:31.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd18efff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 0x7fd1881512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd18efff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd1881601e0 0x7fd18815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd18efff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd188160b70 0x7fd188150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd18efff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18815df90 con 0x7fd188160b70 2023-05-12T09:08:31.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd18efff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd188151ba0 con 0x7fd1881601e0 2023-05-12T09:08:31.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd18efff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18815d1e0 con 0x7fd1880b87a0 2023-05-12T09:08:31.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd18d59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd188160b70 0x7fd188150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd18d59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd188160b70 0x7fd188150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39502/0 (socket says 172.21.15.116:39502) 2023-05-12T09:08:31.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd18d59c700 1 -- 172.21.15.116:0/2903827787 learned_addr learned my addr 172.21.15.116:0/2903827787 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:31.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd18cd9b700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 0x7fd1881512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.494+0000 7fd187fff700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd1881601e0 0x7fd18815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd18d59c700 1 -- 172.21.15.116:0/2903827787 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 msgr2=0x7fd1881512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd18d59c700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 0x7fd1881512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd18d59c700 1 -- 172.21.15.116:0/2903827787 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd1881601e0 msgr2=0x7fd18815cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd18d59c700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd1881601e0 0x7fd18815cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd18d59c700 1 -- 172.21.15.116:0/2903827787 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c0094a0 con 0x7fd188160b70 2023-05-12T09:08:31.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd18d59c700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd188160b70 0x7fd188150a40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd18000cc00 tx=0x7fd18000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:31.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd1857fa700 1 -- 172.21.15.116:0/2903827787 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18000aa20 con 0x7fd188160b70 2023-05-12T09:08:31.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd1857fa700 1 -- 172.21.15.116:0/2903827787 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18000aba0 con 0x7fd188160b70 2023-05-12T09:08:31.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd18efff700 1 -- 172.21.15.116:0/2903827787 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1880cd980 con 0x7fd188160b70 2023-05-12T09:08:31.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd1857fa700 1 -- 172.21.15.116:0/2903827787 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800070d0 con 0x7fd188160b70 2023-05-12T09:08:31.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.495+0000 7fd18efff700 1 -- 172.21.15.116:0/2903827787 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1880cd6a0 con 0x7fd188160b70 2023-05-12T09:08:31.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.496+0000 7fd18efff700 1 -- 172.21.15.116:0/2903827787 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1880d2110 con 0x7fd188160b70 2023-05-12T09:08:31.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.497+0000 7fd1857fa700 1 -- 172.21.15.116:0/2903827787 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd180007230 con 0x7fd188160b70 2023-05-12T09:08:31.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.498+0000 7fd1857fa700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd16c06ace0 0x7fd16c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.498+0000 7fd1857fa700 1 -- 172.21.15.116:0/2903827787 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd1800895b0 con 0x7fd188160b70 2023-05-12T09:08:31.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.499+0000 7fd18cd9b700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd16c06ace0 0x7fd16c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.499+0000 7fd18cd9b700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd16c06ace0 0x7fd16c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000c00 tx=0x7fd17c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:31.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.502+0000 7fd1857fa700 1 -- 172.21.15.116:0/2903827787 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd180054330 con 0x7fd188160b70 2023-05-12T09:08:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.695+0000 7fd18efff700 1 -- 172.21.15.116:0/2903827787 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd188074430 con 0x7fd188160b70 2023-05-12T09:08:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.695+0000 7fd1857fa700 1 -- 172.21.15.116:0/2903827787 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd180057950 con 0x7fd188160b70 2023-05-12T09:08:31.698 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:31.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.697+0000 7fd18efff700 1 -- 172.21.15.116:0/2903827787 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd16c06ace0 msgr2=0x7fd16c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.697+0000 7fd18efff700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd16c06ace0 0x7fd16c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000c00 tx=0x7fd17c008030 comp rx=0 tx=0).stop 2023-05-12T09:08:31.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.697+0000 7fd18efff700 1 -- 172.21.15.116:0/2903827787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd188160b70 msgr2=0x7fd188150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.697+0000 7fd18efff700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd188160b70 0x7fd188150a40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd18000cc00 tx=0x7fd18000cf10 comp rx=0 tx=0).stop 2023-05-12T09:08:31.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.697+0000 7fd18efff700 1 -- 172.21.15.116:0/2903827787 shutdown_connections 2023-05-12T09:08:31.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.697+0000 7fd18efff700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd188160b70 0x7fd188150a40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.697+0000 7fd18efff700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd16c06ace0 0x7fd16c06d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.697+0000 7fd18efff700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd1880b87a0 0x7fd1881512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.698+0000 7fd18efff700 1 --2- 172.21.15.116:0/2903827787 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd1881601e0 0x7fd18815cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.698+0000 7fd18efff700 1 -- 172.21.15.116:0/2903827787 >> 172.21.15.116:0/2903827787 conn(0x7fd188071b10 msgr2=0x7fd188071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:31.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.698+0000 7fd18efff700 1 -- 172.21.15.116:0/2903827787 shutdown_connections 2023-05-12T09:08:31.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.698+0000 7fd18efff700 1 -- 172.21.15.116:0/2903827787 wait complete. 2023-05-12T09:08:31.718 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.902+0000 7f123ffff700 1 Processor -- start 2023-05-12T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.903+0000 7f123ffff700 1 -- start start 2023-05-12T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123ffff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f12380cf010 0x7f1238160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123ffff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380cd520 con 0x7f123815c590 2023-05-12T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123ffff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380d2640 con 0x7f12380cff50 2023-05-12T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123ffff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12381610d0 con 0x7f12380cf010 2023-05-12T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123dd9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f123815c590 0x7f12380cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50846/0 (socket says 172.21.15.116:50846) 2023-05-12T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123d59a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f12380cf010 0x7f1238160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123dd9b700 1 -- 172.21.15.116:0/3511559547 learned_addr learned my addr 172.21.15.116:0/3511559547 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123cd99700 1 -- 172.21.15.116:0/3511559547 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695030725 0 0) 0x7f12380cd520 con 0x7f123815c590 2023-05-12T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123d59a700 1 -- 172.21.15.116:0/3511559547 >> v1:172.21.15.182:6789/0 conn(0x7f12380cff50 legacy=0x7f12380d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123d59a700 1 -- 172.21.15.116:0/3511559547 >> v1:172.21.15.116:6789/0 conn(0x7f123815c590 legacy=0x7f12380cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.904+0000 7f123d59a700 1 -- 172.21.15.116:0/3511559547 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380b23c0 con 0x7f12380cf010 2023-05-12T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.905+0000 7f123d59a700 1 --2- 172.21.15.116:0/3511559547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cf010 0x7f1238160b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1228009840 tx=0x7f1228009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd15833cea6399e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.905+0000 7f123cd99700 1 -- 172.21.15.116:0/3511559547 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228004230 con 0x7f12380cf010 2023-05-12T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.905+0000 7f123cd99700 1 -- 172.21.15.116:0/3511559547 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1228004390 con 0x7f12380cf010 2023-05-12T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.905+0000 7f123cd99700 1 -- 172.21.15.116:0/3511559547 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12280036a0 con 0x7f12380cf010 2023-05-12T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.905+0000 7f123ffff700 1 -- 172.21.15.116:0/3511559547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cf010 msgr2=0x7f1238160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.905+0000 7f123ffff700 1 --2- 172.21.15.116:0/3511559547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cf010 0x7f1238160b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1228009840 tx=0x7f1228009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.905+0000 7f123ffff700 1 -- 172.21.15.116:0/3511559547 shutdown_connections 2023-05-12T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.906+0000 7f123ffff700 1 --2- 172.21.15.116:0/3511559547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cf010 0x7f1238160b90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.906+0000 7f123ffff700 1 -- 172.21.15.116:0/3511559547 >> 172.21.15.116:0/3511559547 conn(0x7f1238071b10 msgr2=0x7f1238071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.906+0000 7f123ffff700 1 -- 172.21.15.116:0/3511559547 shutdown_connections 2023-05-12T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.906+0000 7f123ffff700 1 -- 172.21.15.116:0/3511559547 wait complete. 2023-05-12T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.907+0000 7f123ffff700 1 Processor -- start 2023-05-12T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.907+0000 7f123ffff700 1 -- start start 2023-05-12T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.908+0000 7f123ffff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12380cf010 0x7f12381f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.908+0000 7f123ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cff50 0x7f123815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.908+0000 7f123ffff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f123815c590 0x7f123815cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.908+0000 7f123ffff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12381f2fd0 con 0x7f12380cff50 2023-05-12T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.908+0000 7f123ffff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123815b9a0 con 0x7f123815c590 2023-05-12T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.908+0000 7f123ffff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12381f2450 con 0x7f12380cf010 2023-05-12T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123d59a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cff50 0x7f123815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123d59a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cff50 0x7f123815b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42374/0 (socket says 172.21.15.116:42374) 2023-05-12T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123d59a700 1 -- 172.21.15.116:0/1826898831 learned_addr learned my addr 172.21.15.116:0/1826898831 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123dd9b700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12380cf010 0x7f12381f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123e59c700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f123815c590 0x7f123815cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123d59a700 1 -- 172.21.15.116:0/1826898831 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12380cf010 msgr2=0x7f12381f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123d59a700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12380cf010 0x7f12381f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123d59a700 1 -- 172.21.15.116:0/1826898831 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f123815c590 msgr2=0x7f123815cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123d59a700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f123815c590 0x7f123815cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123d59a700 1 -- 172.21.15.116:0/1826898831 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280094a0 con 0x7f12380cff50 2023-05-12T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123e59c700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f123815c590 0x7f123815cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123d59a700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cff50 0x7f123815b460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1228009b90 tx=0x7f1228004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f122e7fc700 1 -- 172.21.15.116:0/1826898831 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228011630 con 0x7f12380cff50 2023-05-12T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f122e7fc700 1 -- 172.21.15.116:0/1826898831 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122801e070 con 0x7f12380cff50 2023-05-12T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f122e7fc700 1 -- 172.21.15.116:0/1826898831 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12280119b0 con 0x7f12380cff50 2023-05-12T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.909+0000 7f123ffff700 1 -- 172.21.15.116:0/1826898831 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12380cd770 con 0x7f12380cff50 2023-05-12T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.910+0000 7f123ffff700 1 -- 172.21.15.116:0/1826898831 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12380cf560 con 0x7f12380cff50 2023-05-12T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.911+0000 7f123ffff700 1 -- 172.21.15.116:0/1826898831 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123815c960 con 0x7f12380cff50 2023-05-12T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.912+0000 7f122e7fc700 1 -- 172.21.15.116:0/1826898831 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1228011b10 con 0x7f12380cff50 2023-05-12T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.912+0000 7f122e7fc700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f121c06ace0 0x7f121c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.913+0000 7f122e7fc700 1 -- 172.21.15.116:0/1826898831 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f122808ac50 con 0x7f12380cff50 2023-05-12T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.913+0000 7f123dd9b700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f121c06ace0 0x7f121c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.913+0000 7f123dd9b700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f121c06ace0 0x7f121c06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1234000f60 tx=0x7f1234007c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:31.917+0000 7f122e7fc700 1 -- 172.21.15.116:0/1826898831 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f12280559c0 con 0x7f12380cff50 2023-05-12T09:08:32.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.113+0000 7f123ffff700 1 -- 172.21.15.116:0/1826898831 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f12380b51f0 con 0x7f12380cff50 2023-05-12T09:08:32.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.114+0000 7f122e7fc700 1 -- 172.21.15.116:0/1826898831 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f12280200a0 con 0x7f12380cff50 2023-05-12T09:08:32.118 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.116+0000 7f123ffff700 1 -- 172.21.15.116:0/1826898831 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f121c06ace0 msgr2=0x7f121c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.116+0000 7f123ffff700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f121c06ace0 0x7f121c06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1234000f60 tx=0x7f1234007c90 comp rx=0 tx=0).stop 2023-05-12T09:08:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.116+0000 7f123ffff700 1 -- 172.21.15.116:0/1826898831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cff50 msgr2=0x7f123815b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.116+0000 7f123ffff700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cff50 0x7f123815b460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1228009b90 tx=0x7f1228004750 comp rx=0 tx=0).stop 2023-05-12T09:08:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.116+0000 7f123ffff700 1 -- 172.21.15.116:0/1826898831 shutdown_connections 2023-05-12T09:08:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.116+0000 7f123ffff700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f123815c590 0x7f123815cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.116+0000 7f123ffff700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f121c06ace0 0x7f121c06d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.116+0000 7f123ffff700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f12380cf010 0x7f12381f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.116+0000 7f123ffff700 1 --2- 172.21.15.116:0/1826898831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12380cff50 0x7f123815b460 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.116+0000 7f123ffff700 1 -- 172.21.15.116:0/1826898831 >> 172.21.15.116:0/1826898831 conn(0x7f1238071b10 msgr2=0x7f12380d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.117+0000 7f123ffff700 1 -- 172.21.15.116:0/1826898831 shutdown_connections 2023-05-12T09:08:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.117+0000 7f123ffff700 1 -- 172.21.15.116:0/1826898831 wait complete. 2023-05-12T09:08:32.137 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-12T09:08:32.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.320+0000 7f5b497ff700 1 Processor -- start 2023-05-12T09:08:32.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.320+0000 7f5b497ff700 1 -- start start 2023-05-12T09:08:32.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.321+0000 7f5b497ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5b440ad2b0 0x7f5b44160d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:32.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.321+0000 7f5b497ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5b4406a3e0 0x7f5b4406a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:32.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.321+0000 7f5b497ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f5b44070af0 0x7f5b44070f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:32.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.321+0000 7f5b497ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4406ada0 con 0x7f5b440ad2b0 2023-05-12T09:08:32.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.321+0000 7f5b497ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b440cd230 con 0x7f5b44070af0 2023-05-12T09:08:32.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.321+0000 7f5b497ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4406cb90 con 0x7f5b4406a3e0 2023-05-12T09:08:32.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.321+0000 7f5b42ffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5b440ad2b0 0x7f5b44160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:32.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b42ffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5b440ad2b0 0x7f5b44160d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42386/0 (socket says 172.21.15.116:42386) 2023-05-12T09:08:32.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b42ffd700 1 -- 172.21.15.116:0/3336161268 learned_addr learned my addr 172.21.15.116:0/3336161268 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:32.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b427fc700 1 --2- 172.21.15.116:0/3336161268 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5b4406a3e0 0x7f5b4406a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:32.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b437fe700 1 --2- 172.21.15.116:0/3336161268 >> v2:172.21.15.182:3300/0 conn(0x7f5b44070af0 0x7f5b44070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:32.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b42ffd700 1 -- 172.21.15.116:0/3336161268 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5b4406a3e0 msgr2=0x7f5b4406a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:32.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b42ffd700 1 --2- 172.21.15.116:0/3336161268 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5b4406a3e0 0x7f5b4406a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b42ffd700 1 -- 172.21.15.116:0/3336161268 >> v2:172.21.15.182:3300/0 conn(0x7f5b44070af0 msgr2=0x7f5b44070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:32.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b42ffd700 1 --2- 172.21.15.116:0/3336161268 >> v2:172.21.15.182:3300/0 conn(0x7f5b44070af0 0x7f5b44070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b42ffd700 1 -- 172.21.15.116:0/3336161268 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b44161250 con 0x7f5b440ad2b0 2023-05-12T09:08:32.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b437fe700 1 --2- 172.21.15.116:0/3336161268 >> v2:172.21.15.182:3300/0 conn(0x7f5b44070af0 0x7f5b44070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:32.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b42ffd700 1 --2- 172.21.15.116:0/3336161268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b440ad2b0 0x7f5b44160d10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5b440709a0 tx=0x7f5b34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63a7132b4d4ebeb server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:32.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.322+0000 7f5b41ffb700 1 -- 172.21.15.116:0/3336161268 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34011830 con 0x7f5b440ad2b0 2023-05-12T09:08:32.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b41ffb700 1 -- 172.21.15.116:0/3336161268 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b34011990 con 0x7f5b440ad2b0 2023-05-12T09:08:32.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b41ffb700 1 -- 172.21.15.116:0/3336161268 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34011d20 con 0x7f5b440ad2b0 2023-05-12T09:08:32.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b497ff700 1 -- 172.21.15.116:0/3336161268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b440ad2b0 msgr2=0x7f5b44160d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:32.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b497ff700 1 --2- 172.21.15.116:0/3336161268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b440ad2b0 0x7f5b44160d10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5b440709a0 tx=0x7f5b34009bd0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b497ff700 1 -- 172.21.15.116:0/3336161268 shutdown_connections 2023-05-12T09:08:32.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b497ff700 1 --2- 172.21.15.116:0/3336161268 >> v2:172.21.15.182:3300/0 conn(0x7f5b44070af0 0x7f5b44070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b497ff700 1 --2- 172.21.15.116:0/3336161268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b440ad2b0 0x7f5b44160d10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b497ff700 1 --2- 172.21.15.116:0/3336161268 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5b4406a3e0 0x7f5b4406a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b497ff700 1 -- 172.21.15.116:0/3336161268 >> 172.21.15.116:0/3336161268 conn(0x7f5b440cf720 msgr2=0x7f5b440cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:32.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b497ff700 1 -- 172.21.15.116:0/3336161268 shutdown_connections 2023-05-12T09:08:32.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.323+0000 7f5b497ff700 1 -- 172.21.15.116:0/3336161268 wait complete. 2023-05-12T09:08:32.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.325+0000 7f5b497ff700 1 Processor -- start 2023-05-12T09:08:32.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.325+0000 7f5b497ff700 1 -- start start 2023-05-12T09:08:32.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b497ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b4406a3e0 0x7f5b4415d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:32.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b497ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5b44070af0 0x7f5b440abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:32.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b497ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5b440ad2b0 0x7f5b44158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:32.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b497ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4415d2e0 con 0x7f5b4406a3e0 2023-05-12T09:08:32.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b497ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44159920 con 0x7f5b440ad2b0 2023-05-12T09:08:32.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b497ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44159c00 con 0x7f5b44070af0 2023-05-12T09:08:32.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b42ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b4406a3e0 0x7f5b4415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:32.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b42ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b4406a3e0 0x7f5b4415d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42400/0 (socket says 172.21.15.116:42400) 2023-05-12T09:08:32.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b42ffd700 1 -- 172.21.15.116:0/3724738946 learned_addr learned my addr 172.21.15.116:0/3724738946 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:32.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b42ffd700 1 -- 172.21.15.116:0/3724738946 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5b44070af0 msgr2=0x7f5b440abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:32.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b42ffd700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5b44070af0 0x7f5b440abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b42ffd700 1 -- 172.21.15.116:0/3724738946 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5b440ad2b0 msgr2=0x7f5b44158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:32.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b42ffd700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5b440ad2b0 0x7f5b44158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.326+0000 7f5b42ffd700 1 -- 172.21.15.116:0/3724738946 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34009550 con 0x7f5b4406a3e0 2023-05-12T09:08:32.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.327+0000 7f5b42ffd700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b4406a3e0 0x7f5b4415d700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000c00 tx=0x7f5b34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:32.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.327+0000 7f5b2b7fe700 1 -- 172.21.15.116:0/3724738946 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34004380 con 0x7f5b4406a3e0 2023-05-12T09:08:32.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.327+0000 7f5b2b7fe700 1 -- 172.21.15.116:0/3724738946 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3401f070 con 0x7f5b4406a3e0 2023-05-12T09:08:32.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.327+0000 7f5b497ff700 1 -- 172.21.15.116:0/3724738946 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b440ccc70 con 0x7f5b4406a3e0 2023-05-12T09:08:32.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.327+0000 7f5b2b7fe700 1 -- 172.21.15.116:0/3724738946 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340036a0 con 0x7f5b4406a3e0 2023-05-12T09:08:32.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.327+0000 7f5b497ff700 1 -- 172.21.15.116:0/3724738946 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b440cc990 con 0x7f5b4406a3e0 2023-05-12T09:08:32.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.328+0000 7f5b497ff700 1 -- 172.21.15.116:0/3724738946 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b440ccf50 con 0x7f5b4406a3e0 2023-05-12T09:08:32.336 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.329+0000 7f5b2b7fe700 1 -- 172.21.15.116:0/3724738946 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b34021030 con 0x7f5b4406a3e0 2023-05-12T09:08:32.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.330+0000 7f5b2b7fe700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5b3006ace0 0x7f5b3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:32.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.331+0000 7f5b2b7fe700 1 -- 172.21.15.116:0/3724738946 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5b3408ac10 con 0x7f5b4406a3e0 2023-05-12T09:08:32.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.331+0000 7f5b427fc700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5b3006ace0 0x7f5b3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:32.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.331+0000 7f5b427fc700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5b3006ace0 0x7f5b3006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009a20 tx=0x7f5b380094e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:32.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.335+0000 7f5b2b7fe700 1 -- 172.21.15.116:0/3724738946 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5b34055980 con 0x7f5b4406a3e0 2023-05-12T09:08:32.546 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.543+0000 7f5b497ff700 1 -- 172.21.15.116:0/3724738946 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5b44159e20 con 0x7f5b4406a3e0 2023-05-12T09:08:32.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.544+0000 7f5b2b7fe700 1 -- 172.21.15.116:0/3724738946 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5b34058fa0 con 0x7f5b4406a3e0 2023-05-12T09:08:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 -- 172.21.15.116:0/3724738946 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5b3006ace0 msgr2=0x7f5b3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5b3006ace0 0x7f5b3006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009a20 tx=0x7f5b380094e0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 -- 172.21.15.116:0/3724738946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b4406a3e0 msgr2=0x7f5b4415d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:32.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b4406a3e0 0x7f5b4415d700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000c00 tx=0x7f5b34004750 comp rx=0 tx=0).stop 2023-05-12T09:08:32.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 -- 172.21.15.116:0/3724738946 shutdown_connections 2023-05-12T09:08:32.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5b440ad2b0 0x7f5b44158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b4406a3e0 0x7f5b4415d700 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5b3006ace0 0x7f5b3006d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 --2- 172.21.15.116:0/3724738946 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5b44070af0 0x7f5b440abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:32.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 -- 172.21.15.116:0/3724738946 >> 172.21.15.116:0/3724738946 conn(0x7f5b440cf720 msgr2=0x7f5b441605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:32.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 -- 172.21.15.116:0/3724738946 shutdown_connections 2023-05-12T09:08:32.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:32.546+0000 7f5b497ff700 1 -- 172.21.15.116:0/3724738946 wait complete. 2023-05-12T09:08:32.551 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2023-05-12T09:08:32.566 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi182.front.sepia.ceph.com... 2023-05-12T09:08:32.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:32.567 DEBUG:teuthology.orchestra.run.smithi182:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-05-12T09:08:32.637 INFO:teuthology.orchestra.run:waiting for 300 2023-05-12T09:08:32.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi182.front.sepia.ceph.com 2023-05-12T09:08:32.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:32.638 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-12T09:08:32.856 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:08:32.857 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:32.900 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:08:32.901 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:32.982 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:33.206 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.203+0000 7ff8fa7ff700 1 Processor -- start 2023-05-12T09:08:33.206 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.203+0000 7ff8fa7ff700 1 -- start start 2023-05-12T09:08:33.207 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.204+0000 7ff8fa7ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7ff8f40cf010 0x7ff8f4160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.207 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.204+0000 7ff8fa7ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f40cd520 con 0x7ff8f415c590 2023-05-12T09:08:33.207 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.204+0000 7ff8fa7ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f40d2640 con 0x7ff8f40cff50 2023-05-12T09:08:33.207 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.204+0000 7ff8fa7ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f41610d0 con 0x7ff8f40cf010 2023-05-12T09:08:33.208 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.204+0000 7ff8f3fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff8f415c590 0x7ff8f40cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50860/0 (socket says 172.21.15.116:50860) 2023-05-12T09:08:33.208 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.204+0000 7ff8f3fff700 1 -- 172.21.15.116:0/314749389 learned_addr learned my addr 172.21.15.116:0/314749389 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:33.210 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f37fe700 1 --2- 172.21.15.116:0/314749389 >> v2:172.21.15.182:3300/0 conn(0x7ff8f40cf010 0x7ff8f4160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.210 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726782665 0 0) 0x7ff8f40cd520 con 0x7ff8f415c590 2023-05-12T09:08:33.210 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8dc0035b0 con 0x7ff8f415c590 2023-05-12T09:08:33.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508865498 0 0) 0x7ff8dc0035b0 con 0x7ff8f415c590 2023-05-12T09:08:33.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 >> v2:172.21.15.182:3300/0 conn(0x7ff8f40cf010 msgr2=0x7ff8f4160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:33.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 --2- 172.21.15.116:0/314749389 >> v2:172.21.15.182:3300/0 conn(0x7ff8f40cf010 0x7ff8f4160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 >> v1:172.21.15.182:6789/0 conn(0x7ff8f40cff50 legacy=0x7ff8f40d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40b23c0 con 0x7ff8f415c590 2023-05-12T09:08:33.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7ff8e4001670 con 0x7ff8f415c590 2023-05-12T09:08:33.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f37fe700 1 --2- 172.21.15.116:0/314749389 >> v2:172.21.15.182:3300/0 conn(0x7ff8f40cf010 0x7ff8f4160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:33.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 >> v1:172.21.15.116:6789/0 conn(0x7ff8f415c590 legacy=0x7ff8f40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc003a50 0x7ff8dc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc004850 0x7ff8dc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc005200 0x7ff8dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f41610d0 con 0x7ff8dc004850 2023-05-12T09:08:33.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc00c0e0 con 0x7ff8dc005200 2023-05-12T09:08:33.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc00c2a0 con 0x7ff8dc003a50 2023-05-12T09:08:33.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.205+0000 7ff8f37fe700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc004850 0x7ff8dc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f3fff700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc003a50 0x7ff8dc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f8d9c700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc005200 0x7ff8dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f37fe700 1 -- 172.21.15.116:0/314749389 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc003a50 msgr2=0x7ff8dc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f37fe700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc003a50 0x7ff8dc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f37fe700 1 -- 172.21.15.116:0/314749389 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc005200 msgr2=0x7ff8dc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f37fe700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc005200 0x7ff8dc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f37fe700 1 -- 172.21.15.116:0/314749389 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0035b0 con 0x7ff8dc004850 2023-05-12T09:08:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f8d9c700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc005200 0x7ff8dc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f8d9c700 1 -- 172.21.15.116:0/314749389 reap_dead start 2023-05-12T09:08:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f3fff700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc003a50 0x7ff8dc003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f37fe700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc004850 0x7ff8dc004cc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009d00 tx=0x7ff8dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a948a4701b279335 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8009e50 con 0x7ff8dc004850 2023-05-12T09:08:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e800e9a0 con 0x7ff8dc004850 2023-05-12T09:08:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.206+0000 7ff8f2ffd700 1 -- 172.21.15.116:0/314749389 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800ed30 con 0x7ff8dc004850 2023-05-12T09:08:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.207+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/314749389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc004850 msgr2=0x7ff8dc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.207+0000 7ff8fa7ff700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc004850 0x7ff8dc004cc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009d00 tx=0x7ff8dc005880 comp rx=0 tx=0).stop 2023-05-12T09:08:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.207+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/314749389 shutdown_connections 2023-05-12T09:08:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.207+0000 7ff8fa7ff700 1 --2- 172.21.15.116:0/314749389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc004850 0x7ff8dc004cc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.207+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/314749389 >> 172.21.15.116:0/314749389 conn(0x7ff8f4071b10 msgr2=0x7ff8f4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.207+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/314749389 shutdown_connections 2023-05-12T09:08:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.207+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/314749389 wait complete. 2023-05-12T09:08:33.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.209+0000 7ff8fa7ff700 1 Processor -- start 2023-05-12T09:08:33.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.209+0000 7ff8fa7ff700 1 -- start start 2023-05-12T09:08:33.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8fa7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc004850 0x7ff8f40b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8fa7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f415afa0 0x7ff8f40b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8fa7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f40b87e0 0x7ff8f40cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8fa7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40b6740 con 0x7ff8f40b87e0 2023-05-12T09:08:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8fa7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40c9660 con 0x7ff8f415afa0 2023-05-12T09:08:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8fa7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40b5da0 con 0x7ff8dc004850 2023-05-12T09:08:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f8d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f40b87e0 0x7ff8f40cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f8d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f40b87e0 0x7ff8f40cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42404/0 (socket says 172.21.15.116:42404) 2023-05-12T09:08:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f8d9c700 1 -- 172.21.15.116:0/4192753344 learned_addr learned my addr 172.21.15.116:0/4192753344 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f3fff700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc004850 0x7ff8f40b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f37fe700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f415afa0 0x7ff8f40b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f8d9c700 1 -- 172.21.15.116:0/4192753344 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc004850 msgr2=0x7ff8f40b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f8d9c700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc004850 0x7ff8f40b6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f8d9c700 1 -- 172.21.15.116:0/4192753344 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f415afa0 msgr2=0x7ff8f40b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f8d9c700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f415afa0 0x7ff8f40b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f8d9c700 1 -- 172.21.15.116:0/4192753344 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40cd770 con 0x7ff8f40b87e0 2023-05-12T09:08:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f37fe700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f415afa0 0x7ff8f40b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.210+0000 7ff8f3fff700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc004850 0x7ff8f40b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.211+0000 7ff8f8d9c700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f40b87e0 0x7ff8f40cb770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40d1d20 tx=0x7ff8ec00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.211+0000 7ff8f0ff9700 1 -- 172.21.15.116:0/4192753344 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec003c10 con 0x7ff8f40b87e0 2023-05-12T09:08:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.211+0000 7ff8f0ff9700 1 -- 172.21.15.116:0/4192753344 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec003d70 con 0x7ff8f40b87e0 2023-05-12T09:08:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.211+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/4192753344 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f40cf560 con 0x7ff8f40b87e0 2023-05-12T09:08:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.211+0000 7ff8f0ff9700 1 -- 172.21.15.116:0/4192753344 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec005310 con 0x7ff8f40b87e0 2023-05-12T09:08:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.211+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/4192753344 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f415c960 con 0x7ff8f40b87e0 2023-05-12T09:08:33.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.212+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/4192753344 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f40b6880 con 0x7ff8f40b87e0 2023-05-12T09:08:33.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.213+0000 7ff8f0ff9700 1 -- 172.21.15.116:0/4192753344 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8ec005470 con 0x7ff8f40b87e0 2023-05-12T09:08:33.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.214+0000 7ff8f0ff9700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8e006ace0 0x7ff8e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.214+0000 7ff8f0ff9700 1 -- 172.21.15.116:0/4192753344 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff8ec089750 con 0x7ff8f40b87e0 2023-05-12T09:08:33.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.214+0000 7ff8f3fff700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8e006ace0 0x7ff8e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.215+0000 7ff8f3fff700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8e006ace0 0x7ff8e006d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4000ff0 tx=0x7ff8e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:33.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.218+0000 7ff8f0ff9700 1 -- 172.21.15.116:0/4192753344 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff8f40b6880 con 0x7ff8f40b87e0 2023-05-12T09:08:33.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.412+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/4192753344 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8f40b6880 con 0x7ff8f40b87e0 2023-05-12T09:08:33.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.413+0000 7ff8f0ff9700 1 -- 172.21.15.116:0/4192753344 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7ff8f40b6880 con 0x7ff8f40b87e0 2023-05-12T09:08:33.416 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:33.417 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:33.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.415+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/4192753344 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8e006ace0 msgr2=0x7ff8e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.415+0000 7ff8fa7ff700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8e006ace0 0x7ff8e006d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4000ff0 tx=0x7ff8e4009040 comp rx=0 tx=0).stop 2023-05-12T09:08:33.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.415+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/4192753344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f40b87e0 msgr2=0x7ff8f40cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.415+0000 7ff8fa7ff700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f40b87e0 0x7ff8f40cb770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40d1d20 tx=0x7ff8ec00ee00 comp rx=0 tx=0).stop 2023-05-12T09:08:33.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.416+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/4192753344 shutdown_connections 2023-05-12T09:08:33.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.416+0000 7ff8fa7ff700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f40b87e0 0x7ff8f40cb770 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.416+0000 7ff8fa7ff700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8e006ace0 0x7ff8e006d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.416+0000 7ff8fa7ff700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc004850 0x7ff8f40b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.416+0000 7ff8fa7ff700 1 --2- 172.21.15.116:0/4192753344 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f415afa0 0x7ff8f40b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.416+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/4192753344 >> 172.21.15.116:0/4192753344 conn(0x7ff8f4071b10 msgr2=0x7ff8f40b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:33.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.416+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/4192753344 shutdown_connections 2023-05-12T09:08:33.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.416+0000 7ff8fa7ff700 1 -- 172.21.15.116:0/4192753344 wait complete. 2023-05-12T09:08:33.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:33.437 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.623+0000 7f0a1ebff700 1 Processor -- start 2023-05-12T09:08:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.623+0000 7f0a1ebff700 1 -- start start 2023-05-12T09:08:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.624+0000 7f0a1ebff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0a180cd790 0x7f0a180ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1ebff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0a180cdb60 0x7f0a180b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1ebff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0a180b1b80 0x7f0a1806b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1ebff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1806a5f0 con 0x7f0a180cd790 2023-05-12T09:08:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1ebff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1806a840 con 0x7f0a180cdb60 2023-05-12T09:08:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1ebff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1806ab20 con 0x7f0a180b1b80 2023-05-12T09:08:33.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1c99b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0a180cd790 0x7f0a180ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1c99b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0a180cd790 0x7f0a180ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42414/0 (socket says 172.21.15.116:42414) 2023-05-12T09:08:33.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1c99b700 1 -- 172.21.15.116:0/424809729 learned_addr learned my addr 172.21.15.116:0/424809729 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a17fff700 1 --2- 172.21.15.116:0/424809729 >> v2:172.21.15.182:3300/0 conn(0x7f0a180cdb60 0x7f0a180b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1d19c700 1 --2- 172.21.15.116:0/424809729 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0a180b1b80 0x7f0a1806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1c99b700 1 -- 172.21.15.116:0/424809729 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0a180b1b80 msgr2=0x7f0a1806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1c99b700 1 --2- 172.21.15.116:0/424809729 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0a180b1b80 0x7f0a1806b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1c99b700 1 -- 172.21.15.116:0/424809729 >> v2:172.21.15.182:3300/0 conn(0x7f0a180cdb60 msgr2=0x7f0a180b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1c99b700 1 --2- 172.21.15.116:0/424809729 >> v2:172.21.15.182:3300/0 conn(0x7f0a180cdb60 0x7f0a180b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.625+0000 7f0a1c99b700 1 -- 172.21.15.116:0/424809729 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1806ae00 con 0x7f0a180cd790 2023-05-12T09:08:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a1c99b700 1 --2- 172.21.15.116:0/424809729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180cd790 0x7f0a180ca210 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0098f0 tx=0x7f0a0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd94cf4f131cbd33 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a177fe700 1 -- 172.21.15.116:0/424809729 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c011830 con 0x7f0a180cd790 2023-05-12T09:08:33.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a177fe700 1 -- 172.21.15.116:0/424809729 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c011990 con 0x7f0a180cd790 2023-05-12T09:08:33.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a177fe700 1 -- 172.21.15.116:0/424809729 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c011d20 con 0x7f0a180cd790 2023-05-12T09:08:33.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a1ebff700 1 -- 172.21.15.116:0/424809729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180cd790 msgr2=0x7f0a180ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a1ebff700 1 --2- 172.21.15.116:0/424809729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180cd790 0x7f0a180ca210 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0098f0 tx=0x7f0a0c009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:33.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a1ebff700 1 -- 172.21.15.116:0/424809729 shutdown_connections 2023-05-12T09:08:33.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a1ebff700 1 --2- 172.21.15.116:0/424809729 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0a180b1b80 0x7f0a1806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a1ebff700 1 --2- 172.21.15.116:0/424809729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180cd790 0x7f0a180ca210 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a1ebff700 1 --2- 172.21.15.116:0/424809729 >> v2:172.21.15.182:3300/0 conn(0x7f0a180cdb60 0x7f0a180b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.626+0000 7f0a1ebff700 1 -- 172.21.15.116:0/424809729 >> 172.21.15.116:0/424809729 conn(0x7f0a1806e980 msgr2=0x7f0a180cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.627+0000 7f0a1ebff700 1 -- 172.21.15.116:0/424809729 shutdown_connections 2023-05-12T09:08:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.627+0000 7f0a1ebff700 1 -- 172.21.15.116:0/424809729 wait complete. 2023-05-12T09:08:33.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.628+0000 7f0a1ebff700 1 Processor -- start 2023-05-12T09:08:33.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.628+0000 7f0a1ebff700 1 -- start start 2023-05-12T09:08:33.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.629+0000 7f0a1ebff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180b1b80 0x7f0a180c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.629+0000 7f0a1ebff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0a180cd790 0x7f0a180ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.629+0000 7f0a1ebff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0a180cdb60 0x7f0a180abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.629+0000 7f0a1ebff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180c5c50 con 0x7f0a180b1b80 2023-05-12T09:08:33.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.629+0000 7f0a1ebff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180c60e0 con 0x7f0a180cd790 2023-05-12T09:08:33.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.629+0000 7f0a1ebff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180c5040 con 0x7f0a180cdb60 2023-05-12T09:08:33.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.629+0000 7f0a1c99b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180b1b80 0x7f0a180c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.629+0000 7f0a1c99b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180b1b80 0x7f0a180c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42426/0 (socket says 172.21.15.116:42426) 2023-05-12T09:08:33.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.629+0000 7f0a1c99b700 1 -- 172.21.15.116:0/708155416 learned_addr learned my addr 172.21.15.116:0/708155416 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:33.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a1c99b700 1 -- 172.21.15.116:0/708155416 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0a180cdb60 msgr2=0x7f0a180abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a1c99b700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0a180cdb60 0x7f0a180abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a1c99b700 1 -- 172.21.15.116:0/708155416 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0a180cd790 msgr2=0x7f0a180ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a1c99b700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0a180cd790 0x7f0a180ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a1c99b700 1 -- 172.21.15.116:0/708155416 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c009550 con 0x7f0a180b1b80 2023-05-12T09:08:33.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a1c99b700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180b1b80 0x7f0a180c4740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009840 tx=0x7f0a0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:33.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a157fa700 1 -- 172.21.15.116:0/708155416 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c004590 con 0x7f0a180b1b80 2023-05-12T09:08:33.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a157fa700 1 -- 172.21.15.116:0/708155416 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c01f070 con 0x7f0a180b1b80 2023-05-12T09:08:33.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a1ebff700 1 -- 172.21.15.116:0/708155416 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a180b2000 con 0x7f0a180b1b80 2023-05-12T09:08:33.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a157fa700 1 -- 172.21.15.116:0/708155416 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0038e0 con 0x7f0a180b1b80 2023-05-12T09:08:33.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.630+0000 7f0a1ebff700 1 -- 172.21.15.116:0/708155416 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1806b0e0 con 0x7f0a180b1b80 2023-05-12T09:08:33.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.631+0000 7f0a1ebff700 1 -- 172.21.15.116:0/708155416 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a180ce000 con 0x7f0a180b1b80 2023-05-12T09:08:33.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.632+0000 7f0a157fa700 1 -- 172.21.15.116:0/708155416 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a0c003a40 con 0x7f0a180b1b80 2023-05-12T09:08:33.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.633+0000 7f0a157fa700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09fc06ace0 0x7f09fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:33.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.634+0000 7f0a157fa700 1 -- 172.21.15.116:0/708155416 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0a0c021070 con 0x7f0a180b1b80 2023-05-12T09:08:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.634+0000 7f0a17fff700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09fc06ace0 0x7f09fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.634+0000 7f0a17fff700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09fc06ace0 0x7f09fc06d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009ae0 tx=0x7f0a040095a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.638+0000 7f0a157fa700 1 -- 172.21.15.116:0/708155416 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0a0c0559b0 con 0x7f0a180b1b80 2023-05-12T09:08:33.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.834+0000 7f0a1ebff700 1 -- 172.21.15.116:0/708155416 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a18074430 con 0x7f0a180b1b80 2023-05-12T09:08:33.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.835+0000 7f0a157fa700 1 -- 172.21.15.116:0/708155416 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a0c02a020 con 0x7f0a180b1b80 2023-05-12T09:08:33.838 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:33.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 -- 172.21.15.116:0/708155416 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09fc06ace0 msgr2=0x7f09fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09fc06ace0 0x7f09fc06d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009ae0 tx=0x7f0a040095a0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 -- 172.21.15.116:0/708155416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180b1b80 msgr2=0x7f0a180c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:33.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180b1b80 0x7f0a180c4740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009840 tx=0x7f0a0c004750 comp rx=0 tx=0).stop 2023-05-12T09:08:33.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 -- 172.21.15.116:0/708155416 shutdown_connections 2023-05-12T09:08:33.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f09fc06ace0 0x7f09fc06d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0a180cdb60 0x7f0a180abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a180b1b80 0x7f0a180c4740 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 --2- 172.21.15.116:0/708155416 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0a180cd790 0x7f0a180ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:33.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 -- 172.21.15.116:0/708155416 >> 172.21.15.116:0/708155416 conn(0x7f0a1806e980 msgr2=0x7f0a180b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:33.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 -- 172.21.15.116:0/708155416 shutdown_connections 2023-05-12T09:08:33.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:33.837+0000 7f0a1ebff700 1 -- 172.21.15.116:0/708155416 wait complete. 2023-05-12T09:08:33.857 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:34.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.040+0000 7fc5ba7ff700 1 Processor -- start 2023-05-12T09:08:34.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.040+0000 7fc5ba7ff700 1 -- start start 2023-05-12T09:08:34.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.041+0000 7fc5ba7ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc5b406aaf0 0x7fc5b4070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5ba7ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc5b4071030 0x7fc5b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5ba7ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b40cb280 con 0x7fc5b415a5a0 2023-05-12T09:08:34.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5ba7ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b415a970 con 0x7fc5b4071030 2023-05-12T09:08:34.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5ba7ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b4071700 con 0x7fc5b406aaf0 2023-05-12T09:08:34.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5b8d9c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc5b4071030 0x7fc5b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5b3fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc5b415a5a0 0x7fc5b406a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50868/0 (socket says 172.21.15.116:50868) 2023-05-12T09:08:34.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5b3fff700 1 -- 172.21.15.116:0/1329172769 learned_addr learned my addr 172.21.15.116:0/1329172769 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:34.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5b37fe700 1 --2- 172.21.15.116:0/1329172769 >> v2:172.21.15.182:3300/0 conn(0x7fc5b406aaf0 0x7fc5b4070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5b8d9c700 1 -- 172.21.15.116:0/1329172769 >> v2:172.21.15.182:3300/0 conn(0x7fc5b406aaf0 msgr2=0x7fc5b4070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:34.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5b8d9c700 1 --2- 172.21.15.116:0/1329172769 >> v2:172.21.15.182:3300/0 conn(0x7fc5b406aaf0 0x7fc5b4070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5b8d9c700 1 -- 172.21.15.116:0/1329172769 >> v1:172.21.15.116:6789/0 conn(0x7fc5b415a5a0 legacy=0x7fc5b406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5b8d9c700 1 -- 172.21.15.116:0/1329172769 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b40719e0 con 0x7fc5b4071030 2023-05-12T09:08:34.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.042+0000 7fc5b8d9c700 1 --2- 172.21.15.116:0/1329172769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b4071030 0x7fc5b406d1a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc5b406f0c0 tx=0x7fc5ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6199ae5bdc1c46 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:34.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5b2ffd700 1 -- 172.21.15.116:0/1329172769 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00e070 con 0x7fc5b4071030 2023-05-12T09:08:34.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5b2ffd700 1 -- 172.21.15.116:0/1329172769 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac00bbd0 con 0x7fc5b4071030 2023-05-12T09:08:34.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5b2ffd700 1 -- 172.21.15.116:0/1329172769 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac012430 con 0x7fc5b4071030 2023-05-12T09:08:34.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1329172769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b4071030 msgr2=0x7fc5b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5ba7ff700 1 --2- 172.21.15.116:0/1329172769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b4071030 0x7fc5b406d1a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc5b406f0c0 tx=0x7fc5ac00b330 comp rx=0 tx=0).stop 2023-05-12T09:08:34.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1329172769 shutdown_connections 2023-05-12T09:08:34.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5ba7ff700 1 --2- 172.21.15.116:0/1329172769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b4071030 0x7fc5b406d1a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5ba7ff700 1 --2- 172.21.15.116:0/1329172769 >> v2:172.21.15.182:3300/0 conn(0x7fc5b406aaf0 0x7fc5b4070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1329172769 >> 172.21.15.116:0/1329172769 conn(0x7fc5b40cf720 msgr2=0x7fc5b40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:34.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1329172769 shutdown_connections 2023-05-12T09:08:34.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.043+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1329172769 wait complete. 2023-05-12T09:08:34.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.045+0000 7fc5ba7ff700 1 Processor -- start 2023-05-12T09:08:34.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.045+0000 7fc5ba7ff700 1 -- start start 2023-05-12T09:08:34.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.046+0000 7fc5ba7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b406aaf0 0x7fc5b4151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.046+0000 7fc5ba7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5b4071030 0x7fc5b41f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.046+0000 7fc5ba7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5b415a5a0 0x7fc5b415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.046+0000 7fc5ba7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41f37c0 con 0x7fc5b406aaf0 2023-05-12T09:08:34.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.046+0000 7fc5ba7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b415d2e0 con 0x7fc5b415a5a0 2023-05-12T09:08:34.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.046+0000 7fc5ba7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b4152000 con 0x7fc5b4071030 2023-05-12T09:08:34.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.046+0000 7fc5b3fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b406aaf0 0x7fc5b4151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.046+0000 7fc5b3fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b406aaf0 0x7fc5b4151990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42440/0 (socket says 172.21.15.116:42440) 2023-05-12T09:08:34.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.046+0000 7fc5b3fff700 1 -- 172.21.15.116:0/1850913653 learned_addr learned my addr 172.21.15.116:0/1850913653 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:34.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b8d9c700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5b415a5a0 0x7fc5b415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b37fe700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5b4071030 0x7fc5b41f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b3fff700 1 -- 172.21.15.116:0/1850913653 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5b4071030 msgr2=0x7fc5b41f3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b3fff700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5b4071030 0x7fc5b41f3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b3fff700 1 -- 172.21.15.116:0/1850913653 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5b415a5a0 msgr2=0x7fc5b415cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b3fff700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5b415a5a0 0x7fc5b415cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b3fff700 1 -- 172.21.15.116:0/1850913653 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac009a70 con 0x7fc5b406aaf0 2023-05-12T09:08:34.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b8d9c700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5b415a5a0 0x7fc5b415cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:34.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b37fe700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5b4071030 0x7fc5b41f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:34.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b3fff700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b406aaf0 0x7fc5b4151990 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400c480 tx=0x7fc5a400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:34.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b0ff9700 1 -- 172.21.15.116:0/1850913653 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4005d70 con 0x7fc5b406aaf0 2023-05-12T09:08:34.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b0ff9700 1 -- 172.21.15.116:0/1850913653 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a40070d0 con 0x7fc5b406aaf0 2023-05-12T09:08:34.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1850913653 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b406c9a0 con 0x7fc5b406aaf0 2023-05-12T09:08:34.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5b0ff9700 1 -- 172.21.15.116:0/1850913653 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4007440 con 0x7fc5b406aaf0 2023-05-12T09:08:34.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.047+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1850913653 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b406c6c0 con 0x7fc5b406aaf0 2023-05-12T09:08:34.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.049+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1850913653 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b406cc80 con 0x7fc5b406aaf0 2023-05-12T09:08:34.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.049+0000 7fc5b0ff9700 1 -- 172.21.15.116:0/1850913653 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5a40075a0 con 0x7fc5b406aaf0 2023-05-12T09:08:34.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.050+0000 7fc5b0ff9700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5a006ace0 0x7fc5a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.050+0000 7fc5b0ff9700 1 -- 172.21.15.116:0/1850913653 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc5a40889c0 con 0x7fc5b406aaf0 2023-05-12T09:08:34.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.051+0000 7fc5b37fe700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5a006ace0 0x7fc5a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.051+0000 7fc5b37fe700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5a006ace0 0x7fc5a006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc5b415c7e0 tx=0x7fc5a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:34.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.055+0000 7fc5b0ff9700 1 -- 172.21.15.116:0/1850913653 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc5a4053880 con 0x7fc5b406aaf0 2023-05-12T09:08:34.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.248+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1850913653 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5b40cb280 con 0x7fc5b406aaf0 2023-05-12T09:08:34.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.249+0000 7fc5b0ff9700 1 -- 172.21.15.116:0/1850913653 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5b40cb280 con 0x7fc5b406aaf0 2023-05-12T09:08:34.252 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:34.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1850913653 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5a006ace0 msgr2=0x7fc5a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5a006ace0 0x7fc5a006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc5b415c7e0 tx=0x7fc5a8008040 comp rx=0 tx=0).stop 2023-05-12T09:08:34.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1850913653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b406aaf0 msgr2=0x7fc5b4151990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b406aaf0 0x7fc5b4151990 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400c480 tx=0x7fc5a400c840 comp rx=0 tx=0).stop 2023-05-12T09:08:34.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1850913653 shutdown_connections 2023-05-12T09:08:34.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc5b415a5a0 0x7fc5b415cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b406aaf0 0x7fc5b4151990 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc5a006ace0 0x7fc5a006d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 --2- 172.21.15.116:0/1850913653 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc5b4071030 0x7fc5b41f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1850913653 >> 172.21.15.116:0/1850913653 conn(0x7fc5b40cf720 msgr2=0x7fc5b406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:34.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1850913653 shutdown_connections 2023-05-12T09:08:34.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.251+0000 7fc5ba7ff700 1 -- 172.21.15.116:0/1850913653 wait complete. 2023-05-12T09:08:34.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.456+0000 7f8fbf3ff700 1 Processor -- start 2023-05-12T09:08:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.456+0000 7f8fbf3ff700 1 -- start start 2023-05-12T09:08:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.457+0000 7f8fbf3ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8fb80b87a0 0x7f8fb80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.457+0000 7f8fbf3ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f8fb81601e0 0x7f8fb8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.457+0000 7f8fbf3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb8160b70 0x7f8fb80d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.457+0000 7f8fbf3ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb80d02d0 con 0x7f8fb80b87a0 2023-05-12T09:08:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.457+0000 7f8fbf3ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb80d0cb0 con 0x7f8fb81601e0 2023-05-12T09:08:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.457+0000 7f8fbf3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb80b2730 con 0x7f8fb8160b70 2023-05-12T09:08:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbd19b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8fb80b87a0 0x7f8fb80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbd19b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8fb80b87a0 0x7f8fb80cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42446/0 (socket says 172.21.15.116:42446) 2023-05-12T09:08:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbd19b700 1 -- 172.21.15.116:0/1102167325 learned_addr learned my addr 172.21.15.116:0/1102167325 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbd99c700 1 --2- 172.21.15.116:0/1102167325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb8160b70 0x7f8fb80d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbc99a700 1 --2- 172.21.15.116:0/1102167325 >> v2:172.21.15.182:3300/0 conn(0x7f8fb81601e0 0x7f8fb8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbd19b700 1 -- 172.21.15.116:0/1102167325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb8160b70 msgr2=0x7f8fb80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbd19b700 1 --2- 172.21.15.116:0/1102167325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb8160b70 0x7f8fb80d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbd19b700 1 -- 172.21.15.116:0/1102167325 >> v2:172.21.15.182:3300/0 conn(0x7f8fb81601e0 msgr2=0x7f8fb8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbd19b700 1 --2- 172.21.15.116:0/1102167325 >> v2:172.21.15.182:3300/0 conn(0x7f8fb81601e0 0x7f8fb8160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbd19b700 1 -- 172.21.15.116:0/1102167325 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb80cdc60 con 0x7f8fb80b87a0 2023-05-12T09:08:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.458+0000 7f8fbd19b700 1 --2- 172.21.15.116:0/1102167325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 0x7f8fb80cfbf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80b8f60 tx=0x7f8fb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5dc7b684537f4 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8faffff700 1 -- 172.21.15.116:0/1102167325 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4011830 con 0x7f8fb80b87a0 2023-05-12T09:08:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8faffff700 1 -- 172.21.15.116:0/1102167325 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb4011990 con 0x7f8fb80b87a0 2023-05-12T09:08:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8faffff700 1 -- 172.21.15.116:0/1102167325 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4011d20 con 0x7f8fb80b87a0 2023-05-12T09:08:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/1102167325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 msgr2=0x7f8fb80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8fbf3ff700 1 --2- 172.21.15.116:0/1102167325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 0x7f8fb80cfbf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80b8f60 tx=0x7f8fb4009bd0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/1102167325 shutdown_connections 2023-05-12T09:08:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8fbf3ff700 1 --2- 172.21.15.116:0/1102167325 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb8160b70 0x7f8fb80d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8fbf3ff700 1 --2- 172.21.15.116:0/1102167325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 0x7f8fb80cfbf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8fbf3ff700 1 --2- 172.21.15.116:0/1102167325 >> v2:172.21.15.182:3300/0 conn(0x7f8fb81601e0 0x7f8fb8160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/1102167325 >> 172.21.15.116:0/1102167325 conn(0x7f8fb8071b10 msgr2=0x7f8fb8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/1102167325 shutdown_connections 2023-05-12T09:08:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.459+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/1102167325 wait complete. 2023-05-12T09:08:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.461+0000 7f8fbf3ff700 1 Processor -- start 2023-05-12T09:08:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.461+0000 7f8fbf3ff700 1 -- start start 2023-05-12T09:08:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.462+0000 7f8fbf3ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 0x7f8fb80ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.462+0000 7f8fbf3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb81601e0 0x7f8fb81593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.462+0000 7f8fbf3ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8fb8160b70 0x7f8fb815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.462+0000 7f8fbf3ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb815a450 con 0x7f8fb80b87a0 2023-05-12T09:08:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.462+0000 7f8fbf3ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb815ce80 con 0x7f8fb8160b70 2023-05-12T09:08:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.462+0000 7f8fbf3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb815d160 con 0x7f8fb81601e0 2023-05-12T09:08:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.462+0000 7f8fbd19b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 0x7f8fb80ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.462+0000 7f8fbd19b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 0x7f8fb80ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42460/0 (socket says 172.21.15.116:42460) 2023-05-12T09:08:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.462+0000 7f8fbd19b700 1 -- 172.21.15.116:0/4169202699 learned_addr learned my addr 172.21.15.116:0/4169202699 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbd99c700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8fb8160b70 0x7f8fb815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbc99a700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb81601e0 0x7f8fb81593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbd19b700 1 -- 172.21.15.116:0/4169202699 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb81601e0 msgr2=0x7f8fb81593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbd19b700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb81601e0 0x7f8fb81593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbd19b700 1 -- 172.21.15.116:0/4169202699 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8fb8160b70 msgr2=0x7f8fb815ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbd19b700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8fb8160b70 0x7f8fb815ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbd19b700 1 -- 172.21.15.116:0/4169202699 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4009550 con 0x7f8fb80b87a0 2023-05-12T09:08:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbd99c700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8fb8160b70 0x7f8fb815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbc99a700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb81601e0 0x7f8fb81593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbd19b700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 0x7f8fb80ccfa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4000c00 tx=0x7f8fb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fadffb700 1 -- 172.21.15.116:0/4169202699 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4004300 con 0x7f8fb80b87a0 2023-05-12T09:08:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fadffb700 1 -- 172.21.15.116:0/4169202699 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb401f070 con 0x7f8fb80b87a0 2023-05-12T09:08:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/4169202699 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb80cd6a0 con 0x7f8fb80b87a0 2023-05-12T09:08:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fadffb700 1 -- 172.21.15.116:0/4169202699 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40036a0 con 0x7f8fb80b87a0 2023-05-12T09:08:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.463+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/4169202699 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb8160fd0 con 0x7f8fb80b87a0 2023-05-12T09:08:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.464+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/4169202699 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb80cd980 con 0x7f8fb80b87a0 2023-05-12T09:08:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.465+0000 7f8fadffb700 1 -- 172.21.15.116:0/4169202699 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fb4021030 con 0x7f8fb80b87a0 2023-05-12T09:08:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.466+0000 7f8fadffb700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8f9c06ace0 0x7f8f9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.467+0000 7f8fadffb700 1 -- 172.21.15.116:0/4169202699 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8fb408abd0 con 0x7f8fb80b87a0 2023-05-12T09:08:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.467+0000 7f8fbc99a700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8f9c06ace0 0x7f8f9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.467+0000 7f8fbc99a700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8f9c06ace0 0x7f8f9c06d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80b33e0 tx=0x7f8fa8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:34.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.471+0000 7f8fadffb700 1 -- 172.21.15.116:0/4169202699 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8fb4055a60 con 0x7f8fb80b87a0 2023-05-12T09:08:34.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.669+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/4169202699 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8fb8074430 con 0x7f8fb80b87a0 2023-05-12T09:08:34.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.669+0000 7f8fadffb700 1 -- 172.21.15.116:0/4169202699 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8fb4015020 con 0x7f8fb80b87a0 2023-05-12T09:08:34.673 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.671+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/4169202699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8f9c06ace0 msgr2=0x7f8f9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.671+0000 7f8fbf3ff700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8f9c06ace0 0x7f8f9c06d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80b33e0 tx=0x7f8fa8008040 comp rx=0 tx=0).stop 2023-05-12T09:08:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.671+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/4169202699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 msgr2=0x7f8fb80ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.671+0000 7f8fbf3ff700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 0x7f8fb80ccfa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4000c00 tx=0x7f8fb4004750 comp rx=0 tx=0).stop 2023-05-12T09:08:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.671+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/4169202699 shutdown_connections 2023-05-12T09:08:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.671+0000 7f8fbf3ff700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8fb8160b70 0x7f8fb815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.672+0000 7f8fbf3ff700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb80b87a0 0x7f8fb80ccfa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.672+0000 7f8fbf3ff700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f8f9c06ace0 0x7f8f9c06d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.672+0000 7f8fbf3ff700 1 --2- 172.21.15.116:0/4169202699 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f8fb81601e0 0x7f8fb81593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.672+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/4169202699 >> 172.21.15.116:0/4169202699 conn(0x7f8fb8071b10 msgr2=0x7f8fb80b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:34.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.672+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/4169202699 shutdown_connections 2023-05-12T09:08:34.676 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.672+0000 7f8fbf3ff700 1 -- 172.21.15.116:0/4169202699 wait complete. 2023-05-12T09:08:34.692 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:34.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.877+0000 7f41519ff700 1 Processor -- start 2023-05-12T09:08:34.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.878+0000 7f41519ff700 1 -- start start 2023-05-12T09:08:34.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.879+0000 7f41519ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c15a5a0 0x7f414c06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.879+0000 7f41519ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c0cb280 con 0x7f414c06a920 2023-05-12T09:08:34.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.879+0000 7f41519ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c071700 con 0x7f414c071200 2023-05-12T09:08:34.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.879+0000 7f41519ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c15a970 con 0x7f414c15a5a0 2023-05-12T09:08:34.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.879+0000 7f414a7fc700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f414c06a920 0x7f414c070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50884/0 (socket says 172.21.15.116:50884) 2023-05-12T09:08:34.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.879+0000 7f414a7fc700 1 -- 172.21.15.116:0/1913656029 learned_addr learned my addr 172.21.15.116:0/1913656029 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:34.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.879+0000 7f414affd700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c15a5a0 0x7f414c06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.879+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034206254 0 0) 0x7f4140001290 con 0x7f414c06a920 2023-05-12T09:08:34.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41340035b0 con 0x7f414c06a920 2023-05-12T09:08:34.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2582626323 0 0) 0x7f41340035b0 con 0x7f414c06a920 2023-05-12T09:08:34.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c15a5a0 msgr2=0x7f414c06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:34.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c15a5a0 0x7f414c06a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 >> v1:172.21.15.182:6789/0 conn(0x7f414c071200 legacy=0x7f414c06d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0719e0 con 0x7f414c06a920 2023-05-12T09:08:34.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f4140001980 con 0x7f414c06a920 2023-05-12T09:08:34.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 >> v1:172.21.15.116:6789/0 conn(0x7f414c06a920 legacy=0x7f414c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4134003a30 0x7f4134003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c15a5a0 0x7f4134004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4134004d90 0x7f4134005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c15a970 con 0x7f4134003a30 2023-05-12T09:08:34.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413400ba10 con 0x7f4134004d90 2023-05-12T09:08:34.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413400bba0 con 0x7f414c15a5a0 2023-05-12T09:08:34.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f414affd700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4134003a30 0x7f4134003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f414a7fc700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c15a5a0 0x7f4134004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.880+0000 7f414b7fe700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4134004d90 0x7f4134005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f414affd700 1 -- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c15a5a0 msgr2=0x7f4134004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:34.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f414affd700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c15a5a0 0x7f4134004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f414affd700 1 -- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4134004d90 msgr2=0x7f4134005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:34.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f414affd700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f4134004d90 0x7f4134005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f414affd700 1 -- 172.21.15.116:0/1913656029 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340035b0 con 0x7f4134003a30 2023-05-12T09:08:34.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f414affd700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4134003a30 0x7f4134003e00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f413c009b60 tx=0x7f4134005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68be491c266c29c7 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:34.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c00e6c0 con 0x7f4134003a30 2023-05-12T09:08:34.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c00e820 con 0x7f4134003a30 2023-05-12T09:08:34.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f4149ffb700 1 -- 172.21.15.116:0/1913656029 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c00eb90 con 0x7f4134003a30 2023-05-12T09:08:34.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f41519ff700 1 -- 172.21.15.116:0/1913656029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4134003a30 msgr2=0x7f4134003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.881+0000 7f41519ff700 1 --2- 172.21.15.116:0/1913656029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4134003a30 0x7f4134003e00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f413c009b60 tx=0x7f4134005880 comp rx=0 tx=0).stop 2023-05-12T09:08:34.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.882+0000 7f414b7fe700 1 -- 172.21.15.116:0/1913656029 reap_dead start 2023-05-12T09:08:34.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.882+0000 7f41519ff700 1 -- 172.21.15.116:0/1913656029 shutdown_connections 2023-05-12T09:08:34.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.882+0000 7f41519ff700 1 -- 172.21.15.116:0/1913656029 >> 172.21.15.116:0/1913656029 conn(0x7f414c0cf720 msgr2=0x7f414c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:34.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.882+0000 7f41519ff700 1 -- 172.21.15.116:0/1913656029 shutdown_connections 2023-05-12T09:08:34.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.882+0000 7f41519ff700 1 -- 172.21.15.116:0/1913656029 wait complete. 2023-05-12T09:08:34.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.884+0000 7f41519ff700 1 Processor -- start 2023-05-12T09:08:34.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.884+0000 7f41519ff700 1 -- start start 2023-05-12T09:08:34.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.885+0000 7f41519ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c14adc0 0x7f414c0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.885+0000 7f41519ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f414c14b190 0x7f414c0c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.885+0000 7f41519ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f414c0c78d0 0x7f414c0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.885+0000 7f41519ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0c7d40 con 0x7f414c0c78d0 2023-05-12T09:08:34.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.885+0000 7f41519ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0ad270 con 0x7f414c14b190 2023-05-12T09:08:34.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.885+0000 7f41519ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0cda00 con 0x7f414c14adc0 2023-05-12T09:08:34.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414b7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f414c0c78d0 0x7f414c0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414b7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f414c0c78d0 0x7f414c0c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42488/0 (socket says 172.21.15.116:42488) 2023-05-12T09:08:34.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414b7fe700 1 -- 172.21.15.116:0/1006591437 learned_addr learned my addr 172.21.15.116:0/1006591437 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:34.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414affd700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c14adc0 0x7f414c0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414a7fc700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f414c14b190 0x7f414c0c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414b7fe700 1 -- 172.21.15.116:0/1006591437 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c14adc0 msgr2=0x7f414c0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414b7fe700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c14adc0 0x7f414c0cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414b7fe700 1 -- 172.21.15.116:0/1006591437 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f414c14b190 msgr2=0x7f414c0c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:34.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414b7fe700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f414c14b190 0x7f414c0c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:34.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414b7fe700 1 -- 172.21.15.116:0/1006591437 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c06c9a0 con 0x7f414c0c78d0 2023-05-12T09:08:34.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414affd700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c14adc0 0x7f414c0cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:34.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414a7fc700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f414c14b190 0x7f414c0c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:34.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f414b7fe700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f414c0c78d0 0x7f414c0c5ce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f414400eb90 tx=0x7f414400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:34.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.886+0000 7f4133fff700 1 -- 172.21.15.116:0/1006591437 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144003c10 con 0x7f414c0c78d0 2023-05-12T09:08:34.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.887+0000 7f4133fff700 1 -- 172.21.15.116:0/1006591437 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4144003d70 con 0x7f414c0c78d0 2023-05-12T09:08:34.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.887+0000 7f4133fff700 1 -- 172.21.15.116:0/1006591437 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414400c9e0 con 0x7f414c0c78d0 2023-05-12T09:08:34.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.887+0000 7f41519ff700 1 -- 172.21.15.116:0/1006591437 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c06c6c0 con 0x7f414c0c78d0 2023-05-12T09:08:34.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.887+0000 7f41519ff700 1 -- 172.21.15.116:0/1006591437 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c06cc80 con 0x7f414c0c78d0 2023-05-12T09:08:34.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.888+0000 7f41519ff700 1 -- 172.21.15.116:0/1006591437 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c0cbcf0 con 0x7f414c0c78d0 2023-05-12T09:08:34.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.889+0000 7f4133fff700 1 -- 172.21.15.116:0/1006591437 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f414400cb40 con 0x7f414c0c78d0 2023-05-12T09:08:34.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.889+0000 7f4133fff700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f413806ace0 0x7f413806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:34.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.890+0000 7f4133fff700 1 -- 172.21.15.116:0/1006591437 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4144089a80 con 0x7f414c0c78d0 2023-05-12T09:08:34.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.890+0000 7f414affd700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f413806ace0 0x7f413806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:34.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.891+0000 7f414affd700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f413806ace0 0x7f413806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f414c0705a0 tx=0x7f413c01e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:34.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:34.894+0000 7f4133fff700 1 -- 172.21.15.116:0/1006591437 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4144054760 con 0x7f414c0c78d0 2023-05-12T09:08:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.088+0000 7f41519ff700 1 -- 172.21.15.116:0/1006591437 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f414c0cc160 con 0x7f414c0c78d0 2023-05-12T09:08:35.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.089+0000 7f4133fff700 1 -- 172.21.15.116:0/1006591437 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f414400cdf0 con 0x7f414c0c78d0 2023-05-12T09:08:35.093 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:35.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 -- 172.21.15.116:0/1006591437 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f413806ace0 msgr2=0x7f413806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f413806ace0 0x7f413806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f414c0705a0 tx=0x7f413c01e040 comp rx=0 tx=0).stop 2023-05-12T09:08:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 -- 172.21.15.116:0/1006591437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f414c0c78d0 msgr2=0x7f414c0c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f414c0c78d0 0x7f414c0c5ce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f414400eb90 tx=0x7f414400ef50 comp rx=0 tx=0).stop 2023-05-12T09:08:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 -- 172.21.15.116:0/1006591437 shutdown_connections 2023-05-12T09:08:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f414c0c78d0 0x7f414c0c5ce0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f413806ace0 0x7f413806d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f414c14adc0 0x7f414c0cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 --2- 172.21.15.116:0/1006591437 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f414c14b190 0x7f414c0c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 -- 172.21.15.116:0/1006591437 >> 172.21.15.116:0/1006591437 conn(0x7f414c0cf720 msgr2=0x7f414c15cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:35.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 -- 172.21.15.116:0/1006591437 shutdown_connections 2023-05-12T09:08:35.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.091+0000 7f41519ff700 1 -- 172.21.15.116:0/1006591437 wait complete. 2023-05-12T09:08:35.111 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.294+0000 7fbb921ff700 1 Processor -- start 2023-05-12T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.294+0000 7fbb921ff700 1 -- start start 2023-05-12T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.295+0000 7fbb921ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbb8c0cd760 0x7fbb8c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.295+0000 7fbb921ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fbb8c0adf70 0x7fbb8c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.295+0000 7fbb921ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb8c15cf10 0x7fbb8c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.295+0000 7fbb921ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c0cc9e0 con 0x7fbb8c0cd760 2023-05-12T09:08:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.295+0000 7fbb921ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c15de20 con 0x7fbb8c0adf70 2023-05-12T09:08:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.295+0000 7fbb921ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0ce070 con 0x7fbb8c15cf10 2023-05-12T09:08:35.300 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb8b7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbb8c0cd760 0x7fbb8c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb8b7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbb8c0cd760 0x7fbb8c0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42490/0 (socket says 172.21.15.116:42490) 2023-05-12T09:08:35.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb8b7fe700 1 -- 172.21.15.116:0/525245789 learned_addr learned my addr 172.21.15.116:0/525245789 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:35.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb8bfff700 1 --2- 172.21.15.116:0/525245789 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb8c15cf10 0x7fbb8c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb83fff700 1 --2- 172.21.15.116:0/525245789 >> v2:172.21.15.182:3300/0 conn(0x7fbb8c0adf70 0x7fbb8c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb8b7fe700 1 -- 172.21.15.116:0/525245789 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb8c15cf10 msgr2=0x7fbb8c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:35.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb8b7fe700 1 --2- 172.21.15.116:0/525245789 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb8c15cf10 0x7fbb8c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb8b7fe700 1 -- 172.21.15.116:0/525245789 >> v2:172.21.15.182:3300/0 conn(0x7fbb8c0adf70 msgr2=0x7fbb8c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:35.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb8b7fe700 1 --2- 172.21.15.116:0/525245789 >> v2:172.21.15.182:3300/0 conn(0x7fbb8c0adf70 0x7fbb8c0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb8b7fe700 1 -- 172.21.15.116:0/525245789 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c15d860 con 0x7fbb8c0cd760 2023-05-12T09:08:35.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.296+0000 7fbb8b7fe700 1 --2- 172.21.15.116:0/525245789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c0cd760 0x7fbb8c0cdb30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0ae4c0 tx=0x7fbb7c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f8ac8c3c2e1b3a server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:35.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb8affd700 1 -- 172.21.15.116:0/525245789 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c011830 con 0x7fbb8c0cd760 2023-05-12T09:08:35.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb8affd700 1 -- 172.21.15.116:0/525245789 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c011990 con 0x7fbb8c0cd760 2023-05-12T09:08:35.302 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb8affd700 1 -- 172.21.15.116:0/525245789 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c011d20 con 0x7fbb8c0cd760 2023-05-12T09:08:35.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb921ff700 1 -- 172.21.15.116:0/525245789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c0cd760 msgr2=0x7fbb8c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb921ff700 1 --2- 172.21.15.116:0/525245789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c0cd760 0x7fbb8c0cdb30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0ae4c0 tx=0x7fbb7c009bd0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb921ff700 1 -- 172.21.15.116:0/525245789 shutdown_connections 2023-05-12T09:08:35.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb921ff700 1 --2- 172.21.15.116:0/525245789 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb8c15cf10 0x7fbb8c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb921ff700 1 --2- 172.21.15.116:0/525245789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c0cd760 0x7fbb8c0cdb30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb921ff700 1 --2- 172.21.15.116:0/525245789 >> v2:172.21.15.182:3300/0 conn(0x7fbb8c0adf70 0x7fbb8c0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb921ff700 1 -- 172.21.15.116:0/525245789 >> 172.21.15.116:0/525245789 conn(0x7fbb8c0cf720 msgr2=0x7fbb8c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:35.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb921ff700 1 -- 172.21.15.116:0/525245789 shutdown_connections 2023-05-12T09:08:35.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.297+0000 7fbb921ff700 1 -- 172.21.15.116:0/525245789 wait complete. 2023-05-12T09:08:35.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.300+0000 7fbb921ff700 1 Processor -- start 2023-05-12T09:08:35.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.300+0000 7fbb921ff700 1 -- start start 2023-05-12T09:08:35.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.301+0000 7fbb921ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb8c0adf70 0x7fbb8c0b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.301+0000 7fbb921ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb8c0cd760 0x7fbb8c14d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.301+0000 7fbb921ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c15cf10 0x7fbb8c0b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.301+0000 7fbb921ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0af540 con 0x7fbb8c15cf10 2023-05-12T09:08:35.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.301+0000 7fbb921ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0af790 con 0x7fbb8c0cd760 2023-05-12T09:08:35.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.301+0000 7fbb921ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0afa70 con 0x7fbb8c0adf70 2023-05-12T09:08:35.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.301+0000 7fbb8bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c15cf10 0x7fbb8c0b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.301+0000 7fbb8bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c15cf10 0x7fbb8c0b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42496/0 (socket says 172.21.15.116:42496) 2023-05-12T09:08:35.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.301+0000 7fbb8bfff700 1 -- 172.21.15.116:0/3926634220 learned_addr learned my addr 172.21.15.116:0/3926634220 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:35.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb8b7fe700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb8c0adf70 0x7fbb8c0b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb83fff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb8c0cd760 0x7fbb8c14d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb8bfff700 1 -- 172.21.15.116:0/3926634220 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb8c0adf70 msgr2=0x7fbb8c0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb8bfff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb8c0adf70 0x7fbb8c0b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb8bfff700 1 -- 172.21.15.116:0/3926634220 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb8c0cd760 msgr2=0x7fbb8c14d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb8bfff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb8c0cd760 0x7fbb8c14d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb8bfff700 1 -- 172.21.15.116:0/3926634220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c009550 con 0x7fbb8c15cf10 2023-05-12T09:08:35.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb83fff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb8c0cd760 0x7fbb8c14d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:35.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb8bfff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c15cf10 0x7fbb8c0b0830 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400efc0 tx=0x7fbb8400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:35.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb88ff9700 1 -- 172.21.15.116:0/3926634220 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400cb80 con 0x7fbb8c15cf10 2023-05-12T09:08:35.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb88ff9700 1 -- 172.21.15.116:0/3926634220 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8400f040 con 0x7fbb8c15cf10 2023-05-12T09:08:35.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb88ff9700 1 -- 172.21.15.116:0/3926634220 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84014480 con 0x7fbb8c15cf10 2023-05-12T09:08:35.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb921ff700 1 -- 172.21.15.116:0/3926634220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c0cc670 con 0x7fbb8c15cf10 2023-05-12T09:08:35.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.302+0000 7fbb921ff700 1 -- 172.21.15.116:0/3926634220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c15db40 con 0x7fbb8c15cf10 2023-05-12T09:08:35.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.303+0000 7fbb921ff700 1 -- 172.21.15.116:0/3926634220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c071600 con 0x7fbb8c15cf10 2023-05-12T09:08:35.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.304+0000 7fbb88ff9700 1 -- 172.21.15.116:0/3926634220 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb840145e0 con 0x7fbb8c15cf10 2023-05-12T09:08:35.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.305+0000 7fbb88ff9700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb6c06ace0 0x7fbb6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.305+0000 7fbb88ff9700 1 -- 172.21.15.116:0/3926634220 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbb8408a1f0 con 0x7fbb8c15cf10 2023-05-12T09:08:35.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.305+0000 7fbb8b7fe700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb6c06ace0 0x7fbb6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.306+0000 7fbb8b7fe700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb6c06ace0 0x7fbb6c06d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009c10 tx=0x7fbb7c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:35.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.310+0000 7fbb88ff9700 1 -- 172.21.15.116:0/3926634220 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbb84054f60 con 0x7fbb8c15cf10 2023-05-12T09:08:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.501+0000 7fbb921ff700 1 -- 172.21.15.116:0/3926634220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbb8c0b4a10 con 0x7fbb8c15cf10 2023-05-12T09:08:35.505 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.502+0000 7fbb88ff9700 1 -- 172.21.15.116:0/3926634220 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbb84058580 con 0x7fbb8c15cf10 2023-05-12T09:08:35.505 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:35.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 -- 172.21.15.116:0/3926634220 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb6c06ace0 msgr2=0x7fbb6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb6c06ace0 0x7fbb6c06d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009c10 tx=0x7fbb7c008030 comp rx=0 tx=0).stop 2023-05-12T09:08:35.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 -- 172.21.15.116:0/3926634220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c15cf10 msgr2=0x7fbb8c0b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c15cf10 0x7fbb8c0b0830 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400efc0 tx=0x7fbb8400c0c0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 -- 172.21.15.116:0/3926634220 shutdown_connections 2023-05-12T09:08:35.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c15cf10 0x7fbb8c0b0830 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb6c06ace0 0x7fbb6c06d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb8c0adf70 0x7fbb8c0b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 --2- 172.21.15.116:0/3926634220 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb8c0cd760 0x7fbb8c14d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 -- 172.21.15.116:0/3926634220 >> 172.21.15.116:0/3926634220 conn(0x7fbb8c0cf720 msgr2=0x7fbb8c15aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:35.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 -- 172.21.15.116:0/3926634220 shutdown_connections 2023-05-12T09:08:35.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.504+0000 7fbb921ff700 1 -- 172.21.15.116:0/3926634220 wait complete. 2023-05-12T09:08:35.524 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-12T09:08:35.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.707+0000 7feafcfff700 1 Processor -- start 2023-05-12T09:08:35.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.707+0000 7feafcfff700 1 -- start start 2023-05-12T09:08:35.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.708+0000 7feafcfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7feaf815c590 0x7feaf8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.708+0000 7feafcfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cf010 0x7feaf80cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.708+0000 7feafcfff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7feaf80cfd80 0x7feaf80d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.708+0000 7feafcfff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80cd520 con 0x7feaf815c590 2023-05-12T09:08:35.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.708+0000 7feafcfff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80d2640 con 0x7feaf80cfd80 2023-05-12T09:08:35.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.708+0000 7feafcfff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81610d0 con 0x7feaf80cf010 2023-05-12T09:08:35.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.708+0000 7feaf659c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7feaf815c590 0x7feaf8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.708+0000 7feaf659c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7feaf815c590 0x7feaf8160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42508/0 (socket says 172.21.15.116:42508) 2023-05-12T09:08:35.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.708+0000 7feaf659c700 1 -- 172.21.15.116:0/2020299898 learned_addr learned my addr 172.21.15.116:0/2020299898 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:35.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf659c700 1 -- 172.21.15.116:0/2020299898 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cf010 msgr2=0x7feaf80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:35.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf5d9b700 1 --2- 172.21.15.116:0/2020299898 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cf010 0x7feaf80cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf6d9d700 1 --2- 172.21.15.116:0/2020299898 >> v2:172.21.15.182:3300/0 conn(0x7feaf80cfd80 0x7feaf80d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf659c700 1 --2- 172.21.15.116:0/2020299898 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cf010 0x7feaf80cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf659c700 1 -- 172.21.15.116:0/2020299898 >> v2:172.21.15.182:3300/0 conn(0x7feaf80cfd80 msgr2=0x7feaf80d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:35.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf659c700 1 --2- 172.21.15.116:0/2020299898 >> v2:172.21.15.182:3300/0 conn(0x7feaf80cfd80 0x7feaf80d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf659c700 1 -- 172.21.15.116:0/2020299898 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80d0200 con 0x7feaf815c590 2023-05-12T09:08:35.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf5d9b700 1 --2- 172.21.15.116:0/2020299898 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cf010 0x7feaf80cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:35.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf6d9d700 1 --2- 172.21.15.116:0/2020299898 >> v2:172.21.15.182:3300/0 conn(0x7feaf80cfd80 0x7feaf80d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:35.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf659c700 1 --2- 172.21.15.116:0/2020299898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 0x7feaf8160b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feaf808c000 tx=0x7feae8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf6f80d565432a server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:35.716 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf559a700 1 -- 172.21.15.116:0/2020299898 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800b870 con 0x7feaf815c590 2023-05-12T09:08:35.716 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf559a700 1 -- 172.21.15.116:0/2020299898 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae800b9d0 con 0x7feaf815c590 2023-05-12T09:08:35.716 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.709+0000 7feaf559a700 1 -- 172.21.15.116:0/2020299898 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800bd60 con 0x7feaf815c590 2023-05-12T09:08:35.716 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.710+0000 7feafcfff700 1 -- 172.21.15.116:0/2020299898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 msgr2=0x7feaf8160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.716 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.710+0000 7feafcfff700 1 --2- 172.21.15.116:0/2020299898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 0x7feaf8160b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feaf808c000 tx=0x7feae8009bd0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.716 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.710+0000 7feafcfff700 1 -- 172.21.15.116:0/2020299898 shutdown_connections 2023-05-12T09:08:35.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.710+0000 7feafcfff700 1 --2- 172.21.15.116:0/2020299898 >> v2:172.21.15.182:3300/0 conn(0x7feaf80cfd80 0x7feaf80d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.710+0000 7feafcfff700 1 --2- 172.21.15.116:0/2020299898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 0x7feaf8160b90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.710+0000 7feafcfff700 1 --2- 172.21.15.116:0/2020299898 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cf010 0x7feaf80cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.710+0000 7feafcfff700 1 -- 172.21.15.116:0/2020299898 >> 172.21.15.116:0/2020299898 conn(0x7feaf8071b10 msgr2=0x7feaf8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:35.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.710+0000 7feafcfff700 1 -- 172.21.15.116:0/2020299898 shutdown_connections 2023-05-12T09:08:35.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.710+0000 7feafcfff700 1 -- 172.21.15.116:0/2020299898 wait complete. 2023-05-12T09:08:35.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.712+0000 7feafcfff700 1 Processor -- start 2023-05-12T09:08:35.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.712+0000 7feafcfff700 1 -- start start 2023-05-12T09:08:35.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feafcfff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7feaf80cf010 0x7feaf80c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feafcfff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cfd80 0x7feaf814f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feafcfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 0x7feaf814f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feafcfff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81f5f00 con 0x7feaf815c590 2023-05-12T09:08:35.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feafcfff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81f6390 con 0x7feaf80cf010 2023-05-12T09:08:35.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feafcfff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81f55d0 con 0x7feaf80cfd80 2023-05-12T09:08:35.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf6d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 0x7feaf814f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf6d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 0x7feaf814f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42520/0 (socket says 172.21.15.116:42520) 2023-05-12T09:08:35.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf6d9d700 1 -- 172.21.15.116:0/2297046242 learned_addr learned my addr 172.21.15.116:0/2297046242 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:35.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf5d9b700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cfd80 0x7feaf814f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf659c700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7feaf80cf010 0x7feaf80c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf6d9d700 1 -- 172.21.15.116:0/2297046242 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cfd80 msgr2=0x7feaf814f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf6d9d700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cfd80 0x7feaf814f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf6d9d700 1 -- 172.21.15.116:0/2297046242 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7feaf80cf010 msgr2=0x7feaf80c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf6d9d700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7feaf80cf010 0x7feaf80c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf6d9d700 1 -- 172.21.15.116:0/2297046242 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8009550 con 0x7feaf815c590 2023-05-12T09:08:35.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.713+0000 7feaf5d9b700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cfd80 0x7feaf814f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:35.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.714+0000 7feaf6d9d700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 0x7feaf814f890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feaf000cef0 tx=0x7feaf000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:35.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.714+0000 7feae6ffd700 1 -- 172.21.15.116:0/2297046242 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000adb0 con 0x7feaf815c590 2023-05-12T09:08:35.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.714+0000 7feae6ffd700 1 -- 172.21.15.116:0/2297046242 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf0015440 con 0x7feaf815c590 2023-05-12T09:08:35.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.714+0000 7feae6ffd700 1 -- 172.21.15.116:0/2297046242 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00157f0 con 0x7feaf815c590 2023-05-12T09:08:35.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.714+0000 7feafcfff700 1 -- 172.21.15.116:0/2297046242 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf80cf560 con 0x7feaf815c590 2023-05-12T09:08:35.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.714+0000 7feafcfff700 1 -- 172.21.15.116:0/2297046242 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf80b23c0 con 0x7feaf815c590 2023-05-12T09:08:35.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.715+0000 7feafcfff700 1 -- 172.21.15.116:0/2297046242 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf80cd770 con 0x7feaf815c590 2023-05-12T09:08:35.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.716+0000 7feae6ffd700 1 -- 172.21.15.116:0/2297046242 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feaf000d430 con 0x7feaf815c590 2023-05-12T09:08:35.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.717+0000 7feae6ffd700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fead806ace0 0x7fead806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:35.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.717+0000 7feae6ffd700 1 -- 172.21.15.116:0/2297046242 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feaf0089c70 con 0x7feaf815c590 2023-05-12T09:08:35.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.717+0000 7feaf659c700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fead806ace0 0x7fead806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:35.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.718+0000 7feaf659c700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fead806ace0 0x7fead806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feae8014040 tx=0x7feae8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:35.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.722+0000 7feae6ffd700 1 -- 172.21.15.116:0/2297046242 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7feaf00549e0 con 0x7feaf815c590 2023-05-12T09:08:35.934 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.931+0000 7feafcfff700 1 -- 172.21.15.116:0/2297046242 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feaf80b51f0 con 0x7feaf815c590 2023-05-12T09:08:35.935 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.932+0000 7feae6ffd700 1 -- 172.21.15.116:0/2297046242 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7feaf001a080 con 0x7feaf815c590 2023-05-12T09:08:35.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 -- 172.21.15.116:0/2297046242 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fead806ace0 msgr2=0x7fead806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fead806ace0 0x7fead806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feae8014040 tx=0x7feae8008030 comp rx=0 tx=0).stop 2023-05-12T09:08:35.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 -- 172.21.15.116:0/2297046242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 msgr2=0x7feaf814f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:35.937 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 0x7feaf814f890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feaf000cef0 tx=0x7feaf000cf20 comp rx=0 tx=0).stop 2023-05-12T09:08:35.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 -- 172.21.15.116:0/2297046242 shutdown_connections 2023-05-12T09:08:35.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feaf815c590 0x7feaf814f890 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7feaf80cf010 0x7feaf80c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fead806ace0 0x7fead806d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 --2- 172.21.15.116:0/2297046242 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7feaf80cfd80 0x7feaf814f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:35.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 -- 172.21.15.116:0/2297046242 >> 172.21.15.116:0/2297046242 conn(0x7feaf8071b10 msgr2=0x7feaf80d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:35.938 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 -- 172.21.15.116:0/2297046242 shutdown_connections 2023-05-12T09:08:35.939 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:35.934+0000 7feafcfff700 1 -- 172.21.15.116:0/2297046242 wait complete. 2023-05-12T09:08:35.939 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2023-05-12T09:08:35.954 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:08:35.955 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:35.996 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:36.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.216+0000 7fed44fff700 1 Processor -- start 2023-05-12T09:08:36.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.216+0000 7fed44fff700 1 -- start start 2023-05-12T09:08:36.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.217+0000 7fed44fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fed401589d0 0x7fed400cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.217+0000 7fed44fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed400cd690 0x7fed4006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed44fff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed400ca890 con 0x7fed40158da0 2023-05-12T09:08:36.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed44fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed400ca5b0 con 0x7fed401589d0 2023-05-12T09:08:36.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed44fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed400cc670 con 0x7fed400cd690 2023-05-12T09:08:36.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed3ed9d700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fed40158da0 0x7fed4006a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50894/0 (socket says 172.21.15.116:50894) 2023-05-12T09:08:36.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed3e59c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fed401589d0 0x7fed400cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed3ed9d700 1 -- 172.21.15.116:0/3537429267 learned_addr learned my addr 172.21.15.116:0/3537429267 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:36.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed37fff700 1 --2- 172.21.15.116:0/3537429267 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed400cd690 0x7fed4006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed3e59c700 1 -- 172.21.15.116:0/3537429267 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed400cd690 msgr2=0x7fed4006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:36.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed3e59c700 1 --2- 172.21.15.116:0/3537429267 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed400cd690 0x7fed4006c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed3e59c700 1 -- 172.21.15.116:0/3537429267 >> v1:172.21.15.116:6789/0 conn(0x7fed40158da0 legacy=0x7fed4006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.218+0000 7fed3e59c700 1 -- 172.21.15.116:0/3537429267 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed400cc950 con 0x7fed401589d0 2023-05-12T09:08:36.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed3e59c700 1 --2- 172.21.15.116:0/3537429267 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 0x7fed400cd150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fed30009840 tx=0x7fed30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b982e2cb99e67ccd server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:36.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed3dd9b700 1 -- 172.21.15.116:0/3537429267 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3000f8a0 con 0x7fed401589d0 2023-05-12T09:08:36.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed3dd9b700 1 -- 172.21.15.116:0/3537429267 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3000fa00 con 0x7fed401589d0 2023-05-12T09:08:36.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed3dd9b700 1 -- 172.21.15.116:0/3537429267 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3000fd90 con 0x7fed401589d0 2023-05-12T09:08:36.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed44fff700 1 -- 172.21.15.116:0/3537429267 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 msgr2=0x7fed400cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed44fff700 1 --2- 172.21.15.116:0/3537429267 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 0x7fed400cd150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fed30009840 tx=0x7fed30009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:36.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed44fff700 1 -- 172.21.15.116:0/3537429267 shutdown_connections 2023-05-12T09:08:36.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed44fff700 1 --2- 172.21.15.116:0/3537429267 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 0x7fed400cd150 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed44fff700 1 --2- 172.21.15.116:0/3537429267 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed400cd690 0x7fed4006c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed44fff700 1 -- 172.21.15.116:0/3537429267 >> 172.21.15.116:0/3537429267 conn(0x7fed400cf720 msgr2=0x7fed400cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:36.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed44fff700 1 -- 172.21.15.116:0/3537429267 shutdown_connections 2023-05-12T09:08:36.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.219+0000 7fed44fff700 1 -- 172.21.15.116:0/3537429267 wait complete. 2023-05-12T09:08:36.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.221+0000 7fed44fff700 1 Processor -- start 2023-05-12T09:08:36.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.221+0000 7fed44fff700 1 -- start start 2023-05-12T09:08:36.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.222+0000 7fed44fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed400cd690 0x7fed4014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.222+0000 7fed44fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 0x7fed401576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.222+0000 7fed44fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed40158da0 0x7fed401f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.222+0000 7fed44fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4014e130 con 0x7fed401589d0 2023-05-12T09:08:36.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.222+0000 7fed44fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed400c3ec0 con 0x7fed400cd690 2023-05-12T09:08:36.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.222+0000 7fed44fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed400c41a0 con 0x7fed40158da0 2023-05-12T09:08:36.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.222+0000 7fed37fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 0x7fed401576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.222+0000 7fed37fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 0x7fed401576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42536/0 (socket says 172.21.15.116:42536) 2023-05-12T09:08:36.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.222+0000 7fed37fff700 1 -- 172.21.15.116:0/3269467790 learned_addr learned my addr 172.21.15.116:0/3269467790 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:36.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed37fff700 1 -- 172.21.15.116:0/3269467790 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed40158da0 msgr2=0x7fed401f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed37fff700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed40158da0 0x7fed401f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed37fff700 1 -- 172.21.15.116:0/3269467790 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed400cd690 msgr2=0x7fed4014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed3e59c700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed400cd690 0x7fed4014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed37fff700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed400cd690 0x7fed4014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed37fff700 1 -- 172.21.15.116:0/3269467790 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed300094a0 con 0x7fed401589d0 2023-05-12T09:08:36.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed3e59c700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed400cd690 0x7fed4014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:36.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed37fff700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 0x7fed401576a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fed2800e730 tx=0x7fed2800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:36.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed36ffd700 1 -- 172.21.15.116:0/3269467790 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28013610 con 0x7fed401589d0 2023-05-12T09:08:36.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed36ffd700 1 -- 172.21.15.116:0/3269467790 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed28013770 con 0x7fed401589d0 2023-05-12T09:08:36.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed44fff700 1 -- 172.21.15.116:0/3269467790 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4006aaf0 con 0x7fed401589d0 2023-05-12T09:08:36.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed36ffd700 1 -- 172.21.15.116:0/3269467790 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28013b20 con 0x7fed401589d0 2023-05-12T09:08:36.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.223+0000 7fed44fff700 1 -- 172.21.15.116:0/3269467790 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed400ccc30 con 0x7fed401589d0 2023-05-12T09:08:36.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.224+0000 7fed44fff700 1 -- 172.21.15.116:0/3269467790 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4006ac80 con 0x7fed401589d0 2023-05-12T09:08:36.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.225+0000 7fed36ffd700 1 -- 172.21.15.116:0/3269467790 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed28013c80 con 0x7fed401589d0 2023-05-12T09:08:36.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.226+0000 7fed36ffd700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed2006ace0 0x7fed2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.226+0000 7fed36ffd700 1 -- 172.21.15.116:0/3269467790 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fed28089460 con 0x7fed401589d0 2023-05-12T09:08:36.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.226+0000 7fed3e59c700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed2006ace0 0x7fed2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.227+0000 7fed3e59c700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed2006ace0 0x7fed2006d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed300090b0 tx=0x7fed30008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:36.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.230+0000 7fed36ffd700 1 -- 172.21.15.116:0/3269467790 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fed28057c60 con 0x7fed401589d0 2023-05-12T09:08:36.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.425+0000 7fed44fff700 1 -- 172.21.15.116:0/3269467790 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed400b4a10 con 0x7fed401589d0 2023-05-12T09:08:36.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.427+0000 7fed36ffd700 1 -- 172.21.15.116:0/3269467790 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7fed280577f0 con 0x7fed401589d0 2023-05-12T09:08:36.430 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:36.431 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:36.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 -- 172.21.15.116:0/3269467790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed2006ace0 msgr2=0x7fed2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed2006ace0 0x7fed2006d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed300090b0 tx=0x7fed30008030 comp rx=0 tx=0).stop 2023-05-12T09:08:36.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 -- 172.21.15.116:0/3269467790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 msgr2=0x7fed401576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 0x7fed401576a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fed2800e730 tx=0x7fed2800eaf0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 -- 172.21.15.116:0/3269467790 shutdown_connections 2023-05-12T09:08:36.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fed2006ace0 0x7fed2006d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fed40158da0 0x7fed401f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fed400cd690 0x7fed4014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 --2- 172.21.15.116:0/3269467790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed401589d0 0x7fed401576a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 -- 172.21.15.116:0/3269467790 >> 172.21.15.116:0/3269467790 conn(0x7fed400cf720 msgr2=0x7fed400aceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:36.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 -- 172.21.15.116:0/3269467790 shutdown_connections 2023-05-12T09:08:36.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.429+0000 7fed44fff700 1 -- 172.21.15.116:0/3269467790 wait complete. 2023-05-12T09:08:36.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:36.451 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.634+0000 7f39d53ff700 1 Processor -- start 2023-05-12T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.634+0000 7f39d53ff700 1 -- start start 2023-05-12T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.635+0000 7f39d53ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f39d006b4f0 0x7f39d006b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.635+0000 7f39d53ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f39d00cbf90 0x7f39d00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.635+0000 7f39d53ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d00b26f0 con 0x7f39d00d0130 2023-05-12T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.635+0000 7f39d53ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d006be00 con 0x7f39d006b4f0 2023-05-12T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.635+0000 7f39d53ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00cfb60 con 0x7f39d00cbf90 2023-05-12T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.636+0000 7f39ceffd700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f39d006b4f0 0x7f39d006b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.636+0000 7f39cf7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f39d00cbf90 0x7f39d00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.636+0000 7f39ceffd700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f39d006b4f0 0x7f39d006b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:50972/0 (socket says 172.21.15.116:50972) 2023-05-12T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.636+0000 7f39ceffd700 1 -- 172.21.15.116:0/2162574719 learned_addr learned my addr 172.21.15.116:0/2162574719 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.636+0000 7f39ceffd700 1 -- 172.21.15.116:0/2162574719 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f39d00cbf90 msgr2=0x7f39d00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.636+0000 7f39ceffd700 1 --2- 172.21.15.116:0/2162574719 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f39d00cbf90 0x7f39d00cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.636+0000 7f39ceffd700 1 -- 172.21.15.116:0/2162574719 >> v1:172.21.15.182:6789/0 conn(0x7f39d00d0130 legacy=0x7f39d00cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.636+0000 7f39ceffd700 1 -- 172.21.15.116:0/2162574719 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00cfe40 con 0x7f39d006b4f0 2023-05-12T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.637+0000 7f39ceffd700 1 --2- 172.21.15.116:0/2162574719 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f39d006b4f0 0x7f39d006b8c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009920 tx=0x7f39c0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fe69575f7235af4 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.637+0000 7f39cdffb700 1 -- 172.21.15.116:0/2162574719 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0011830 con 0x7f39d006b4f0 2023-05-12T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.637+0000 7f39cdffb700 1 -- 172.21.15.116:0/2162574719 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c0011990 con 0x7f39d006b4f0 2023-05-12T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.637+0000 7f39cdffb700 1 -- 172.21.15.116:0/2162574719 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0011d20 con 0x7f39d006b4f0 2023-05-12T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.638+0000 7f39d53ff700 1 -- 172.21.15.116:0/2162574719 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f39d006b4f0 msgr2=0x7f39d006b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.638+0000 7f39d53ff700 1 --2- 172.21.15.116:0/2162574719 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f39d006b4f0 0x7f39d006b8c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009920 tx=0x7f39c0009c30 comp rx=0 tx=0).stop 2023-05-12T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.638+0000 7f39d53ff700 1 -- 172.21.15.116:0/2162574719 shutdown_connections 2023-05-12T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.638+0000 7f39d53ff700 1 --2- 172.21.15.116:0/2162574719 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f39d00cbf90 0x7f39d00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.638+0000 7f39d53ff700 1 --2- 172.21.15.116:0/2162574719 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f39d006b4f0 0x7f39d006b8c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.638+0000 7f39d53ff700 1 -- 172.21.15.116:0/2162574719 >> 172.21.15.116:0/2162574719 conn(0x7f39d009a090 msgr2=0x7f39d00d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.638+0000 7f39d53ff700 1 -- 172.21.15.116:0/2162574719 shutdown_connections 2023-05-12T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.638+0000 7f39d53ff700 1 -- 172.21.15.116:0/2162574719 wait complete. 2023-05-12T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.639+0000 7f39d53ff700 1 Processor -- start 2023-05-12T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.640+0000 7f39d53ff700 1 -- start start 2023-05-12T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.640+0000 7f39d53ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f39d006b4f0 0x7f39d01e4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.640+0000 7f39d53ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39d00cbf90 0x7f39d01581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.640+0000 7f39d53ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f39d00d0130 0x7f39d00c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.640+0000 7f39d53ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d0158710 con 0x7f39d00cbf90 2023-05-12T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.640+0000 7f39d53ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d01e4850 con 0x7f39d006b4f0 2023-05-12T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.640+0000 7f39d53ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d0158a20 con 0x7f39d00d0130 2023-05-12T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39ce7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39d00cbf90 0x7f39d01581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39ce7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39d00cbf90 0x7f39d01581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42540/0 (socket says 172.21.15.116:42540) 2023-05-12T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39ce7fc700 1 -- 172.21.15.116:0/1642342285 learned_addr learned my addr 172.21.15.116:0/1642342285 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39ceffd700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f39d006b4f0 0x7f39d01e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39cf7fe700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f39d00d0130 0x7f39d00c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39ce7fc700 1 -- 172.21.15.116:0/1642342285 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f39d00d0130 msgr2=0x7f39d00c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39ce7fc700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f39d00d0130 0x7f39d00c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39ce7fc700 1 -- 172.21.15.116:0/1642342285 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f39d006b4f0 msgr2=0x7f39d01e4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39ce7fc700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f39d006b4f0 0x7f39d01e4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39ce7fc700 1 -- 172.21.15.116:0/1642342285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0009550 con 0x7f39d00cbf90 2023-05-12T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.641+0000 7f39ce7fc700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39d00cbf90 0x7f39d01581d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c4e0 tx=0x7f39c400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.642+0000 7f39b77fe700 1 -- 172.21.15.116:0/1642342285 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c40052d0 con 0x7f39d00cbf90 2023-05-12T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.642+0000 7f39b77fe700 1 -- 172.21.15.116:0/1642342285 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c4005430 con 0x7f39d00cbf90 2023-05-12T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.642+0000 7f39d53ff700 1 -- 172.21.15.116:0/1642342285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d00cb790 con 0x7f39d00cbf90 2023-05-12T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.642+0000 7f39b77fe700 1 -- 172.21.15.116:0/1642342285 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c40038c0 con 0x7f39d00cbf90 2023-05-12T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.642+0000 7f39d53ff700 1 -- 172.21.15.116:0/1642342285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d00cb4b0 con 0x7f39d00cbf90 2023-05-12T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.643+0000 7f39d53ff700 1 -- 172.21.15.116:0/1642342285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d00cba70 con 0x7f39d00cbf90 2023-05-12T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.644+0000 7f39b77fe700 1 -- 172.21.15.116:0/1642342285 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39c4003a20 con 0x7f39d00cbf90 2023-05-12T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.645+0000 7f39b77fe700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f39bc06ace0 0x7f39bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.645+0000 7f39b77fe700 1 -- 172.21.15.116:0/1642342285 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f39c4088bf0 con 0x7f39d00cbf90 2023-05-12T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.645+0000 7f39ceffd700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f39bc06ace0 0x7f39bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.646+0000 7f39ceffd700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f39bc06ace0 0x7f39bc06d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009840 tx=0x7f39c0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.649+0000 7f39b77fe700 1 -- 172.21.15.116:0/1642342285 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f39c40538d0 con 0x7f39d00cbf90 2023-05-12T09:08:36.845 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.843+0000 7f39d53ff700 1 -- 172.21.15.116:0/1642342285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39d0074430 con 0x7f39d00cbf90 2023-05-12T09:08:36.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.843+0000 7f39b77fe700 1 -- 172.21.15.116:0/1642342285 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f39c4017020 con 0x7f39d00cbf90 2023-05-12T09:08:36.846 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:36.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 -- 172.21.15.116:0/1642342285 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f39bc06ace0 msgr2=0x7f39bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f39bc06ace0 0x7f39bc06d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009840 tx=0x7f39c0008030 comp rx=0 tx=0).stop 2023-05-12T09:08:36.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 -- 172.21.15.116:0/1642342285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39d00cbf90 msgr2=0x7f39d01581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:36.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39d00cbf90 0x7f39d01581d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c4e0 tx=0x7f39c400c7f0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 -- 172.21.15.116:0/1642342285 shutdown_connections 2023-05-12T09:08:36.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f39bc06ace0 0x7f39bc06d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f39d00d0130 0x7f39d00c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f39d006b4f0 0x7f39d01e4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 --2- 172.21.15.116:0/1642342285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39d00cbf90 0x7f39d01581d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:36.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 -- 172.21.15.116:0/1642342285 >> 172.21.15.116:0/1642342285 conn(0x7f39d009a090 msgr2=0x7f39d006fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:36.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.845+0000 7f39d53ff700 1 -- 172.21.15.116:0/1642342285 shutdown_connections 2023-05-12T09:08:36.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:36.846+0000 7f39d53ff700 1 -- 172.21.15.116:0/1642342285 wait complete. 2023-05-12T09:08:36.866 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.050+0000 7f9563fff700 1 Processor -- start 2023-05-12T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.051+0000 7f9563fff700 1 -- start start 2023-05-12T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9563fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f955c0cd790 0x7f955c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9563fff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f955c0cdb60 0x7f955c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9563fff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955c06a5f0 con 0x7f955c0b1b80 2023-05-12T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9563fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955c06a840 con 0x7f955c0cd790 2023-05-12T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9563fff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955c06ab20 con 0x7f955c0cdb60 2023-05-12T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f956259c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f955c0b1b80 0x7f955c06b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50902/0 (socket says 172.21.15.116:50902) 2023-05-12T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f956259c700 1 -- 172.21.15.116:0/1367270362 learned_addr learned my addr 172.21.15.116:0/1367270362 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9561d9b700 1 --2- 172.21.15.116:0/1367270362 >> v2:172.21.15.116:3300/0 conn(0x7f955c0cd790 0x7f955c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f956159a700 1 --2- 172.21.15.116:0/1367270362 >> v2:172.21.15.182:3300/0 conn(0x7f955c0cdb60 0x7f955c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9561d9b700 1 -- 172.21.15.116:0/1367270362 >> v2:172.21.15.182:3300/0 conn(0x7f955c0cdb60 msgr2=0x7f955c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9560d99700 1 -- 172.21.15.116:0/1367270362 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534822982 0 0) 0x7f955c06a5f0 con 0x7f955c0b1b80 2023-05-12T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9561d9b700 1 --2- 172.21.15.116:0/1367270362 >> v2:172.21.15.182:3300/0 conn(0x7f955c0cdb60 0x7f955c0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9561d9b700 1 -- 172.21.15.116:0/1367270362 >> v1:172.21.15.116:6789/0 conn(0x7f955c0b1b80 legacy=0x7f955c06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f9561d9b700 1 -- 172.21.15.116:0/1367270362 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c06ae00 con 0x7f955c0cd790 2023-05-12T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.052+0000 7f956159a700 1 --2- 172.21.15.116:0/1367270362 >> v2:172.21.15.182:3300/0 conn(0x7f955c0cdb60 0x7f955c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.053+0000 7f9561d9b700 1 --2- 172.21.15.116:0/1367270362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 0x7f955c0ca210 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9558009840 tx=0x7f9558009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26442b2771ca5a78 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.053+0000 7f9560d99700 1 -- 172.21.15.116:0/1367270362 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558011830 con 0x7f955c0cd790 2023-05-12T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.053+0000 7f9560d99700 1 -- 172.21.15.116:0/1367270362 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9558011990 con 0x7f955c0cd790 2023-05-12T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.053+0000 7f9560d99700 1 -- 172.21.15.116:0/1367270362 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558011d20 con 0x7f955c0cd790 2023-05-12T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.053+0000 7f9563fff700 1 -- 172.21.15.116:0/1367270362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 msgr2=0x7f955c0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.053+0000 7f9563fff700 1 --2- 172.21.15.116:0/1367270362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 0x7f955c0ca210 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9558009840 tx=0x7f9558009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.054+0000 7f9563fff700 1 -- 172.21.15.116:0/1367270362 shutdown_connections 2023-05-12T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.054+0000 7f9563fff700 1 --2- 172.21.15.116:0/1367270362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 0x7f955c0ca210 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.054+0000 7f9563fff700 1 --2- 172.21.15.116:0/1367270362 >> v2:172.21.15.182:3300/0 conn(0x7f955c0cdb60 0x7f955c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.054+0000 7f9563fff700 1 -- 172.21.15.116:0/1367270362 >> 172.21.15.116:0/1367270362 conn(0x7f955c06e980 msgr2=0x7f955c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.054+0000 7f9563fff700 1 -- 172.21.15.116:0/1367270362 shutdown_connections 2023-05-12T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.054+0000 7f9563fff700 1 -- 172.21.15.116:0/1367270362 wait complete. 2023-05-12T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.055+0000 7f9563fff700 1 Processor -- start 2023-05-12T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.055+0000 7f9563fff700 1 -- start start 2023-05-12T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.056+0000 7f9563fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f955c0b1b80 0x7f955c158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.056+0000 7f9563fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 0x7f955c159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.056+0000 7f9563fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f955c0cdb60 0x7f955c159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.056+0000 7f9563fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c0b2c90 con 0x7f955c0cd790 2023-05-12T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.056+0000 7f9563fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c0c8430 con 0x7f955c0b1b80 2023-05-12T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.056+0000 7f9563fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955c15b900 con 0x7f955c0cdb60 2023-05-12T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.056+0000 7f956159a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 0x7f955c159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f956159a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 0x7f955c159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42558/0 (socket says 172.21.15.116:42558) 2023-05-12T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f956159a700 1 -- 172.21.15.116:0/4022446867 learned_addr learned my addr 172.21.15.116:0/4022446867 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f9561d9b700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f955c0b1b80 0x7f955c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f956259c700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f955c0cdb60 0x7f955c159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f956159a700 1 -- 172.21.15.116:0/4022446867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f955c0cdb60 msgr2=0x7f955c159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f956159a700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f955c0cdb60 0x7f955c159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f956159a700 1 -- 172.21.15.116:0/4022446867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f955c0b1b80 msgr2=0x7f955c158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f956159a700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f955c0b1b80 0x7f955c158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f956159a700 1 -- 172.21.15.116:0/4022446867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95580094a0 con 0x7f955c0cd790 2023-05-12T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f9561d9b700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f955c0b1b80 0x7f955c158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f956159a700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 0x7f955c159100 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f954c00c750 tx=0x7f954c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.057+0000 7f95527fc700 1 -- 172.21.15.116:0/4022446867 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c011800 con 0x7f955c0cd790 2023-05-12T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.058+0000 7f95527fc700 1 -- 172.21.15.116:0/4022446867 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c011960 con 0x7f955c0cd790 2023-05-12T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.058+0000 7f9563fff700 1 -- 172.21.15.116:0/4022446867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955c0b2000 con 0x7f955c0cd790 2023-05-12T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.058+0000 7f95527fc700 1 -- 172.21.15.116:0/4022446867 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c011cd0 con 0x7f955c0cd790 2023-05-12T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.058+0000 7f9563fff700 1 -- 172.21.15.116:0/4022446867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955c06b0e0 con 0x7f955c0cd790 2023-05-12T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.059+0000 7f9563fff700 1 -- 172.21.15.116:0/4022446867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955c0ce000 con 0x7f955c0cd790 2023-05-12T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.060+0000 7f95527fc700 1 -- 172.21.15.116:0/4022446867 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f954c021350 con 0x7f955c0cd790 2023-05-12T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.061+0000 7f95527fc700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f954006ace0 0x7f954006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.061+0000 7f95527fc700 1 -- 172.21.15.116:0/4022446867 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f954c0897a0 con 0x7f955c0cd790 2023-05-12T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.061+0000 7f9561d9b700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f954006ace0 0x7f954006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.061+0000 7f9561d9b700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f954006ace0 0x7f954006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95580090b0 tx=0x7f955801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.065+0000 7f95527fc700 1 -- 172.21.15.116:0/4022446867 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f954c057fa0 con 0x7f955c0cd790 2023-05-12T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.259+0000 7f9563fff700 1 -- 172.21.15.116:0/4022446867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f955c15fc80 con 0x7f955c0cd790 2023-05-12T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.259+0000 7f95527fc700 1 -- 172.21.15.116:0/4022446867 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f954c057b30 con 0x7f955c0cd790 2023-05-12T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 -- 172.21.15.116:0/4022446867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f954006ace0 msgr2=0x7f954006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f954006ace0 0x7f954006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95580090b0 tx=0x7f955801c040 comp rx=0 tx=0).stop 2023-05-12T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 -- 172.21.15.116:0/4022446867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 msgr2=0x7f955c159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 0x7f955c159100 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f954c00c750 tx=0x7f954c00cb10 comp rx=0 tx=0).stop 2023-05-12T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 -- 172.21.15.116:0/4022446867 shutdown_connections 2023-05-12T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f954006ace0 0x7f954006d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f955c0cdb60 0x7f955c159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f955c0b1b80 0x7f955c158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 --2- 172.21.15.116:0/4022446867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f955c0cd790 0x7f955c159100 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 -- 172.21.15.116:0/4022446867 >> 172.21.15.116:0/4022446867 conn(0x7f955c06e980 msgr2=0x7f955c157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 -- 172.21.15.116:0/4022446867 shutdown_connections 2023-05-12T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.262+0000 7f9563fff700 1 -- 172.21.15.116:0/4022446867 wait complete. 2023-05-12T09:08:37.282 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.466+0000 7f32301ff700 1 Processor -- start 2023-05-12T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.466+0000 7f32301ff700 1 -- start start 2023-05-12T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f32301ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f32280cff50 0x7f3228160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f32301ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32280cd520 con 0x7f322815c590 2023-05-12T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f32301ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32280d2640 con 0x7f32280cf010 2023-05-12T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f32301ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32281610d0 con 0x7f32280cff50 2023-05-12T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f322df9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f322815c590 0x7f32280cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50906/0 (socket says 172.21.15.116:50906) 2023-05-12T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f322df9b700 1 -- 172.21.15.116:0/1642092202 learned_addr learned my addr 172.21.15.116:0/1642092202 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f322e79c700 1 --2- 172.21.15.116:0/1642092202 >> v2:172.21.15.116:3300/0 conn(0x7f32280cff50 0x7f3228160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f322e79c700 1 -- 172.21.15.116:0/1642092202 >> v1:172.21.15.182:6789/0 conn(0x7f32280cf010 legacy=0x7f32280d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f322e79c700 1 -- 172.21.15.116:0/1642092202 >> v1:172.21.15.116:6789/0 conn(0x7f322815c590 legacy=0x7f32280cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f322e79c700 1 -- 172.21.15.116:0/1642092202 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32280b23c0 con 0x7f32280cff50 2023-05-12T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.468+0000 7f322cf99700 1 -- 172.21.15.116:0/1642092202 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588854297 0 0) 0x7f32280cd520 con 0x7f322815c590 2023-05-12T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.469+0000 7f322e79c700 1 --2- 172.21.15.116:0/1642092202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 0x7f3228160b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3220009d90 tx=0x7f322000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6713225c961ef636 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.469+0000 7f322cf99700 1 -- 172.21.15.116:0/1642092202 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322000e070 con 0x7f32280cff50 2023-05-12T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.469+0000 7f322cf99700 1 -- 172.21.15.116:0/1642092202 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322000bbd0 con 0x7f32280cff50 2023-05-12T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.469+0000 7f322cf99700 1 -- 172.21.15.116:0/1642092202 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220012430 con 0x7f32280cff50 2023-05-12T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.469+0000 7f32301ff700 1 -- 172.21.15.116:0/1642092202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 msgr2=0x7f3228160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.469+0000 7f32301ff700 1 --2- 172.21.15.116:0/1642092202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 0x7f3228160b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3220009d90 tx=0x7f322000b330 comp rx=0 tx=0).stop 2023-05-12T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.469+0000 7f32301ff700 1 -- 172.21.15.116:0/1642092202 shutdown_connections 2023-05-12T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.469+0000 7f32301ff700 1 --2- 172.21.15.116:0/1642092202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 0x7f3228160b90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.469+0000 7f32301ff700 1 -- 172.21.15.116:0/1642092202 >> 172.21.15.116:0/1642092202 conn(0x7f3228071b10 msgr2=0x7f3228071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.470+0000 7f32301ff700 1 -- 172.21.15.116:0/1642092202 shutdown_connections 2023-05-12T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.470+0000 7f32301ff700 1 -- 172.21.15.116:0/1642092202 wait complete. 2023-05-12T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.471+0000 7f32301ff700 1 Processor -- start 2023-05-12T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.471+0000 7f32301ff700 1 -- start start 2023-05-12T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.472+0000 7f32301ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32280cf010 0x7f32280c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.472+0000 7f32301ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 0x7f32281606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.472+0000 7f32301ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f322815c590 0x7f32281523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.472+0000 7f32301ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32280b6d10 con 0x7f32280cff50 2023-05-12T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.472+0000 7f32301ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322815fc10 con 0x7f32280cf010 2023-05-12T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.472+0000 7f32301ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322815fef0 con 0x7f322815c590 2023-05-12T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.472+0000 7f322d79a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 0x7f32281606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.472+0000 7f322d79a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 0x7f32281606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42584/0 (socket says 172.21.15.116:42584) 2023-05-12T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.472+0000 7f322d79a700 1 -- 172.21.15.116:0/3667758971 learned_addr learned my addr 172.21.15.116:0/3667758971 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f322df9b700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32280cf010 0x7f32280c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f322e79c700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f322815c590 0x7f32281523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f322d79a700 1 -- 172.21.15.116:0/3667758971 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f322815c590 msgr2=0x7f32281523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f322d79a700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f322815c590 0x7f32281523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f322d79a700 1 -- 172.21.15.116:0/3667758971 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32280cf010 msgr2=0x7f32280c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f322d79a700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32280cf010 0x7f32280c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f322d79a700 1 -- 172.21.15.116:0/3667758971 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3220009a70 con 0x7f32280cff50 2023-05-12T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f322e79c700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f322815c590 0x7f32281523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f322d79a700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 0x7f32281606f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f321800c4e0 tx=0x7f321800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f321e7fc700 1 -- 172.21.15.116:0/3667758971 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32180052d0 con 0x7f32280cff50 2023-05-12T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f321e7fc700 1 -- 172.21.15.116:0/3667758971 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3218005430 con 0x7f32280cff50 2023-05-12T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f32301ff700 1 -- 172.21.15.116:0/3667758971 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32280cd770 con 0x7f32280cff50 2023-05-12T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f321e7fc700 1 -- 172.21.15.116:0/3667758971 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32180038c0 con 0x7f32280cff50 2023-05-12T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.473+0000 7f32301ff700 1 -- 172.21.15.116:0/3667758971 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32280cf560 con 0x7f32280cff50 2023-05-12T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.474+0000 7f32301ff700 1 -- 172.21.15.116:0/3667758971 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322815c960 con 0x7f32280cff50 2023-05-12T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.475+0000 7f321e7fc700 1 -- 172.21.15.116:0/3667758971 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3218003a20 con 0x7f32280cff50 2023-05-12T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.476+0000 7f321e7fc700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f320c06ace0 0x7f320c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.476+0000 7f321e7fc700 1 -- 172.21.15.116:0/3667758971 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3218088c60 con 0x7f32280cff50 2023-05-12T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.477+0000 7f322df9b700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f320c06ace0 0x7f320c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.477+0000 7f322df9b700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f320c06ace0 0x7f320c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3224000f60 tx=0x7f3224004a50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.480+0000 7f321e7fc700 1 -- 172.21.15.116:0/3667758971 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f32180539d0 con 0x7f32280cff50 2023-05-12T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.676+0000 7f32301ff700 1 -- 172.21.15.116:0/3667758971 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32280b51f0 con 0x7f32280cff50 2023-05-12T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.676+0000 7f321e7fc700 1 -- 172.21.15.116:0/3667758971 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3218056ff0 con 0x7f32280cff50 2023-05-12T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.678+0000 7f32301ff700 1 -- 172.21.15.116:0/3667758971 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f320c06ace0 msgr2=0x7f320c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.678+0000 7f32301ff700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f320c06ace0 0x7f320c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3224000f60 tx=0x7f3224004a50 comp rx=0 tx=0).stop 2023-05-12T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.678+0000 7f32301ff700 1 -- 172.21.15.116:0/3667758971 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 msgr2=0x7f32281606f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.678+0000 7f32301ff700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 0x7f32281606f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f321800c4e0 tx=0x7f321800c7f0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.678+0000 7f32301ff700 1 -- 172.21.15.116:0/3667758971 shutdown_connections 2023-05-12T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.678+0000 7f32301ff700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f320c06ace0 0x7f320c06d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.678+0000 7f32301ff700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f322815c590 0x7f32281523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.678+0000 7f32301ff700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f32280cf010 0x7f32280c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.678+0000 7f32301ff700 1 --2- 172.21.15.116:0/3667758971 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32280cff50 0x7f32281606f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.678+0000 7f32301ff700 1 -- 172.21.15.116:0/3667758971 >> 172.21.15.116:0/3667758971 conn(0x7f3228071b10 msgr2=0x7f32280b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.679+0000 7f32301ff700 1 -- 172.21.15.116:0/3667758971 shutdown_connections 2023-05-12T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.679+0000 7f32301ff700 1 -- 172.21.15.116:0/3667758971 wait complete. 2023-05-12T09:08:37.699 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:37.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.884+0000 7f93273ff700 1 Processor -- start 2023-05-12T09:08:37.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.884+0000 7f93273ff700 1 -- start start 2023-05-12T09:08:37.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.885+0000 7f93273ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f932006b4f0 0x7f932006b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.885+0000 7f93273ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200d0130 0x7f93200cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.886+0000 7f93273ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93200b26f0 con 0x7f93200cd7d0 2023-05-12T09:08:37.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.886+0000 7f93273ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932006be00 con 0x7f932006b4f0 2023-05-12T09:08:37.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.886+0000 7f93273ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93200cf890 con 0x7f93200d0130 2023-05-12T09:08:37.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.886+0000 7f932599c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f93200cd7d0 0x7f93200cdc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50916/0 (socket says 172.21.15.116:50916) 2023-05-12T09:08:37.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.886+0000 7f932599c700 1 -- 172.21.15.116:0/411333990 learned_addr learned my addr 172.21.15.116:0/411333990 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:37.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.886+0000 7f932499a700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200d0130 0x7f93200cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.886+0000 7f932519b700 1 --2- 172.21.15.116:0/411333990 >> v2:172.21.15.182:3300/0 conn(0x7f932006b4f0 0x7f932006b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.886+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934787927 0 0) 0x7f93200b26f0 con 0x7f93200cd7d0 2023-05-12T09:08:37.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.886+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f930c0035b0 con 0x7f93200cd7d0 2023-05-12T09:08:37.892 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1603666207 0 0) 0x7f930c0035b0 con 0x7f93200cd7d0 2023-05-12T09:08:37.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200d0130 msgr2=0x7f93200cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:37.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200d0130 0x7f93200cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 >> v2:172.21.15.182:3300/0 conn(0x7f932006b4f0 msgr2=0x7f932006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:37.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 --2- 172.21.15.116:0/411333990 >> v2:172.21.15.182:3300/0 conn(0x7f932006b4f0 0x7f932006b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93200cfb60 con 0x7f93200cd7d0 2023-05-12T09:08:37.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f93180019f0 con 0x7f93200cd7d0 2023-05-12T09:08:37.893 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f932519b700 1 --2- 172.21.15.116:0/411333990 >> v2:172.21.15.182:3300/0 conn(0x7f932006b4f0 0x7f932006b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:37.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 >> v1:172.21.15.116:6789/0 conn(0x7f93200cd7d0 legacy=0x7f93200cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f930c003a00 0x7f930c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200d0130 0x7f930c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f930c004d90 0x7f930c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932006be00 con 0x7f930c004d90 2023-05-12T09:08:37.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93200cf890 con 0x7f930c003a00 2023-05-12T09:08:37.894 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c00ba10 con 0x7f93200d0130 2023-05-12T09:08:37.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f932599c700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f930c004d90 0x7f930c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f932519b700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f930c003a00 0x7f930c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f932499a700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200d0130 0x7f930c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f932599c700 1 -- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200d0130 msgr2=0x7f930c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:37.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f932599c700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200d0130 0x7f930c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f932599c700 1 -- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f930c003a00 msgr2=0x7f930c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:37.895 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f932599c700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f930c003a00 0x7f930c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f932599c700 1 -- 172.21.15.116:0/411333990 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c0035b0 con 0x7f930c004d90 2023-05-12T09:08:37.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.887+0000 7f932499a700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200d0130 0x7f930c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:37.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.888+0000 7f932599c700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f930c004d90 0x7f930c005200 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f931800a860 tx=0x7f930c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0254b2b4079858 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:37.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.888+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318012600 con 0x7f930c004d90 2023-05-12T09:08:37.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.888+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318012780 con 0x7f930c004d90 2023-05-12T09:08:37.896 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.888+0000 7f9317fff700 1 -- 172.21.15.116:0/411333990 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318012b30 con 0x7f930c004d90 2023-05-12T09:08:37.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.888+0000 7f93273ff700 1 -- 172.21.15.116:0/411333990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f930c004d90 msgr2=0x7f930c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.888+0000 7f93273ff700 1 --2- 172.21.15.116:0/411333990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f930c004d90 0x7f930c005200 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f931800a860 tx=0x7f930c005880 comp rx=0 tx=0).stop 2023-05-12T09:08:37.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.888+0000 7f932599c700 1 -- 172.21.15.116:0/411333990 reap_dead start 2023-05-12T09:08:37.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.888+0000 7f93273ff700 1 -- 172.21.15.116:0/411333990 shutdown_connections 2023-05-12T09:08:37.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.888+0000 7f93273ff700 1 -- 172.21.15.116:0/411333990 >> 172.21.15.116:0/411333990 conn(0x7f932009a090 msgr2=0x7f93200d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:37.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.888+0000 7f93273ff700 1 -- 172.21.15.116:0/411333990 shutdown_connections 2023-05-12T09:08:37.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.889+0000 7f93273ff700 1 -- 172.21.15.116:0/411333990 wait complete. 2023-05-12T09:08:37.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.890+0000 7f93273ff700 1 Processor -- start 2023-05-12T09:08:37.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.890+0000 7f93273ff700 1 -- start start 2023-05-12T09:08:37.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.891+0000 7f93273ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f930c004d90 0x7f93200c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.891+0000 7f93273ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9320155460 0x7f93200c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.891+0000 7f93273ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200c90c0 0x7f93200c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.891+0000 7f93273ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93200c9560 con 0x7f9320155460 2023-05-12T09:08:37.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.891+0000 7f93273ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320155cd0 con 0x7f930c004d90 2023-05-12T09:08:37.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.891+0000 7f93273ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93200c6950 con 0x7f93200c90c0 2023-05-12T09:08:37.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932499a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9320155460 0x7f93200c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932499a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9320155460 0x7f93200c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42604/0 (socket says 172.21.15.116:42604) 2023-05-12T09:08:37.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932499a700 1 -- 172.21.15.116:0/1143552088 learned_addr learned my addr 172.21.15.116:0/1143552088 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:37.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932519b700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f930c004d90 0x7f93200c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932599c700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200c90c0 0x7f93200c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932499a700 1 -- 172.21.15.116:0/1143552088 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200c90c0 msgr2=0x7f93200c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932499a700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200c90c0 0x7f93200c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932499a700 1 -- 172.21.15.116:0/1143552088 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f930c004d90 msgr2=0x7f93200c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:37.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932499a700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f930c004d90 0x7f93200c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:37.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932499a700 1 -- 172.21.15.116:0/1143552088 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93200cb4b0 con 0x7f9320155460 2023-05-12T09:08:37.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932519b700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f930c004d90 0x7f93200c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:37.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932599c700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200c90c0 0x7f93200c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:37.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f932499a700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9320155460 0x7f93200c8b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9310011900 tx=0x7f9310011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:37.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f9315ffb700 1 -- 172.21.15.116:0/1143552088 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310004220 con 0x7f9320155460 2023-05-12T09:08:37.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f9315ffb700 1 -- 172.21.15.116:0/1143552088 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9310004380 con 0x7f9320155460 2023-05-12T09:08:37.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f9315ffb700 1 -- 172.21.15.116:0/1143552088 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93100036a0 con 0x7f9320155460 2023-05-12T09:08:37.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.892+0000 7f93273ff700 1 -- 172.21.15.116:0/1143552088 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93200cfe40 con 0x7f9320155460 2023-05-12T09:08:37.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.893+0000 7f93273ff700 1 -- 172.21.15.116:0/1143552088 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93200cb790 con 0x7f9320155460 2023-05-12T09:08:37.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.894+0000 7f93273ff700 1 -- 172.21.15.116:0/1143552088 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93200c6a90 con 0x7f9320155460 2023-05-12T09:08:37.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.895+0000 7f9315ffb700 1 -- 172.21.15.116:0/1143552088 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9310003800 con 0x7f9320155460 2023-05-12T09:08:37.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.895+0000 7f9315ffb700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f930406ace0 0x7f930406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:37.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.895+0000 7f9315ffb700 1 -- 172.21.15.116:0/1143552088 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9310089c00 con 0x7f9320155460 2023-05-12T09:08:37.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.896+0000 7f932519b700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f930406ace0 0x7f930406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:37.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.896+0000 7f932519b700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f930406ace0 0x7f930406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f931c006ba0 tx=0x7f931c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:37.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:37.900+0000 7f9315ffb700 1 -- 172.21.15.116:0/1143552088 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9310054970 con 0x7f9320155460 2023-05-12T09:08:38.099 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.096+0000 7f93273ff700 1 -- 172.21.15.116:0/1143552088 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93200c6c20 con 0x7f9320155460 2023-05-12T09:08:38.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.097+0000 7f9315ffb700 1 -- 172.21.15.116:0/1143552088 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f93200c6c20 con 0x7f9320155460 2023-05-12T09:08:38.100 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:38.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 -- 172.21.15.116:0/1143552088 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f930406ace0 msgr2=0x7f930406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f930406ace0 0x7f930406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f931c006ba0 tx=0x7f931c008040 comp rx=0 tx=0).stop 2023-05-12T09:08:38.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 -- 172.21.15.116:0/1143552088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9320155460 msgr2=0x7f93200c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9320155460 0x7f93200c8b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9310011900 tx=0x7f9310011cc0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 -- 172.21.15.116:0/1143552088 shutdown_connections 2023-05-12T09:08:38.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f930406ace0 0x7f930406d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f93200c90c0 0x7f93200c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f930c004d90 0x7f93200c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 --2- 172.21.15.116:0/1143552088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9320155460 0x7f93200c8b80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 -- 172.21.15.116:0/1143552088 >> 172.21.15.116:0/1143552088 conn(0x7f932009a090 msgr2=0x7f93200cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:38.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 -- 172.21.15.116:0/1143552088 shutdown_connections 2023-05-12T09:08:38.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.099+0000 7f93273ff700 1 -- 172.21.15.116:0/1143552088 wait complete. 2023-05-12T09:08:38.121 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:38.307 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.304+0000 7fa7e99ff700 1 Processor -- start 2023-05-12T09:08:38.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.304+0000 7fa7e99ff700 1 -- start start 2023-05-12T09:08:38.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7e99ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fa7e40cd760 0x7fa7e40cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7e99ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa7e40adf70 0x7fa7e40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7e99ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e40cc9e0 con 0x7fa7e415cf10 2023-05-12T09:08:38.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7e99ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e415de20 con 0x7fa7e40adf70 2023-05-12T09:08:38.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7e99ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e40ce070 con 0x7fa7e40cd760 2023-05-12T09:08:38.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7dbfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa7e40adf70 0x7fa7e40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7dbfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa7e40adf70 0x7fa7e40cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42616/0 (socket says 172.21.15.116:42616) 2023-05-12T09:08:38.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7dbfff700 1 -- 172.21.15.116:0/469140923 learned_addr learned my addr 172.21.15.116:0/469140923 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:38.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7dbfff700 1 -- 172.21.15.116:0/469140923 >> v2:172.21.15.182:3300/0 conn(0x7fa7e40cd760 msgr2=0x7fa7e40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:38.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7e2ffd700 1 --2- 172.21.15.116:0/469140923 >> v2:172.21.15.182:3300/0 conn(0x7fa7e40cd760 0x7fa7e40cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7dbfff700 1 --2- 172.21.15.116:0/469140923 >> v2:172.21.15.182:3300/0 conn(0x7fa7e40cd760 0x7fa7e40cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7dbfff700 1 -- 172.21.15.116:0/469140923 >> v1:172.21.15.182:6789/0 conn(0x7fa7e415cf10 legacy=0x7fa7e406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:38.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.306+0000 7fa7dbfff700 1 -- 172.21.15.116:0/469140923 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e415d860 con 0x7fa7e40adf70 2023-05-12T09:08:38.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.307+0000 7fa7e2ffd700 1 --2- 172.21.15.116:0/469140923 >> v2:172.21.15.182:3300/0 conn(0x7fa7e40cd760 0x7fa7e40cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:38.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.307+0000 7fa7dbfff700 1 --2- 172.21.15.116:0/469140923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 0x7fa7e40cce70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40cc230 tx=0x7fa7cc00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bfc4f56b3af49d server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:38.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.307+0000 7fa7e27fc700 1 -- 172.21.15.116:0/469140923 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc005e30 con 0x7fa7e40adf70 2023-05-12T09:08:38.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.307+0000 7fa7e27fc700 1 -- 172.21.15.116:0/469140923 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc00d8b0 con 0x7fa7e40adf70 2023-05-12T09:08:38.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.307+0000 7fa7e27fc700 1 -- 172.21.15.116:0/469140923 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc00dc40 con 0x7fa7e40adf70 2023-05-12T09:08:38.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.307+0000 7fa7e99ff700 1 -- 172.21.15.116:0/469140923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 msgr2=0x7fa7e40cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.307+0000 7fa7e99ff700 1 --2- 172.21.15.116:0/469140923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 0x7fa7e40cce70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40cc230 tx=0x7fa7cc00be70 comp rx=0 tx=0).stop 2023-05-12T09:08:38.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.308+0000 7fa7e99ff700 1 -- 172.21.15.116:0/469140923 shutdown_connections 2023-05-12T09:08:38.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.308+0000 7fa7e99ff700 1 --2- 172.21.15.116:0/469140923 >> v2:172.21.15.182:3300/0 conn(0x7fa7e40cd760 0x7fa7e40cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.308+0000 7fa7e99ff700 1 --2- 172.21.15.116:0/469140923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 0x7fa7e40cce70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.308+0000 7fa7e99ff700 1 -- 172.21.15.116:0/469140923 >> 172.21.15.116:0/469140923 conn(0x7fa7e40cf720 msgr2=0x7fa7e40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:38.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.308+0000 7fa7e99ff700 1 -- 172.21.15.116:0/469140923 shutdown_connections 2023-05-12T09:08:38.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.308+0000 7fa7e99ff700 1 -- 172.21.15.116:0/469140923 wait complete. 2023-05-12T09:08:38.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.309+0000 7fa7e99ff700 1 Processor -- start 2023-05-12T09:08:38.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.309+0000 7fa7e99ff700 1 -- start start 2023-05-12T09:08:38.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.310+0000 7fa7e99ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 0x7fa7e41504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.310+0000 7fa7e99ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa7e40cd760 0x7fa7e40b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.310+0000 7fa7e99ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa7e415cf10 0x7fa7e41580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.316 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.310+0000 7fa7e99ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e41509e0 con 0x7fa7e40adf70 2023-05-12T09:08:38.317 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.310+0000 7fa7e99ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e414e2e0 con 0x7fa7e415cf10 2023-05-12T09:08:38.317 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.310+0000 7fa7e99ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40b4590 con 0x7fa7e40cd760 2023-05-12T09:08:38.317 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7e2ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 0x7fa7e41504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.317 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7e2ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 0x7fa7e41504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42626/0 (socket says 172.21.15.116:42626) 2023-05-12T09:08:38.317 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7e2ffd700 1 -- 172.21.15.116:0/3173642343 learned_addr learned my addr 172.21.15.116:0/3173642343 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:38.317 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7dbfff700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa7e40cd760 0x7fa7e40b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.317 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7e37fe700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa7e415cf10 0x7fa7e41580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7e2ffd700 1 -- 172.21.15.116:0/3173642343 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa7e40cd760 msgr2=0x7fa7e40b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7e2ffd700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa7e40cd760 0x7fa7e40b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7e2ffd700 1 -- 172.21.15.116:0/3173642343 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa7e415cf10 msgr2=0x7fa7e41580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7e2ffd700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa7e415cf10 0x7fa7e41580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7e2ffd700 1 -- 172.21.15.116:0/3173642343 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc00b7a0 con 0x7fa7e40adf70 2023-05-12T09:08:38.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.311+0000 7fa7e2ffd700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 0x7fa7e41504a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400c780 tx=0x7fa7d400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:38.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.312+0000 7fa7e0ff9700 1 -- 172.21.15.116:0/3173642343 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4011800 con 0x7fa7e40adf70 2023-05-12T09:08:38.319 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.312+0000 7fa7e0ff9700 1 -- 172.21.15.116:0/3173642343 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d4011960 con 0x7fa7e40adf70 2023-05-12T09:08:38.319 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.312+0000 7fa7e0ff9700 1 -- 172.21.15.116:0/3173642343 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4011cd0 con 0x7fa7e40adf70 2023-05-12T09:08:38.319 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.312+0000 7fa7e99ff700 1 -- 172.21.15.116:0/3173642343 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e40cc670 con 0x7fa7e40adf70 2023-05-12T09:08:38.319 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.312+0000 7fa7e99ff700 1 -- 172.21.15.116:0/3173642343 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e415db40 con 0x7fa7e40adf70 2023-05-12T09:08:38.319 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.313+0000 7fa7e99ff700 1 -- 172.21.15.116:0/3173642343 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e4071600 con 0x7fa7e40adf70 2023-05-12T09:08:38.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.314+0000 7fa7e0ff9700 1 -- 172.21.15.116:0/3173642343 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7d4021350 con 0x7fa7e40adf70 2023-05-12T09:08:38.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.315+0000 7fa7e0ff9700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa7c406ad10 0x7fa7c406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.315+0000 7fa7e0ff9700 1 -- 172.21.15.116:0/3173642343 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa7d4089770 con 0x7fa7e40adf70 2023-05-12T09:08:38.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.315+0000 7fa7dbfff700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa7c406ad10 0x7fa7c406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.315+0000 7fa7dbfff700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa7c406ad10 0x7fa7c406d1c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc000c00 tx=0x7fa7cc01c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:38.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.319+0000 7fa7e0ff9700 1 -- 172.21.15.116:0/3173642343 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa7d4057e50 con 0x7fa7e40adf70 2023-05-12T09:08:38.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.510+0000 7fa7e99ff700 1 -- 172.21.15.116:0/3173642343 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa7e40672e0 con 0x7fa7e40adf70 2023-05-12T09:08:38.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.510+0000 7fa7e0ff9700 1 -- 172.21.15.116:0/3173642343 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa7d40579e0 con 0x7fa7e40adf70 2023-05-12T09:08:38.514 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:38.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.512+0000 7fa7e99ff700 1 -- 172.21.15.116:0/3173642343 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa7c406ad10 msgr2=0x7fa7c406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.516 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa7c406ad10 0x7fa7c406d1c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc000c00 tx=0x7fa7cc01c040 comp rx=0 tx=0).stop 2023-05-12T09:08:38.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 -- 172.21.15.116:0/3173642343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 msgr2=0x7fa7e41504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 0x7fa7e41504a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400c780 tx=0x7fa7d400ca90 comp rx=0 tx=0).stop 2023-05-12T09:08:38.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 -- 172.21.15.116:0/3173642343 shutdown_connections 2023-05-12T09:08:38.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa7e415cf10 0x7fa7e41580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.517 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e40adf70 0x7fa7e41504a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa7c406ad10 0x7fa7c406d1c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 --2- 172.21.15.116:0/3173642343 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa7e40cd760 0x7fa7e40b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 -- 172.21.15.116:0/3173642343 >> 172.21.15.116:0/3173642343 conn(0x7fa7e40cf720 msgr2=0x7fa7e406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:38.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 -- 172.21.15.116:0/3173642343 shutdown_connections 2023-05-12T09:08:38.518 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.513+0000 7fa7e99ff700 1 -- 172.21.15.116:0/3173642343 wait complete. 2023-05-12T09:08:38.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-12T09:08:38.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.718+0000 7f3d635ff700 1 Processor -- start 2023-05-12T09:08:38.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.718+0000 7f3d635ff700 1 -- start start 2023-05-12T09:08:38.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d635ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3d5c0d2110 0x7f3d5c167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d635ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c161000 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d635ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c0d0020 con 0x7f3d5c0cfbf0 2023-05-12T09:08:38.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d635ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c0d02d0 con 0x7f3d5c0d2110 2023-05-12T09:08:38.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d6139b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f3d5c0b87a0 0x7f3d5c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50918/0 (socket says 172.21.15.116:50918) 2023-05-12T09:08:38.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d61b9c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3d5c0d2110 0x7f3d5c167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d6139b700 1 -- 172.21.15.116:0/2342409140 learned_addr learned my addr 172.21.15.116:0/2342409140 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:38.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d53fff700 1 -- 172.21.15.116:0/2342409140 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629462428 0 0) 0x7f3d5c161000 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d53fff700 1 -- 172.21.15.116:0/2342409140 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d480035b0 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d61b9c700 1 -- 172.21.15.116:0/2342409140 >> v1:172.21.15.182:6789/0 conn(0x7f3d5c0cfbf0 legacy=0x7f3d5c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d61b9c700 1 -- 172.21.15.116:0/2342409140 >> v1:172.21.15.116:6789/0 conn(0x7f3d5c0b87a0 legacy=0x7f3d5c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.720+0000 7f3d61b9c700 1 -- 172.21.15.116:0/2342409140 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0cdc60 con 0x7f3d5c0d2110 2023-05-12T09:08:38.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.721+0000 7f3d61b9c700 1 --2- 172.21.15.116:0/2342409140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0d2110 0x7f3d5c167550 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009d90 tx=0x7f3d5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eeed2b9c6e15bc server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:38.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.721+0000 7f3d53fff700 1 -- 172.21.15.116:0/2342409140 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5400e070 con 0x7f3d5c0d2110 2023-05-12T09:08:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.721+0000 7f3d53fff700 1 -- 172.21.15.116:0/2342409140 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5400bb20 con 0x7f3d5c0d2110 2023-05-12T09:08:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.721+0000 7f3d53fff700 1 -- 172.21.15.116:0/2342409140 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54012430 con 0x7f3d5c0d2110 2023-05-12T09:08:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.721+0000 7f3d635ff700 1 -- 172.21.15.116:0/2342409140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0d2110 msgr2=0x7f3d5c167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.721+0000 7f3d635ff700 1 --2- 172.21.15.116:0/2342409140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0d2110 0x7f3d5c167550 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009d90 tx=0x7f3d5400b330 comp rx=0 tx=0).stop 2023-05-12T09:08:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.721+0000 7f3d635ff700 1 -- 172.21.15.116:0/2342409140 shutdown_connections 2023-05-12T09:08:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.721+0000 7f3d635ff700 1 --2- 172.21.15.116:0/2342409140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0d2110 0x7f3d5c167550 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.721+0000 7f3d635ff700 1 -- 172.21.15.116:0/2342409140 >> 172.21.15.116:0/2342409140 conn(0x7f3d5c071b10 msgr2=0x7f3d5c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.721+0000 7f3d635ff700 1 -- 172.21.15.116:0/2342409140 shutdown_connections 2023-05-12T09:08:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.722+0000 7f3d635ff700 1 -- 172.21.15.116:0/2342409140 wait complete. 2023-05-12T09:08:38.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.723+0000 7f3d635ff700 1 Processor -- start 2023-05-12T09:08:38.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.723+0000 7f3d635ff700 1 -- start start 2023-05-12T09:08:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.724+0000 7f3d635ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0b87a0 0x7f3d5c14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.724+0000 7f3d635ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3d5c0cfbf0 0x7f3d5c0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.724+0000 7f3d635ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3d5c0d2110 0x7f3d5c14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.724+0000 7f3d635ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c14cb00 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.724+0000 7f3d635ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c14d3a0 con 0x7f3d5c0cfbf0 2023-05-12T09:08:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.724+0000 7f3d635ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0b7180 con 0x7f3d5c0d2110 2023-05-12T09:08:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.724+0000 7f3d6139b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0b87a0 0x7f3d5c14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.724+0000 7f3d6139b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0b87a0 0x7f3d5c14b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42646/0 (socket says 172.21.15.116:42646) 2023-05-12T09:08:38.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.724+0000 7f3d6139b700 1 -- 172.21.15.116:0/829438661 learned_addr learned my addr 172.21.15.116:0/829438661 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:38.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d61b9c700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3d5c0d2110 0x7f3d5c14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d60b9a700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3d5c0cfbf0 0x7f3d5c0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d6139b700 1 -- 172.21.15.116:0/829438661 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3d5c0d2110 msgr2=0x7f3d5c14d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d6139b700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3d5c0d2110 0x7f3d5c14d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d6139b700 1 -- 172.21.15.116:0/829438661 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3d5c0cfbf0 msgr2=0x7f3d5c0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d6139b700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3d5c0cfbf0 0x7f3d5c0c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d6139b700 1 -- 172.21.15.116:0/829438661 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54009a70 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d6139b700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0b87a0 0x7f3d5c14b790 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c4d0 tx=0x7f3d5800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:38.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d51ffb700 1 -- 172.21.15.116:0/829438661 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58005d70 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d51ffb700 1 -- 172.21.15.116:0/829438661 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580070d0 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d635ff700 1 -- 172.21.15.116:0/829438661 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c0cd980 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d51ffb700 1 -- 172.21.15.116:0/829438661 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58007460 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.731 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.725+0000 7f3d635ff700 1 -- 172.21.15.116:0/829438661 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c0cd6a0 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.726+0000 7f3d635ff700 1 -- 172.21.15.116:0/829438661 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c167a90 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.727+0000 7f3d51ffb700 1 -- 172.21.15.116:0/829438661 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d580075c0 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.728+0000 7f3d51ffb700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3d4006ace0 0x7f3d4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:38.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.728+0000 7f3d51ffb700 1 -- 172.21.15.116:0/829438661 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3d58088d30 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.728+0000 7f3d60b9a700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3d4006ace0 0x7f3d4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:38.733 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.729+0000 7f3d60b9a700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3d4006ace0 0x7f3d4006d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c14ea60 tx=0x7f3d4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:38.735 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.732+0000 7f3d51ffb700 1 -- 172.21.15.116:0/829438661 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3d58053aa0 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.943+0000 7f3d635ff700 1 -- 172.21.15.116:0/829438661 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3d5c0b52f0 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.944+0000 7f3d51ffb700 1 -- 172.21.15.116:0/829438661 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3d580570c0 con 0x7f3d5c0b87a0 2023-05-12T09:08:38.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 -- 172.21.15.116:0/829438661 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3d4006ace0 msgr2=0x7f3d4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3d4006ace0 0x7f3d4006d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c14ea60 tx=0x7f3d4c009040 comp rx=0 tx=0).stop 2023-05-12T09:08:38.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 -- 172.21.15.116:0/829438661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0b87a0 msgr2=0x7f3d5c14b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:38.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0b87a0 0x7f3d5c14b790 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c4d0 tx=0x7f3d5800c890 comp rx=0 tx=0).stop 2023-05-12T09:08:38.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 -- 172.21.15.116:0/829438661 shutdown_connections 2023-05-12T09:08:38.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3d4006ace0 0x7f3d4006d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3d5c0d2110 0x7f3d5c14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d5c0b87a0 0x7f3d5c14b790 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 --2- 172.21.15.116:0/829438661 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3d5c0cfbf0 0x7f3d5c0c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:38.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 -- 172.21.15.116:0/829438661 >> 172.21.15.116:0/829438661 conn(0x7f3d5c071b10 msgr2=0x7f3d5c1601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:38.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 -- 172.21.15.116:0/829438661 shutdown_connections 2023-05-12T09:08:38.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:38.946+0000 7f3d635ff700 1 -- 172.21.15.116:0/829438661 wait complete. 2023-05-12T09:08:38.952 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2023-05-12T09:08:38.966 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi116.front.sepia.ceph.com... 2023-05-12T09:08:38.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:38.967 DEBUG:teuthology.orchestra.run.smithi116:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-05-12T09:08:39.029 INFO:teuthology.orchestra.run:waiting for 300 2023-05-12T09:08:39.030 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T09:08:39.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:39.030 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-12T09:08:39.072 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:08:39.073 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:39.119 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:08:39.119 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:39.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:39.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.383+0000 7faad4dff700 1 Processor -- start 2023-05-12T09:08:39.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.383+0000 7faad4dff700 1 -- start start 2023-05-12T09:08:39.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.384+0000 7faad4dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faad00cd760 0x7faad00cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.384+0000 7faad4dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faad015cf10 0x7faad006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.384+0000 7faad4dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad00cc9e0 con 0x7faad00adf70 2023-05-12T09:08:39.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.384+0000 7faad4dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad00cd580 con 0x7faad015cf10 2023-05-12T09:08:39.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.384+0000 7faad4dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad015de20 con 0x7faad00cd760 2023-05-12T09:08:39.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.384+0000 7faacdd9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7faad00adf70 0x7faad00cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50922/0 (socket says 172.21.15.116:50922) 2023-05-12T09:08:39.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faacdd9b700 1 -- 172.21.15.116:0/3845421724 learned_addr learned my addr 172.21.15.116:0/3845421724 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:39.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.384+0000 7faaced9d700 1 --2- 172.21.15.116:0/3845421724 >> v2:172.21.15.116:3300/0 conn(0x7faad015cf10 0x7faad006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:39.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faace59c700 1 --2- 172.21.15.116:0/3845421724 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faad00cd760 0x7faad00cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:39.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faacd59a700 1 -- 172.21.15.116:0/3845421724 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229412184 0 0) 0x7faad00cc9e0 con 0x7faad00adf70 2023-05-12T09:08:39.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faacd59a700 1 -- 172.21.15.116:0/3845421724 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab80035b0 con 0x7faad00adf70 2023-05-12T09:08:39.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faaced9d700 1 -- 172.21.15.116:0/3845421724 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faad00cd760 msgr2=0x7faad00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:39.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faaced9d700 1 --2- 172.21.15.116:0/3845421724 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faad00cd760 0x7faad00cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faaced9d700 1 -- 172.21.15.116:0/3845421724 >> v1:172.21.15.116:6789/0 conn(0x7faad00adf70 legacy=0x7faad00cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:39.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faaced9d700 1 -- 172.21.15.116:0/3845421724 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00ce070 con 0x7faad015cf10 2023-05-12T09:08:39.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faace59c700 1 --2- 172.21.15.116:0/3845421724 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faad00cd760 0x7faad00cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:39.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faaced9d700 1 --2- 172.21.15.116:0/3845421724 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad015cf10 0x7faad006c6c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faac8009d90 tx=0x7faac800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a1c1ba10e7fce2 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:39.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.385+0000 7faacd59a700 1 -- 172.21.15.116:0/3845421724 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800e070 con 0x7faad015cf10 2023-05-12T09:08:39.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.386+0000 7faacd59a700 1 -- 172.21.15.116:0/3845421724 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac800bb20 con 0x7faad015cf10 2023-05-12T09:08:39.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.386+0000 7faacd59a700 1 -- 172.21.15.116:0/3845421724 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800be90 con 0x7faad015cf10 2023-05-12T09:08:39.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.386+0000 7faad4dff700 1 -- 172.21.15.116:0/3845421724 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad015cf10 msgr2=0x7faad006c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:39.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.386+0000 7faad4dff700 1 --2- 172.21.15.116:0/3845421724 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad015cf10 0x7faad006c6c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faac8009d90 tx=0x7faac800b330 comp rx=0 tx=0).stop 2023-05-12T09:08:39.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.386+0000 7faad4dff700 1 -- 172.21.15.116:0/3845421724 shutdown_connections 2023-05-12T09:08:39.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.386+0000 7faad4dff700 1 --2- 172.21.15.116:0/3845421724 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad015cf10 0x7faad006c6c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.386+0000 7faad4dff700 1 --2- 172.21.15.116:0/3845421724 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faad00cd760 0x7faad00cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.386+0000 7faad4dff700 1 -- 172.21.15.116:0/3845421724 >> 172.21.15.116:0/3845421724 conn(0x7faad00cf720 msgr2=0x7faad00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:39.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.386+0000 7faad4dff700 1 -- 172.21.15.116:0/3845421724 shutdown_connections 2023-05-12T09:08:39.392 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.386+0000 7faad4dff700 1 -- 172.21.15.116:0/3845421724 wait complete. 2023-05-12T09:08:39.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.388+0000 7faad4dff700 1 Processor -- start 2023-05-12T09:08:39.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.388+0000 7faad4dff700 1 -- start start 2023-05-12T09:08:39.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faad4dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faad00adf70 0x7faad015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faad4dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad00cd760 0x7faad00ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faad4dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faad015cf10 0x7faad00c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.394 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faad4dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad00b0dd0 con 0x7faad00cd760 2023-05-12T09:08:39.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faad4dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad00b04a0 con 0x7faad00adf70 2023-05-12T09:08:39.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faad4dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad00b0710 con 0x7faad015cf10 2023-05-12T09:08:39.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faacdd9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad00cd760 0x7faad00ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:39.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faacdd9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad00cd760 0x7faad00ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42670/0 (socket says 172.21.15.116:42670) 2023-05-12T09:08:39.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faacdd9b700 1 -- 172.21.15.116:0/965428938 learned_addr learned my addr 172.21.15.116:0/965428938 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:39.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faacdd9b700 1 -- 172.21.15.116:0/965428938 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faad015cf10 msgr2=0x7faad00c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:39.395 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faacdd9b700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faad015cf10 0x7faad00c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faacdd9b700 1 -- 172.21.15.116:0/965428938 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faad00adf70 msgr2=0x7faad015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:39.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faace59c700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faad00adf70 0x7faad015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:39.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faacdd9b700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faad00adf70 0x7faad015bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faacdd9b700 1 -- 172.21.15.116:0/965428938 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac8009a70 con 0x7faad00cd760 2023-05-12T09:08:39.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.389+0000 7faace59c700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faad00adf70 0x7faad015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:39.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.390+0000 7faacdd9b700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad00cd760 0x7faad00ae3c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faac400c700 tx=0x7faac400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:39.396 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.390+0000 7faabeffd700 1 -- 172.21.15.116:0/965428938 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40074e0 con 0x7faad00cd760 2023-05-12T09:08:39.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.390+0000 7faabeffd700 1 -- 172.21.15.116:0/965428938 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac4007640 con 0x7faad00cd760 2023-05-12T09:08:39.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.390+0000 7faad4dff700 1 -- 172.21.15.116:0/965428938 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad015db40 con 0x7faad00cd760 2023-05-12T09:08:39.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.390+0000 7faabeffd700 1 -- 172.21.15.116:0/965428938 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4005a50 con 0x7faad00cd760 2023-05-12T09:08:39.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.390+0000 7faad4dff700 1 -- 172.21.15.116:0/965428938 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad015d860 con 0x7faad00cd760 2023-05-12T09:08:39.397 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.391+0000 7faad4dff700 1 -- 172.21.15.116:0/965428938 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad00cc670 con 0x7faad00cd760 2023-05-12T09:08:39.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.392+0000 7faabeffd700 1 -- 172.21.15.116:0/965428938 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faac4005bb0 con 0x7faad00cd760 2023-05-12T09:08:39.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.393+0000 7faabeffd700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faab006ace0 0x7faab006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.393+0000 7faabeffd700 1 -- 172.21.15.116:0/965428938 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faac4088dc0 con 0x7faad00cd760 2023-05-12T09:08:39.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.393+0000 7faace59c700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faab006ace0 0x7faab006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:39.398 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.393+0000 7faace59c700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faab006ace0 0x7faab006d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faac000cbc0 tx=0x7faac0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:39.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.397+0000 7faabeffd700 1 -- 172.21.15.116:0/965428938 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faac40575c0 con 0x7faad00cd760 2023-05-12T09:08:39.594 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.591+0000 7faad4dff700 1 -- 172.21.15.116:0/965428938 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faad00b0f10 con 0x7faad00cd760 2023-05-12T09:08:39.596 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.593+0000 7faabeffd700 1 -- 172.21.15.116:0/965428938 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7faad00b0f10 con 0x7faad00cd760 2023-05-12T09:08:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:39.596 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:39.598 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 -- 172.21.15.116:0/965428938 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faab006ace0 msgr2=0x7faab006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:39.598 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faab006ace0 0x7faab006d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faac000cbc0 tx=0x7faac0008040 comp rx=0 tx=0).stop 2023-05-12T09:08:39.599 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 -- 172.21.15.116:0/965428938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad00cd760 msgr2=0x7faad00ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:39.599 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad00cd760 0x7faad00ae3c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faac400c700 tx=0x7faac400cac0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.599 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 -- 172.21.15.116:0/965428938 shutdown_connections 2023-05-12T09:08:39.599 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faab006ace0 0x7faab006d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.599 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faad015cf10 0x7faad00c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.599 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faad00adf70 0x7faad015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.599 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 --2- 172.21.15.116:0/965428938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faad00cd760 0x7faad00ae3c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.600 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 -- 172.21.15.116:0/965428938 >> 172.21.15.116:0/965428938 conn(0x7faad00cf720 msgr2=0x7faad006a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:39.600 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 -- 172.21.15.116:0/965428938 shutdown_connections 2023-05-12T09:08:39.600 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.595+0000 7faad4dff700 1 -- 172.21.15.116:0/965428938 wait complete. 2023-05-12T09:08:39.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:39.618 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:39.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.803+0000 7f1de69ff700 1 Processor -- start 2023-05-12T09:08:39.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.804+0000 7f1de69ff700 1 -- start start 2023-05-12T09:08:39.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1de69ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1de00d2110 0x7f1de0167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1de69ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de0161000 con 0x7f1de00cfbf0 2023-05-12T09:08:39.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1de69ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de00d0020 con 0x7f1de00b87a0 2023-05-12T09:08:39.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1de69ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de00d02d0 con 0x7f1de00d2110 2023-05-12T09:08:39.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1ddf7fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1de00cfbf0 0x7f1de01608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50924/0 (socket says 172.21.15.116:50924) 2023-05-12T09:08:39.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1ddf7fe700 1 -- 172.21.15.116:0/1975089767 learned_addr learned my addr 172.21.15.116:0/1975089767 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:39.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1de4f9c700 1 --2- 172.21.15.116:0/1975089767 >> v2:172.21.15.116:3300/0 conn(0x7f1de00d2110 0x7f1de0167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:39.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1ddeffd700 1 -- 172.21.15.116:0/1975089767 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520770392 0 0) 0x7f1de0161000 con 0x7f1de00cfbf0 2023-05-12T09:08:39.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1ddeffd700 1 -- 172.21.15.116:0/1975089767 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc80035b0 con 0x7f1de00cfbf0 2023-05-12T09:08:39.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1de4f9c700 1 -- 172.21.15.116:0/1975089767 >> v1:172.21.15.182:6789/0 conn(0x7f1de00b87a0 legacy=0x7f1de01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:39.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1de4f9c700 1 -- 172.21.15.116:0/1975089767 >> v1:172.21.15.116:6789/0 conn(0x7f1de00cfbf0 legacy=0x7f1de01608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:39.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.805+0000 7f1de4f9c700 1 -- 172.21.15.116:0/1975089767 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00cdc60 con 0x7f1de00d2110 2023-05-12T09:08:39.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.806+0000 7f1de4f9c700 1 --2- 172.21.15.116:0/1975089767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00d2110 0x7f1de0167550 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009d90 tx=0x7f1dd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93f110d31f85625 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:39.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.806+0000 7f1ddeffd700 1 -- 172.21.15.116:0/1975089767 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800e070 con 0x7f1de00d2110 2023-05-12T09:08:39.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.806+0000 7f1ddeffd700 1 -- 172.21.15.116:0/1975089767 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd800bae0 con 0x7f1de00d2110 2023-05-12T09:08:39.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.806+0000 7f1ddeffd700 1 -- 172.21.15.116:0/1975089767 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800be90 con 0x7f1de00d2110 2023-05-12T09:08:39.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.806+0000 7f1de69ff700 1 -- 172.21.15.116:0/1975089767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00d2110 msgr2=0x7f1de0167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:39.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.806+0000 7f1de69ff700 1 --2- 172.21.15.116:0/1975089767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00d2110 0x7f1de0167550 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009d90 tx=0x7f1dd800b330 comp rx=0 tx=0).stop 2023-05-12T09:08:39.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.807+0000 7f1de69ff700 1 -- 172.21.15.116:0/1975089767 shutdown_connections 2023-05-12T09:08:39.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.807+0000 7f1de69ff700 1 --2- 172.21.15.116:0/1975089767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00d2110 0x7f1de0167550 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.807+0000 7f1de69ff700 1 -- 172.21.15.116:0/1975089767 >> 172.21.15.116:0/1975089767 conn(0x7f1de0071b10 msgr2=0x7f1de0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:39.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.807+0000 7f1de69ff700 1 -- 172.21.15.116:0/1975089767 shutdown_connections 2023-05-12T09:08:39.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.807+0000 7f1de69ff700 1 -- 172.21.15.116:0/1975089767 wait complete. 2023-05-12T09:08:39.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.808+0000 7f1de69ff700 1 Processor -- start 2023-05-12T09:08:39.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.808+0000 7f1de69ff700 1 -- start start 2023-05-12T09:08:39.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.809+0000 7f1de69ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1de00b87a0 0x7f1de0157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.809+0000 7f1de69ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00cfbf0 0x7f1de00b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.809+0000 7f1de69ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1de00d2110 0x7f1de014e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.809+0000 7f1de69ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00c6e40 con 0x7f1de00cfbf0 2023-05-12T09:08:39.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.809+0000 7f1de69ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0156330 con 0x7f1de00b87a0 2023-05-12T09:08:39.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.809+0000 7f1de69ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0156610 con 0x7f1de00d2110 2023-05-12T09:08:39.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddf7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00cfbf0 0x7f1de00b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:39.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddf7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00cfbf0 0x7f1de00b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42684/0 (socket says 172.21.15.116:42684) 2023-05-12T09:08:39.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddf7fe700 1 -- 172.21.15.116:0/1307885332 learned_addr learned my addr 172.21.15.116:0/1307885332 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:39.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddffff700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1de00b87a0 0x7f1de0157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:39.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1de4f9c700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1de00d2110 0x7f1de014e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:39.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddf7fe700 1 -- 172.21.15.116:0/1307885332 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1de00d2110 msgr2=0x7f1de014e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:39.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddf7fe700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1de00d2110 0x7f1de014e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddf7fe700 1 -- 172.21.15.116:0/1307885332 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1de00b87a0 msgr2=0x7f1de0157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:39.818 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddf7fe700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1de00b87a0 0x7f1de0157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:39.818 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddf7fe700 1 -- 172.21.15.116:0/1307885332 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8009a70 con 0x7f1de00cfbf0 2023-05-12T09:08:39.818 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddffff700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1de00b87a0 0x7f1de0157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:39.818 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddf7fe700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00cfbf0 0x7f1de00b2b80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c4d0 tx=0x7f1dd400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:39.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.810+0000 7f1ddcff9700 1 -- 172.21.15.116:0/1307885332 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4005d70 con 0x7f1de00cfbf0 2023-05-12T09:08:39.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.811+0000 7f1ddcff9700 1 -- 172.21.15.116:0/1307885332 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd40070d0 con 0x7f1de00cfbf0 2023-05-12T09:08:39.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.811+0000 7f1de69ff700 1 -- 172.21.15.116:0/1307885332 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de00cd980 con 0x7f1de00cfbf0 2023-05-12T09:08:39.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.811+0000 7f1ddcff9700 1 -- 172.21.15.116:0/1307885332 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4007440 con 0x7f1de00cfbf0 2023-05-12T09:08:39.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.811+0000 7f1de69ff700 1 -- 172.21.15.116:0/1307885332 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de00cd6a0 con 0x7f1de00cfbf0 2023-05-12T09:08:39.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.812+0000 7f1de69ff700 1 -- 172.21.15.116:0/1307885332 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de0167a90 con 0x7f1de00cfbf0 2023-05-12T09:08:39.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.813+0000 7f1ddcff9700 1 -- 172.21.15.116:0/1307885332 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1dd40075a0 con 0x7f1de00cfbf0 2023-05-12T09:08:39.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.813+0000 7f1ddcff9700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1dcc06ace0 0x7f1dcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:39.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.814+0000 7f1ddcff9700 1 -- 172.21.15.116:0/1307885332 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1dd4088c10 con 0x7f1de00cfbf0 2023-05-12T09:08:39.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.814+0000 7f1ddffff700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1dcc06ace0 0x7f1dcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:39.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.814+0000 7f1ddffff700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1dcc06ace0 0x7f1dcc06d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1de0156190 tx=0x7f1dd0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:39.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:39.818+0000 7f1ddcff9700 1 -- 172.21.15.116:0/1307885332 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1dd4053a30 con 0x7f1de00cfbf0 2023-05-12T09:08:40.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.012+0000 7f1de69ff700 1 -- 172.21.15.116:0/1307885332 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1de00c6f80 con 0x7f1de00cfbf0 2023-05-12T09:08:40.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.012+0000 7f1ddcff9700 1 -- 172.21.15.116:0/1307885332 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1de00c6f80 con 0x7f1de00cfbf0 2023-05-12T09:08:40.016 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:40.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 -- 172.21.15.116:0/1307885332 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1dcc06ace0 msgr2=0x7f1dcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1dcc06ace0 0x7f1dcc06d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1de0156190 tx=0x7f1dd0008040 comp rx=0 tx=0).stop 2023-05-12T09:08:40.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 -- 172.21.15.116:0/1307885332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00cfbf0 msgr2=0x7f1de00b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00cfbf0 0x7f1de00b2b80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c4d0 tx=0x7f1dd400c890 comp rx=0 tx=0).stop 2023-05-12T09:08:40.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 -- 172.21.15.116:0/1307885332 shutdown_connections 2023-05-12T09:08:40.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1dcc06ace0 0x7f1dcc06d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1de00d2110 0x7f1de014e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1de00b87a0 0x7f1de0157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 --2- 172.21.15.116:0/1307885332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de00cfbf0 0x7f1de00b2b80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 -- 172.21.15.116:0/1307885332 >> 172.21.15.116:0/1307885332 conn(0x7f1de0071b10 msgr2=0x7f1de0157870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:40.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 -- 172.21.15.116:0/1307885332 shutdown_connections 2023-05-12T09:08:40.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.015+0000 7f1de69ff700 1 -- 172.21.15.116:0/1307885332 wait complete. 2023-05-12T09:08:40.035 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:40.158 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:08:40.162 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:08:40.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.221+0000 7fbb9a3ff700 1 Processor -- start 2023-05-12T09:08:40.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.221+0000 7fbb9a3ff700 1 -- start start 2023-05-12T09:08:40.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.222+0000 7fbb9a3ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbb940d2110 0x7fbb94167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:40.225 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.222+0000 7fbb9a3ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb94161000 con 0x7fbb940cfbf0 2023-05-12T09:08:40.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.222+0000 7fbb9a3ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb940d0020 con 0x7fbb940b87a0 2023-05-12T09:08:40.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.222+0000 7fbb9a3ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb940d02d0 con 0x7fbb940d2110 2023-05-12T09:08:40.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.223+0000 7fbb937fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fbb940cfbf0 0x7fbb941608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50930/0 (socket says 172.21.15.116:50930) 2023-05-12T09:08:40.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.223+0000 7fbb937fe700 1 -- 172.21.15.116:0/2058425988 learned_addr learned my addr 172.21.15.116:0/2058425988 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:40.226 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.223+0000 7fbb9899c700 1 --2- 172.21.15.116:0/2058425988 >> v2:172.21.15.116:3300/0 conn(0x7fbb940d2110 0x7fbb94167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:40.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.223+0000 7fbb92ffd700 1 -- 172.21.15.116:0/2058425988 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263822924 0 0) 0x7fbb94161000 con 0x7fbb940cfbf0 2023-05-12T09:08:40.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.223+0000 7fbb92ffd700 1 -- 172.21.15.116:0/2058425988 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c0035b0 con 0x7fbb940cfbf0 2023-05-12T09:08:40.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.223+0000 7fbb9899c700 1 -- 172.21.15.116:0/2058425988 >> v1:172.21.15.182:6789/0 conn(0x7fbb940b87a0 legacy=0x7fbb941601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.223+0000 7fbb9899c700 1 -- 172.21.15.116:0/2058425988 >> v1:172.21.15.116:6789/0 conn(0x7fbb940cfbf0 legacy=0x7fbb941608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.223+0000 7fbb9899c700 1 -- 172.21.15.116:0/2058425988 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940cdc60 con 0x7fbb940d2110 2023-05-12T09:08:40.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.223+0000 7fbb9899c700 1 --2- 172.21.15.116:0/2058425988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940d2110 0x7fbb94167550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009d90 tx=0x7fbb8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fd16c2dbcec910 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:40.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.224+0000 7fbb92ffd700 1 -- 172.21.15.116:0/2058425988 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c00e070 con 0x7fbb940d2110 2023-05-12T09:08:40.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.224+0000 7fbb92ffd700 1 -- 172.21.15.116:0/2058425988 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c00bb20 con 0x7fbb940d2110 2023-05-12T09:08:40.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.224+0000 7fbb92ffd700 1 -- 172.21.15.116:0/2058425988 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c012430 con 0x7fbb940d2110 2023-05-12T09:08:40.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.224+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2058425988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940d2110 msgr2=0x7fbb94167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.224+0000 7fbb9a3ff700 1 --2- 172.21.15.116:0/2058425988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940d2110 0x7fbb94167550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009d90 tx=0x7fbb8c00b330 comp rx=0 tx=0).stop 2023-05-12T09:08:40.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.224+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2058425988 shutdown_connections 2023-05-12T09:08:40.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.224+0000 7fbb9a3ff700 1 --2- 172.21.15.116:0/2058425988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940d2110 0x7fbb94167550 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.224+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2058425988 >> 172.21.15.116:0/2058425988 conn(0x7fbb94071b10 msgr2=0x7fbb94071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:40.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.224+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2058425988 shutdown_connections 2023-05-12T09:08:40.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.224+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2058425988 wait complete. 2023-05-12T09:08:40.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.226+0000 7fbb9a3ff700 1 Processor -- start 2023-05-12T09:08:40.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.226+0000 7fbb9a3ff700 1 -- start start 2023-05-12T09:08:40.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb9a3ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940b87a0 0x7fbb9414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:40.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb9a3ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb940cfbf0 0x7fbb940c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:40.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb9a3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb940d2110 0x7fbb940b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:40.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb9a3ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941523a0 con 0x7fbb940b87a0 2023-05-12T09:08:40.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb9a3ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94152680 con 0x7fbb940cfbf0 2023-05-12T09:08:40.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb9a3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94152960 con 0x7fbb940d2110 2023-05-12T09:08:40.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb93fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940b87a0 0x7fbb9414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:40.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb93fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940b87a0 0x7fbb9414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42696/0 (socket says 172.21.15.116:42696) 2023-05-12T09:08:40.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb93fff700 1 -- 172.21.15.116:0/2885654671 learned_addr learned my addr 172.21.15.116:0/2885654671 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:40.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb937fe700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb940cfbf0 0x7fbb940c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:40.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.227+0000 7fbb9899c700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb940d2110 0x7fbb940b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:40.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb93fff700 1 -- 172.21.15.116:0/2885654671 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb940d2110 msgr2=0x7fbb940b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb93fff700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb940d2110 0x7fbb940b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb93fff700 1 -- 172.21.15.116:0/2885654671 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb940cfbf0 msgr2=0x7fbb940c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb93fff700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb940cfbf0 0x7fbb940c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb93fff700 1 -- 172.21.15.116:0/2885654671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c009a70 con 0x7fbb940b87a0 2023-05-12T09:08:40.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb93fff700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940b87a0 0x7fbb9414e490 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c450 tx=0x7fbb8400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:40.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb90ff9700 1 -- 172.21.15.116:0/2885654671 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840052d0 con 0x7fbb940b87a0 2023-05-12T09:08:40.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb90ff9700 1 -- 172.21.15.116:0/2885654671 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84005430 con 0x7fbb940b87a0 2023-05-12T09:08:40.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb90ff9700 1 -- 172.21.15.116:0/2885654671 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840038c0 con 0x7fbb940b87a0 2023-05-12T09:08:40.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2885654671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb940cd980 con 0x7fbb940b87a0 2023-05-12T09:08:40.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.228+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2885654671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb940cd6a0 con 0x7fbb940b87a0 2023-05-12T09:08:40.235 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.229+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2885654671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb94167a90 con 0x7fbb940b87a0 2023-05-12T09:08:40.235 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.230+0000 7fbb90ff9700 1 -- 172.21.15.116:0/2885654671 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb84003a20 con 0x7fbb940b87a0 2023-05-12T09:08:40.236 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.231+0000 7fbb90ff9700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb8006ace0 0x7fbb8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:40.236 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.231+0000 7fbb90ff9700 1 -- 172.21.15.116:0/2885654671 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbb84088ac0 con 0x7fbb940b87a0 2023-05-12T09:08:40.236 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.231+0000 7fbb937fe700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb8006ace0 0x7fbb8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:40.236 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.232+0000 7fbb937fe700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb8006ace0 0x7fbb8006d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb88007fd0 tx=0x7fbb88007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:40.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.235+0000 7fbb90ff9700 1 -- 172.21.15.116:0/2885654671 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbb84053830 con 0x7fbb940b87a0 2023-05-12T09:08:40.432 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.429+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2885654671 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb940b52f0 con 0x7fbb940b87a0 2023-05-12T09:08:40.433 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.430+0000 7fbb90ff9700 1 -- 172.21.15.116:0/2885654671 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb8400ce60 con 0x7fbb940b87a0 2023-05-12T09:08:40.434 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:40.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.432+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2885654671 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb8006ace0 msgr2=0x7fbb8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.432+0000 7fbb9a3ff700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb8006ace0 0x7fbb8006d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb88007fd0 tx=0x7fbb88007dc0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.432+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2885654671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940b87a0 msgr2=0x7fbb9414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.432+0000 7fbb9a3ff700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940b87a0 0x7fbb9414e490 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c450 tx=0x7fbb8400c760 comp rx=0 tx=0).stop 2023-05-12T09:08:40.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.433+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2885654671 shutdown_connections 2023-05-12T09:08:40.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.433+0000 7fbb9a3ff700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fbb8006ace0 0x7fbb8006d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.433+0000 7fbb9a3ff700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fbb940d2110 0x7fbb940b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.433+0000 7fbb9a3ff700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940b87a0 0x7fbb9414e490 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.433+0000 7fbb9a3ff700 1 --2- 172.21.15.116:0/2885654671 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fbb940cfbf0 0x7fbb940c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.433+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2885654671 >> 172.21.15.116:0/2885654671 conn(0x7fbb94071b10 msgr2=0x7fbb94154bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:40.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.433+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2885654671 shutdown_connections 2023-05-12T09:08:40.437 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.433+0000 7fbb9a3ff700 1 -- 172.21.15.116:0/2885654671 wait complete. 2023-05-12T09:08:40.453 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:40.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.637+0000 7f52901ff700 1 Processor -- start 2023-05-12T09:08:40.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.637+0000 7f52901ff700 1 -- start start 2023-05-12T09:08:40.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.638+0000 7f52901ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f52880cf010 0x7f5288160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.639+0000 7f52901ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52880cd520 con 0x7f52880cff50 2023-05-12T09:08:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.639+0000 7f52901ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52880d2640 con 0x7f528815c590 2023-05-12T09:08:40.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.639+0000 7f52901ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52881610d0 con 0x7f52880cf010 2023-05-12T09:08:40.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.639+0000 7f528e79c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f52880cff50 0x7f52880d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50934/0 (socket says 172.21.15.116:50934) 2023-05-12T09:08:40.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.639+0000 7f528e79c700 1 -- 172.21.15.116:0/2568396459 learned_addr learned my addr 172.21.15.116:0/2568396459 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:40.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.639+0000 7f528d79a700 1 --2- 172.21.15.116:0/2568396459 >> v2:172.21.15.182:3300/0 conn(0x7f52880cf010 0x7f5288160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.639+0000 7f528cf99700 1 -- 172.21.15.116:0/2568396459 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805691874 0 0) 0x7f52880cd520 con 0x7f52880cff50 2023-05-12T09:08:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.639+0000 7f528cf99700 1 -- 172.21.15.116:0/2568396459 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52740035b0 con 0x7f52880cff50 2023-05-12T09:08:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.639+0000 7f528cf99700 1 -- 172.21.15.116:0/2568396459 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865488265 0 0) 0x7f52880d2640 con 0x7f528815c590 2023-05-12T09:08:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.639+0000 7f528cf99700 1 -- 172.21.15.116:0/2568396459 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52880cd520 con 0x7f528815c590 2023-05-12T09:08:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.640+0000 7f528cf99700 1 -- 172.21.15.116:0/2568396459 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1601568392 0 0) 0x7f52740035b0 con 0x7f52880cff50 2023-05-12T09:08:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.640+0000 7f528d79a700 1 -- 172.21.15.116:0/2568396459 >> v1:172.21.15.182:6789/0 conn(0x7f528815c590 legacy=0x7f52880cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.640+0000 7f528d79a700 1 -- 172.21.15.116:0/2568396459 >> v1:172.21.15.116:6789/0 conn(0x7f52880cff50 legacy=0x7f52880d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.645 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.640+0000 7f528d79a700 1 -- 172.21.15.116:0/2568396459 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880b23c0 con 0x7f52880cf010 2023-05-12T09:08:40.645 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.640+0000 7f528d79a700 1 --2- 172.21.15.116:0/2568396459 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52880cf010 0x7f5288160b90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5278009840 tx=0x7f5278009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d84f8a213ab6668 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:40.645 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.640+0000 7f528cf99700 1 -- 172.21.15.116:0/2568396459 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278011830 con 0x7f52880cf010 2023-05-12T09:08:40.645 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.640+0000 7f528cf99700 1 -- 172.21.15.116:0/2568396459 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278011990 con 0x7f52880cf010 2023-05-12T09:08:40.645 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.640+0000 7f528cf99700 1 -- 172.21.15.116:0/2568396459 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278011d20 con 0x7f52880cf010 2023-05-12T09:08:40.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.641+0000 7f52901ff700 1 -- 172.21.15.116:0/2568396459 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52880cf010 msgr2=0x7f5288160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.641+0000 7f52901ff700 1 --2- 172.21.15.116:0/2568396459 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52880cf010 0x7f5288160b90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5278009840 tx=0x7f5278009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:40.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.641+0000 7f52901ff700 1 -- 172.21.15.116:0/2568396459 shutdown_connections 2023-05-12T09:08:40.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.641+0000 7f52901ff700 1 --2- 172.21.15.116:0/2568396459 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52880cf010 0x7f5288160b90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.641+0000 7f52901ff700 1 -- 172.21.15.116:0/2568396459 >> 172.21.15.116:0/2568396459 conn(0x7f5288071b10 msgr2=0x7f5288071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:40.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.641+0000 7f52901ff700 1 -- 172.21.15.116:0/2568396459 shutdown_connections 2023-05-12T09:08:40.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.641+0000 7f52901ff700 1 -- 172.21.15.116:0/2568396459 wait complete. 2023-05-12T09:08:40.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.642+0000 7f52901ff700 1 Processor -- start 2023-05-12T09:08:40.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.643+0000 7f52901ff700 1 -- start start 2023-05-12T09:08:40.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.643+0000 7f52901ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52880cf010 0x7f52881f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:40.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.643+0000 7f52901ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52880cff50 0x7f52881f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:40.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f52901ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f528815c590 0x7f52880c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:40.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f52901ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528815cbb0 con 0x7f52880cf010 2023-05-12T09:08:40.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f52901ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528814dbe0 con 0x7f52880cff50 2023-05-12T09:08:40.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f52901ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52881f59e0 con 0x7f528815c590 2023-05-12T09:08:40.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528df9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52880cf010 0x7f52881f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:40.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528df9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52880cf010 0x7f52881f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42712/0 (socket says 172.21.15.116:42712) 2023-05-12T09:08:40.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528df9b700 1 -- 172.21.15.116:0/1273882192 learned_addr learned my addr 172.21.15.116:0/1273882192 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:40.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528e79c700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f528815c590 0x7f52880c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:40.649 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528d79a700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52880cff50 0x7f52881f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:40.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528df9b700 1 -- 172.21.15.116:0/1273882192 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f528815c590 msgr2=0x7f52880c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528df9b700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f528815c590 0x7f52880c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528df9b700 1 -- 172.21.15.116:0/1273882192 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52880cff50 msgr2=0x7f52881f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528df9b700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52880cff50 0x7f52881f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528df9b700 1 -- 172.21.15.116:0/1273882192 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52780094a0 con 0x7f52880cf010 2023-05-12T09:08:40.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f528df9b700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52880cf010 0x7f52881f54a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f528400c500 tx=0x7f528400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:40.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.644+0000 7f527e7fc700 1 -- 172.21.15.116:0/1273882192 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52840052d0 con 0x7f52880cf010 2023-05-12T09:08:40.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.645+0000 7f527e7fc700 1 -- 172.21.15.116:0/1273882192 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5284005450 con 0x7f52880cf010 2023-05-12T09:08:40.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.645+0000 7f527e7fc700 1 -- 172.21.15.116:0/1273882192 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52840038c0 con 0x7f52880cf010 2023-05-12T09:08:40.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.645+0000 7f52901ff700 1 -- 172.21.15.116:0/1273882192 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52880cd770 con 0x7f52880cf010 2023-05-12T09:08:40.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.645+0000 7f52901ff700 1 -- 172.21.15.116:0/1273882192 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52880cf560 con 0x7f52880cf010 2023-05-12T09:08:40.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.646+0000 7f52901ff700 1 -- 172.21.15.116:0/1273882192 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528815c960 con 0x7f52880cf010 2023-05-12T09:08:40.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.647+0000 7f527e7fc700 1 -- 172.21.15.116:0/1273882192 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5284003a20 con 0x7f52880cf010 2023-05-12T09:08:40.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.647+0000 7f527e7fc700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f526c06ace0 0x7f526c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:40.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.648+0000 7f527e7fc700 1 -- 172.21.15.116:0/1273882192 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5284088d00 con 0x7f52880cf010 2023-05-12T09:08:40.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.648+0000 7f528d79a700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f526c06ace0 0x7f526c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:40.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.648+0000 7f528d79a700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f526c06ace0 0x7f526c06d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5278009fd0 tx=0x7f527801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:40.655 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.652+0000 7f527e7fc700 1 -- 172.21.15.116:0/1273882192 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f52840539e0 con 0x7f52880cf010 2023-05-12T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.847+0000 7f52901ff700 1 -- 172.21.15.116:0/1273882192 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f528815de70 con 0x7f52880cf010 2023-05-12T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.847+0000 7f527e7fc700 1 -- 172.21.15.116:0/1273882192 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5284057000 con 0x7f52880cf010 2023-05-12T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 -- 172.21.15.116:0/1273882192 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f526c06ace0 msgr2=0x7f526c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f526c06ace0 0x7f526c06d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5278009fd0 tx=0x7f527801c040 comp rx=0 tx=0).stop 2023-05-12T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 -- 172.21.15.116:0/1273882192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52880cf010 msgr2=0x7f52881f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52880cf010 0x7f52881f54a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f528400c500 tx=0x7f528400c8c0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 -- 172.21.15.116:0/1273882192 shutdown_connections 2023-05-12T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f526c06ace0 0x7f526c06d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f528815c590 0x7f52880c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52880cf010 0x7f52881f54a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 --2- 172.21.15.116:0/1273882192 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52880cff50 0x7f52881f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 -- 172.21.15.116:0/1273882192 >> 172.21.15.116:0/1273882192 conn(0x7f5288071b10 msgr2=0x7f52880b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 -- 172.21.15.116:0/1273882192 shutdown_connections 2023-05-12T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:40.850+0000 7f52901ff700 1 -- 172.21.15.116:0/1273882192 wait complete. 2023-05-12T09:08:40.870 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.054+0000 7f1d307ff700 1 Processor -- start 2023-05-12T09:08:41.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.055+0000 7f1d307ff700 1 -- start start 2023-05-12T09:08:41.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d307ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1d2815cf10 0x7f1d2806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d307ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d280cc9e0 con 0x7f1d280cd760 2023-05-12T09:08:41.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d307ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2815de20 con 0x7f1d280adf70 2023-05-12T09:08:41.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d307ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d280cd580 con 0x7f1d2815cf10 2023-05-12T09:08:41.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d2e59b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1d280cd760 0x7f1d280cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50946/0 (socket says 172.21.15.116:50946) 2023-05-12T09:08:41.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d2e59b700 1 -- 172.21.15.116:0/2134356957 learned_addr learned my addr 172.21.15.116:0/2134356957 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:41.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d2ed9c700 1 --2- 172.21.15.116:0/2134356957 >> v2:172.21.15.116:3300/0 conn(0x7f1d2815cf10 0x7f1d2806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d2d599700 1 -- 172.21.15.116:0/2134356957 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760029750 0 0) 0x7f1d280cc9e0 con 0x7f1d280cd760 2023-05-12T09:08:41.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d2d599700 1 -- 172.21.15.116:0/2134356957 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d140057c0 con 0x7f1d280cd760 2023-05-12T09:08:41.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d2ed9c700 1 -- 172.21.15.116:0/2134356957 >> v1:172.21.15.182:6789/0 conn(0x7f1d280adf70 legacy=0x7f1d280cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d2ed9c700 1 -- 172.21.15.116:0/2134356957 >> v1:172.21.15.116:6789/0 conn(0x7f1d280cd760 legacy=0x7f1d280cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.056+0000 7f1d2ed9c700 1 -- 172.21.15.116:0/2134356957 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2815d860 con 0x7f1d2815cf10 2023-05-12T09:08:41.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.057+0000 7f1d2ed9c700 1 --2- 172.21.15.116:0/2134356957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d2815cf10 0x7f1d2806c6c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009d90 tx=0x7f1d2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115b31b22ecac6e8 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:41.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.057+0000 7f1d2d599700 1 -- 172.21.15.116:0/2134356957 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000e070 con 0x7f1d2815cf10 2023-05-12T09:08:41.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.057+0000 7f1d2d599700 1 -- 172.21.15.116:0/2134356957 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2000bb20 con 0x7f1d2815cf10 2023-05-12T09:08:41.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.057+0000 7f1d2d599700 1 -- 172.21.15.116:0/2134356957 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20012430 con 0x7f1d2815cf10 2023-05-12T09:08:41.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.057+0000 7f1d307ff700 1 -- 172.21.15.116:0/2134356957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d2815cf10 msgr2=0x7f1d2806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.057+0000 7f1d307ff700 1 --2- 172.21.15.116:0/2134356957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d2815cf10 0x7f1d2806c6c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009d90 tx=0x7f1d2000b330 comp rx=0 tx=0).stop 2023-05-12T09:08:41.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.058+0000 7f1d307ff700 1 -- 172.21.15.116:0/2134356957 shutdown_connections 2023-05-12T09:08:41.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.058+0000 7f1d307ff700 1 --2- 172.21.15.116:0/2134356957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d2815cf10 0x7f1d2806c6c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.058+0000 7f1d307ff700 1 -- 172.21.15.116:0/2134356957 >> 172.21.15.116:0/2134356957 conn(0x7f1d280cf720 msgr2=0x7f1d280cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:41.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.058+0000 7f1d307ff700 1 -- 172.21.15.116:0/2134356957 shutdown_connections 2023-05-12T09:08:41.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.058+0000 7f1d307ff700 1 -- 172.21.15.116:0/2134356957 wait complete. 2023-05-12T09:08:41.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.060+0000 7f1d307ff700 1 Processor -- start 2023-05-12T09:08:41.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.060+0000 7f1d307ff700 1 -- start start 2023-05-12T09:08:41.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.061+0000 7f1d307ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280adf70 0x7f1d281f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.061+0000 7f1d307ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1d280cd760 0x7f1d280b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.061+0000 7f1d307ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d2815cf10 0x7f1d280b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.061+0000 7f1d307ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280b4800 con 0x7f1d280adf70 2023-05-12T09:08:41.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.061+0000 7f1d307ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280b3c80 con 0x7f1d280cd760 2023-05-12T09:08:41.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.061+0000 7f1d307ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280b3f60 con 0x7f1d2815cf10 2023-05-12T09:08:41.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2e59b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280adf70 0x7f1d281f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2e59b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280adf70 0x7f1d281f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42720/0 (socket says 172.21.15.116:42720) 2023-05-12T09:08:41.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2e59b700 1 -- 172.21.15.116:0/1946435622 learned_addr learned my addr 172.21.15.116:0/1946435622 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:41.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2dd9a700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1d280cd760 0x7f1d280b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2ed9c700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d2815cf10 0x7f1d280b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2e59b700 1 -- 172.21.15.116:0/1946435622 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d2815cf10 msgr2=0x7f1d280b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2e59b700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d2815cf10 0x7f1d280b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2e59b700 1 -- 172.21.15.116:0/1946435622 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1d280cd760 msgr2=0x7f1d280b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2e59b700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1d280cd760 0x7f1d280b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2e59b700 1 -- 172.21.15.116:0/1946435622 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20009a70 con 0x7f1d280adf70 2023-05-12T09:08:41.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d2e59b700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280adf70 0x7f1d281f1e40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c700 tx=0x7f1d2400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:41.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d1effd700 1 -- 172.21.15.116:0/1946435622 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24005d70 con 0x7f1d280adf70 2023-05-12T09:08:41.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.062+0000 7f1d1effd700 1 -- 172.21.15.116:0/1946435622 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d240070d0 con 0x7f1d280adf70 2023-05-12T09:08:41.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.063+0000 7f1d1effd700 1 -- 172.21.15.116:0/1946435622 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24007460 con 0x7f1d280adf70 2023-05-12T09:08:41.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.063+0000 7f1d307ff700 1 -- 172.21.15.116:0/1946435622 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d280cc670 con 0x7f1d280adf70 2023-05-12T09:08:41.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.063+0000 7f1d307ff700 1 -- 172.21.15.116:0/1946435622 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2815db40 con 0x7f1d280adf70 2023-05-12T09:08:41.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.064+0000 7f1d307ff700 1 -- 172.21.15.116:0/1946435622 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d28071600 con 0x7f1d280adf70 2023-05-12T09:08:41.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.064+0000 7f1d1effd700 1 -- 172.21.15.116:0/1946435622 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d240075c0 con 0x7f1d280adf70 2023-05-12T09:08:41.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.065+0000 7f1d1effd700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 0x7f1d0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.065+0000 7f1d1effd700 1 -- 172.21.15.116:0/1946435622 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1d24088e60 con 0x7f1d280adf70 2023-05-12T09:08:41.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.066+0000 7f1d2dd9a700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 0x7f1d0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.066+0000 7f1d2dd9a700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 0x7f1d0c06d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1d2814d9a0 tx=0x7f1d18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:41.072 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.070+0000 7f1d1effd700 1 -- 172.21.15.116:0/1946435622 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1d24053b50 con 0x7f1d280adf70 2023-05-12T09:08:41.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.266+0000 7f1d307ff700 1 -- 172.21.15.116:0/1946435622 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d2806a8d0 con 0x7f1d280adf70 2023-05-12T09:08:41.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.266+0000 7f1d1effd700 1 -- 172.21.15.116:0/1946435622 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d24057170 con 0x7f1d280adf70 2023-05-12T09:08:41.270 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:41.271 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.268+0000 7f1d307ff700 1 -- 172.21.15.116:0/1946435622 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 msgr2=0x7f1d0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.268+0000 7f1d307ff700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 0x7f1d0c06d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1d2814d9a0 tx=0x7f1d18009040 comp rx=0 tx=0).stop 2023-05-12T09:08:41.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.268+0000 7f1d307ff700 1 -- 172.21.15.116:0/1946435622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280adf70 msgr2=0x7f1d281f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.268+0000 7f1d307ff700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280adf70 0x7f1d281f1e40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c700 tx=0x7f1d2400cac0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.268+0000 7f1d307ff700 1 -- 172.21.15.116:0/1946435622 shutdown_connections 2023-05-12T09:08:41.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.268+0000 7f1d307ff700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 0x7f1d0c06d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.268+0000 7f1d307ff700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d2815cf10 0x7f1d280b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.268+0000 7f1d307ff700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280adf70 0x7f1d281f1e40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.268+0000 7f1d307ff700 1 --2- 172.21.15.116:0/1946435622 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1d280cd760 0x7f1d280b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.268+0000 7f1d307ff700 1 -- 172.21.15.116:0/1946435622 >> 172.21.15.116:0/1946435622 conn(0x7f1d280cf720 msgr2=0x7f1d280cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:41.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.269+0000 7f1d307ff700 1 -- 172.21.15.116:0/1946435622 shutdown_connections 2023-05-12T09:08:41.273 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.269+0000 7f1d307ff700 1 -- 172.21.15.116:0/1946435622 wait complete. 2023-05-12T09:08:41.289 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:41.477 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.474+0000 7f34a13ff700 1 Processor -- start 2023-05-12T09:08:41.478 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.474+0000 7f34a13ff700 1 -- start start 2023-05-12T09:08:41.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.475+0000 7f34a13ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f349c071200 0x7f349c165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.475+0000 7f34a13ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c0cb280 con 0x7f349c06aaf0 2023-05-12T09:08:41.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f34a13ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c071700 con 0x7f349c15a5a0 2023-05-12T09:08:41.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f34a13ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c15a970 con 0x7f349c071200 2023-05-12T09:08:41.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f349b7fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f349c071200 0x7f349c165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f3493fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f349c06aaf0 0x7f349c070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50954/0 (socket says 172.21.15.116:50954) 2023-05-12T09:08:41.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f3493fff700 1 -- 172.21.15.116:0/1252665179 learned_addr learned my addr 172.21.15.116:0/1252665179 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:41.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f349a7fc700 1 -- 172.21.15.116:0/1252665179 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975903764 0 0) 0x7f3484001290 con 0x7f349c06aaf0 2023-05-12T09:08:41.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f349a7fc700 1 -- 172.21.15.116:0/1252665179 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34880035b0 con 0x7f349c06aaf0 2023-05-12T09:08:41.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f349b7fe700 1 -- 172.21.15.116:0/1252665179 >> v1:172.21.15.182:6789/0 conn(0x7f349c15a5a0 legacy=0x7f349c06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f349a7fc700 1 -- 172.21.15.116:0/1252665179 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161294564 0 0) 0x7f349c071700 con 0x7f349c15a5a0 2023-05-12T09:08:41.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f349b7fe700 1 -- 172.21.15.116:0/1252665179 >> v1:172.21.15.116:6789/0 conn(0x7f349c06aaf0 legacy=0x7f349c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.476+0000 7f349b7fe700 1 -- 172.21.15.116:0/1252665179 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0719e0 con 0x7f349c071200 2023-05-12T09:08:41.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.477+0000 7f349b7fe700 1 --2- 172.21.15.116:0/1252665179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 0x7f349c165340 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3494009d90 tx=0x7f349400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a974bc65b99067 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:41.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.477+0000 7f349a7fc700 1 -- 172.21.15.116:0/1252665179 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400e070 con 0x7f349c071200 2023-05-12T09:08:41.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.477+0000 7f349a7fc700 1 -- 172.21.15.116:0/1252665179 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400bb20 con 0x7f349c071200 2023-05-12T09:08:41.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.477+0000 7f349a7fc700 1 -- 172.21.15.116:0/1252665179 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400bed0 con 0x7f349c071200 2023-05-12T09:08:41.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.477+0000 7f34a13ff700 1 -- 172.21.15.116:0/1252665179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 msgr2=0x7f349c165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.477+0000 7f34a13ff700 1 --2- 172.21.15.116:0/1252665179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 0x7f349c165340 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3494009d90 tx=0x7f349400b330 comp rx=0 tx=0).stop 2023-05-12T09:08:41.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.477+0000 7f34a13ff700 1 -- 172.21.15.116:0/1252665179 shutdown_connections 2023-05-12T09:08:41.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.477+0000 7f34a13ff700 1 --2- 172.21.15.116:0/1252665179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 0x7f349c165340 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.477+0000 7f34a13ff700 1 -- 172.21.15.116:0/1252665179 >> 172.21.15.116:0/1252665179 conn(0x7f349c0cf720 msgr2=0x7f349c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:41.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.478+0000 7f34a13ff700 1 -- 172.21.15.116:0/1252665179 shutdown_connections 2023-05-12T09:08:41.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.478+0000 7f34a13ff700 1 -- 172.21.15.116:0/1252665179 wait complete. 2023-05-12T09:08:41.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.479+0000 7f34a13ff700 1 Processor -- start 2023-05-12T09:08:41.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.479+0000 7f34a13ff700 1 -- start start 2023-05-12T09:08:41.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.480+0000 7f34a13ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f349c06aaf0 0x7f349c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.480+0000 7f34a13ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 0x7f349c0c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.480+0000 7f34a13ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f349c15a5a0 0x7f349c0c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.480+0000 7f34a13ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0b3930 con 0x7f349c071200 2023-05-12T09:08:41.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.480+0000 7f34a13ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c1f01b0 con 0x7f349c15a5a0 2023-05-12T09:08:41.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.480+0000 7f34a13ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0b4290 con 0x7f349c06aaf0 2023-05-12T09:08:41.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.480+0000 7f3493fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 0x7f349c0c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f3493fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 0x7f349c0c2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:42732/0 (socket says 172.21.15.116:42732) 2023-05-12T09:08:41.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f3493fff700 1 -- 172.21.15.116:0/3489104199 learned_addr learned my addr 172.21.15.116:0/3489104199 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:41.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f349b7fe700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f349c15a5a0 0x7f349c0c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f349affd700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f349c06aaf0 0x7f349c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f3493fff700 1 -- 172.21.15.116:0/3489104199 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f349c06aaf0 msgr2=0x7f349c0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f3493fff700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f349c06aaf0 0x7f349c0b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f3493fff700 1 -- 172.21.15.116:0/3489104199 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f349c15a5a0 msgr2=0x7f349c0c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f3493fff700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f349c15a5a0 0x7f349c0c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f3493fff700 1 -- 172.21.15.116:0/3489104199 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494009a70 con 0x7f349c071200 2023-05-12T09:08:41.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f349affd700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f349c06aaf0 0x7f349c0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:41.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f3493fff700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 0x7f349c0c2530 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f348400c500 tx=0x7f348400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:41.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f34937fe700 1 -- 172.21.15.116:0/3489104199 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484005c40 con 0x7f349c071200 2023-05-12T09:08:41.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f34937fe700 1 -- 172.21.15.116:0/3489104199 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3484005da0 con 0x7f349c071200 2023-05-12T09:08:41.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f34a13ff700 1 -- 172.21.15.116:0/3489104199 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c06c9a0 con 0x7f349c071200 2023-05-12T09:08:41.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.481+0000 7f34937fe700 1 -- 172.21.15.116:0/3489104199 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840072f0 con 0x7f349c071200 2023-05-12T09:08:41.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.482+0000 7f34a13ff700 1 -- 172.21.15.116:0/3489104199 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c06c6c0 con 0x7f349c071200 2023-05-12T09:08:41.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.482+0000 7f34a13ff700 1 -- 172.21.15.116:0/3489104199 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c06cc80 con 0x7f349c071200 2023-05-12T09:08:41.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.483+0000 7f34937fe700 1 -- 172.21.15.116:0/3489104199 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3484007450 con 0x7f349c071200 2023-05-12T09:08:41.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.484+0000 7f34937fe700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f347c06ace0 0x7f347c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.484+0000 7f34937fe700 1 -- 172.21.15.116:0/3489104199 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3484088b80 con 0x7f349c071200 2023-05-12T09:08:41.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.485+0000 7f349affd700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f347c06ace0 0x7f347c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.485+0000 7f349affd700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f347c06ace0 0x7f347c06d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f348c000f60 tx=0x7f348c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:41.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.489+0000 7f34937fe700 1 -- 172.21.15.116:0/3489104199 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3484053860 con 0x7f349c071200 2023-05-12T09:08:41.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.684+0000 7f34a13ff700 1 -- 172.21.15.116:0/3489104199 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f349c0b3a70 con 0x7f349c071200 2023-05-12T09:08:41.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.684+0000 7f34937fe700 1 -- 172.21.15.116:0/3489104199 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3484017020 con 0x7f349c071200 2023-05-12T09:08:41.688 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:41.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.686+0000 7f34a13ff700 1 -- 172.21.15.116:0/3489104199 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f347c06ace0 msgr2=0x7f347c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.686+0000 7f34a13ff700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f347c06ace0 0x7f347c06d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f348c000f60 tx=0x7f348c009040 comp rx=0 tx=0).stop 2023-05-12T09:08:41.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.686+0000 7f34a13ff700 1 -- 172.21.15.116:0/3489104199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 msgr2=0x7f349c0c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.686+0000 7f34a13ff700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 0x7f349c0c2530 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f348400c500 tx=0x7f348400c810 comp rx=0 tx=0).stop 2023-05-12T09:08:41.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.686+0000 7f34a13ff700 1 -- 172.21.15.116:0/3489104199 shutdown_connections 2023-05-12T09:08:41.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.686+0000 7f34a13ff700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f349c15a5a0 0x7f349c0c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.687+0000 7f34a13ff700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f347c06ace0 0x7f347c06d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.687+0000 7f34a13ff700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f349c06aaf0 0x7f349c0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.687+0000 7f34a13ff700 1 --2- 172.21.15.116:0/3489104199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f349c071200 0x7f349c0c2530 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.687+0000 7f34a13ff700 1 -- 172.21.15.116:0/3489104199 >> 172.21.15.116:0/3489104199 conn(0x7f349c0cf720 msgr2=0x7f349c1537b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:41.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.687+0000 7f34a13ff700 1 -- 172.21.15.116:0/3489104199 shutdown_connections 2023-05-12T09:08:41.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.687+0000 7f34a13ff700 1 -- 172.21.15.116:0/3489104199 wait complete. 2023-05-12T09:08:41.708 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-12T09:08:41.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.894+0000 7f3bd5dff700 1 Processor -- start 2023-05-12T09:08:41.897 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.894+0000 7f3bd5dff700 1 -- start start 2023-05-12T09:08:41.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bd5dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3bd006aaf0 0x7f3bd0070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.899 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bd5dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f3bd0071030 0x7f3bd006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bd5dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd00cb280 con 0x7f3bd015a5a0 2023-05-12T09:08:41.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bd5dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd015a970 con 0x7f3bd006aaf0 2023-05-12T09:08:41.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bd5dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd0071700 con 0x7f3bd0071030 2023-05-12T09:08:41.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bceffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3bd006aaf0 0x7f3bd0070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bceffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3bd006aaf0 0x7f3bd0070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38904/0 (socket says 172.21.15.116:38904) 2023-05-12T09:08:41.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bceffd700 1 -- 172.21.15.116:0/3173245800 learned_addr learned my addr 172.21.15.116:0/3173245800 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:41.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bcffff700 1 --2- 172.21.15.116:0/3173245800 >> v2:172.21.15.182:3300/0 conn(0x7f3bd0071030 0x7f3bd006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bceffd700 1 -- 172.21.15.116:0/3173245800 >> v2:172.21.15.182:3300/0 conn(0x7f3bd0071030 msgr2=0x7f3bd006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:41.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.895+0000 7f3bceffd700 1 --2- 172.21.15.116:0/3173245800 >> v2:172.21.15.182:3300/0 conn(0x7f3bd0071030 0x7f3bd006d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.896+0000 7f3bceffd700 1 -- 172.21.15.116:0/3173245800 >> v1:172.21.15.182:6789/0 conn(0x7f3bd015a5a0 legacy=0x7f3bd006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.896+0000 7f3bceffd700 1 -- 172.21.15.116:0/3173245800 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd00719e0 con 0x7f3bd006aaf0 2023-05-12T09:08:41.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.896+0000 7f3bcffff700 1 --2- 172.21.15.116:0/3173245800 >> v2:172.21.15.182:3300/0 conn(0x7f3bd0071030 0x7f3bd006d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:41.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.896+0000 7f3bceffd700 1 --2- 172.21.15.116:0/3173245800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd006aaf0 0x7f3bd0070af0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00cbc90 tx=0x7f3bc4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaafc7fd4a2a08ff server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:41.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.896+0000 7f3bce7fc700 1 -- 172.21.15.116:0/3173245800 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4005e30 con 0x7f3bd006aaf0 2023-05-12T09:08:41.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.896+0000 7f3bce7fc700 1 -- 172.21.15.116:0/3173245800 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4004030 con 0x7f3bd006aaf0 2023-05-12T09:08:41.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.896+0000 7f3bce7fc700 1 -- 172.21.15.116:0/3173245800 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40043e0 con 0x7f3bd006aaf0 2023-05-12T09:08:41.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.897+0000 7f3bd5dff700 1 -- 172.21.15.116:0/3173245800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd006aaf0 msgr2=0x7f3bd0070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.897+0000 7f3bd5dff700 1 --2- 172.21.15.116:0/3173245800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd006aaf0 0x7f3bd0070af0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00cbc90 tx=0x7f3bc4009bd0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.897+0000 7f3bd5dff700 1 -- 172.21.15.116:0/3173245800 shutdown_connections 2023-05-12T09:08:41.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.897+0000 7f3bd5dff700 1 --2- 172.21.15.116:0/3173245800 >> v2:172.21.15.182:3300/0 conn(0x7f3bd0071030 0x7f3bd006d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.897+0000 7f3bd5dff700 1 --2- 172.21.15.116:0/3173245800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd006aaf0 0x7f3bd0070af0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.897+0000 7f3bd5dff700 1 -- 172.21.15.116:0/3173245800 >> 172.21.15.116:0/3173245800 conn(0x7f3bd00cf720 msgr2=0x7f3bd00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:41.905 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.897+0000 7f3bd5dff700 1 -- 172.21.15.116:0/3173245800 shutdown_connections 2023-05-12T09:08:41.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.897+0000 7f3bd5dff700 1 -- 172.21.15.116:0/3173245800 wait complete. 2023-05-12T09:08:41.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.898+0000 7f3bd5dff700 1 Processor -- start 2023-05-12T09:08:41.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.899+0000 7f3bd5dff700 1 -- start start 2023-05-12T09:08:41.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.899+0000 7f3bd5dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3bd006aaf0 0x7f3bd00c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.899+0000 7f3bd5dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0071030 0x7f3bd00b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bd5dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3bd015a5a0 0x7f3bd0158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.906 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bd5dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00c82c0 con 0x7f3bd0071030 2023-05-12T09:08:41.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bd5dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00c7220 con 0x7f3bd015a5a0 2023-05-12T09:08:41.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bd5dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00c7500 con 0x7f3bd006aaf0 2023-05-12T09:08:41.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bceffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0071030 0x7f3bd00b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bceffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0071030 0x7f3bd00b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38916/0 (socket says 172.21.15.116:38916) 2023-05-12T09:08:41.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bceffd700 1 -- 172.21.15.116:0/194593558 learned_addr learned my addr 172.21.15.116:0/194593558 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:41.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bcf7fe700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3bd006aaf0 0x7f3bd00c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.907 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bcffff700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3bd015a5a0 0x7f3bd0158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bceffd700 1 -- 172.21.15.116:0/194593558 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3bd006aaf0 msgr2=0x7f3bd00c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bceffd700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3bd006aaf0 0x7f3bd00c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bceffd700 1 -- 172.21.15.116:0/194593558 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3bd015a5a0 msgr2=0x7f3bd0158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:41.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bceffd700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3bd015a5a0 0x7f3bd0158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:41.908 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.900+0000 7f3bceffd700 1 -- 172.21.15.116:0/194593558 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc4009500 con 0x7f3bd0071030 2023-05-12T09:08:41.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.901+0000 7f3bceffd700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0071030 0x7f3bd00b4160 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009c10 tx=0x7f3bc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:41.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.901+0000 7f3bb7fff700 1 -- 172.21.15.116:0/194593558 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4003c30 con 0x7f3bd0071030 2023-05-12T09:08:41.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.901+0000 7f3bb7fff700 1 -- 172.21.15.116:0/194593558 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4003d90 con 0x7f3bd0071030 2023-05-12T09:08:41.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.901+0000 7f3bb7fff700 1 -- 172.21.15.116:0/194593558 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011640 con 0x7f3bd0071030 2023-05-12T09:08:41.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.901+0000 7f3bd5dff700 1 -- 172.21.15.116:0/194593558 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd006c9a0 con 0x7f3bd0071030 2023-05-12T09:08:41.909 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.901+0000 7f3bd5dff700 1 -- 172.21.15.116:0/194593558 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd006c6c0 con 0x7f3bd0071030 2023-05-12T09:08:41.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.902+0000 7f3bd5dff700 1 -- 172.21.15.116:0/194593558 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd006cc80 con 0x7f3bd0071030 2023-05-12T09:08:41.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.903+0000 7f3bb7fff700 1 -- 172.21.15.116:0/194593558 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bc40117a0 con 0x7f3bd0071030 2023-05-12T09:08:41.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.904+0000 7f3bb7fff700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3bbc06ad10 0x7f3bbc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:41.910 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.904+0000 7f3bb7fff700 1 -- 172.21.15.116:0/194593558 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3bc408a8f0 con 0x7f3bd0071030 2023-05-12T09:08:41.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.904+0000 7f3bcf7fe700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3bbc06ad10 0x7f3bbc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:41.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.905+0000 7f3bcf7fe700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3bbc06ad10 0x7f3bbc06d1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0007fd0 tx=0x7f3bc0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:41.911 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:41.909+0000 7f3bb7fff700 1 -- 172.21.15.116:0/194593558 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3bc40556f0 con 0x7f3bd0071030 2023-05-12T09:08:42.125 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.118+0000 7f3bd5dff700 1 -- 172.21.15.116:0/194593558 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3bd0074430 con 0x7f3bd0071030 2023-05-12T09:08:42.126 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.118+0000 7f3bb7fff700 1 -- 172.21.15.116:0/194593558 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3bc4058d10 con 0x7f3bd0071030 2023-05-12T09:08:42.126 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 -- 172.21.15.116:0/194593558 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3bbc06ad10 msgr2=0x7f3bbc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.126 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3bbc06ad10 0x7f3bbc06d1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0007fd0 tx=0x7f3bc0009040 comp rx=0 tx=0).stop 2023-05-12T09:08:42.126 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 -- 172.21.15.116:0/194593558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0071030 msgr2=0x7f3bd00b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.126 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0071030 0x7f3bd00b4160 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009c10 tx=0x7f3bc4004750 comp rx=0 tx=0).stop 2023-05-12T09:08:42.127 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 -- 172.21.15.116:0/194593558 shutdown_connections 2023-05-12T09:08:42.127 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3bd015a5a0 0x7f3bd0158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.127 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f3bbc06ad10 0x7f3bbc06d1c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.127 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3bd006aaf0 0x7f3bd00c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.127 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 --2- 172.21.15.116:0/194593558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0071030 0x7f3bd00b4160 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.127 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 -- 172.21.15.116:0/194593558 >> 172.21.15.116:0/194593558 conn(0x7f3bd00cf720 msgr2=0x7f3bd00ae790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:42.127 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 -- 172.21.15.116:0/194593558 shutdown_connections 2023-05-12T09:08:42.128 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.120+0000 7f3bd5dff700 1 -- 172.21.15.116:0/194593558 wait complete. 2023-05-12T09:08:42.128 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2023-05-12T09:08:42.141 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T09:08:42.141 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T09:08:42.188 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:42.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.370+0000 7f74be3ff700 1 Processor -- start 2023-05-12T09:08:42.373 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.370+0000 7f74be3ff700 1 -- start start 2023-05-12T09:08:42.374 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.371+0000 7f74be3ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f74b80b87a0 0x7f74b80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.374 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.371+0000 7f74be3ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f74b81601e0 0x7f74b8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.375 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.371+0000 7f74be3ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b80cdc60 con 0x7f74b8160b70 2023-05-12T09:08:42.375 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.371+0000 7f74be3ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b80d02d0 con 0x7f74b81601e0 2023-05-12T09:08:42.375 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.371+0000 7f74be3ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b80d0cb0 con 0x7f74b80b87a0 2023-05-12T09:08:42.375 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.371+0000 7f74b77fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f74b81601e0 0x7f74b8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.375 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.371+0000 7f74bc99c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f74b8160b70 0x7f74b80d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56872/0 (socket says 172.21.15.116:56872) 2023-05-12T09:08:42.375 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.371+0000 7f74bc99c700 1 -- 172.21.15.116:0/2005391401 learned_addr learned my addr 172.21.15.116:0/2005391401 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:42.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.372+0000 7f74b7fff700 1 --2- 172.21.15.116:0/2005391401 >> v2:172.21.15.182:3300/0 conn(0x7f74b80b87a0 0x7f74b80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.372+0000 7f74b6ffd700 1 -- 172.21.15.116:0/2005391401 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609898623 0 0) 0x7f74b80cdc60 con 0x7f74b8160b70 2023-05-12T09:08:42.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.372+0000 7f74b77fe700 1 -- 172.21.15.116:0/2005391401 >> v2:172.21.15.182:3300/0 conn(0x7f74b80b87a0 msgr2=0x7f74b80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:42.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.372+0000 7f74b77fe700 1 --2- 172.21.15.116:0/2005391401 >> v2:172.21.15.182:3300/0 conn(0x7f74b80b87a0 0x7f74b80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.372+0000 7f74b77fe700 1 -- 172.21.15.116:0/2005391401 >> v1:172.21.15.116:6789/0 conn(0x7f74b8160b70 legacy=0x7f74b80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.372+0000 7f74b77fe700 1 -- 172.21.15.116:0/2005391401 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80cd6a0 con 0x7f74b81601e0 2023-05-12T09:08:42.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.372+0000 7f74b77fe700 1 --2- 172.21.15.116:0/2005391401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b81601e0 0x7f74b8160630 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f74b80b4ac0 tx=0x7f74ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5e5c42288085ad server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:42.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.372+0000 7f74b6ffd700 1 -- 172.21.15.116:0/2005391401 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011830 con 0x7f74b81601e0 2023-05-12T09:08:42.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.372+0000 7f74b6ffd700 1 -- 172.21.15.116:0/2005391401 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac011990 con 0x7f74b81601e0 2023-05-12T09:08:42.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.372+0000 7f74b6ffd700 1 -- 172.21.15.116:0/2005391401 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011d20 con 0x7f74b81601e0 2023-05-12T09:08:42.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.373+0000 7f74be3ff700 1 -- 172.21.15.116:0/2005391401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b81601e0 msgr2=0x7f74b8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.373+0000 7f74be3ff700 1 --2- 172.21.15.116:0/2005391401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b81601e0 0x7f74b8160630 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f74b80b4ac0 tx=0x7f74ac009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:42.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.373+0000 7f74be3ff700 1 -- 172.21.15.116:0/2005391401 shutdown_connections 2023-05-12T09:08:42.378 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.373+0000 7f74be3ff700 1 --2- 172.21.15.116:0/2005391401 >> v2:172.21.15.182:3300/0 conn(0x7f74b80b87a0 0x7f74b80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.373+0000 7f74be3ff700 1 --2- 172.21.15.116:0/2005391401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b81601e0 0x7f74b8160630 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.373+0000 7f74be3ff700 1 -- 172.21.15.116:0/2005391401 >> 172.21.15.116:0/2005391401 conn(0x7f74b8071b10 msgr2=0x7f74b8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:42.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.373+0000 7f74be3ff700 1 -- 172.21.15.116:0/2005391401 shutdown_connections 2023-05-12T09:08:42.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.373+0000 7f74be3ff700 1 -- 172.21.15.116:0/2005391401 wait complete. 2023-05-12T09:08:42.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.375+0000 7f74be3ff700 1 Processor -- start 2023-05-12T09:08:42.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.375+0000 7f74be3ff700 1 -- start start 2023-05-12T09:08:42.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74be3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74b80b87a0 0x7f74b815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74be3ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74b81601e0 0x7f74b80b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74be3ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b8160b70 0x7f74b815f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74be3ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b815fa80 con 0x7f74b8160b70 2023-05-12T09:08:42.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74be3ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b815c1b0 con 0x7f74b81601e0 2023-05-12T09:08:42.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74be3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b815cd30 con 0x7f74b80b87a0 2023-05-12T09:08:42.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74bc99c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b8160b70 0x7f74b815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74bc99c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b8160b70 0x7f74b815f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38932/0 (socket says 172.21.15.116:38932) 2023-05-12T09:08:42.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74bc99c700 1 -- 172.21.15.116:0/2461278571 learned_addr learned my addr 172.21.15.116:0/2461278571 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:42.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74b7fff700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74b80b87a0 0x7f74b815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.382 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74b77fe700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74b81601e0 0x7f74b80b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74bc99c700 1 -- 172.21.15.116:0/2461278571 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74b80b87a0 msgr2=0x7f74b815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74bc99c700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74b80b87a0 0x7f74b815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74bc99c700 1 -- 172.21.15.116:0/2461278571 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74b81601e0 msgr2=0x7f74b80b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74bc99c700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74b81601e0 0x7f74b80b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.376+0000 7f74bc99c700 1 -- 172.21.15.116:0/2461278571 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0094a0 con 0x7f74b8160b70 2023-05-12T09:08:42.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.377+0000 7f74bc99c700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b8160b70 0x7f74b815f540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f74b000cba0 tx=0x7f74b000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:42.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.377+0000 7f74b4ff9700 1 -- 172.21.15.116:0/2461278571 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b000ab80 con 0x7f74b8160b70 2023-05-12T09:08:42.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.377+0000 7f74b4ff9700 1 -- 172.21.15.116:0/2461278571 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b000ad00 con 0x7f74b8160b70 2023-05-12T09:08:42.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.377+0000 7f74be3ff700 1 -- 172.21.15.116:0/2461278571 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b8160f90 con 0x7f74b8160b70 2023-05-12T09:08:42.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.377+0000 7f74b4ff9700 1 -- 172.21.15.116:0/2461278571 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0007310 con 0x7f74b8160b70 2023-05-12T09:08:42.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.377+0000 7f74be3ff700 1 -- 172.21.15.116:0/2461278571 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b80cd980 con 0x7f74b8160b70 2023-05-12T09:08:42.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.378+0000 7f74be3ff700 1 -- 172.21.15.116:0/2461278571 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b80d2110 con 0x7f74b8160b70 2023-05-12T09:08:42.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.379+0000 7f74b4ff9700 1 -- 172.21.15.116:0/2461278571 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74b0007470 con 0x7f74b8160b70 2023-05-12T09:08:42.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.380+0000 7f74b4ff9700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74a406ace0 0x7f74a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.380+0000 7f74b4ff9700 1 -- 172.21.15.116:0/2461278571 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f74b00896b0 con 0x7f74b8160b70 2023-05-12T09:08:42.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.380+0000 7f74b7fff700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74a406ace0 0x7f74a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.381+0000 7f74b7fff700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74a406ace0 0x7f74a406d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009930 tx=0x7f74a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:42.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.384+0000 7f74b4ff9700 1 -- 172.21.15.116:0/2461278571 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f74b0054390 con 0x7f74b8160b70 2023-05-12T09:08:42.582 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.579+0000 7f74be3ff700 1 -- 172.21.15.116:0/2461278571 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74b815cea0 con 0x7f74b8160b70 2023-05-12T09:08:42.583 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.581+0000 7f74b4ff9700 1 -- 172.21.15.116:0/2461278571 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7f74b00579b0 con 0x7f74b8160b70 2023-05-12T09:08:42.584 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:42.584 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:42.586 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 -- 172.21.15.116:0/2461278571 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74a406ace0 msgr2=0x7f74a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.586 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74a406ace0 0x7f74a406d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009930 tx=0x7f74a8008040 comp rx=0 tx=0).stop 2023-05-12T09:08:42.587 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 -- 172.21.15.116:0/2461278571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b8160b70 msgr2=0x7f74b815f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.587 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b8160b70 0x7f74b815f540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f74b000cba0 tx=0x7f74b000cf60 comp rx=0 tx=0).stop 2023-05-12T09:08:42.587 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 -- 172.21.15.116:0/2461278571 shutdown_connections 2023-05-12T09:08:42.587 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b8160b70 0x7f74b815f540 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.587 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f74a406ace0 0x7f74a406d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.587 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f74b80b87a0 0x7f74b815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.588 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 --2- 172.21.15.116:0/2461278571 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f74b81601e0 0x7f74b80b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.588 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 -- 172.21.15.116:0/2461278571 >> 172.21.15.116:0/2461278571 conn(0x7f74b8071b10 msgr2=0x7f74b8071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:42.588 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 -- 172.21.15.116:0/2461278571 shutdown_connections 2023-05-12T09:08:42.588 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.583+0000 7f74be3ff700 1 -- 172.21.15.116:0/2461278571 wait complete. 2023-05-12T09:08:42.605 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:42.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:42.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.790+0000 7ff8e1dff700 1 Processor -- start 2023-05-12T09:08:42.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.790+0000 7ff8e1dff700 1 -- start start 2023-05-12T09:08:42.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.792+0000 7ff8e1dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc0b87a0 0x7ff8dc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.792+0000 7ff8e1dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7ff8dc160d40 0x7ff8dc0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.792+0000 7ff8e1dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0cdc60 con 0x7ff8dc1601e0 2023-05-12T09:08:42.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.792+0000 7ff8e1dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc0d02d0 con 0x7ff8dc160d40 2023-05-12T09:08:42.795 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.792+0000 7ff8e1dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0d0cb0 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.797 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.792+0000 7ff8db7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc0b87a0 0x7ff8dc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.797 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.792+0000 7ff8dbfff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7ff8dc160d40 0x7ff8dc0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.797 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.792+0000 7ff8dbfff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7ff8dc160d40 0x7ff8dc0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:57100/0 (socket says 172.21.15.116:57100) 2023-05-12T09:08:42.797 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.792+0000 7ff8dbfff700 1 -- 172.21.15.116:0/195875259 learned_addr learned my addr 172.21.15.116:0/195875259 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:42.797 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.792+0000 7ff8db7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc0b87a0 0x7ff8dc0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:60546/0 (socket says 172.21.15.116:60546) 2023-05-12T09:08:42.797 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.793+0000 7ff8dbfff700 1 -- 172.21.15.116:0/195875259 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc0b87a0 msgr2=0x7ff8dc0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:42.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.793+0000 7ff8dbfff700 1 --2- 172.21.15.116:0/195875259 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc0b87a0 0x7ff8dc0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.793+0000 7ff8dbfff700 1 -- 172.21.15.116:0/195875259 >> v1:172.21.15.182:6789/0 conn(0x7ff8dc1601e0 legacy=0x7ff8dc160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.793+0000 7ff8dbfff700 1 -- 172.21.15.116:0/195875259 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0cd6a0 con 0x7ff8dc160d40 2023-05-12T09:08:42.798 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.793+0000 7ff8db7fe700 1 --2- 172.21.15.116:0/195875259 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc0b87a0 0x7ff8dc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:42.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.793+0000 7ff8dbfff700 1 --2- 172.21.15.116:0/195875259 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc160d40 0x7ff8dc0d1100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009e50 tx=0x7ff8d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=598baa5a5a8cf01c server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:42.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.793+0000 7ff8daffd700 1 -- 172.21.15.116:0/195875259 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d400e070 con 0x7ff8dc160d40 2023-05-12T09:08:42.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.793+0000 7ff8daffd700 1 -- 172.21.15.116:0/195875259 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d400b910 con 0x7ff8dc160d40 2023-05-12T09:08:42.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.793+0000 7ff8daffd700 1 -- 172.21.15.116:0/195875259 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d400bcc0 con 0x7ff8dc160d40 2023-05-12T09:08:42.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.794+0000 7ff8e1dff700 1 -- 172.21.15.116:0/195875259 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc160d40 msgr2=0x7ff8dc0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.794+0000 7ff8e1dff700 1 --2- 172.21.15.116:0/195875259 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc160d40 0x7ff8dc0d1100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009e50 tx=0x7ff8d400b330 comp rx=0 tx=0).stop 2023-05-12T09:08:42.799 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.794+0000 7ff8e1dff700 1 -- 172.21.15.116:0/195875259 shutdown_connections 2023-05-12T09:08:42.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.794+0000 7ff8e1dff700 1 --2- 172.21.15.116:0/195875259 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc160d40 0x7ff8dc0d1100 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.794+0000 7ff8e1dff700 1 --2- 172.21.15.116:0/195875259 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc0b87a0 0x7ff8dc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.794+0000 7ff8e1dff700 1 -- 172.21.15.116:0/195875259 >> 172.21.15.116:0/195875259 conn(0x7ff8dc071b10 msgr2=0x7ff8dc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:42.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.794+0000 7ff8e1dff700 1 -- 172.21.15.116:0/195875259 shutdown_connections 2023-05-12T09:08:42.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.794+0000 7ff8e1dff700 1 -- 172.21.15.116:0/195875259 wait complete. 2023-05-12T09:08:42.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.795+0000 7ff8e1dff700 1 Processor -- start 2023-05-12T09:08:42.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.796+0000 7ff8e1dff700 1 -- start start 2023-05-12T09:08:42.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.796+0000 7ff8e1dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc0b87a0 0x7ff8dc15f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.796+0000 7ff8e1dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc1601e0 0x7ff8dc15a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.796+0000 7ff8e1dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc160d40 0x7ff8dc1502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.796+0000 7ff8e1dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc15ed10 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.796+0000 7ff8e1dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc15eff0 con 0x7ff8dc1601e0 2023-05-12T09:08:42.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.796+0000 7ff8e1dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc15f2d0 con 0x7ff8dc160d40 2023-05-12T09:08:42.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8db7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc0b87a0 0x7ff8dc15f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8db7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc0b87a0 0x7ff8dc15f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38944/0 (socket says 172.21.15.116:38944) 2023-05-12T09:08:42.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8db7fe700 1 -- 172.21.15.116:0/335183150 learned_addr learned my addr 172.21.15.116:0/335183150 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:42.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8d3fff700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc1601e0 0x7ff8dc15a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8dbfff700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc160d40 0x7ff8dc1502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8db7fe700 1 -- 172.21.15.116:0/335183150 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc160d40 msgr2=0x7ff8dc1502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8db7fe700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc160d40 0x7ff8dc1502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8db7fe700 1 -- 172.21.15.116:0/335183150 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc1601e0 msgr2=0x7ff8dc15a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:42.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8db7fe700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc1601e0 0x7ff8dc15a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:42.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8db7fe700 1 -- 172.21.15.116:0/335183150 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0094a0 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.797+0000 7ff8db7fe700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc0b87a0 0x7ff8dc15f560 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00ebe0 tx=0x7ff8cc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:42.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.798+0000 7ff8d8ff9700 1 -- 172.21.15.116:0/335183150 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00c850 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.798+0000 7ff8d8ff9700 1 -- 172.21.15.116:0/335183150 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc00c9b0 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.798+0000 7ff8e1dff700 1 -- 172.21.15.116:0/335183150 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d4009b30 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.798+0000 7ff8d8ff9700 1 -- 172.21.15.116:0/335183150 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00cd40 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.798+0000 7ff8e1dff700 1 -- 172.21.15.116:0/335183150 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc0d1640 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.799+0000 7ff8e1dff700 1 -- 172.21.15.116:0/335183150 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc0cd980 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.800+0000 7ff8d8ff9700 1 -- 172.21.15.116:0/335183150 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8cc013470 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.801+0000 7ff8d8ff9700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8bc06ace0 0x7ff8bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:42.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.801+0000 7ff8d8ff9700 1 -- 172.21.15.116:0/335183150 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff8cc089800 con 0x7ff8dc0b87a0 2023-05-12T09:08:42.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.801+0000 7ff8d3fff700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8bc06ace0 0x7ff8bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:42.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.801+0000 7ff8d3fff700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8bc06ace0 0x7ff8bc06d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc1e8f20 tx=0x7ff8c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:42.808 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.805+0000 7ff8d8ff9700 1 -- 172.21.15.116:0/335183150 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff8cc054570 con 0x7ff8dc0b87a0 2023-05-12T09:08:43.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.998+0000 7ff8e1dff700 1 -- 172.21.15.116:0/335183150 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff8dc1e78e0 con 0x7ff8dc0b87a0 2023-05-12T09:08:43.001 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:42.998+0000 7ff8d8ff9700 1 -- 172.21.15.116:0/335183150 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff8cc00cea0 con 0x7ff8dc0b87a0 2023-05-12T09:08:43.002 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:43.003 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.000+0000 7ff8e1dff700 1 -- 172.21.15.116:0/335183150 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8bc06ace0 msgr2=0x7ff8bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.000+0000 7ff8e1dff700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8bc06ace0 0x7ff8bc06d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc1e8f20 tx=0x7ff8c4009040 comp rx=0 tx=0).stop 2023-05-12T09:08:43.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.000+0000 7ff8e1dff700 1 -- 172.21.15.116:0/335183150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc0b87a0 msgr2=0x7ff8dc15f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.000+0000 7ff8e1dff700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc0b87a0 0x7ff8dc15f560 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00ebe0 tx=0x7ff8cc00eef0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.001+0000 7ff8e1dff700 1 -- 172.21.15.116:0/335183150 shutdown_connections 2023-05-12T09:08:43.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.001+0000 7ff8e1dff700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8bc06ace0 0x7ff8bc06d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.001+0000 7ff8e1dff700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8dc160d40 0x7ff8dc1502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.001+0000 7ff8e1dff700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8dc0b87a0 0x7ff8dc15f560 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.001+0000 7ff8e1dff700 1 --2- 172.21.15.116:0/335183150 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8dc1601e0 0x7ff8dc15a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.001+0000 7ff8e1dff700 1 -- 172.21.15.116:0/335183150 >> 172.21.15.116:0/335183150 conn(0x7ff8dc071b10 msgr2=0x7ff8dc071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:43.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.001+0000 7ff8e1dff700 1 -- 172.21.15.116:0/335183150 shutdown_connections 2023-05-12T09:08:43.005 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.001+0000 7ff8e1dff700 1 -- 172.21.15.116:0/335183150 wait complete. 2023-05-12T09:08:43.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:43.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.206+0000 7faa133ff700 1 Processor -- start 2023-05-12T09:08:43.210 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.206+0000 7faa133ff700 1 -- start start 2023-05-12T09:08:43.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.207+0000 7faa133ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa0c0cfbf0 0x7faa0c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.207+0000 7faa133ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7faa0c0d1100 0x7faa0c0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.207+0000 7faa133ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0d0020 con 0x7faa0c0b87a0 2023-05-12T09:08:43.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.207+0000 7faa133ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c0d02d0 con 0x7faa0c0d1100 2023-05-12T09:08:43.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.207+0000 7faa133ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0d0cb0 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.208+0000 7faa1119b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7faa0c0b87a0 0x7faa0c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56886/0 (socket says 172.21.15.116:56886) 2023-05-12T09:08:43.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.208+0000 7faa1119b700 1 -- 172.21.15.116:0/3530169483 learned_addr learned my addr 172.21.15.116:0/3530169483 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:43.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.208+0000 7faa1199c700 1 --2- 172.21.15.116:0/3530169483 >> v2:172.21.15.182:3300/0 conn(0x7faa0c0d1100 0x7faa0c0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.212 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.208+0000 7faa1099a700 1 --2- 172.21.15.116:0/3530169483 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa0c0cfbf0 0x7faa0c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.208+0000 7faa03fff700 1 -- 172.21.15.116:0/3530169483 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185579594 0 0) 0x7faa0c0d0020 con 0x7faa0c0b87a0 2023-05-12T09:08:43.213 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.208+0000 7faa03fff700 1 -- 172.21.15.116:0/3530169483 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f80035b0 con 0x7faa0c0b87a0 2023-05-12T09:08:43.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.208+0000 7faa1199c700 1 -- 172.21.15.116:0/3530169483 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa0c0cfbf0 msgr2=0x7faa0c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:43.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.208+0000 7faa1199c700 1 --2- 172.21.15.116:0/3530169483 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa0c0cfbf0 0x7faa0c1608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.208+0000 7faa1199c700 1 -- 172.21.15.116:0/3530169483 >> v1:172.21.15.116:6789/0 conn(0x7faa0c0b87a0 legacy=0x7faa0c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.208+0000 7faa1199c700 1 -- 172.21.15.116:0/3530169483 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0cdc60 con 0x7faa0c0d1100 2023-05-12T09:08:43.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.209+0000 7faa1199c700 1 --2- 172.21.15.116:0/3530169483 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa0c0d1100 0x7faa0c0d1580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa04009d90 tx=0x7faa0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cddfa986f66d8d8 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:43.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.209+0000 7faa03fff700 1 -- 172.21.15.116:0/3530169483 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0400e070 con 0x7faa0c0d1100 2023-05-12T09:08:43.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.209+0000 7faa03fff700 1 -- 172.21.15.116:0/3530169483 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0400bb20 con 0x7faa0c0d1100 2023-05-12T09:08:43.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.209+0000 7faa03fff700 1 -- 172.21.15.116:0/3530169483 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa04012430 con 0x7faa0c0d1100 2023-05-12T09:08:43.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.209+0000 7faa133ff700 1 -- 172.21.15.116:0/3530169483 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa0c0d1100 msgr2=0x7faa0c0d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.209+0000 7faa133ff700 1 --2- 172.21.15.116:0/3530169483 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa0c0d1100 0x7faa0c0d1580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa04009d90 tx=0x7faa0400b330 comp rx=0 tx=0).stop 2023-05-12T09:08:43.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.210+0000 7faa133ff700 1 -- 172.21.15.116:0/3530169483 shutdown_connections 2023-05-12T09:08:43.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.210+0000 7faa133ff700 1 --2- 172.21.15.116:0/3530169483 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa0c0d1100 0x7faa0c0d1580 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.210+0000 7faa133ff700 1 --2- 172.21.15.116:0/3530169483 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa0c0cfbf0 0x7faa0c1608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.210+0000 7faa133ff700 1 -- 172.21.15.116:0/3530169483 >> 172.21.15.116:0/3530169483 conn(0x7faa0c071b10 msgr2=0x7faa0c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:43.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.210+0000 7faa133ff700 1 -- 172.21.15.116:0/3530169483 shutdown_connections 2023-05-12T09:08:43.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.210+0000 7faa133ff700 1 -- 172.21.15.116:0/3530169483 wait complete. 2023-05-12T09:08:43.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.211+0000 7faa133ff700 1 Processor -- start 2023-05-12T09:08:43.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.211+0000 7faa133ff700 1 -- start start 2023-05-12T09:08:43.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.212+0000 7faa133ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa0c0b87a0 0x7faa0c15f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.212+0000 7faa133ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa0c0cfbf0 0x7faa0c156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.218 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.212+0000 7faa133ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa0c0d1100 0x7faa0c15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.212+0000 7faa133ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0d3320 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.212+0000 7faa133ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c15f9c0 con 0x7faa0c0d1100 2023-05-12T09:08:43.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.212+0000 7faa133ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0cb110 con 0x7faa0c0b87a0 2023-05-12T09:08:43.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1099a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa0c0cfbf0 0x7faa0c156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.219 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1099a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa0c0cfbf0 0x7faa0c156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38958/0 (socket says 172.21.15.116:38958) 2023-05-12T09:08:43.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1099a700 1 -- 172.21.15.116:0/2729900641 learned_addr learned my addr 172.21.15.116:0/2729900641 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:43.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1119b700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa0c0b87a0 0x7faa0c15f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1199c700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa0c0d1100 0x7faa0c15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1099a700 1 -- 172.21.15.116:0/2729900641 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa0c0b87a0 msgr2=0x7faa0c15f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1099a700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa0c0b87a0 0x7faa0c15f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1099a700 1 -- 172.21.15.116:0/2729900641 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa0c0d1100 msgr2=0x7faa0c15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1099a700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa0c0d1100 0x7faa0c15d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1099a700 1 -- 172.21.15.116:0/2729900641 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa04009a70 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa1099a700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa0c0cfbf0 0x7faa0c156d70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00e870 tx=0x7fa9fc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:43.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.213+0000 7faa01ffb700 1 -- 172.21.15.116:0/2729900641 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc009590 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.214+0000 7faa01ffb700 1 -- 172.21.15.116:0/2729900641 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc013680 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.221 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.214+0000 7faa133ff700 1 -- 172.21.15.116:0/2729900641 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c0cd980 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.214+0000 7faa01ffb700 1 -- 172.21.15.116:0/2729900641 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0139f0 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.214+0000 7faa133ff700 1 -- 172.21.15.116:0/2729900641 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c0cd6a0 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.222 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.215+0000 7faa133ff700 1 -- 172.21.15.116:0/2729900641 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c160e30 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.216+0000 7faa01ffb700 1 -- 172.21.15.116:0/2729900641 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9fc013b50 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.216+0000 7faa01ffb700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa9f006ace0 0x7fa9f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.217+0000 7faa01ffb700 1 -- 172.21.15.116:0/2729900641 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa9fc089710 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.217+0000 7faa1119b700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa9f006ace0 0x7fa9f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.217+0000 7faa1119b700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa9f006ace0 0x7fa9f006d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa08007fd0 tx=0x7faa08007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:43.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.221+0000 7faa01ffb700 1 -- 172.21.15.116:0/2729900641 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa9fc057e80 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.417 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.414+0000 7faa133ff700 1 -- 172.21.15.116:0/2729900641 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa0c0cbd20 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.415+0000 7faa01ffb700 1 -- 172.21.15.116:0/2729900641 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9fc057a10 con 0x7faa0c0cfbf0 2023-05-12T09:08:43.418 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:43.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 -- 172.21.15.116:0/2729900641 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa9f006ace0 msgr2=0x7fa9f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa9f006ace0 0x7fa9f006d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa08007fd0 tx=0x7faa08007dc0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 -- 172.21.15.116:0/2729900641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa0c0cfbf0 msgr2=0x7faa0c156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa0c0cfbf0 0x7faa0c156d70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00e870 tx=0x7fa9fc00eb80 comp rx=0 tx=0).stop 2023-05-12T09:08:43.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 -- 172.21.15.116:0/2729900641 shutdown_connections 2023-05-12T09:08:43.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa0c0d1100 0x7faa0c15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa9f006ace0 0x7fa9f006d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.421 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa0c0b87a0 0x7faa0c15f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 --2- 172.21.15.116:0/2729900641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa0c0cfbf0 0x7faa0c156d70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 -- 172.21.15.116:0/2729900641 >> 172.21.15.116:0/2729900641 conn(0x7faa0c071b10 msgr2=0x7faa0c160170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:43.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 -- 172.21.15.116:0/2729900641 shutdown_connections 2023-05-12T09:08:43.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.417+0000 7faa133ff700 1 -- 172.21.15.116:0/2729900641 wait complete. 2023-05-12T09:08:43.437 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:43.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.621+0000 7f777bdff700 1 Processor -- start 2023-05-12T09:08:43.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.622+0000 7f777bdff700 1 -- start start 2023-05-12T09:08:43.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.623+0000 7f777bdff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777415a5a0 0x7f777406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.623+0000 7f777bdff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77740cb280 con 0x7f777406a920 2023-05-12T09:08:43.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.623+0000 7f777bdff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7774071700 con 0x7f7774071200 2023-05-12T09:08:43.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.623+0000 7f777bdff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777415a970 con 0x7f777415a5a0 2023-05-12T09:08:43.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.623+0000 7f777939a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f777406a920 0x7f7774070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56888/0 (socket says 172.21.15.116:56888) 2023-05-12T09:08:43.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.623+0000 7f777939a700 1 -- 172.21.15.116:0/3208638303 learned_addr learned my addr 172.21.15.116:0/3208638303 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:43.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.623+0000 7f7779b9b700 1 --2- 172.21.15.116:0/3208638303 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777415a5a0 0x7f777406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.623+0000 7f7778b99700 1 -- 172.21.15.116:0/3208638303 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778139414 0 0) 0x7f7764001290 con 0x7f777406a920 2023-05-12T09:08:43.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.623+0000 7f7778b99700 1 -- 172.21.15.116:0/3208638303 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77600035b0 con 0x7f777406a920 2023-05-12T09:08:43.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.624+0000 7f7778b99700 1 -- 172.21.15.116:0/3208638303 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121793759 0 0) 0x7f7774071700 con 0x7f7774071200 2023-05-12T09:08:43.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.624+0000 7f7778b99700 1 -- 172.21.15.116:0/3208638303 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7764001290 con 0x7f7774071200 2023-05-12T09:08:43.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.624+0000 7f7779b9b700 1 -- 172.21.15.116:0/3208638303 >> v1:172.21.15.182:6789/0 conn(0x7f7774071200 legacy=0x7f777406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.624+0000 7f7778b99700 1 -- 172.21.15.116:0/3208638303 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274428932 0 0) 0x7f77600035b0 con 0x7f777406a920 2023-05-12T09:08:43.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.624+0000 7f7779b9b700 1 -- 172.21.15.116:0/3208638303 >> v1:172.21.15.116:6789/0 conn(0x7f777406a920 legacy=0x7f7774070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.624+0000 7f7779b9b700 1 -- 172.21.15.116:0/3208638303 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740719e0 con 0x7f777415a5a0 2023-05-12T09:08:43.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.624+0000 7f7779b9b700 1 --2- 172.21.15.116:0/3208638303 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777415a5a0 0x7f777406a3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7770009870 tx=0x7f7770009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9466d77b06009e52 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:43.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.624+0000 7f7778b99700 1 -- 172.21.15.116:0/3208638303 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764001980 con 0x7f777415a5a0 2023-05-12T09:08:43.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.624+0000 7f7778b99700 1 -- 172.21.15.116:0/3208638303 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7770004030 con 0x7f777415a5a0 2023-05-12T09:08:43.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.624+0000 7f7778b99700 1 -- 172.21.15.116:0/3208638303 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700043c0 con 0x7f777415a5a0 2023-05-12T09:08:43.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.625+0000 7f777bdff700 1 -- 172.21.15.116:0/3208638303 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777415a5a0 msgr2=0x7f777406a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.625+0000 7f777bdff700 1 --2- 172.21.15.116:0/3208638303 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777415a5a0 0x7f777406a3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7770009870 tx=0x7f7770009b80 comp rx=0 tx=0).stop 2023-05-12T09:08:43.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.625+0000 7f777bdff700 1 -- 172.21.15.116:0/3208638303 shutdown_connections 2023-05-12T09:08:43.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.625+0000 7f777bdff700 1 --2- 172.21.15.116:0/3208638303 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777415a5a0 0x7f777406a3e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.625+0000 7f777bdff700 1 -- 172.21.15.116:0/3208638303 >> 172.21.15.116:0/3208638303 conn(0x7f77740cf720 msgr2=0x7f77740cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:43.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.625+0000 7f777bdff700 1 -- 172.21.15.116:0/3208638303 shutdown_connections 2023-05-12T09:08:43.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.625+0000 7f777bdff700 1 -- 172.21.15.116:0/3208638303 wait complete. 2023-05-12T09:08:43.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.627+0000 7f777bdff700 1 Processor -- start 2023-05-12T09:08:43.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.627+0000 7f777bdff700 1 -- start start 2023-05-12T09:08:43.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777bdff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777406a920 0x7f777415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777bdff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7774071200 0x7f7774148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777bdff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f777415a5a0 0x7f77740b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777bdff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77740c6a30 con 0x7f7774071200 2023-05-12T09:08:43.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777bdff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77740b33c0 con 0x7f777415a5a0 2023-05-12T09:08:43.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777bdff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77741493f0 con 0x7f777406a920 2023-05-12T09:08:43.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777939a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7774071200 0x7f7774148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777939a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7774071200 0x7f7774148eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38970/0 (socket says 172.21.15.116:38970) 2023-05-12T09:08:43.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777939a700 1 -- 172.21.15.116:0/2031259792 learned_addr learned my addr 172.21.15.116:0/2031259792 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:43.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777a39c700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f777415a5a0 0x7f77740b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f7779b9b700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777406a920 0x7f777415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777939a700 1 -- 172.21.15.116:0/2031259792 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777406a920 msgr2=0x7f777415cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.638 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777939a700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777406a920 0x7f777415cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777939a700 1 -- 172.21.15.116:0/2031259792 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f777415a5a0 msgr2=0x7f77740b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777939a700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f777415a5a0 0x7f77740b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.628+0000 7f777939a700 1 -- 172.21.15.116:0/2031259792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700094a0 con 0x7f7774071200 2023-05-12T09:08:43.639 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.629+0000 7f777939a700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7774071200 0x7f7774148eb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f776400c730 tx=0x7f776400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:43.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.629+0000 7f776a7fc700 1 -- 172.21.15.116:0/2031259792 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640074e0 con 0x7f7774071200 2023-05-12T09:08:43.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.629+0000 7f776a7fc700 1 -- 172.21.15.116:0/2031259792 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7764007640 con 0x7f7774071200 2023-05-12T09:08:43.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.629+0000 7f777bdff700 1 -- 172.21.15.116:0/2031259792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777406c9a0 con 0x7f7774071200 2023-05-12T09:08:43.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.629+0000 7f776a7fc700 1 -- 172.21.15.116:0/2031259792 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764005a70 con 0x7f7774071200 2023-05-12T09:08:43.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.629+0000 7f777bdff700 1 -- 172.21.15.116:0/2031259792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777406c6c0 con 0x7f7774071200 2023-05-12T09:08:43.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.630+0000 7f777bdff700 1 -- 172.21.15.116:0/2031259792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777406cc80 con 0x7f7774071200 2023-05-12T09:08:43.641 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.631+0000 7f776a7fc700 1 -- 172.21.15.116:0/2031259792 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7764005bd0 con 0x7f7774071200 2023-05-12T09:08:43.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.632+0000 7f776a7fc700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f775806ace0 0x7f775806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:43.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.632+0000 7f776a7fc700 1 -- 172.21.15.116:0/2031259792 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7764088cc0 con 0x7f7774071200 2023-05-12T09:08:43.642 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.632+0000 7f7779b9b700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f775806ace0 0x7f775806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:43.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.633+0000 7f7779b9b700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f775806ace0 0x7f775806d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f77700097c0 tx=0x7f7770008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:43.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.636+0000 7f776a7fc700 1 -- 172.21.15.116:0/2031259792 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f776408f080 con 0x7f7774071200 2023-05-12T09:08:43.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.834+0000 7f777bdff700 1 -- 172.21.15.116:0/2031259792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77740cbcf0 con 0x7f7774071200 2023-05-12T09:08:43.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.835+0000 7f776a7fc700 1 -- 172.21.15.116:0/2031259792 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7764017020 con 0x7f7774071200 2023-05-12T09:08:43.838 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:43.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 -- 172.21.15.116:0/2031259792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f775806ace0 msgr2=0x7f775806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f775806ace0 0x7f775806d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f77700097c0 tx=0x7f7770008030 comp rx=0 tx=0).stop 2023-05-12T09:08:43.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 -- 172.21.15.116:0/2031259792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7774071200 msgr2=0x7f7774148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:43.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7774071200 0x7f7774148eb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f776400c730 tx=0x7f776400ca40 comp rx=0 tx=0).stop 2023-05-12T09:08:43.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 -- 172.21.15.116:0/2031259792 shutdown_connections 2023-05-12T09:08:43.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f777415a5a0 0x7f77740b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f775806ace0 0x7f775806d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f777406a920 0x7f777415cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 --2- 172.21.15.116:0/2031259792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7774071200 0x7f7774148eb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:43.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 -- 172.21.15.116:0/2031259792 >> 172.21.15.116:0/2031259792 conn(0x7f77740cf720 msgr2=0x7f777406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:43.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 -- 172.21.15.116:0/2031259792 shutdown_connections 2023-05-12T09:08:43.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:43.837+0000 7f777bdff700 1 -- 172.21.15.116:0/2031259792 wait complete. 2023-05-12T09:08:43.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:44.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.042+0000 7f503b7ff700 1 Processor -- start 2023-05-12T09:08:44.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.042+0000 7f503b7ff700 1 -- start start 2023-05-12T09:08:44.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.043+0000 7f503b7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50340cf010 0x7f5034160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.043+0000 7f503b7ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f50340cff50 0x7f50340d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.043+0000 7f503b7ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340cd520 con 0x7f503415c590 2023-05-12T09:08:44.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.043+0000 7f503b7ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340d2640 con 0x7f50340cff50 2023-05-12T09:08:44.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.043+0000 7f503b7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50341610d0 con 0x7f50340cf010 2023-05-12T09:08:44.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f503959b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f503415c590 0x7f50340cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56894/0 (socket says 172.21.15.116:56894) 2023-05-12T09:08:44.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f503959b700 1 -- 172.21.15.116:0/603255718 learned_addr learned my addr 172.21.15.116:0/603255718 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:44.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f5039d9c700 1 --2- 172.21.15.116:0/603255718 >> v2:172.21.15.116:3300/0 conn(0x7f50340cff50 0x7f50340d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f502bfff700 1 -- 172.21.15.116:0/603255718 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846443960 0 0) 0x7f50340cd520 con 0x7f503415c590 2023-05-12T09:08:44.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f502bfff700 1 -- 172.21.15.116:0/603255718 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50200035b0 con 0x7f503415c590 2023-05-12T09:08:44.048 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f5038d9a700 1 --2- 172.21.15.116:0/603255718 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50340cf010 0x7f5034160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f5039d9c700 1 -- 172.21.15.116:0/603255718 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50340cf010 msgr2=0x7f5034160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:44.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f5039d9c700 1 --2- 172.21.15.116:0/603255718 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50340cf010 0x7f5034160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f5039d9c700 1 -- 172.21.15.116:0/603255718 >> v1:172.21.15.116:6789/0 conn(0x7f503415c590 legacy=0x7f50340cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f5039d9c700 1 -- 172.21.15.116:0/603255718 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340b23c0 con 0x7f50340cff50 2023-05-12T09:08:44.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.044+0000 7f5039d9c700 1 --2- 172.21.15.116:0/603255718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 0x7f50340d2ad0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f502c009d90 tx=0x7f502c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c75996107954ed server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:44.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f502bfff700 1 -- 172.21.15.116:0/603255718 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00e070 con 0x7f50340cff50 2023-05-12T09:08:44.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f502bfff700 1 -- 172.21.15.116:0/603255718 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c00bb20 con 0x7f50340cff50 2023-05-12T09:08:44.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f502bfff700 1 -- 172.21.15.116:0/603255718 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c012430 con 0x7f50340cff50 2023-05-12T09:08:44.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f503b7ff700 1 -- 172.21.15.116:0/603255718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 msgr2=0x7f50340d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f503b7ff700 1 --2- 172.21.15.116:0/603255718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 0x7f50340d2ad0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f502c009d90 tx=0x7f502c00b330 comp rx=0 tx=0).stop 2023-05-12T09:08:44.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f503b7ff700 1 -- 172.21.15.116:0/603255718 shutdown_connections 2023-05-12T09:08:44.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f503b7ff700 1 --2- 172.21.15.116:0/603255718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 0x7f50340d2ad0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f503b7ff700 1 --2- 172.21.15.116:0/603255718 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50340cf010 0x7f5034160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f503b7ff700 1 -- 172.21.15.116:0/603255718 >> 172.21.15.116:0/603255718 conn(0x7f5034071b10 msgr2=0x7f5034071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:44.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f503b7ff700 1 -- 172.21.15.116:0/603255718 shutdown_connections 2023-05-12T09:08:44.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.045+0000 7f503b7ff700 1 -- 172.21.15.116:0/603255718 wait complete. 2023-05-12T09:08:44.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.047+0000 7f503b7ff700 1 Processor -- start 2023-05-12T09:08:44.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.047+0000 7f503b7ff700 1 -- start start 2023-05-12T09:08:44.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f503b7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50340cf010 0x7f5034158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f503b7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 0x7f50340b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f503b7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f503415c590 0x7f503415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f503b7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b69b0 con 0x7f50340cff50 2023-05-12T09:08:44.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f503b7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b5da0 con 0x7f503415c590 2023-05-12T09:08:44.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f503b7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b6080 con 0x7f50340cf010 2023-05-12T09:08:44.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f5038d9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 0x7f50340b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f5038d9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 0x7f50340b8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38990/0 (socket says 172.21.15.116:38990) 2023-05-12T09:08:44.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f5038d9a700 1 -- 172.21.15.116:0/290664453 learned_addr learned my addr 172.21.15.116:0/290664453 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:44.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f503959b700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50340cf010 0x7f5034158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.048+0000 7f5039d9c700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f503415c590 0x7f503415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f5038d9a700 1 -- 172.21.15.116:0/290664453 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50340cf010 msgr2=0x7f5034158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f5038d9a700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50340cf010 0x7f5034158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f5038d9a700 1 -- 172.21.15.116:0/290664453 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f503415c590 msgr2=0x7f503415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f5038d9a700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f503415c590 0x7f503415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f5038d9a700 1 -- 172.21.15.116:0/290664453 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c009a70 con 0x7f50340cff50 2023-05-12T09:08:44.056 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f5038d9a700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 0x7f50340b8250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f502400e810 tx=0x7f502400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:44.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f5029ffb700 1 -- 172.21.15.116:0/290664453 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024013610 con 0x7f50340cff50 2023-05-12T09:08:44.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f5029ffb700 1 -- 172.21.15.116:0/290664453 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5024013770 con 0x7f50340cff50 2023-05-12T09:08:44.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f5029ffb700 1 -- 172.21.15.116:0/290664453 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024013b20 con 0x7f50340cff50 2023-05-12T09:08:44.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f503b7ff700 1 -- 172.21.15.116:0/290664453 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340cd770 con 0x7f50340cff50 2023-05-12T09:08:44.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.049+0000 7f503b7ff700 1 -- 172.21.15.116:0/290664453 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340cf560 con 0x7f50340cff50 2023-05-12T09:08:44.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.050+0000 7f503b7ff700 1 -- 172.21.15.116:0/290664453 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503415c960 con 0x7f50340cff50 2023-05-12T09:08:44.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.051+0000 7f5029ffb700 1 -- 172.21.15.116:0/290664453 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5024013c80 con 0x7f50340cff50 2023-05-12T09:08:44.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.052+0000 7f5029ffb700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f501806ace0 0x7f501806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.053+0000 7f5029ffb700 1 -- 172.21.15.116:0/290664453 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f50240894e0 con 0x7f50340cff50 2023-05-12T09:08:44.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.053+0000 7f503959b700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f501806ace0 0x7f501806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.053+0000 7f503959b700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f501806ace0 0x7f501806d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f50300011e0 tx=0x7f5030009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:44.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.057+0000 7f5029ffb700 1 -- 172.21.15.116:0/290664453 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f50240541d0 con 0x7f50340cff50 2023-05-12T09:08:44.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.248+0000 7f503b7ff700 1 -- 172.21.15.116:0/290664453 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50340b6af0 con 0x7f50340cff50 2023-05-12T09:08:44.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.248+0000 7f5029ffb700 1 -- 172.21.15.116:0/290664453 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50240577f0 con 0x7f50340cff50 2023-05-12T09:08:44.252 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:44.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 -- 172.21.15.116:0/290664453 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f501806ace0 msgr2=0x7f501806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f501806ace0 0x7f501806d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f50300011e0 tx=0x7f5030009040 comp rx=0 tx=0).stop 2023-05-12T09:08:44.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 -- 172.21.15.116:0/290664453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 msgr2=0x7f50340b8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 0x7f50340b8250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f502400e810 tx=0x7f502400ebd0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 -- 172.21.15.116:0/290664453 shutdown_connections 2023-05-12T09:08:44.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f503415c590 0x7f503415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f501806ace0 0x7f501806d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f50340cf010 0x7f5034158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 --2- 172.21.15.116:0/290664453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50340cff50 0x7f50340b8250 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 -- 172.21.15.116:0/290664453 >> 172.21.15.116:0/290664453 conn(0x7f5034071b10 msgr2=0x7f50340d10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:44.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 -- 172.21.15.116:0/290664453 shutdown_connections 2023-05-12T09:08:44.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.251+0000 7f503b7ff700 1 -- 172.21.15.116:0/290664453 wait complete. 2023-05-12T09:08:44.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:44.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.456+0000 7fb8c89ff700 1 Processor -- start 2023-05-12T09:08:44.460 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.456+0000 7fb8c89ff700 1 -- start start 2023-05-12T09:08:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c89ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8c40cfbf0 0x7fb8c41608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c89ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb8c40d1100 0x7fb8c40d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c89ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c40d0020 con 0x7fb8c40b87a0 2023-05-12T09:08:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c89ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c40d02d0 con 0x7fb8c40d1100 2023-05-12T09:08:44.461 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c89ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40d0cb0 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c2d9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb8c40d1100 0x7fb8c40d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c2d9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb8c40d1100 0x7fb8c40d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39002/0 (socket says 172.21.15.116:39002) 2023-05-12T09:08:44.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c2d9d700 1 -- 172.21.15.116:0/2800987096 learned_addr learned my addr 172.21.15.116:0/2800987096 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:44.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8bbfff700 1 --2- 172.21.15.116:0/2800987096 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8c40cfbf0 0x7fb8c41608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c2d9d700 1 -- 172.21.15.116:0/2800987096 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8c40cfbf0 msgr2=0x7fb8c41608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:44.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c2d9d700 1 --2- 172.21.15.116:0/2800987096 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8c40cfbf0 0x7fb8c41608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c2d9d700 1 -- 172.21.15.116:0/2800987096 >> v1:172.21.15.182:6789/0 conn(0x7fb8c40b87a0 legacy=0x7fb8c41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c2d9d700 1 -- 172.21.15.116:0/2800987096 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40cdc60 con 0x7fb8c40d1100 2023-05-12T09:08:44.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.458+0000 7fb8c1d9b700 1 -- 172.21.15.116:0/2800987096 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455559212 0 0) 0x7fb8c40d0020 con 0x7fb8c40b87a0 2023-05-12T09:08:44.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.459+0000 7fb8c2d9d700 1 --2- 172.21.15.116:0/2800987096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40d1100 0x7fb8c40d1580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009e50 tx=0x7fb8bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07535507c2d638e server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:44.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.459+0000 7fb8c1d9b700 1 -- 172.21.15.116:0/2800987096 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc00e070 con 0x7fb8c40d1100 2023-05-12T09:08:44.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.459+0000 7fb8c1d9b700 1 -- 172.21.15.116:0/2800987096 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc00b910 con 0x7fb8c40d1100 2023-05-12T09:08:44.464 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.459+0000 7fb8c1d9b700 1 -- 172.21.15.116:0/2800987096 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc00bcc0 con 0x7fb8c40d1100 2023-05-12T09:08:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.459+0000 7fb8c89ff700 1 -- 172.21.15.116:0/2800987096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40d1100 msgr2=0x7fb8c40d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.459+0000 7fb8c89ff700 1 --2- 172.21.15.116:0/2800987096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40d1100 0x7fb8c40d1580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009e50 tx=0x7fb8bc00b330 comp rx=0 tx=0).stop 2023-05-12T09:08:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.459+0000 7fb8c89ff700 1 -- 172.21.15.116:0/2800987096 shutdown_connections 2023-05-12T09:08:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.459+0000 7fb8c89ff700 1 --2- 172.21.15.116:0/2800987096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40d1100 0x7fb8c40d1580 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.459+0000 7fb8c89ff700 1 --2- 172.21.15.116:0/2800987096 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8c40cfbf0 0x7fb8c41608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.459+0000 7fb8c89ff700 1 -- 172.21.15.116:0/2800987096 >> 172.21.15.116:0/2800987096 conn(0x7fb8c4071b10 msgr2=0x7fb8c4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:44.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.460+0000 7fb8c89ff700 1 -- 172.21.15.116:0/2800987096 shutdown_connections 2023-05-12T09:08:44.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.460+0000 7fb8c89ff700 1 -- 172.21.15.116:0/2800987096 wait complete. 2023-05-12T09:08:44.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.461+0000 7fb8c89ff700 1 Processor -- start 2023-05-12T09:08:44.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.461+0000 7fb8c89ff700 1 -- start start 2023-05-12T09:08:44.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.462+0000 7fb8c89ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8c40b87a0 0x7fb8c40ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.462+0000 7fb8c89ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40cfbf0 0x7fb8c4159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.462+0000 7fb8c89ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8c40d1100 0x7fb8c40cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.462+0000 7fb8c89ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c415e200 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.462+0000 7fb8c89ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40c86d0 con 0x7fb8c40b87a0 2023-05-12T09:08:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.462+0000 7fb8c89ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40c89b0 con 0x7fb8c40d1100 2023-05-12T09:08:44.468 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.462+0000 7fb8bbfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40cfbf0 0x7fb8c4159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.462+0000 7fb8bbfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40cfbf0 0x7fb8c4159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39006/0 (socket says 172.21.15.116:39006) 2023-05-12T09:08:44.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.462+0000 7fb8bbfff700 1 -- 172.21.15.116:0/3872193556 learned_addr learned my addr 172.21.15.116:0/3872193556 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:44.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8c2d9d700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8c40d1100 0x7fb8c40cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8c259c700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8c40b87a0 0x7fb8c40ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8bbfff700 1 -- 172.21.15.116:0/3872193556 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8c40d1100 msgr2=0x7fb8c40cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8bbfff700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8c40d1100 0x7fb8c40cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.469 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8bbfff700 1 -- 172.21.15.116:0/3872193556 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8c40b87a0 msgr2=0x7fb8c40ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8bbfff700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8c40b87a0 0x7fb8c40ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8bbfff700 1 -- 172.21.15.116:0/3872193556 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc009b30 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8c259c700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8c40b87a0 0x7fb8c40ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8bbfff700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40cfbf0 0x7fb8c4159640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00e9b0 tx=0x7fb8ac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8baffd700 1 -- 172.21.15.116:0/3872193556 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac009710 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8baffd700 1 -- 172.21.15.116:0/3872193556 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac00c850 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8c89ff700 1 -- 172.21.15.116:0/3872193556 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c40cd980 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.470 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8baffd700 1 -- 172.21.15.116:0/3872193556 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00cbc0 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.463+0000 7fb8c89ff700 1 -- 172.21.15.116:0/3872193556 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c40cd6a0 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.464+0000 7fb8c89ff700 1 -- 172.21.15.116:0/3872193556 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c4160e30 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.471 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.465+0000 7fb8baffd700 1 -- 172.21.15.116:0/3872193556 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8ac00cd20 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.467+0000 7fb8baffd700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb8a406ace0 0x7fb8a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.467+0000 7fb8baffd700 1 -- 172.21.15.116:0/3872193556 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8ac089960 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.467+0000 7fb8c259c700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb8a406ace0 0x7fb8a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.472 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.468+0000 7fb8c259c700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb8a406ace0 0x7fb8a406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4000f60 tx=0x7fb8b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:44.474 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.472+0000 7fb8baffd700 1 -- 172.21.15.116:0/3872193556 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb8ac0580d0 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.665+0000 7fb8c89ff700 1 -- 172.21.15.116:0/3872193556 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb8c4074430 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.669 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.665+0000 7fb8baffd700 1 -- 172.21.15.116:0/3872193556 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb8ac057c60 con 0x7fb8c40cfbf0 2023-05-12T09:08:44.669 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:44.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.667+0000 7fb8c89ff700 1 -- 172.21.15.116:0/3872193556 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb8a406ace0 msgr2=0x7fb8a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.667+0000 7fb8c89ff700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb8a406ace0 0x7fb8a406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4000f60 tx=0x7fb8b4009040 comp rx=0 tx=0).stop 2023-05-12T09:08:44.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.667+0000 7fb8c89ff700 1 -- 172.21.15.116:0/3872193556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40cfbf0 msgr2=0x7fb8c4159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.667+0000 7fb8c89ff700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40cfbf0 0x7fb8c4159640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00e9b0 tx=0x7fb8ac00ed70 comp rx=0 tx=0).stop 2023-05-12T09:08:44.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.667+0000 7fb8c89ff700 1 -- 172.21.15.116:0/3872193556 shutdown_connections 2023-05-12T09:08:44.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.667+0000 7fb8c89ff700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb8a406ace0 0x7fb8a406d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.667+0000 7fb8c89ff700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8c40d1100 0x7fb8c40cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.667+0000 7fb8c89ff700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8c40b87a0 0x7fb8c40ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.667+0000 7fb8c89ff700 1 --2- 172.21.15.116:0/3872193556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8c40cfbf0 0x7fb8c4159640 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.667+0000 7fb8c89ff700 1 -- 172.21.15.116:0/3872193556 >> 172.21.15.116:0/3872193556 conn(0x7fb8c4071b10 msgr2=0x7fb8c40d3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:44.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.668+0000 7fb8c89ff700 1 -- 172.21.15.116:0/3872193556 shutdown_connections 2023-05-12T09:08:44.672 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.668+0000 7fb8c89ff700 1 -- 172.21.15.116:0/3872193556 wait complete. 2023-05-12T09:08:44.687 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-12T09:08:44.871 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.868+0000 7fad81dff700 1 Processor -- start 2023-05-12T09:08:44.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.868+0000 7fad81dff700 1 -- start start 2023-05-12T09:08:44.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.869+0000 7fad81dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fad7c0b87a0 0x7fad7c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.872 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.869+0000 7fad81dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fad7c160d40 0x7fad7c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.869+0000 7fad81dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7c0cdc60 con 0x7fad7c1601e0 2023-05-12T09:08:44.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.869+0000 7fad81dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c0d02d0 con 0x7fad7c160d40 2023-05-12T09:08:44.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.869+0000 7fad81dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0d0cb0 con 0x7fad7c0b87a0 2023-05-12T09:08:44.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.870+0000 7fad7bfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fad7c160d40 0x7fad7c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.870+0000 7fad7affd700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fad7c1601e0 0x7fad7c160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56908/0 (socket says 172.21.15.116:56908) 2023-05-12T09:08:44.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.870+0000 7fad7affd700 1 -- 172.21.15.116:0/1553263999 learned_addr learned my addr 172.21.15.116:0/1553263999 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:44.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.870+0000 7fad7b7fe700 1 --2- 172.21.15.116:0/1553263999 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fad7c0b87a0 0x7fad7c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.870+0000 7fad7bfff700 1 -- 172.21.15.116:0/1553263999 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fad7c0b87a0 msgr2=0x7fad7c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:44.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.870+0000 7fad7bfff700 1 --2- 172.21.15.116:0/1553263999 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fad7c0b87a0 0x7fad7c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.870+0000 7fad7bfff700 1 -- 172.21.15.116:0/1553263999 >> v1:172.21.15.116:6789/0 conn(0x7fad7c1601e0 legacy=0x7fad7c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.870+0000 7fad7bfff700 1 -- 172.21.15.116:0/1553263999 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c0cd6a0 con 0x7fad7c160d40 2023-05-12T09:08:44.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.870+0000 7fad7a7fc700 1 -- 172.21.15.116:0/1553263999 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646795255 0 0) 0x7fad7c0cdc60 con 0x7fad7c1601e0 2023-05-12T09:08:44.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.870+0000 7fad7bfff700 1 --2- 172.21.15.116:0/1553263999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c160d40 0x7fad7c0d1100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fad74009d90 tx=0x7fad7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05c8e03576f999b server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:44.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad7a7fc700 1 -- 172.21.15.116:0/1553263999 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400e070 con 0x7fad7c160d40 2023-05-12T09:08:44.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad7a7fc700 1 -- 172.21.15.116:0/1553263999 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7400bbd0 con 0x7fad7c160d40 2023-05-12T09:08:44.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad7a7fc700 1 -- 172.21.15.116:0/1553263999 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74012430 con 0x7fad7c160d40 2023-05-12T09:08:44.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad81dff700 1 -- 172.21.15.116:0/1553263999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c160d40 msgr2=0x7fad7c0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad81dff700 1 --2- 172.21.15.116:0/1553263999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c160d40 0x7fad7c0d1100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fad74009d90 tx=0x7fad7400b330 comp rx=0 tx=0).stop 2023-05-12T09:08:44.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad81dff700 1 -- 172.21.15.116:0/1553263999 shutdown_connections 2023-05-12T09:08:44.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad81dff700 1 --2- 172.21.15.116:0/1553263999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c160d40 0x7fad7c0d1100 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad81dff700 1 --2- 172.21.15.116:0/1553263999 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fad7c0b87a0 0x7fad7c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad81dff700 1 -- 172.21.15.116:0/1553263999 >> 172.21.15.116:0/1553263999 conn(0x7fad7c071b10 msgr2=0x7fad7c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:44.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad81dff700 1 -- 172.21.15.116:0/1553263999 shutdown_connections 2023-05-12T09:08:44.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.871+0000 7fad81dff700 1 -- 172.21.15.116:0/1553263999 wait complete. 2023-05-12T09:08:44.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.874+0000 7fad81dff700 1 Processor -- start 2023-05-12T09:08:44.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.874+0000 7fad81dff700 1 -- start start 2023-05-12T09:08:44.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad81dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c0b87a0 0x7fad7c0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad81dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fad7c1601e0 0x7fad7c1f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad81dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fad7c160d40 0x7fad7c159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad81dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0cc650 con 0x7fad7c0b87a0 2023-05-12T09:08:44.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad81dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c1f54b0 con 0x7fad7c1601e0 2023-05-12T09:08:44.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad81dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c1f24b0 con 0x7fad7c160d40 2023-05-12T09:08:44.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad7b7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c0b87a0 0x7fad7c0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad7b7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c0b87a0 0x7fad7c0ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39022/0 (socket says 172.21.15.116:39022) 2023-05-12T09:08:44.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad7b7fe700 1 -- 172.21.15.116:0/3999232066 learned_addr learned my addr 172.21.15.116:0/3999232066 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:44.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad7bfff700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fad7c160d40 0x7fad7c159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.875+0000 7fad7affd700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fad7c1601e0 0x7fad7c1f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad7b7fe700 1 -- 172.21.15.116:0/3999232066 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fad7c160d40 msgr2=0x7fad7c159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad7b7fe700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fad7c160d40 0x7fad7c159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad7b7fe700 1 -- 172.21.15.116:0/3999232066 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fad7c1601e0 msgr2=0x7fad7c1f1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:44.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad7b7fe700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fad7c1601e0 0x7fad7c1f1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:44.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad7b7fe700 1 -- 172.21.15.116:0/3999232066 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad74009a70 con 0x7fad7c0b87a0 2023-05-12T09:08:44.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad7b7fe700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c0b87a0 0x7fad7c0ccb40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e810 tx=0x7fad6c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:44.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad63fff700 1 -- 172.21.15.116:0/3999232066 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c013610 con 0x7fad7c0b87a0 2023-05-12T09:08:44.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad63fff700 1 -- 172.21.15.116:0/3999232066 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c013770 con 0x7fad7c0b87a0 2023-05-12T09:08:44.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad81dff700 1 -- 172.21.15.116:0/3999232066 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c0d1640 con 0x7fad7c0b87a0 2023-05-12T09:08:44.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad63fff700 1 -- 172.21.15.116:0/3999232066 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c013b20 con 0x7fad7c0b87a0 2023-05-12T09:08:44.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.876+0000 7fad81dff700 1 -- 172.21.15.116:0/3999232066 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c0cd980 con 0x7fad7c0b87a0 2023-05-12T09:08:44.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.877+0000 7fad81dff700 1 -- 172.21.15.116:0/3999232066 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c0d17d0 con 0x7fad7c0b87a0 2023-05-12T09:08:44.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.878+0000 7fad63fff700 1 -- 172.21.15.116:0/3999232066 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad6c013c80 con 0x7fad7c0b87a0 2023-05-12T09:08:44.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.879+0000 7fad63fff700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fad6806ace0 0x7fad6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:44.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.880+0000 7fad63fff700 1 -- 172.21.15.116:0/3999232066 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fad6c089520 con 0x7fad7c0b87a0 2023-05-12T09:08:44.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.880+0000 7fad7affd700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fad6806ace0 0x7fad6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:44.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.880+0000 7fad7affd700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fad6806ace0 0x7fad6806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0c9ec0 tx=0x7fad70007be0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:44.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:44.884+0000 7fad63fff700 1 -- 172.21.15.116:0/3999232066 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fad6c054210 con 0x7fad7c0b87a0 2023-05-12T09:08:45.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.095+0000 7fad81dff700 1 -- 172.21.15.116:0/3999232066 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fad7c074430 con 0x7fad7c0b87a0 2023-05-12T09:08:45.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.095+0000 7fad63fff700 1 -- 172.21.15.116:0/3999232066 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fad6c057830 con 0x7fad7c0b87a0 2023-05-12T09:08:45.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 -- 172.21.15.116:0/3999232066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fad6806ace0 msgr2=0x7fad6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fad6806ace0 0x7fad6806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0c9ec0 tx=0x7fad70007be0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 -- 172.21.15.116:0/3999232066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c0b87a0 msgr2=0x7fad7c0ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c0b87a0 0x7fad7c0ccb40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e810 tx=0x7fad6c00ebd0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 -- 172.21.15.116:0/3999232066 shutdown_connections 2023-05-12T09:08:45.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fad6806ace0 0x7fad6806d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fad7c160d40 0x7fad7c159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad7c0b87a0 0x7fad7c0ccb40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 --2- 172.21.15.116:0/3999232066 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fad7c1601e0 0x7fad7c1f1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 -- 172.21.15.116:0/3999232066 >> 172.21.15.116:0/3999232066 conn(0x7fad7c071b10 msgr2=0x7fad7c160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:45.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 -- 172.21.15.116:0/3999232066 shutdown_connections 2023-05-12T09:08:45.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.098+0000 7fad81dff700 1 -- 172.21.15.116:0/3999232066 wait complete. 2023-05-12T09:08:45.103 INFO:teuthology.orchestra.run.smithi116.stderr:listed 0 entries 2023-05-12T09:08:45.118 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi182.front.sepia.ceph.com... 2023-05-12T09:08:45.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:45.118 DEBUG:teuthology.orchestra.run.smithi182:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-05-12T09:08:45.186 INFO:teuthology.orchestra.run:waiting for 300 2023-05-12T09:08:45.187 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi182.front.sepia.ceph.com 2023-05-12T09:08:45.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:08:45.188 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-12T09:08:45.231 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-12T09:08:45.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:08:45.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.412+0000 7f1282dff700 1 Processor -- start 2023-05-12T09:08:45.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.412+0000 7f1282dff700 1 -- start start 2023-05-12T09:08:45.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f1282dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f127c0cfbf0 0x7f127c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f1282dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c0d0020 con 0x7f127c0b87a0 2023-05-12T09:08:45.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f1282dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c0cdc60 con 0x7f127c0d1100 2023-05-12T09:08:45.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f1282dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127c0d02d0 con 0x7f127c0cfbf0 2023-05-12T09:08:45.417 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f127bfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f127c0cfbf0 0x7f127c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.417 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f1280b9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f127c0b87a0 0x7f127c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56914/0 (socket says 172.21.15.116:56914) 2023-05-12T09:08:45.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f1280b9b700 1 -- 172.21.15.116:0/4065053183 learned_addr learned my addr 172.21.15.116:0/4065053183 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:45.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f127bfff700 1 -- 172.21.15.116:0/4065053183 >> v1:172.21.15.182:6789/0 conn(0x7f127c0d1100 legacy=0x7f127c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f127bfff700 1 -- 172.21.15.116:0/4065053183 >> v1:172.21.15.116:6789/0 conn(0x7f127c0b87a0 legacy=0x7f127c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f127bfff700 1 -- 172.21.15.116:0/4065053183 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0cd6a0 con 0x7f127c0cfbf0 2023-05-12T09:08:45.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.413+0000 7f127b7fe700 1 -- 172.21.15.116:0/4065053183 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911871619 0 0) 0x7f127c0d0020 con 0x7f127c0b87a0 2023-05-12T09:08:45.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.415+0000 7f127bfff700 1 --2- 172.21.15.116:0/4065053183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0cfbf0 0x7f127c1608f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1268009840 tx=0x7f1268009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926624bb9654f269 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:45.418 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.415+0000 7f127b7fe700 1 -- 172.21.15.116:0/4065053183 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268011830 con 0x7f127c0cfbf0 2023-05-12T09:08:45.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.415+0000 7f127b7fe700 1 -- 172.21.15.116:0/4065053183 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268011990 con 0x7f127c0cfbf0 2023-05-12T09:08:45.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.415+0000 7f127b7fe700 1 -- 172.21.15.116:0/4065053183 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268011d20 con 0x7f127c0cfbf0 2023-05-12T09:08:45.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.415+0000 7f1282dff700 1 -- 172.21.15.116:0/4065053183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0cfbf0 msgr2=0x7f127c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.415+0000 7f1282dff700 1 --2- 172.21.15.116:0/4065053183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0cfbf0 0x7f127c1608f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1268009840 tx=0x7f1268009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:45.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.415+0000 7f1282dff700 1 -- 172.21.15.116:0/4065053183 shutdown_connections 2023-05-12T09:08:45.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.415+0000 7f1282dff700 1 --2- 172.21.15.116:0/4065053183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0cfbf0 0x7f127c1608f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.419 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.415+0000 7f1282dff700 1 -- 172.21.15.116:0/4065053183 >> 172.21.15.116:0/4065053183 conn(0x7f127c071b10 msgr2=0x7f127c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:45.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.415+0000 7f1282dff700 1 -- 172.21.15.116:0/4065053183 shutdown_connections 2023-05-12T09:08:45.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.416+0000 7f1282dff700 1 -- 172.21.15.116:0/4065053183 wait complete. 2023-05-12T09:08:45.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.418+0000 7f1282dff700 1 Processor -- start 2023-05-12T09:08:45.420 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.418+0000 7f1282dff700 1 -- start start 2023-05-12T09:08:45.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.419+0000 7f1282dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f127c0b87a0 0x7f127c1e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.419+0000 7f1282dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f127c0cfbf0 0x7f127c0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.419+0000 7f1282dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0d1100 0x7f127c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.422 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.419+0000 7f1282dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0ca4c0 con 0x7f127c0d1100 2023-05-12T09:08:45.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.419+0000 7f1282dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c9920 con 0x7f127c0b87a0 2023-05-12T09:08:45.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.419+0000 7f1282dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0cb300 con 0x7f127c0cfbf0 2023-05-12T09:08:45.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.419+0000 7f128139c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0d1100 0x7f127c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f128139c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0d1100 0x7f127c0c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39050/0 (socket says 172.21.15.116:39050) 2023-05-12T09:08:45.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f128139c700 1 -- 172.21.15.116:0/1747717547 learned_addr learned my addr 172.21.15.116:0/1747717547 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:45.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f1280b9b700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f127c0b87a0 0x7f127c1e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f127bfff700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f127c0cfbf0 0x7f127c0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.423 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f128139c700 1 -- 172.21.15.116:0/1747717547 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f127c0cfbf0 msgr2=0x7f127c0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f128139c700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f127c0cfbf0 0x7f127c0c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f128139c700 1 -- 172.21.15.116:0/1747717547 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f127c0b87a0 msgr2=0x7f127c1e8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f128139c700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f127c0b87a0 0x7f127c1e8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f128139c700 1 -- 172.21.15.116:0/1747717547 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12680094a0 con 0x7f127c0d1100 2023-05-12T09:08:45.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f127bfff700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f127c0cfbf0 0x7f127c0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:45.424 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f128139c700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0d1100 0x7f127c0c93e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f127400cb50 tx=0x7f127400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:45.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f12797fa700 1 -- 172.21.15.116:0/1747717547 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274003c00 con 0x7f127c0d1100 2023-05-12T09:08:45.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.420+0000 7f12797fa700 1 -- 172.21.15.116:0/1747717547 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1274003d60 con 0x7f127c0d1100 2023-05-12T09:08:45.425 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.421+0000 7f12797fa700 1 -- 172.21.15.116:0/1747717547 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400aac0 con 0x7f127c0d1100 2023-05-12T09:08:45.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.421+0000 7f1282dff700 1 -- 172.21.15.116:0/1747717547 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c160e30 con 0x7f127c0d1100 2023-05-12T09:08:45.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.421+0000 7f1282dff700 1 -- 172.21.15.116:0/1747717547 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c0cd980 con 0x7f127c0d1100 2023-05-12T09:08:45.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.422+0000 7f1282dff700 1 -- 172.21.15.116:0/1747717547 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c160fc0 con 0x7f127c0d1100 2023-05-12T09:08:45.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.422+0000 7f12797fa700 1 -- 172.21.15.116:0/1747717547 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f127400ac20 con 0x7f127c0d1100 2023-05-12T09:08:45.426 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.424+0000 7f12797fa700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f126006ace0 0x7f126006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.424+0000 7f12797fa700 1 -- 172.21.15.116:0/1747717547 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f12740897b0 con 0x7f127c0d1100 2023-05-12T09:08:45.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.424+0000 7f1280b9b700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f126006ace0 0x7f126006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.427 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.424+0000 7f1280b9b700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f126006ace0 0x7f126006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1270007b10 tx=0x7f1270007a60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:45.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.428+0000 7f12797fa700 1 -- 172.21.15.116:0/1747717547 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1274054520 con 0x7f127c0d1100 2023-05-12T09:08:45.667 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.665+0000 7f1282dff700 1 -- 172.21.15.116:0/1747717547 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f127c0cb470 con 0x7f127c0d1100 2023-05-12T09:08:45.668 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.665+0000 7f12797fa700 1 -- 172.21.15.116:0/1747717547 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f1274057b40 con 0x7f127c0d1100 2023-05-12T09:08:45.668 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:45.668 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:07:10.529423+0000","modified":"2023-05-12T09:07:38.475430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-12T09:08:45.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 -- 172.21.15.116:0/1747717547 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f126006ace0 msgr2=0x7f126006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f126006ace0 0x7f126006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1270007b10 tx=0x7f1270007a60 comp rx=0 tx=0).stop 2023-05-12T09:08:45.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 -- 172.21.15.116:0/1747717547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0d1100 msgr2=0x7f127c0c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0d1100 0x7f127c0c93e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f127400cb50 tx=0x7f127400ce60 comp rx=0 tx=0).stop 2023-05-12T09:08:45.670 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 -- 172.21.15.116:0/1747717547 shutdown_connections 2023-05-12T09:08:45.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f127c0d1100 0x7f127c0c93e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f127c0b87a0 0x7f127c1e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f126006ace0 0x7f126006d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 --2- 172.21.15.116:0/1747717547 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f127c0cfbf0 0x7f127c0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 -- 172.21.15.116:0/1747717547 >> 172.21.15.116:0/1747717547 conn(0x7f127c071b10 msgr2=0x7f127c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:45.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 -- 172.21.15.116:0/1747717547 shutdown_connections 2023-05-12T09:08:45.671 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.668+0000 7f1282dff700 1 -- 172.21.15.116:0/1747717547 wait complete. 2023-05-12T09:08:45.672 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 9 2023-05-12T09:08:45.688 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:45.873 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.871+0000 7f1d307ff700 1 Processor -- start 2023-05-12T09:08:45.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.871+0000 7f1d307ff700 1 -- start start 2023-05-12T09:08:45.874 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.872+0000 7f1d307ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1d280b87a0 0x7f1d280cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.872+0000 7f1d307ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d281601e0 0x7f1d28160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.872+0000 7f1d307ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d28160ff0 con 0x7f1d28160b70 2023-05-12T09:08:45.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.872+0000 7f1d307ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d280d02d0 con 0x7f1d280b87a0 2023-05-12T09:08:45.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.872+0000 7f1d307ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280d0cb0 con 0x7f1d281601e0 2023-05-12T09:08:45.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.873+0000 7f1d2e59b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1d280b87a0 0x7f1d280cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.875 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.873+0000 7f1d2ed9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1d28160b70 0x7f1d280d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56916/0 (socket says 172.21.15.116:56916) 2023-05-12T09:08:45.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.873+0000 7f1d2ed9c700 1 -- 172.21.15.116:0/3611145966 learned_addr learned my addr 172.21.15.116:0/3611145966 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:45.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.873+0000 7f1d2dd9a700 1 --2- 172.21.15.116:0/3611145966 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d281601e0 0x7f1d28160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.873+0000 7f1d2e59b700 1 -- 172.21.15.116:0/3611145966 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d281601e0 msgr2=0x7f1d28160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:45.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.873+0000 7f1d2e59b700 1 --2- 172.21.15.116:0/3611145966 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d281601e0 0x7f1d28160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.873+0000 7f1d2e59b700 1 -- 172.21.15.116:0/3611145966 >> v1:172.21.15.116:6789/0 conn(0x7f1d28160b70 legacy=0x7f1d280d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.873+0000 7f1d2e59b700 1 -- 172.21.15.116:0/3611145966 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d280cdc60 con 0x7f1d280b87a0 2023-05-12T09:08:45.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.873+0000 7f1d2d599700 1 -- 172.21.15.116:0/3611145966 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307519903 0 0) 0x7f1d28160ff0 con 0x7f1d28160b70 2023-05-12T09:08:45.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.873+0000 7f1d2e59b700 1 --2- 172.21.15.116:0/3611145966 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 0x7f1d280cfbf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009840 tx=0x7f1d24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fef4fecf1142663 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:45.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d2d599700 1 -- 172.21.15.116:0/3611145966 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24011830 con 0x7f1d280b87a0 2023-05-12T09:08:45.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d2d599700 1 -- 172.21.15.116:0/3611145966 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d24011990 con 0x7f1d280b87a0 2023-05-12T09:08:45.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d2d599700 1 -- 172.21.15.116:0/3611145966 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24011d20 con 0x7f1d280b87a0 2023-05-12T09:08:45.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d307ff700 1 -- 172.21.15.116:0/3611145966 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 msgr2=0x7f1d280cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d307ff700 1 --2- 172.21.15.116:0/3611145966 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 0x7f1d280cfbf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009840 tx=0x7f1d24009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:45.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d307ff700 1 -- 172.21.15.116:0/3611145966 shutdown_connections 2023-05-12T09:08:45.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d307ff700 1 --2- 172.21.15.116:0/3611145966 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 0x7f1d280cfbf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d307ff700 1 --2- 172.21.15.116:0/3611145966 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d281601e0 0x7f1d28160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d307ff700 1 -- 172.21.15.116:0/3611145966 >> 172.21.15.116:0/3611145966 conn(0x7f1d28071b10 msgr2=0x7f1d28071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:45.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d307ff700 1 -- 172.21.15.116:0/3611145966 shutdown_connections 2023-05-12T09:08:45.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.874+0000 7f1d307ff700 1 -- 172.21.15.116:0/3611145966 wait complete. 2023-05-12T09:08:45.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.877+0000 7f1d307ff700 1 Processor -- start 2023-05-12T09:08:45.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.877+0000 7f1d307ff700 1 -- start start 2023-05-12T09:08:45.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d307ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 0x7f1d28157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d307ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1d281601e0 0x7f1d280b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d307ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d28160b70 0x7f1d280b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d307ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d281f2b50 con 0x7f1d280b87a0 2023-05-12T09:08:45.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d307ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28158f60 con 0x7f1d281601e0 2023-05-12T09:08:45.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d307ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28159240 con 0x7f1d28160b70 2023-05-12T09:08:45.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d2e59b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 0x7f1d28157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d2e59b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 0x7f1d28157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39074/0 (socket says 172.21.15.116:39074) 2023-05-12T09:08:45.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d2e59b700 1 -- 172.21.15.116:0/3910709375 learned_addr learned my addr 172.21.15.116:0/3910709375 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:45.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d2dd9a700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1d281601e0 0x7f1d280b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.878+0000 7f1d2ed9c700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d28160b70 0x7f1d280b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d2e59b700 1 -- 172.21.15.116:0/3910709375 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d28160b70 msgr2=0x7f1d280b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d2e59b700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d28160b70 0x7f1d280b6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d2e59b700 1 -- 172.21.15.116:0/3910709375 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1d281601e0 msgr2=0x7f1d280b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:45.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d2e59b700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1d281601e0 0x7f1d280b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:45.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d2e59b700 1 -- 172.21.15.116:0/3910709375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d240094a0 con 0x7f1d280b87a0 2023-05-12T09:08:45.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d2e59b700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 0x7f1d28157620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009fd0 tx=0x7f1d24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:45.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d1effd700 1 -- 172.21.15.116:0/3910709375 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d240036a0 con 0x7f1d280b87a0 2023-05-12T09:08:45.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d1effd700 1 -- 172.21.15.116:0/3910709375 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2401f070 con 0x7f1d280b87a0 2023-05-12T09:08:45.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d1effd700 1 -- 172.21.15.116:0/3910709375 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24003a60 con 0x7f1d280b87a0 2023-05-12T09:08:45.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d307ff700 1 -- 172.21.15.116:0/3910709375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d280cd980 con 0x7f1d280b87a0 2023-05-12T09:08:45.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.879+0000 7f1d307ff700 1 -- 172.21.15.116:0/3910709375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d280cd6a0 con 0x7f1d280b87a0 2023-05-12T09:08:45.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.880+0000 7f1d307ff700 1 -- 172.21.15.116:0/3910709375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d280d2110 con 0x7f1d280b87a0 2023-05-12T09:08:45.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.881+0000 7f1d1effd700 1 -- 172.21.15.116:0/3910709375 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d24003bc0 con 0x7f1d280b87a0 2023-05-12T09:08:45.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.882+0000 7f1d1effd700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 0x7f1d0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:45.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.882+0000 7f1d1effd700 1 -- 172.21.15.116:0/3910709375 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1d24021070 con 0x7f1d280b87a0 2023-05-12T09:08:45.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.882+0000 7f1d2dd9a700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 0x7f1d0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:45.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.883+0000 7f1d2dd9a700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 0x7f1d0c06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d280b1ca0 tx=0x7f1d18008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:45.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:45.887+0000 7f1d1effd700 1 -- 172.21.15.116:0/3910709375 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1d24055e80 con 0x7f1d280b87a0 2023-05-12T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.087+0000 7f1d307ff700 1 -- 172.21.15.116:0/3910709375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d28074430 con 0x7f1d280b87a0 2023-05-12T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.089+0000 7f1d1effd700 1 -- 172.21.15.116:0/3910709375 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7f1d240594a0 con 0x7f1d280b87a0 2023-05-12T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 -- 172.21.15.116:0/3910709375 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 msgr2=0x7f1d0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 0x7f1d0c06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d280b1ca0 tx=0x7f1d18008040 comp rx=0 tx=0).stop 2023-05-12T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 -- 172.21.15.116:0/3910709375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 msgr2=0x7f1d28157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 0x7f1d28157620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009fd0 tx=0x7f1d24004750 comp rx=0 tx=0).stop 2023-05-12T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 -- 172.21.15.116:0/3910709375 shutdown_connections 2023-05-12T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f1d0c06ace0 0x7f1d0c06d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f1d28160b70 0x7f1d280b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d280b87a0 0x7f1d28157620 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 --2- 172.21.15.116:0/3910709375 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1d281601e0 0x7f1d280b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 -- 172.21.15.116:0/3910709375 >> 172.21.15.116:0/3910709375 conn(0x7f1d28071b10 msgr2=0x7f1d28071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 -- 172.21.15.116:0/3910709375 shutdown_connections 2023-05-12T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.091+0000 7f1d307ff700 1 -- 172.21.15.116:0/3910709375 wait complete. 2023-05-12T09:08:46.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-12T09:07:08.752948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-12T09:07:09.510824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-12T09:07:12.586151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-12T09:08:46.111 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:08:46.298 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.296+0000 7f829c7ff700 1 Processor -- start 2023-05-12T09:08:46.298 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.296+0000 7f829c7ff700 1 -- start start 2023-05-12T09:08:46.300 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.298+0000 7f829c7ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f82940b87a0 0x7f82940cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.300 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.298+0000 7f829c7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 0x7f8294160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.298+0000 7f829c7ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8294160ff0 con 0x7f8294160b70 2023-05-12T09:08:46.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.298+0000 7f829c7ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940d02d0 con 0x7f82940b87a0 2023-05-12T09:08:46.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.298+0000 7f829c7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940d0cb0 con 0x7f82941601e0 2023-05-12T09:08:46.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.298+0000 7f829ad9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8294160b70 0x7f82940d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56918/0 (socket says 172.21.15.116:56918) 2023-05-12T09:08:46.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.298+0000 7f829ad9c700 1 -- 172.21.15.116:0/1543453098 learned_addr learned my addr 172.21.15.116:0/1543453098 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:46.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.299+0000 7f829a59b700 1 --2- 172.21.15.116:0/1543453098 >> v2:172.21.15.182:3300/0 conn(0x7f82940b87a0 0x7f82940cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.301 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.299+0000 7f8299d9a700 1 --2- 172.21.15.116:0/1543453098 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 0x7f8294160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.299+0000 7f8299599700 1 -- 172.21.15.116:0/1543453098 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258887777 0 0) 0x7f8294160ff0 con 0x7f8294160b70 2023-05-12T09:08:46.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.299+0000 7f8299599700 1 -- 172.21.15.116:0/1543453098 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82800035b0 con 0x7f8294160b70 2023-05-12T09:08:46.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.299+0000 7f829a59b700 1 -- 172.21.15.116:0/1543453098 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 msgr2=0x7f8294160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:46.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.299+0000 7f829a59b700 1 --2- 172.21.15.116:0/1543453098 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 0x7f8294160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.299+0000 7f829a59b700 1 -- 172.21.15.116:0/1543453098 >> v1:172.21.15.116:6789/0 conn(0x7f8294160b70 legacy=0x7f82940d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.303 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.299+0000 7f829a59b700 1 -- 172.21.15.116:0/1543453098 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940cdc60 con 0x7f82940b87a0 2023-05-12T09:08:46.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.299+0000 7f8299d9a700 1 --2- 172.21.15.116:0/1543453098 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 0x7f8294160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:46.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.299+0000 7f829a59b700 1 --2- 172.21.15.116:0/1543453098 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f82940b87a0 0x7f82940cfbf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8290009840 tx=0x7f8290009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=659efe2c3c07ad33 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:46.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f8299599700 1 -- 172.21.15.116:0/1543453098 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290011830 con 0x7f82940b87a0 2023-05-12T09:08:46.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f8299599700 1 -- 172.21.15.116:0/1543453098 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8290011990 con 0x7f82940b87a0 2023-05-12T09:08:46.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f8299599700 1 -- 172.21.15.116:0/1543453098 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290011d20 con 0x7f82940b87a0 2023-05-12T09:08:46.304 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f829c7ff700 1 -- 172.21.15.116:0/1543453098 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f82940b87a0 msgr2=0x7f82940cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f829c7ff700 1 --2- 172.21.15.116:0/1543453098 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f82940b87a0 0x7f82940cfbf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8290009840 tx=0x7f8290009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:46.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f829c7ff700 1 -- 172.21.15.116:0/1543453098 shutdown_connections 2023-05-12T09:08:46.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f829c7ff700 1 --2- 172.21.15.116:0/1543453098 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f82940b87a0 0x7f82940cfbf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f829c7ff700 1 --2- 172.21.15.116:0/1543453098 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 0x7f8294160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f829c7ff700 1 -- 172.21.15.116:0/1543453098 >> 172.21.15.116:0/1543453098 conn(0x7f8294071b10 msgr2=0x7f8294071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:46.305 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f829c7ff700 1 -- 172.21.15.116:0/1543453098 shutdown_connections 2023-05-12T09:08:46.306 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.300+0000 7f829c7ff700 1 -- 172.21.15.116:0/1543453098 wait complete. 2023-05-12T09:08:46.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.302+0000 7f829c7ff700 1 Processor -- start 2023-05-12T09:08:46.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.302+0000 7f829c7ff700 1 -- start start 2023-05-12T09:08:46.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f829c7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82940b87a0 0x7f82941f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f829c7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 0x7f82941f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f829c7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8294160b70 0x7f82941f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.308 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f829c7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940c81c0 con 0x7f82940b87a0 2023-05-12T09:08:46.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f829c7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940c8990 con 0x7f8294160b70 2023-05-12T09:08:46.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f829c7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82941f6530 con 0x7f82941601e0 2023-05-12T09:08:46.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f829a59b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82940b87a0 0x7f82941f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f829a59b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82940b87a0 0x7f82941f5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39088/0 (socket says 172.21.15.116:39088) 2023-05-12T09:08:46.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f829a59b700 1 -- 172.21.15.116:0/4080456582 learned_addr learned my addr 172.21.15.116:0/4080456582 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:46.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f8299d9a700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 0x7f82941f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.309 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.303+0000 7f829ad9c700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8294160b70 0x7f82941f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f829a59b700 1 -- 172.21.15.116:0/4080456582 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 msgr2=0x7f82941f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f829a59b700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 0x7f82941f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f829a59b700 1 -- 172.21.15.116:0/4080456582 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8294160b70 msgr2=0x7f82941f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f829a59b700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8294160b70 0x7f82941f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f829a59b700 1 -- 172.21.15.116:0/4080456582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82840094a0 con 0x7f82940b87a0 2023-05-12T09:08:46.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f8299d9a700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 0x7f82941f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:46.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f829ad9c700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8294160b70 0x7f82941f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:46.310 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f829a59b700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82940b87a0 0x7f82941f5ff0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f82900090b0 tx=0x7f8290004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:46.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f828affd700 1 -- 172.21.15.116:0/4080456582 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82900036a0 con 0x7f82940b87a0 2023-05-12T09:08:46.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f828affd700 1 -- 172.21.15.116:0/4080456582 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829001f070 con 0x7f82940b87a0 2023-05-12T09:08:46.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f829c7ff700 1 -- 172.21.15.116:0/4080456582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82900094a0 con 0x7f82940b87a0 2023-05-12T09:08:46.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f828affd700 1 -- 172.21.15.116:0/4080456582 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290003a40 con 0x7f82940b87a0 2023-05-12T09:08:46.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.304+0000 7f829c7ff700 1 -- 172.21.15.116:0/4080456582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82940cd980 con 0x7f82940b87a0 2023-05-12T09:08:46.311 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.305+0000 7f829c7ff700 1 -- 172.21.15.116:0/4080456582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82940d2110 con 0x7f82940b87a0 2023-05-12T09:08:46.312 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.306+0000 7f828affd700 1 -- 172.21.15.116:0/4080456582 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8290003ba0 con 0x7f82940b87a0 2023-05-12T09:08:46.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.307+0000 7f828affd700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f827806ace0 0x7f827806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.313 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.307+0000 7f828affd700 1 -- 172.21.15.116:0/4080456582 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8290021070 con 0x7f82940b87a0 2023-05-12T09:08:46.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.307+0000 7f8299d9a700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f827806ace0 0x7f827806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.314 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.308+0000 7f8299d9a700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f827806ace0 0x7f827806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f82941550a0 tx=0x7f8284008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:46.315 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.311+0000 7f828affd700 1 -- 172.21.15.116:0/4080456582 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8290055dd0 con 0x7f82940b87a0 2023-05-12T09:08:46.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.505+0000 7f829c7ff700 1 -- 172.21.15.116:0/4080456582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8294074430 con 0x7f82940b87a0 2023-05-12T09:08:46.507 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.505+0000 7f828affd700 1 -- 172.21.15.116:0/4080456582 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f82900593f0 con 0x7f82940b87a0 2023-05-12T09:08:46.508 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:08:46.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 -- 172.21.15.116:0/4080456582 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f827806ace0 msgr2=0x7f827806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f827806ace0 0x7f827806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f82941550a0 tx=0x7f8284008040 comp rx=0 tx=0).stop 2023-05-12T09:08:46.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 -- 172.21.15.116:0/4080456582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82940b87a0 msgr2=0x7f82941f5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82940b87a0 0x7f82941f5ff0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f82900090b0 tx=0x7f8290004750 comp rx=0 tx=0).stop 2023-05-12T09:08:46.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 -- 172.21.15.116:0/4080456582 shutdown_connections 2023-05-12T09:08:46.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f8294160b70 0x7f82941f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82940b87a0 0x7f82941f5ff0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f827806ace0 0x7f827806d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 --2- 172.21.15.116:0/4080456582 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f82941601e0 0x7f82941f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 -- 172.21.15.116:0/4080456582 >> 172.21.15.116:0/4080456582 conn(0x7f8294071b10 msgr2=0x7f829406bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:46.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 -- 172.21.15.116:0/4080456582 shutdown_connections 2023-05-12T09:08:46.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.508+0000 7f829c7ff700 1 -- 172.21.15.116:0/4080456582 wait complete. 2023-05-12T09:08:46.527 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:08:46.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.715+0000 7f7f19bff700 1 Processor -- start 2023-05-12T09:08:46.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.716+0000 7f7f19bff700 1 -- start start 2023-05-12T09:08:46.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.717+0000 7f7f19bff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7f1415a5a0 0x7f7f1406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.717+0000 7f7f19bff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f140cb280 con 0x7f7f1406a920 2023-05-12T09:08:46.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.717+0000 7f7f19bff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f14071700 con 0x7f7f14071200 2023-05-12T09:08:46.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.717+0000 7f7f19bff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1406adc0 con 0x7f7f1415a5a0 2023-05-12T09:08:46.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.717+0000 7f7f0bfff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f7f1406a920 0x7f7f14070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56922/0 (socket says 172.21.15.116:56922) 2023-05-12T09:08:46.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.717+0000 7f7f0bfff700 1 -- 172.21.15.116:0/2024729437 learned_addr learned my addr 172.21.15.116:0/2024729437 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:46.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.717+0000 7f7f137fe700 1 --2- 172.21.15.116:0/2024729437 >> v2:172.21.15.116:3300/0 conn(0x7f7f1415a5a0 0x7f7f1406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.717+0000 7f7f12ffd700 1 -- 172.21.15.116:0/2024729437 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288803926 0 0) 0x7f7efc001290 con 0x7f7f1406a920 2023-05-12T09:08:46.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.717+0000 7f7f12ffd700 1 -- 172.21.15.116:0/2024729437 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f000035b0 con 0x7f7f1406a920 2023-05-12T09:08:46.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.717+0000 7f7f137fe700 1 -- 172.21.15.116:0/2024729437 >> v1:172.21.15.182:6789/0 conn(0x7f7f14071200 legacy=0x7f7f1406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.718+0000 7f7f137fe700 1 -- 172.21.15.116:0/2024729437 >> v1:172.21.15.116:6789/0 conn(0x7f7f1406a920 legacy=0x7f7f14070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.718+0000 7f7f137fe700 1 -- 172.21.15.116:0/2024729437 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f140719e0 con 0x7f7f1415a5a0 2023-05-12T09:08:46.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.718+0000 7f7f137fe700 1 --2- 172.21.15.116:0/2024729437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f1415a5a0 0x7f7f1406a3e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009840 tx=0x7f7f04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f901427da1b596 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:46.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.718+0000 7f7f12ffd700 1 -- 172.21.15.116:0/2024729437 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04011830 con 0x7f7f1415a5a0 2023-05-12T09:08:46.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.718+0000 7f7f12ffd700 1 -- 172.21.15.116:0/2024729437 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f04011990 con 0x7f7f1415a5a0 2023-05-12T09:08:46.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.718+0000 7f7f12ffd700 1 -- 172.21.15.116:0/2024729437 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04011d20 con 0x7f7f1415a5a0 2023-05-12T09:08:46.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.719+0000 7f7f19bff700 1 -- 172.21.15.116:0/2024729437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f1415a5a0 msgr2=0x7f7f1406a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.719+0000 7f7f19bff700 1 --2- 172.21.15.116:0/2024729437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f1415a5a0 0x7f7f1406a3e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009840 tx=0x7f7f04009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:46.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.719+0000 7f7f19bff700 1 -- 172.21.15.116:0/2024729437 shutdown_connections 2023-05-12T09:08:46.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.719+0000 7f7f19bff700 1 --2- 172.21.15.116:0/2024729437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f1415a5a0 0x7f7f1406a3e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.719+0000 7f7f19bff700 1 -- 172.21.15.116:0/2024729437 >> 172.21.15.116:0/2024729437 conn(0x7f7f140cf720 msgr2=0x7f7f140cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:46.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.719+0000 7f7f19bff700 1 -- 172.21.15.116:0/2024729437 shutdown_connections 2023-05-12T09:08:46.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.719+0000 7f7f19bff700 1 -- 172.21.15.116:0/2024729437 wait complete. 2023-05-12T09:08:46.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.720+0000 7f7f19bff700 1 Processor -- start 2023-05-12T09:08:46.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.721+0000 7f7f19bff700 1 -- start start 2023-05-12T09:08:46.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.721+0000 7f7f19bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7f1406a920 0x7f7f14159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f19bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f14071200 0x7f7f141419a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f19bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7f1415a5a0 0x7f7f14141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f19bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140c5390 con 0x7f7f14071200 2023-05-12T09:08:46.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f19bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14159c50 con 0x7f7f1406a920 2023-05-12T09:08:46.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f19bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140c8790 con 0x7f7f1415a5a0 2023-05-12T09:08:46.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f14071200 0x7f7f141419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f14071200 0x7f7f141419a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39112/0 (socket says 172.21.15.116:39112) 2023-05-12T09:08:46.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f0bfff700 1 -- 172.21.15.116:0/2342781378 learned_addr learned my addr 172.21.15.116:0/2342781378 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:46.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f137fe700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7f1406a920 0x7f7f14159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f13fff700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7f1415a5a0 0x7f7f14141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f0bfff700 1 -- 172.21.15.116:0/2342781378 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7f1415a5a0 msgr2=0x7f7f14141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f0bfff700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7f1415a5a0 0x7f7f14141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f0bfff700 1 -- 172.21.15.116:0/2342781378 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7f1406a920 msgr2=0x7f7f14159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f0bfff700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7f1406a920 0x7f7f14159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f0bfff700 1 -- 172.21.15.116:0/2342781378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f040094a0 con 0x7f7f14071200 2023-05-12T09:08:46.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f137fe700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7f1406a920 0x7f7f14159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:46.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.722+0000 7f7f0bfff700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f14071200 0x7f7f141419a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7efc001eb0 tx=0x7f7efc00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:46.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.723+0000 7f7f10ff9700 1 -- 172.21.15.116:0/2342781378 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc005c40 con 0x7f7f14071200 2023-05-12T09:08:46.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.723+0000 7f7f10ff9700 1 -- 172.21.15.116:0/2342781378 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc005da0 con 0x7f7f14071200 2023-05-12T09:08:46.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.723+0000 7f7f10ff9700 1 -- 172.21.15.116:0/2342781378 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0072f0 con 0x7f7f14071200 2023-05-12T09:08:46.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.723+0000 7f7f19bff700 1 -- 172.21.15.116:0/2342781378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1406c9a0 con 0x7f7f14071200 2023-05-12T09:08:46.728 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.723+0000 7f7f19bff700 1 -- 172.21.15.116:0/2342781378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1406c6c0 con 0x7f7f14071200 2023-05-12T09:08:46.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.724+0000 7f7f19bff700 1 -- 172.21.15.116:0/2342781378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1406cc80 con 0x7f7f14071200 2023-05-12T09:08:46.729 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.725+0000 7f7f10ff9700 1 -- 172.21.15.116:0/2342781378 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7efc007450 con 0x7f7f14071200 2023-05-12T09:08:46.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.725+0000 7f7f10ff9700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7ef406ace0 0x7f7ef406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:46.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.726+0000 7f7f10ff9700 1 -- 172.21.15.116:0/2342781378 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7efc088c10 con 0x7f7f14071200 2023-05-12T09:08:46.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.726+0000 7f7f137fe700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7ef406ace0 0x7f7ef406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:46.730 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.726+0000 7f7f137fe700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7ef406ace0 0x7f7ef406d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7f040090b0 tx=0x7f7f0401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:46.732 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.730+0000 7f7f10ff9700 1 -- 172.21.15.116:0/2342781378 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7efc053980 con 0x7f7f14071200 2023-05-12T09:08:46.929 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.927+0000 7f7f19bff700 1 -- 172.21.15.116:0/2342781378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f140cbcf0 con 0x7f7f14071200 2023-05-12T09:08:46.930 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.928+0000 7f7f10ff9700 1 -- 172.21.15.116:0/2342781378 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7efc0170a0 con 0x7f7f14071200 2023-05-12T09:08:46.930 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:08:46.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 -- 172.21.15.116:0/2342781378 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7ef406ace0 msgr2=0x7f7ef406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7ef406ace0 0x7f7ef406d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7f040090b0 tx=0x7f7f0401c040 comp rx=0 tx=0).stop 2023-05-12T09:08:46.932 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 -- 172.21.15.116:0/2342781378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f14071200 msgr2=0x7f7f141419a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:46.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f14071200 0x7f7f141419a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7efc001eb0 tx=0x7f7efc00ca90 comp rx=0 tx=0).stop 2023-05-12T09:08:46.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 -- 172.21.15.116:0/2342781378 shutdown_connections 2023-05-12T09:08:46.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7ef406ace0 0x7f7ef406d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7f1415a5a0 0x7f7f14141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7f1406a920 0x7f7f14159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 --2- 172.21.15.116:0/2342781378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f14071200 0x7f7f141419a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:46.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 -- 172.21.15.116:0/2342781378 >> 172.21.15.116:0/2342781378 conn(0x7f7f140cf720 msgr2=0x7f7f140b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:46.933 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 -- 172.21.15.116:0/2342781378 shutdown_connections 2023-05-12T09:08:46.934 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:46.930+0000 7f7f19bff700 1 -- 172.21.15.116:0/2342781378 wait complete. 2023-05-12T09:08:46.949 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-12T09:08:47.134 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.132+0000 7fc355dff700 1 Processor -- start 2023-05-12T09:08:47.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.132+0000 7fc355dff700 1 -- start start 2023-05-12T09:08:47.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.133+0000 7fc355dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc35015a5a0 0x7fc35006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.133+0000 7fc355dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc35006a920 0x7fc350070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.133+0000 7fc355dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3500cb280 con 0x7fc350071030 2023-05-12T09:08:47.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.133+0000 7fc355dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35015a970 con 0x7fc35006a920 2023-05-12T09:08:47.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.133+0000 7fc355dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35006ad90 con 0x7fc35015a5a0 2023-05-12T09:08:47.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.134+0000 7fc347fff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc35006a920 0x7fc350070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.134+0000 7fc34f7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc35015a5a0 0x7fc35006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.134+0000 7fc34ffff700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7fc350071030 0x7fc35015dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:39918/0 (socket says 172.21.15.116:39918) 2023-05-12T09:08:47.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.134+0000 7fc34ffff700 1 -- 172.21.15.116:0/657714407 learned_addr learned my addr 172.21.15.116:0/657714407 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:47.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.135+0000 7fc34effd700 1 -- 172.21.15.116:0/657714407 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959811713 0 0) 0x7fc348001490 con 0x7fc350071030 2023-05-12T09:08:47.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.135+0000 7fc34effd700 1 -- 172.21.15.116:0/657714407 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc33c0035b0 con 0x7fc350071030 2023-05-12T09:08:47.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.135+0000 7fc347fff700 1 -- 172.21.15.116:0/657714407 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc35015a5a0 msgr2=0x7fc35006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:47.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.135+0000 7fc347fff700 1 --2- 172.21.15.116:0/657714407 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc35015a5a0 0x7fc35006a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.135+0000 7fc347fff700 1 -- 172.21.15.116:0/657714407 >> v1:172.21.15.182:6789/0 conn(0x7fc350071030 legacy=0x7fc35015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.135+0000 7fc347fff700 1 -- 172.21.15.116:0/657714407 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3500714b0 con 0x7fc35006a920 2023-05-12T09:08:47.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.135+0000 7fc347fff700 1 --2- 172.21.15.116:0/657714407 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc35006a920 0x7fc350070af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc338009850 tx=0x7fc338009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b796b4772fec1a8d server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:47.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.135+0000 7fc34effd700 1 -- 172.21.15.116:0/657714407 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338005e30 con 0x7fc35006a920 2023-05-12T09:08:47.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.135+0000 7fc34effd700 1 -- 172.21.15.116:0/657714407 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc338006030 con 0x7fc35006a920 2023-05-12T09:08:47.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.135+0000 7fc34effd700 1 -- 172.21.15.116:0/657714407 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380063c0 con 0x7fc35006a920 2023-05-12T09:08:47.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.136+0000 7fc355dff700 1 -- 172.21.15.116:0/657714407 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc35006a920 msgr2=0x7fc350070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.136+0000 7fc355dff700 1 --2- 172.21.15.116:0/657714407 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc35006a920 0x7fc350070af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc338009850 tx=0x7fc338009b60 comp rx=0 tx=0).stop 2023-05-12T09:08:47.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.136+0000 7fc355dff700 1 -- 172.21.15.116:0/657714407 shutdown_connections 2023-05-12T09:08:47.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.136+0000 7fc355dff700 1 --2- 172.21.15.116:0/657714407 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc35015a5a0 0x7fc35006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.136+0000 7fc355dff700 1 --2- 172.21.15.116:0/657714407 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc35006a920 0x7fc350070af0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.136+0000 7fc355dff700 1 -- 172.21.15.116:0/657714407 >> 172.21.15.116:0/657714407 conn(0x7fc3500cf720 msgr2=0x7fc3500cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:47.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.136+0000 7fc355dff700 1 -- 172.21.15.116:0/657714407 shutdown_connections 2023-05-12T09:08:47.142 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.136+0000 7fc355dff700 1 -- 172.21.15.116:0/657714407 wait complete. 2023-05-12T09:08:47.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.138+0000 7fc355dff700 1 Processor -- start 2023-05-12T09:08:47.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.138+0000 7fc355dff700 1 -- start start 2023-05-12T09:08:47.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc355dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc35006a920 0x7fc350155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc355dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc350071030 0x7fc35015c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc355dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc35015a5a0 0x7fc3500ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc355dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35015cd70 con 0x7fc35006a920 2023-05-12T09:08:47.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc355dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35015ab50 con 0x7fc35015a5a0 2023-05-12T09:08:47.144 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc355dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35015ae30 con 0x7fc350071030 2023-05-12T09:08:47.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc34f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc35006a920 0x7fc350155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc34f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc35006a920 0x7fc350155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39128/0 (socket says 172.21.15.116:39128) 2023-05-12T09:08:47.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc34f7fe700 1 -- 172.21.15.116:0/1232195263 learned_addr learned my addr 172.21.15.116:0/1232195263 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:47.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc34f7fe700 1 -- 172.21.15.116:0/1232195263 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc350071030 msgr2=0x7fc35015c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc34f7fe700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc350071030 0x7fc35015c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc34f7fe700 1 -- 172.21.15.116:0/1232195263 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc35015a5a0 msgr2=0x7fc3500ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.145 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc34f7fe700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc35015a5a0 0x7fc3500ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.139+0000 7fc34f7fe700 1 -- 172.21.15.116:0/1232195263 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009430 con 0x7fc35006a920 2023-05-12T09:08:47.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.140+0000 7fc34f7fe700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc35006a920 0x7fc350155870 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc34000e870 tx=0x7fc34000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:47.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.140+0000 7fc34cff9700 1 -- 172.21.15.116:0/1232195263 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340009590 con 0x7fc35006a920 2023-05-12T09:08:47.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.140+0000 7fc34cff9700 1 -- 172.21.15.116:0/1232195263 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34000ee70 con 0x7fc35006a920 2023-05-12T09:08:47.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.140+0000 7fc355dff700 1 -- 172.21.15.116:0/1232195263 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3500719e0 con 0x7fc35006a920 2023-05-12T09:08:47.146 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.140+0000 7fc34cff9700 1 -- 172.21.15.116:0/1232195263 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000ca50 con 0x7fc35006a920 2023-05-12T09:08:47.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.140+0000 7fc355dff700 1 -- 172.21.15.116:0/1232195263 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc350071700 con 0x7fc35006a920 2023-05-12T09:08:47.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.141+0000 7fc355dff700 1 -- 172.21.15.116:0/1232195263 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35006c6c0 con 0x7fc35006a920 2023-05-12T09:08:47.147 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.142+0000 7fc34cff9700 1 -- 172.21.15.116:0/1232195263 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc34000cbb0 con 0x7fc35006a920 2023-05-12T09:08:47.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.143+0000 7fc34cff9700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc33006ace0 0x7fc33006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.143+0000 7fc34cff9700 1 -- 172.21.15.116:0/1232195263 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc340089820 con 0x7fc35006a920 2023-05-12T09:08:47.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.143+0000 7fc347fff700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc33006ace0 0x7fc33006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.148 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.144+0000 7fc347fff700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc33006ace0 0x7fc33006d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc3501f5710 tx=0x7fc338010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:47.149 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.147+0000 7fc34cff9700 1 -- 172.21.15.116:0/1232195263 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc340057f90 con 0x7fc35006a920 2023-05-12T09:08:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.339+0000 7fc355dff700 1 -- 172.21.15.116:0/1232195263 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc350074430 con 0x7fc35006a920 2023-05-12T09:08:47.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.339+0000 7fc34cff9700 1 -- 172.21.15.116:0/1232195263 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc34000ce60 con 0x7fc35006a920 2023-05-12T09:08:47.342 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:47.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.341+0000 7fc355dff700 1 -- 172.21.15.116:0/1232195263 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc33006ace0 msgr2=0x7fc33006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.341+0000 7fc355dff700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc33006ace0 0x7fc33006d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc3501f5710 tx=0x7fc338010000 comp rx=0 tx=0).stop 2023-05-12T09:08:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.341+0000 7fc355dff700 1 -- 172.21.15.116:0/1232195263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc35006a920 msgr2=0x7fc350155870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.341+0000 7fc355dff700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc35006a920 0x7fc350155870 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc34000e870 tx=0x7fc34000ec30 comp rx=0 tx=0).stop 2023-05-12T09:08:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.342+0000 7fc355dff700 1 -- 172.21.15.116:0/1232195263 shutdown_connections 2023-05-12T09:08:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.342+0000 7fc355dff700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc35015a5a0 0x7fc3500ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.342+0000 7fc355dff700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc35006a920 0x7fc350155870 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.342+0000 7fc355dff700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fc33006ace0 0x7fc33006d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.342+0000 7fc355dff700 1 --2- 172.21.15.116:0/1232195263 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc350071030 0x7fc35015c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.342+0000 7fc355dff700 1 -- 172.21.15.116:0/1232195263 >> 172.21.15.116:0/1232195263 conn(0x7fc3500cf720 msgr2=0x7fc3500ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:47.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.342+0000 7fc355dff700 1 -- 172.21.15.116:0/1232195263 shutdown_connections 2023-05-12T09:08:47.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.342+0000 7fc355dff700 1 -- 172.21.15.116:0/1232195263 wait complete. 2023-05-12T09:08:47.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-12T09:08:47.547 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.545+0000 7ff50b1ff700 1 Processor -- start 2023-05-12T09:08:47.548 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.546+0000 7ff50b1ff700 1 -- start start 2023-05-12T09:08:47.549 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.547+0000 7ff50b1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff5041589d0 0x7ff5040cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.547+0000 7ff50b1ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff5040cd690 0x7ff50406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.547+0000 7ff50b1ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5040ca890 con 0x7ff504158da0 2023-05-12T09:08:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.547+0000 7ff50b1ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5040ca5b0 con 0x7ff5040cd690 2023-05-12T09:08:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.547+0000 7ff50b1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040cc670 con 0x7ff5041589d0 2023-05-12T09:08:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff50979c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff504158da0 0x7ff50406a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56924/0 (socket says 172.21.15.116:56924) 2023-05-12T09:08:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff503fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff5040cd690 0x7ff50406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff50979c700 1 -- 172.21.15.116:0/3865674753 learned_addr learned my addr 172.21.15.116:0/3865674753 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff508f9b700 1 --2- 172.21.15.116:0/3865674753 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff5041589d0 0x7ff5040cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.552 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff503fff700 1 -- 172.21.15.116:0/3865674753 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff5041589d0 msgr2=0x7ff5040cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff503fff700 1 --2- 172.21.15.116:0/3865674753 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff5041589d0 0x7ff5040cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff503fff700 1 -- 172.21.15.116:0/3865674753 >> v1:172.21.15.116:6789/0 conn(0x7ff504158da0 legacy=0x7ff50406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff503fff700 1 -- 172.21.15.116:0/3865674753 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040cc950 con 0x7ff5040cd690 2023-05-12T09:08:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff5037fe700 1 -- 172.21.15.116:0/3865674753 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254176843 0 0) 0x7ff5040ca890 con 0x7ff504158da0 2023-05-12T09:08:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff503fff700 1 --2- 172.21.15.116:0/3865674753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5040cd690 0x7ff50406c6c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000a9c0 tx=0x7ff4f000acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dea833da6ff17c server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.548+0000 7ff5037fe700 1 -- 172.21.15.116:0/3865674753 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0005e30 con 0x7ff5040cd690 2023-05-12T09:08:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.549+0000 7ff5037fe700 1 -- 172.21.15.116:0/3865674753 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f000ae60 con 0x7ff5040cd690 2023-05-12T09:08:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.549+0000 7ff5037fe700 1 -- 172.21.15.116:0/3865674753 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000c980 con 0x7ff5040cd690 2023-05-12T09:08:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.549+0000 7ff50b1ff700 1 -- 172.21.15.116:0/3865674753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5040cd690 msgr2=0x7ff50406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.549+0000 7ff50b1ff700 1 --2- 172.21.15.116:0/3865674753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5040cd690 0x7ff50406c6c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000a9c0 tx=0x7ff4f000acd0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.549+0000 7ff50b1ff700 1 -- 172.21.15.116:0/3865674753 shutdown_connections 2023-05-12T09:08:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.549+0000 7ff50b1ff700 1 --2- 172.21.15.116:0/3865674753 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff5041589d0 0x7ff5040cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.549+0000 7ff50b1ff700 1 --2- 172.21.15.116:0/3865674753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5040cd690 0x7ff50406c6c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.549+0000 7ff50b1ff700 1 -- 172.21.15.116:0/3865674753 >> 172.21.15.116:0/3865674753 conn(0x7ff5040cf720 msgr2=0x7ff5040cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.549+0000 7ff50b1ff700 1 -- 172.21.15.116:0/3865674753 shutdown_connections 2023-05-12T09:08:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.549+0000 7ff50b1ff700 1 -- 172.21.15.116:0/3865674753 wait complete. 2023-05-12T09:08:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.551+0000 7ff50b1ff700 1 Processor -- start 2023-05-12T09:08:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.551+0000 7ff50b1ff700 1 -- start start 2023-05-12T09:08:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff50b1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff5040cd690 0x7ff504070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff50b1ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff5041589d0 0x7ff504071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff50b1ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff504158da0 0x7ff50414e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff50b1ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040acad0 con 0x7ff504158da0 2023-05-12T09:08:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff50b1ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040acd20 con 0x7ff5041589d0 2023-05-12T09:08:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff50b1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040ad000 con 0x7ff5040cd690 2023-05-12T09:08:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff50979c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff504158da0 0x7ff50414e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff50979c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff504158da0 0x7ff50414e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39136/0 (socket says 172.21.15.116:39136) 2023-05-12T09:08:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff50979c700 1 -- 172.21.15.116:0/4096734493 learned_addr learned my addr 172.21.15.116:0/4096734493 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff503fff700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff5041589d0 0x7ff504071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.552+0000 7ff508f9b700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff5040cd690 0x7ff504070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff50979c700 1 -- 172.21.15.116:0/4096734493 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff5040cd690 msgr2=0x7ff504070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff50979c700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff5040cd690 0x7ff504070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff50979c700 1 -- 172.21.15.116:0/4096734493 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff5041589d0 msgr2=0x7ff504071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff50979c700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff5041589d0 0x7ff504071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff50979c700 1 -- 172.21.15.116:0/4096734493 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f000a5d0 con 0x7ff504158da0 2023-05-12T09:08:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff50979c700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff504158da0 0x7ff50414e8d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00cb30 tx=0x7ff4fc00ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff5017fa700 1 -- 172.21.15.116:0/4096734493 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00a9e0 con 0x7ff504158da0 2023-05-12T09:08:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff5017fa700 1 -- 172.21.15.116:0/4096734493 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00ab80 con 0x7ff504158da0 2023-05-12T09:08:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff50b1ff700 1 -- 172.21.15.116:0/4096734493 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50406aaf0 con 0x7ff504158da0 2023-05-12T09:08:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff5017fa700 1 -- 172.21.15.116:0/4096734493 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0070d0 con 0x7ff504158da0 2023-05-12T09:08:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.553+0000 7ff50b1ff700 1 -- 172.21.15.116:0/4096734493 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5040ccc30 con 0x7ff504158da0 2023-05-12T09:08:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.554+0000 7ff50b1ff700 1 -- 172.21.15.116:0/4096734493 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50406ac80 con 0x7ff504158da0 2023-05-12T09:08:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.555+0000 7ff5017fa700 1 -- 172.21.15.116:0/4096734493 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4fc007230 con 0x7ff504158da0 2023-05-12T09:08:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.556+0000 7ff5017fa700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff4e806ace0 0x7ff4e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.556+0000 7ff5017fa700 1 -- 172.21.15.116:0/4096734493 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff4fc0892b0 con 0x7ff504158da0 2023-05-12T09:08:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.557+0000 7ff508f9b700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff4e806ace0 0x7ff4e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.557+0000 7ff508f9b700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff4e806ace0 0x7ff4e806d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009be0 tx=0x7ff4f8009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.560+0000 7ff5017fa700 1 -- 172.21.15.116:0/4096734493 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff4fc053f90 con 0x7ff504158da0 2023-05-12T09:08:47.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.754+0000 7ff50b1ff700 1 -- 172.21.15.116:0/4096734493 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5040b14b0 con 0x7ff504158da0 2023-05-12T09:08:47.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.755+0000 7ff5017fa700 1 -- 172.21.15.116:0/4096734493 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4fc001ba0 con 0x7ff504158da0 2023-05-12T09:08:47.757 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 64 2023-05-12T09:08:47.759 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 -- 172.21.15.116:0/4096734493 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff4e806ace0 msgr2=0x7ff4e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.759 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff4e806ace0 0x7ff4e806d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009be0 tx=0x7ff4f8009210 comp rx=0 tx=0).stop 2023-05-12T09:08:47.760 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 -- 172.21.15.116:0/4096734493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff504158da0 msgr2=0x7ff50414e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.760 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff504158da0 0x7ff50414e8d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00cb30 tx=0x7ff4fc00ce40 comp rx=0 tx=0).stop 2023-05-12T09:08:47.760 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 -- 172.21.15.116:0/4096734493 shutdown_connections 2023-05-12T09:08:47.760 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff504158da0 0x7ff50414e8d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff4e806ace0 0x7ff4e806d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff5040cd690 0x7ff504070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 --2- 172.21.15.116:0/4096734493 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff5041589d0 0x7ff504071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 -- 172.21.15.116:0/4096734493 >> 172.21.15.116:0/4096734493 conn(0x7ff5040cf720 msgr2=0x7ff50414c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:47.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 -- 172.21.15.116:0/4096734493 shutdown_connections 2023-05-12T09:08:47.761 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.757+0000 7ff50b1ff700 1 -- 172.21.15.116:0/4096734493 wait complete. 2023-05-12T09:08:47.776 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-12T09:08:47.963 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.961+0000 7f76145ff700 1 Processor -- start 2023-05-12T09:08:47.964 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.961+0000 7f76145ff700 1 -- start start 2023-05-12T09:08:47.967 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.962+0000 7f76145ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f760c0cf010 0x7f760c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.962+0000 7f76145ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0cd520 con 0x7f760c15c590 2023-05-12T09:08:47.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.962+0000 7f76145ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0d2640 con 0x7f760c0cff50 2023-05-12T09:08:47.968 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.962+0000 7f76145ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c1610d0 con 0x7f760c0cf010 2023-05-12T09:08:47.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.963+0000 7f761239b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f760c15c590 0x7f760c0cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56938/0 (socket says 172.21.15.116:56938) 2023-05-12T09:08:47.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.963+0000 7f761239b700 1 -- 172.21.15.116:0/3068548265 learned_addr learned my addr 172.21.15.116:0/3068548265 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:47.969 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.963+0000 7f7611b9a700 1 --2- 172.21.15.116:0/3068548265 >> v2:172.21.15.182:3300/0 conn(0x7f760c0cf010 0x7f760c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.963+0000 7f7611399700 1 -- 172.21.15.116:0/3068548265 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722901898 0 0) 0x7f760c0cd520 con 0x7f760c15c590 2023-05-12T09:08:47.970 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.963+0000 7f7611399700 1 -- 172.21.15.116:0/3068548265 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f80035b0 con 0x7f760c15c590 2023-05-12T09:08:47.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.963+0000 7f7611b9a700 1 -- 172.21.15.116:0/3068548265 >> v1:172.21.15.182:6789/0 conn(0x7f760c0cff50 legacy=0x7f760c0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.963+0000 7f7611b9a700 1 -- 172.21.15.116:0/3068548265 >> v1:172.21.15.116:6789/0 conn(0x7f760c15c590 legacy=0x7f760c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.971 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.963+0000 7f7611b9a700 1 -- 172.21.15.116:0/3068548265 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0b23c0 con 0x7f760c0cf010 2023-05-12T09:08:47.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.964+0000 7f7611b9a700 1 --2- 172.21.15.116:0/3068548265 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f760c0cf010 0x7f760c160b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009840 tx=0x7f75fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=285ffe9e4b0b2062 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:47.972 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.964+0000 7f7611399700 1 -- 172.21.15.116:0/3068548265 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc011830 con 0x7f760c0cf010 2023-05-12T09:08:47.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.964+0000 7f7611399700 1 -- 172.21.15.116:0/3068548265 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc011990 con 0x7f760c0cf010 2023-05-12T09:08:47.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.964+0000 7f7611399700 1 -- 172.21.15.116:0/3068548265 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc011d20 con 0x7f760c0cf010 2023-05-12T09:08:47.973 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.964+0000 7f76145ff700 1 -- 172.21.15.116:0/3068548265 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f760c0cf010 msgr2=0x7f760c160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.964+0000 7f76145ff700 1 --2- 172.21.15.116:0/3068548265 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f760c0cf010 0x7f760c160b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009840 tx=0x7f75fc009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:47.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.964+0000 7f76145ff700 1 -- 172.21.15.116:0/3068548265 shutdown_connections 2023-05-12T09:08:47.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.964+0000 7f76145ff700 1 --2- 172.21.15.116:0/3068548265 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f760c0cf010 0x7f760c160b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.965+0000 7f76145ff700 1 -- 172.21.15.116:0/3068548265 >> 172.21.15.116:0/3068548265 conn(0x7f760c071b10 msgr2=0x7f760c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:47.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.965+0000 7f76145ff700 1 -- 172.21.15.116:0/3068548265 shutdown_connections 2023-05-12T09:08:47.975 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.965+0000 7f76145ff700 1 -- 172.21.15.116:0/3068548265 wait complete. 2023-05-12T09:08:47.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.966+0000 7f76145ff700 1 Processor -- start 2023-05-12T09:08:47.980 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.966+0000 7f76145ff700 1 -- start start 2023-05-12T09:08:47.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.967+0000 7f76145ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f760c0cf010 0x7f760c1e8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.967+0000 7f76145ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f760c0cff50 0x7f760c15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.967+0000 7f76145ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f760c15c590 0x7f760c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.967+0000 7f76145ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c1e6f50 con 0x7f760c0cf010 2023-05-12T09:08:47.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.967+0000 7f76145ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c1e7230 con 0x7f760c0cff50 2023-05-12T09:08:47.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.967+0000 7f76145ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c1e7510 con 0x7f760c15c590 2023-05-12T09:08:47.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.967+0000 7f761239b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f760c0cf010 0x7f760c1e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.967+0000 7f761239b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f760c0cf010 0x7f760c1e8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39154/0 (socket says 172.21.15.116:39154) 2023-05-12T09:08:47.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.967+0000 7f761239b700 1 -- 172.21.15.116:0/862198857 learned_addr learned my addr 172.21.15.116:0/862198857 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:47.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f7611b9a700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f760c0cff50 0x7f760c15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f7612b9c700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f760c15c590 0x7f760c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f761239b700 1 -- 172.21.15.116:0/862198857 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f760c15c590 msgr2=0x7f760c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f761239b700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f760c15c590 0x7f760c15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.982 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f761239b700 1 -- 172.21.15.116:0/862198857 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f760c0cff50 msgr2=0x7f760c15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:47.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f761239b700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f760c0cff50 0x7f760c15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:47.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f761239b700 1 -- 172.21.15.116:0/862198857 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0094a0 con 0x7f760c0cf010 2023-05-12T09:08:47.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f761239b700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f760c0cf010 0x7f760c1e8840 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f760800cbc0 tx=0x7f760800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:47.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f7602ffd700 1 -- 172.21.15.116:0/862198857 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800ab50 con 0x7f760c0cf010 2023-05-12T09:08:47.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f7602ffd700 1 -- 172.21.15.116:0/862198857 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760800acb0 con 0x7f760c0cf010 2023-05-12T09:08:47.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f76145ff700 1 -- 172.21.15.116:0/862198857 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0cd770 con 0x7f760c0cf010 2023-05-12T09:08:47.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.968+0000 7f7602ffd700 1 -- 172.21.15.116:0/862198857 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608012620 con 0x7f760c0cf010 2023-05-12T09:08:47.983 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.969+0000 7f76145ff700 1 -- 172.21.15.116:0/862198857 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c0cf560 con 0x7f760c0cf010 2023-05-12T09:08:47.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.969+0000 7f76145ff700 1 -- 172.21.15.116:0/862198857 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c15c960 con 0x7f760c0cf010 2023-05-12T09:08:47.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.970+0000 7f7602ffd700 1 -- 172.21.15.116:0/862198857 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f760801b3b0 con 0x7f760c0cf010 2023-05-12T09:08:47.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.971+0000 7f7602ffd700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75f006ace0 0x7f75f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:47.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.971+0000 7f7602ffd700 1 -- 172.21.15.116:0/862198857 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7608089700 con 0x7f760c0cf010 2023-05-12T09:08:47.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.972+0000 7f7611b9a700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75f006ace0 0x7f75f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:47.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.972+0000 7f7611b9a700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75f006ace0 0x7f75f006d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0090b0 tx=0x7f75fc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:47.984 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:47.976+0000 7f7602ffd700 1 -- 172.21.15.116:0/862198857 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7608054360 con 0x7f760c0cf010 2023-05-12T09:08:48.171 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.169+0000 7f76145ff700 1 -- 172.21.15.116:0/862198857 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f760c0b51f0 con 0x7f760c0cf010 2023-05-12T09:08:48.171 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.169+0000 7f7602ffd700 1 -- 172.21.15.116:0/862198857 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7608057980 con 0x7f760c0cf010 2023-05-12T09:08:48.172 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 32 2023-05-12T09:08:48.174 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.171+0000 7f76145ff700 1 -- 172.21.15.116:0/862198857 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75f006ace0 msgr2=0x7f75f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.171+0000 7f76145ff700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75f006ace0 0x7f75f006d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0090b0 tx=0x7f75fc008030 comp rx=0 tx=0).stop 2023-05-12T09:08:48.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.171+0000 7f76145ff700 1 -- 172.21.15.116:0/862198857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f760c0cf010 msgr2=0x7f760c1e8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.171+0000 7f76145ff700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f760c0cf010 0x7f760c1e8840 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f760800cbc0 tx=0x7f760800cf80 comp rx=0 tx=0).stop 2023-05-12T09:08:48.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.171+0000 7f76145ff700 1 -- 172.21.15.116:0/862198857 shutdown_connections 2023-05-12T09:08:48.176 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.171+0000 7f76145ff700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f75f006ace0 0x7f75f006d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.176 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.171+0000 7f76145ff700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f760c15c590 0x7f760c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.176 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.171+0000 7f76145ff700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f760c0cf010 0x7f760c1e8840 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.177 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.171+0000 7f76145ff700 1 --2- 172.21.15.116:0/862198857 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f760c0cff50 0x7f760c15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.177 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.171+0000 7f76145ff700 1 -- 172.21.15.116:0/862198857 >> 172.21.15.116:0/862198857 conn(0x7f760c071b10 msgr2=0x7f760c0b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:48.177 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.172+0000 7f76145ff700 1 -- 172.21.15.116:0/862198857 shutdown_connections 2023-05-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.172+0000 7f76145ff700 1 -- 172.21.15.116:0/862198857 wait complete. 2023-05-12T09:08:48.191 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:08:48.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.374+0000 7fb8bfdff700 1 Processor -- start 2023-05-12T09:08:48.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.374+0000 7fb8bfdff700 1 -- start start 2023-05-12T09:08:48.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.375+0000 7fb8bfdff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 0x7fb8b80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.375+0000 7fb8bfdff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b80cc9e0 con 0x7fb8b80cd760 2023-05-12T09:08:48.379 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.375+0000 7fb8bfdff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b815de20 con 0x7fb8b815cf10 2023-05-12T09:08:48.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.375+0000 7fb8bfdff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b815d860 con 0x7fb8b80adf70 2023-05-12T09:08:48.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.375+0000 7fb8bdb9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb8b80cd760 0x7fb8b80cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56948/0 (socket says 172.21.15.116:56948) 2023-05-12T09:08:48.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.375+0000 7fb8bdb9b700 1 -- 172.21.15.116:0/2728574592 learned_addr learned my addr 172.21.15.116:0/2728574592 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:48.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.376+0000 7fb8bd39a700 1 --2- 172.21.15.116:0/2728574592 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 0x7fb8b80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.376+0000 7fb8bcb99700 1 -- 172.21.15.116:0/2728574592 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612199319 0 0) 0x7fb8b80cc9e0 con 0x7fb8b80cd760 2023-05-12T09:08:48.380 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.376+0000 7fb8bcb99700 1 -- 172.21.15.116:0/2728574592 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a40035b0 con 0x7fb8b80cd760 2023-05-12T09:08:48.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.376+0000 7fb8bd39a700 1 -- 172.21.15.116:0/2728574592 >> v1:172.21.15.182:6789/0 conn(0x7fb8b815cf10 legacy=0x7fb8b806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.376+0000 7fb8bcb99700 1 -- 172.21.15.116:0/2728574592 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843144155 0 0) 0x7fb8b815de20 con 0x7fb8b815cf10 2023-05-12T09:08:48.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.376+0000 7fb8bd39a700 1 -- 172.21.15.116:0/2728574592 >> v1:172.21.15.116:6789/0 conn(0x7fb8b80cd760 legacy=0x7fb8b80cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.376+0000 7fb8bd39a700 1 -- 172.21.15.116:0/2728574592 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b815db40 con 0x7fb8b80adf70 2023-05-12T09:08:48.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.376+0000 7fb8bd39a700 1 --2- 172.21.15.116:0/2728574592 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 0x7fb8b80cce70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009850 tx=0x7fb8a8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c57c45cbadbcf9d server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:48.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.377+0000 7fb8bcb99700 1 -- 172.21.15.116:0/2728574592 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8005e30 con 0x7fb8b80adf70 2023-05-12T09:08:48.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.377+0000 7fb8bcb99700 1 -- 172.21.15.116:0/2728574592 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8006030 con 0x7fb8b80adf70 2023-05-12T09:08:48.381 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.377+0000 7fb8bcb99700 1 -- 172.21.15.116:0/2728574592 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80063e0 con 0x7fb8b80adf70 2023-05-12T09:08:48.383 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.377+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2728574592 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 msgr2=0x7fb8b80cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.377+0000 7fb8bfdff700 1 --2- 172.21.15.116:0/2728574592 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 0x7fb8b80cce70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009850 tx=0x7fb8a8009b60 comp rx=0 tx=0).stop 2023-05-12T09:08:48.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.377+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2728574592 shutdown_connections 2023-05-12T09:08:48.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.377+0000 7fb8bfdff700 1 --2- 172.21.15.116:0/2728574592 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 0x7fb8b80cce70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.377+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2728574592 >> 172.21.15.116:0/2728574592 conn(0x7fb8b80cf720 msgr2=0x7fb8b80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:48.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.377+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2728574592 shutdown_connections 2023-05-12T09:08:48.384 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.377+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2728574592 wait complete. 2023-05-12T09:08:48.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.379+0000 7fb8bfdff700 1 Processor -- start 2023-05-12T09:08:48.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.379+0000 7fb8bfdff700 1 -- start start 2023-05-12T09:08:48.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.380+0000 7fb8bfdff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 0x7fb8b80b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.385 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.380+0000 7fb8bfdff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8b80cd760 0x7fb8b8158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.380+0000 7fb8bfdff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8b815cf10 0x7fb8b815b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.380+0000 7fb8bfdff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80ac470 con 0x7fb8b80cd760 2023-05-12T09:08:48.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.380+0000 7fb8bfdff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b8158670 con 0x7fb8b815cf10 2023-05-12T09:08:48.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.380+0000 7fb8bfdff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80ac0d0 con 0x7fb8b80adf70 2023-05-12T09:08:48.386 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.380+0000 7fb8bd39a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8b80cd760 0x7fb8b8158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8bd39a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8b80cd760 0x7fb8b8158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39168/0 (socket says 172.21.15.116:39168) 2023-05-12T09:08:48.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8bd39a700 1 -- 172.21.15.116:0/2454287824 learned_addr learned my addr 172.21.15.116:0/2454287824 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:48.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8bdb9b700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 0x7fb8b80b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8be39c700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8b815cf10 0x7fb8b815b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8bd39a700 1 -- 172.21.15.116:0/2454287824 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 msgr2=0x7fb8b80b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8bd39a700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 0x7fb8b80b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8bd39a700 1 -- 172.21.15.116:0/2454287824 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8b815cf10 msgr2=0x7fb8b815b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8bd39a700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8b815cf10 0x7fb8b815b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8bd39a700 1 -- 172.21.15.116:0/2454287824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a8009430 con 0x7fb8b80cd760 2023-05-12T09:08:48.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8bdb9b700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 0x7fb8b80b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:48.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8bd39a700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8b80cd760 0x7fb8b8158130 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8013040 tx=0x7fb8a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:48.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.381+0000 7fb8ae7fc700 1 -- 172.21.15.116:0/2454287824 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8006810 con 0x7fb8b80cd760 2023-05-12T09:08:48.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.382+0000 7fb8ae7fc700 1 -- 172.21.15.116:0/2454287824 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8020070 con 0x7fb8b80cd760 2023-05-12T09:08:48.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.382+0000 7fb8ae7fc700 1 -- 172.21.15.116:0/2454287824 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8025630 con 0x7fb8b80cd760 2023-05-12T09:08:48.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.382+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2454287824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b8071600 con 0x7fb8b80cd760 2023-05-12T09:08:48.389 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.382+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2454287824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b80cc670 con 0x7fb8b80cd760 2023-05-12T09:08:48.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.383+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2454287824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b80cd3b0 con 0x7fb8b80cd760 2023-05-12T09:08:48.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.384+0000 7fb8ae7fc700 1 -- 172.21.15.116:0/2454287824 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8a8022030 con 0x7fb8b80cd760 2023-05-12T09:08:48.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.384+0000 7fb8ae7fc700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb89c06ace0 0x7fb89c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.385+0000 7fb8ae7fc700 1 -- 172.21.15.116:0/2454287824 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8a808aca0 con 0x7fb8b80cd760 2023-05-12T09:08:48.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.385+0000 7fb8bdb9b700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb89c06ace0 0x7fb89c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.385+0000 7fb8bdb9b700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb89c06ace0 0x7fb89c06d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4007fd0 tx=0x7fb8b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:48.391 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.389+0000 7fb8ae7fc700 1 -- 172.21.15.116:0/2454287824 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb8a8055a10 con 0x7fb8b80cd760 2023-05-12T09:08:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.621+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2454287824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8b8071b50 con 0x7fb8b80cd760 2023-05-12T09:08:48.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.622+0000 7fb8ae7fc700 1 -- 172.21.15.116:0/2454287824 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7fb8a8059030 con 0x7fb8b80cd760 2023-05-12T09:08:48.624 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:48.624 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:07:10.529423+0000","modified":"2023-05-12T09:07:38.475430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-12T09:08:48.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2454287824 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb89c06ace0 msgr2=0x7fb89c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb89c06ace0 0x7fb89c06d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4007fd0 tx=0x7fb8b4009040 comp rx=0 tx=0).stop 2023-05-12T09:08:48.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2454287824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8b80cd760 msgr2=0x7fb8b8158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8b80cd760 0x7fb8b8158130 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8013040 tx=0x7fb8a8004750 comp rx=0 tx=0).stop 2023-05-12T09:08:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2454287824 shutdown_connections 2023-05-12T09:08:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb8b815cf10 0x7fb8b815b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb89c06ace0 0x7fb89c06d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb8b80adf70 0x7fb8b80b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 --2- 172.21.15.116:0/2454287824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8b80cd760 0x7fb8b8158130 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2454287824 >> 172.21.15.116:0/2454287824 conn(0x7fb8b80cf720 msgr2=0x7fb8b80cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:48.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2454287824 shutdown_connections 2023-05-12T09:08:48.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.624+0000 7fb8bfdff700 1 -- 172.21.15.116:0/2454287824 wait complete. 2023-05-12T09:08:48.628 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 9 2023-05-12T09:08:48.643 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.826+0000 7fb300bff700 1 Processor -- start 2023-05-12T09:08:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.826+0000 7fb300bff700 1 -- start start 2023-05-12T09:08:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.827+0000 7fb300bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0cfbf0 0x7fb2fc1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.827+0000 7fb300bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fb2fc0d1100 0x7fb2fc0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.827+0000 7fb300bff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc0d0020 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.827+0000 7fb300bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc0d02d0 con 0x7fb2fc0d1100 2023-05-12T09:08:48.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.827+0000 7fb300bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0d0cb0 con 0x7fb2fc0cfbf0 2023-05-12T09:08:48.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2f9d9b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0cfbf0 0x7fb2fc1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2fad9d700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fb2fc0d1100 0x7fb2fc0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2f9d9b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0cfbf0 0x7fb2fc1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:60782/0 (socket says 172.21.15.116:60782) 2023-05-12T09:08:48.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2fad9d700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fb2fc0d1100 0x7fb2fc0d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:57290/0 (socket says 172.21.15.116:57290) 2023-05-12T09:08:48.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2fa59c700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7fb2fc0b87a0 0x7fb2fc1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:39940/0 (socket says 172.21.15.116:39940) 2023-05-12T09:08:48.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2f9d9b700 1 -- 172.21.15.116:0/221265701 learned_addr learned my addr 172.21.15.116:0/221265701 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:48.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2f959a700 1 -- 172.21.15.116:0/221265701 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647650176 0 0) 0x7fb2fc0d0020 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2f959a700 1 -- 172.21.15.116:0/221265701 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e40035b0 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2f9d9b700 1 -- 172.21.15.116:0/221265701 >> v2:172.21.15.182:3300/0 conn(0x7fb2fc0d1100 msgr2=0x7fb2fc0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:48.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2f9d9b700 1 --2- 172.21.15.116:0/221265701 >> v2:172.21.15.182:3300/0 conn(0x7fb2fc0d1100 0x7fb2fc0d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2f9d9b700 1 -- 172.21.15.116:0/221265701 >> v1:172.21.15.182:6789/0 conn(0x7fb2fc0b87a0 legacy=0x7fb2fc1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2f9d9b700 1 -- 172.21.15.116:0/221265701 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc0cdc60 con 0x7fb2fc0cfbf0 2023-05-12T09:08:48.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.828+0000 7fb2f9d9b700 1 --2- 172.21.15.116:0/221265701 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0cfbf0 0x7fb2fc1608f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00098f0 tx=0x7fb2f0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b865b43d58be432 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:48.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb2f959a700 1 -- 172.21.15.116:0/221265701 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0011830 con 0x7fb2fc0cfbf0 2023-05-12T09:08:48.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb2f959a700 1 -- 172.21.15.116:0/221265701 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0011990 con 0x7fb2fc0cfbf0 2023-05-12T09:08:48.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb2f959a700 1 -- 172.21.15.116:0/221265701 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0011d20 con 0x7fb2fc0cfbf0 2023-05-12T09:08:48.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb300bff700 1 -- 172.21.15.116:0/221265701 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0cfbf0 msgr2=0x7fb2fc1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb300bff700 1 --2- 172.21.15.116:0/221265701 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0cfbf0 0x7fb2fc1608f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00098f0 tx=0x7fb2f0009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:48.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb300bff700 1 -- 172.21.15.116:0/221265701 shutdown_connections 2023-05-12T09:08:48.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb300bff700 1 --2- 172.21.15.116:0/221265701 >> v2:172.21.15.182:3300/0 conn(0x7fb2fc0d1100 0x7fb2fc0d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb300bff700 1 --2- 172.21.15.116:0/221265701 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0cfbf0 0x7fb2fc1608f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb300bff700 1 -- 172.21.15.116:0/221265701 >> 172.21.15.116:0/221265701 conn(0x7fb2fc071b10 msgr2=0x7fb2fc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:48.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb300bff700 1 -- 172.21.15.116:0/221265701 shutdown_connections 2023-05-12T09:08:48.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.829+0000 7fb300bff700 1 -- 172.21.15.116:0/221265701 wait complete. 2023-05-12T09:08:48.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.831+0000 7fb300bff700 1 Processor -- start 2023-05-12T09:08:48.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.831+0000 7fb300bff700 1 -- start start 2023-05-12T09:08:48.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.832+0000 7fb300bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2fc0b87a0 0x7fb2fc0cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.832+0000 7fb300bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb2fc0cfbf0 0x7fb2fc153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.832+0000 7fb300bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0d1100 0x7fb2fc1e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.832+0000 7fb300bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc1e8e30 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.832+0000 7fb300bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc1e8100 con 0x7fb2fc0cfbf0 2023-05-12T09:08:48.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.832+0000 7fb300bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0c9f80 con 0x7fb2fc0d1100 2023-05-12T09:08:48.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2fa59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2fc0b87a0 0x7fb2fc0cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2fa59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2fc0b87a0 0x7fb2fc0cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39174/0 (socket says 172.21.15.116:39174) 2023-05-12T09:08:48.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2fa59c700 1 -- 172.21.15.116:0/1061645028 learned_addr learned my addr 172.21.15.116:0/1061645028 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:48.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2f9d9b700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb2fc0cfbf0 0x7fb2fc153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2fad9d700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0d1100 0x7fb2fc1e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2fa59c700 1 -- 172.21.15.116:0/1061645028 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0d1100 msgr2=0x7fb2fc1e7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2fa59c700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0d1100 0x7fb2fc1e7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2fa59c700 1 -- 172.21.15.116:0/1061645028 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb2fc0cfbf0 msgr2=0x7fb2fc153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:48.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2fa59c700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb2fc0cfbf0 0x7fb2fc153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:48.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2fa59c700 1 -- 172.21.15.116:0/1061645028 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0009550 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.833+0000 7fb2fa59c700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2fc0b87a0 0x7fb2fc0cb310 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec001eb0 tx=0x7fb2ec00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:48.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.834+0000 7fb2eaffd700 1 -- 172.21.15.116:0/1061645028 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec005cb0 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.834+0000 7fb2eaffd700 1 -- 172.21.15.116:0/1061645028 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec005e10 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.834+0000 7fb300bff700 1 -- 172.21.15.116:0/1061645028 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc0cd980 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.834+0000 7fb2eaffd700 1 -- 172.21.15.116:0/1061645028 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0072d0 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.834+0000 7fb300bff700 1 -- 172.21.15.116:0/1061645028 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc0cd6a0 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.835+0000 7fb300bff700 1 -- 172.21.15.116:0/1061645028 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc160e30 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.836+0000 7fb2eaffd700 1 -- 172.21.15.116:0/1061645028 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb2ec007430 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.836+0000 7fb2eaffd700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb2dc06ace0 0x7fb2dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:48.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.837+0000 7fb2eaffd700 1 -- 172.21.15.116:0/1061645028 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb2ec088b40 con 0x7fb2fc0b87a0 2023-05-12T09:08:48.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.837+0000 7fb2f9d9b700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb2dc06ace0 0x7fb2dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:48.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.837+0000 7fb2f9d9b700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb2dc06ace0 0x7fb2dc06d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009c40 tx=0x7fb2f0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:48.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:48.841+0000 7fb2eaffd700 1 -- 172.21.15.116:0/1061645028 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb2ec0538d0 con 0x7fb2fc0b87a0 2023-05-12T09:08:49.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.035+0000 7fb300bff700 1 -- 172.21.15.116:0/1061645028 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2fc0d0020 con 0x7fb2fc0b87a0 2023-05-12T09:08:49.038 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.037+0000 7fb2eaffd700 1 -- 172.21.15.116:0/1061645028 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7fb2ec056ef0 con 0x7fb2fc0b87a0 2023-05-12T09:08:49.039 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:49.039 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:49.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 -- 172.21.15.116:0/1061645028 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb2dc06ace0 msgr2=0x7fb2dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb2dc06ace0 0x7fb2dc06d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009c40 tx=0x7fb2f0008030 comp rx=0 tx=0).stop 2023-05-12T09:08:49.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 -- 172.21.15.116:0/1061645028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2fc0b87a0 msgr2=0x7fb2fc0cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2fc0b87a0 0x7fb2fc0cb310 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec001eb0 tx=0x7fb2ec00c7b0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 -- 172.21.15.116:0/1061645028 shutdown_connections 2023-05-12T09:08:49.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb2dc06ace0 0x7fb2dc06d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb2fc0d1100 0x7fb2fc1e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2fc0b87a0 0x7fb2fc0cb310 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 --2- 172.21.15.116:0/1061645028 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb2fc0cfbf0 0x7fb2fc153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 -- 172.21.15.116:0/1061645028 >> 172.21.15.116:0/1061645028 conn(0x7fb2fc071b10 msgr2=0x7fb2fc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:49.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 -- 172.21.15.116:0/1061645028 shutdown_connections 2023-05-12T09:08:49.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.039+0000 7fb300bff700 1 -- 172.21.15.116:0/1061645028 wait complete. 2023-05-12T09:08:49.058 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-12T09:08:49.059 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:08:49.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.240+0000 7f5d97dff700 1 Processor -- start 2023-05-12T09:08:49.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.241+0000 7f5d97dff700 1 -- start start 2023-05-12T09:08:49.246 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d97dff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5d900cd760 0x7f5d900cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d97dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 0x7f5d900cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d97dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d900cc9e0 con 0x7f5d9015cf10 2023-05-12T09:08:49.247 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d97dff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9015de20 con 0x7f5d900cd760 2023-05-12T09:08:49.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d97dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900ce070 con 0x7f5d900adf70 2023-05-12T09:08:49.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d95b9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5d900cd760 0x7f5d900cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d95b9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5d900cd760 0x7f5d900cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39188/0 (socket says 172.21.15.116:39188) 2023-05-12T09:08:49.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d95b9b700 1 -- 172.21.15.116:0/640538959 learned_addr learned my addr 172.21.15.116:0/640538959 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:49.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d9539a700 1 --2- 172.21.15.116:0/640538959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 0x7f5d900cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d95b9b700 1 -- 172.21.15.116:0/640538959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 msgr2=0x7f5d900cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:49.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d95b9b700 1 --2- 172.21.15.116:0/640538959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 0x7f5d900cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d95b9b700 1 -- 172.21.15.116:0/640538959 >> v1:172.21.15.182:6789/0 conn(0x7f5d9015cf10 legacy=0x7f5d9006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d95b9b700 1 -- 172.21.15.116:0/640538959 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9015d860 con 0x7f5d900cd760 2023-05-12T09:08:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.242+0000 7f5d9539a700 1 --2- 172.21.15.116:0/640538959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 0x7f5d900cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.243+0000 7f5d95b9b700 1 --2- 172.21.15.116:0/640538959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d900cd760 0x7f5d900cdb30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0098f0 tx=0x7f5d8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e83ff137ddd91e server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.243+0000 7f5d94b99700 1 -- 172.21.15.116:0/640538959 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c00b8a0 con 0x7f5d900cd760 2023-05-12T09:08:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.243+0000 7f5d94b99700 1 -- 172.21.15.116:0/640538959 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c00ba00 con 0x7f5d900cd760 2023-05-12T09:08:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.243+0000 7f5d94b99700 1 -- 172.21.15.116:0/640538959 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c00bd90 con 0x7f5d900cd760 2023-05-12T09:08:49.253 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.243+0000 7f5d97dff700 1 -- 172.21.15.116:0/640538959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d900cd760 msgr2=0x7f5d900cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.253 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.243+0000 7f5d97dff700 1 --2- 172.21.15.116:0/640538959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d900cd760 0x7f5d900cdb30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0098f0 tx=0x7f5d8c009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.243+0000 7f5d97dff700 1 -- 172.21.15.116:0/640538959 shutdown_connections 2023-05-12T09:08:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.243+0000 7f5d97dff700 1 --2- 172.21.15.116:0/640538959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d900cd760 0x7f5d900cdb30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.243+0000 7f5d97dff700 1 --2- 172.21.15.116:0/640538959 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 0x7f5d900cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.243+0000 7f5d97dff700 1 -- 172.21.15.116:0/640538959 >> 172.21.15.116:0/640538959 conn(0x7f5d900cf720 msgr2=0x7f5d900cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:49.255 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.244+0000 7f5d97dff700 1 -- 172.21.15.116:0/640538959 shutdown_connections 2023-05-12T09:08:49.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.244+0000 7f5d97dff700 1 -- 172.21.15.116:0/640538959 wait complete. 2023-05-12T09:08:49.260 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.245+0000 7f5d97dff700 1 Processor -- start 2023-05-12T09:08:49.260 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.245+0000 7f5d97dff700 1 -- start start 2023-05-12T09:08:49.260 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.246+0000 7f5d97dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 0x7f5d900c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.246+0000 7f5d97dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5d900cd760 0x7f5d900b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.246+0000 7f5d97dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d9015cf10 0x7f5d9014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.246+0000 7f5d97dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900b3150 con 0x7f5d9015cf10 2023-05-12T09:08:49.261 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.246+0000 7f5d97dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900b3430 con 0x7f5d900cd760 2023-05-12T09:08:49.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.246+0000 7f5d97dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900b3710 con 0x7f5d900adf70 2023-05-12T09:08:49.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d9639c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d9015cf10 0x7f5d9014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d9639c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d9015cf10 0x7f5d9014e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39190/0 (socket says 172.21.15.116:39190) 2023-05-12T09:08:49.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d9639c700 1 -- 172.21.15.116:0/4246564183 learned_addr learned my addr 172.21.15.116:0/4246564183 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:49.262 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d9539a700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5d900cd760 0x7f5d900b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d95b9b700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 0x7f5d900c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d9639c700 1 -- 172.21.15.116:0/4246564183 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 msgr2=0x7f5d900c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d9639c700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 0x7f5d900c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d9639c700 1 -- 172.21.15.116:0/4246564183 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5d900cd760 msgr2=0x7f5d900b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d9639c700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5d900cd760 0x7f5d900b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d9639c700 1 -- 172.21.15.116:0/4246564183 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c009550 con 0x7f5d9015cf10 2023-05-12T09:08:49.263 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d9639c700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d9015cf10 0x7f5d9014e820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800cb50 tx=0x7f5d8800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:49.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d867fc700 1 -- 172.21.15.116:0/4246564183 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88003c00 con 0x7f5d9015cf10 2023-05-12T09:08:49.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d867fc700 1 -- 172.21.15.116:0/4246564183 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d88003d60 con 0x7f5d9015cf10 2023-05-12T09:08:49.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d867fc700 1 -- 172.21.15.116:0/4246564183 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800aa20 con 0x7f5d9015cf10 2023-05-12T09:08:49.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.247+0000 7f5d97dff700 1 -- 172.21.15.116:0/4246564183 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d900cc670 con 0x7f5d9015cf10 2023-05-12T09:08:49.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.248+0000 7f5d97dff700 1 -- 172.21.15.116:0/4246564183 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9015db40 con 0x7f5d9015cf10 2023-05-12T09:08:49.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.249+0000 7f5d97dff700 1 -- 172.21.15.116:0/4246564183 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d90071600 con 0x7f5d9015cf10 2023-05-12T09:08:49.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.249+0000 7f5d867fc700 1 -- 172.21.15.116:0/4246564183 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d8800ab80 con 0x7f5d9015cf10 2023-05-12T09:08:49.264 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.250+0000 7f5d867fc700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5d7406ace0 0x7f5d7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.251+0000 7f5d867fc700 1 -- 172.21.15.116:0/4246564183 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5d880897d0 con 0x7f5d9015cf10 2023-05-12T09:08:49.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.251+0000 7f5d95b9b700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5d7406ace0 0x7f5d7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.251+0000 7f5d95b9b700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5d7406ace0 0x7f5d7406d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c000c00 tx=0x7f5d8c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:49.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.255+0000 7f5d867fc700 1 -- 172.21.15.116:0/4246564183 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5d88054540 con 0x7f5d9015cf10 2023-05-12T09:08:49.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.490+0000 7f5d97dff700 1 -- 172.21.15.116:0/4246564183 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d900cb6c0 con 0x7f5d9015cf10 2023-05-12T09:08:49.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.490+0000 7f5d867fc700 1 -- 172.21.15.116:0/4246564183 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f5d88057b60 con 0x7f5d9015cf10 2023-05-12T09:08:49.493 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:49.493 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:07:10.529423+0000","modified":"2023-05-12T09:07:38.475430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-12T09:08:49.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 -- 172.21.15.116:0/4246564183 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5d7406ace0 msgr2=0x7f5d7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5d7406ace0 0x7f5d7406d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c000c00 tx=0x7f5d8c008030 comp rx=0 tx=0).stop 2023-05-12T09:08:49.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 -- 172.21.15.116:0/4246564183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d9015cf10 msgr2=0x7f5d9014e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d9015cf10 0x7f5d9014e820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800cb50 tx=0x7f5d8800ce60 comp rx=0 tx=0).stop 2023-05-12T09:08:49.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 -- 172.21.15.116:0/4246564183 shutdown_connections 2023-05-12T09:08:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d9015cf10 0x7f5d9014e820 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5d7406ace0 0x7f5d7406d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5d900adf70 0x7f5d900c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 --2- 172.21.15.116:0/4246564183 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5d900cd760 0x7f5d900b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 -- 172.21.15.116:0/4246564183 >> 172.21.15.116:0/4246564183 conn(0x7f5d900cf720 msgr2=0x7f5d9006a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 -- 172.21.15.116:0/4246564183 shutdown_connections 2023-05-12T09:08:49.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.493+0000 7f5d97dff700 1 -- 172.21.15.116:0/4246564183 wait complete. 2023-05-12T09:08:49.497 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 9 2023-05-12T09:08:49.512 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:08:49.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.694+0000 7f500adff700 1 Processor -- start 2023-05-12T09:08:49.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.694+0000 7f500adff700 1 -- start start 2023-05-12T09:08:49.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.695+0000 7f500adff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5004071200 0x7f5004165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.695+0000 7f500adff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50040cb280 con 0x7f500415a5a0 2023-05-12T09:08:49.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.695+0000 7f500adff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5004071700 con 0x7f500406aaf0 2023-05-12T09:08:49.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.696+0000 7f500adff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500415a970 con 0x7f5004071200 2023-05-12T09:08:49.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.696+0000 7f5008b9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f500415a5a0 0x7f500406a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56964/0 (socket says 172.21.15.116:56964) 2023-05-12T09:08:49.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.696+0000 7f5008b9b700 1 -- 172.21.15.116:0/1942626497 learned_addr learned my addr 172.21.15.116:0/1942626497 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:49.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.696+0000 7f500939c700 1 --2- 172.21.15.116:0/1942626497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5004071200 0x7f5004165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.696+0000 7f50037fe700 1 -- 172.21.15.116:0/1942626497 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771930004 0 0) 0x7f4ff8001110 con 0x7f500415a5a0 2023-05-12T09:08:49.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.696+0000 7f50037fe700 1 -- 172.21.15.116:0/1942626497 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff40035b0 con 0x7f500415a5a0 2023-05-12T09:08:49.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.696+0000 7f500939c700 1 -- 172.21.15.116:0/1942626497 >> v1:172.21.15.182:6789/0 conn(0x7f500406aaf0 legacy=0x7f5004070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.696+0000 7f50037fe700 1 -- 172.21.15.116:0/1942626497 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450144946 0 0) 0x7f5004071700 con 0x7f500406aaf0 2023-05-12T09:08:49.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.696+0000 7f500939c700 1 -- 172.21.15.116:0/1942626497 >> v1:172.21.15.116:6789/0 conn(0x7f500415a5a0 legacy=0x7f500406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.696+0000 7f500939c700 1 -- 172.21.15.116:0/1942626497 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040719e0 con 0x7f5004071200 2023-05-12T09:08:49.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.697+0000 7f500939c700 1 --2- 172.21.15.116:0/1942626497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5004071200 0x7f5004165340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009dc0 tx=0x7f4ffc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76322c945752a1e9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:49.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.697+0000 7f50037fe700 1 -- 172.21.15.116:0/1942626497 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00e070 con 0x7f5004071200 2023-05-12T09:08:49.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.697+0000 7f50037fe700 1 -- 172.21.15.116:0/1942626497 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc00bb20 con 0x7f5004071200 2023-05-12T09:08:49.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.697+0000 7f50037fe700 1 -- 172.21.15.116:0/1942626497 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00bed0 con 0x7f5004071200 2023-05-12T09:08:49.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.697+0000 7f500adff700 1 -- 172.21.15.116:0/1942626497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5004071200 msgr2=0x7f5004165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.697+0000 7f500adff700 1 --2- 172.21.15.116:0/1942626497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5004071200 0x7f5004165340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009dc0 tx=0x7f4ffc00b330 comp rx=0 tx=0).stop 2023-05-12T09:08:49.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.697+0000 7f500adff700 1 -- 172.21.15.116:0/1942626497 shutdown_connections 2023-05-12T09:08:49.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.697+0000 7f500adff700 1 --2- 172.21.15.116:0/1942626497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5004071200 0x7f5004165340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.697+0000 7f500adff700 1 -- 172.21.15.116:0/1942626497 >> 172.21.15.116:0/1942626497 conn(0x7f50040cf720 msgr2=0x7f50040cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:49.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.697+0000 7f500adff700 1 -- 172.21.15.116:0/1942626497 shutdown_connections 2023-05-12T09:08:49.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.698+0000 7f500adff700 1 -- 172.21.15.116:0/1942626497 wait complete. 2023-05-12T09:08:49.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.699+0000 7f500adff700 1 Processor -- start 2023-05-12T09:08:49.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.699+0000 7f500adff700 1 -- start start 2023-05-12T09:08:49.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.700+0000 7f500adff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f500406aaf0 0x7f500415d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.700+0000 7f500adff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5004071200 0x7f500415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.700+0000 7f500adff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f500415a5a0 0x7f50040c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.700+0000 7f500adff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500415aff0 con 0x7f500415a5a0 2023-05-12T09:08:49.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.700+0000 7f500adff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500415b270 con 0x7f5004071200 2023-05-12T09:08:49.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.700+0000 7f500adff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500415b550 con 0x7f500406aaf0 2023-05-12T09:08:49.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.700+0000 7f500939c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f500415a5a0 0x7f50040c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f500939c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f500415a5a0 0x7f50040c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39204/0 (socket says 172.21.15.116:39204) 2023-05-12T09:08:49.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f500939c700 1 -- 172.21.15.116:0/3871262909 learned_addr learned my addr 172.21.15.116:0/3871262909 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:49.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f5003fff700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5004071200 0x7f500415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f5008b9b700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f500406aaf0 0x7f500415d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f500939c700 1 -- 172.21.15.116:0/3871262909 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f500406aaf0 msgr2=0x7f500415d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f500939c700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f500406aaf0 0x7f500415d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f500939c700 1 -- 172.21.15.116:0/3871262909 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5004071200 msgr2=0x7f500415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f500939c700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5004071200 0x7f500415aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f500939c700 1 -- 172.21.15.116:0/3871262909 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc009a70 con 0x7f500415a5a0 2023-05-12T09:08:49.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f5003fff700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5004071200 0x7f500415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:49.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f500939c700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f500415a5a0 0x7f50040c51d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009f30 tx=0x7f4ffc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:49.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f50017fa700 1 -- 172.21.15.116:0/3871262909 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc01b810 con 0x7f500415a5a0 2023-05-12T09:08:49.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f50017fa700 1 -- 172.21.15.116:0/3871262909 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc020070 con 0x7f500415a5a0 2023-05-12T09:08:49.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f500adff700 1 -- 172.21.15.116:0/3871262909 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500406c9a0 con 0x7f500415a5a0 2023-05-12T09:08:49.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.701+0000 7f50017fa700 1 -- 172.21.15.116:0/3871262909 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc01bbb0 con 0x7f500415a5a0 2023-05-12T09:08:49.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.702+0000 7f500adff700 1 -- 172.21.15.116:0/3871262909 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500406c6c0 con 0x7f500415a5a0 2023-05-12T09:08:49.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.703+0000 7f500adff700 1 -- 172.21.15.116:0/3871262909 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500406cc80 con 0x7f500415a5a0 2023-05-12T09:08:49.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.703+0000 7f50017fa700 1 -- 172.21.15.116:0/3871262909 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ffc01bd10 con 0x7f500415a5a0 2023-05-12T09:08:49.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.704+0000 7f50017fa700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fe806ace0 0x7f4fe806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:49.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.705+0000 7f50017fa700 1 -- 172.21.15.116:0/3871262909 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4ffc022070 con 0x7f500415a5a0 2023-05-12T09:08:49.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.705+0000 7f5008b9b700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fe806ace0 0x7f4fe806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:49.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.705+0000 7f5008b9b700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fe806ace0 0x7f4fe806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8005910 tx=0x7f4ff8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:49.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.709+0000 7f50017fa700 1 -- 172.21.15.116:0/3871262909 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4ffc056850 con 0x7f500415a5a0 2023-05-12T09:08:49.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.946+0000 7f500adff700 1 -- 172.21.15.116:0/3871262909 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f500406eeb0 con 0x7f500415a5a0 2023-05-12T09:08:49.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.946+0000 7f50017fa700 1 -- 172.21.15.116:0/3871262909 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4676 (secure 0 0 0) 0x7f4ffc059e70 con 0x7f500415a5a0 2023-05-12T09:08:49.950 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:49.950 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/1555557244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6834","nonce":1555557244},{"type":"v1","addr":"172.21.15.182:6835","nonce":1555557244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/3735592784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":3735592784},{"type":"v1","addr":"172.21.15.116:6837","nonce":3735592784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3968831598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3968831598},{"type":"v1","addr":"172.21.15.116:6835","nonce":3968831598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:07:10.529423+0000","modified":"2023-05-12T09:07:38.475430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.182:6833/765908362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":765908362},{"type":"v1","addr":"172.21.15.182:6833","nonce":765908362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-12T09:08:49.952 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 -- 172.21.15.116:0/3871262909 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fe806ace0 msgr2=0x7f4fe806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.952 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fe806ace0 0x7f4fe806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8005910 tx=0x7f4ff8009040 comp rx=0 tx=0).stop 2023-05-12T09:08:49.952 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 -- 172.21.15.116:0/3871262909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f500415a5a0 msgr2=0x7f50040c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:49.952 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f500415a5a0 0x7f50040c51d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009f30 tx=0x7f4ffc004ad0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.952 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 -- 172.21.15.116:0/3871262909 shutdown_connections 2023-05-12T09:08:49.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f500415a5a0 0x7f50040c51d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f4fe806ace0 0x7f4fe806d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f500406aaf0 0x7f500415d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 --2- 172.21.15.116:0/3871262909 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5004071200 0x7f500415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:49.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 -- 172.21.15.116:0/3871262909 >> 172.21.15.116:0/3871262909 conn(0x7f50040cf720 msgr2=0x7f50040cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:49.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 -- 172.21.15.116:0/3871262909 shutdown_connections 2023-05-12T09:08:49.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:49.949+0000 7f500adff700 1 -- 172.21.15.116:0/3871262909 wait complete. 2023-05-12T09:08:49.954 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 9 2023-05-12T09:08:49.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:08:50.152 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.149+0000 7fa1f83ff700 1 Processor -- start 2023-05-12T09:08:50.153 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.149+0000 7fa1f83ff700 1 -- start start 2023-05-12T09:08:50.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.150+0000 7fa1f83ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa1f00d2110 0x7fa1f0167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.150+0000 7fa1f83ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f0161000 con 0x7fa1f00b87a0 2023-05-12T09:08:50.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.150+0000 7fa1f83ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00d0020 con 0x7fa1f00cfbf0 2023-05-12T09:08:50.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.150+0000 7fa1f83ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f00d02d0 con 0x7fa1f00d2110 2023-05-12T09:08:50.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.150+0000 7fa1f619b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa1f00b87a0 0x7fa1f01601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:56970/0 (socket says 172.21.15.116:56970) 2023-05-12T09:08:50.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.150+0000 7fa1f619b700 1 -- 172.21.15.116:0/139049447 learned_addr learned my addr 172.21.15.116:0/139049447 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:50.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.151+0000 7fa1f699c700 1 --2- 172.21.15.116:0/139049447 >> v2:172.21.15.116:3300/0 conn(0x7fa1f00d2110 0x7fa1f0167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.151+0000 7fa1f5199700 1 -- 172.21.15.116:0/139049447 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747514929 0 0) 0x7fa1f0161000 con 0x7fa1f00b87a0 2023-05-12T09:08:50.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.151+0000 7fa1f5199700 1 -- 172.21.15.116:0/139049447 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1dc0035b0 con 0x7fa1f00b87a0 2023-05-12T09:08:50.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.151+0000 7fa1f699c700 1 -- 172.21.15.116:0/139049447 >> v1:172.21.15.182:6789/0 conn(0x7fa1f00cfbf0 legacy=0x7fa1f01608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:50.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.151+0000 7fa1f699c700 1 -- 172.21.15.116:0/139049447 >> v1:172.21.15.116:6789/0 conn(0x7fa1f00b87a0 legacy=0x7fa1f01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:50.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.151+0000 7fa1f699c700 1 -- 172.21.15.116:0/139049447 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00cdc60 con 0x7fa1f00d2110 2023-05-12T09:08:50.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.151+0000 7fa1f699c700 1 --2- 172.21.15.116:0/139049447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00d2110 0x7fa1f0167550 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009d90 tx=0x7fa1e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f175f1a926cc0c3 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:50.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.151+0000 7fa1f5199700 1 -- 172.21.15.116:0/139049447 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800e070 con 0x7fa1f00d2110 2023-05-12T09:08:50.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.151+0000 7fa1f5199700 1 -- 172.21.15.116:0/139049447 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e800bae0 con 0x7fa1f00d2110 2023-05-12T09:08:50.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.152+0000 7fa1f5199700 1 -- 172.21.15.116:0/139049447 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800be90 con 0x7fa1f00d2110 2023-05-12T09:08:50.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.152+0000 7fa1f83ff700 1 -- 172.21.15.116:0/139049447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00d2110 msgr2=0x7fa1f0167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:50.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.152+0000 7fa1f83ff700 1 --2- 172.21.15.116:0/139049447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00d2110 0x7fa1f0167550 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009d90 tx=0x7fa1e800b330 comp rx=0 tx=0).stop 2023-05-12T09:08:50.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.152+0000 7fa1f83ff700 1 -- 172.21.15.116:0/139049447 shutdown_connections 2023-05-12T09:08:50.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.152+0000 7fa1f83ff700 1 --2- 172.21.15.116:0/139049447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00d2110 0x7fa1f0167550 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.152+0000 7fa1f83ff700 1 -- 172.21.15.116:0/139049447 >> 172.21.15.116:0/139049447 conn(0x7fa1f0071b10 msgr2=0x7fa1f0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:50.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.152+0000 7fa1f83ff700 1 -- 172.21.15.116:0/139049447 shutdown_connections 2023-05-12T09:08:50.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.152+0000 7fa1f83ff700 1 -- 172.21.15.116:0/139049447 wait complete. 2023-05-12T09:08:50.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.154+0000 7fa1f83ff700 1 Processor -- start 2023-05-12T09:08:50.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.154+0000 7fa1f83ff700 1 -- start start 2023-05-12T09:08:50.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f83ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00b87a0 0x7fa1f014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f83ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa1f00cfbf0 0x7fa1f0147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f83ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa1f00d2110 0x7fa1f014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f83ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0147e70 con 0x7fa1f00b87a0 2023-05-12T09:08:50.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f83ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0152040 con 0x7fa1f00cfbf0 2023-05-12T09:08:50.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f83ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0148110 con 0x7fa1f00d2110 2023-05-12T09:08:50.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f619b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00b87a0 0x7fa1f014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f619b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00b87a0 0x7fa1f014f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39218/0 (socket says 172.21.15.116:39218) 2023-05-12T09:08:50.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f619b700 1 -- 172.21.15.116:0/1482333988 learned_addr learned my addr 172.21.15.116:0/1482333988 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:50.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f699c700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa1f00d2110 0x7fa1f014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f599a700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa1f00cfbf0 0x7fa1f0147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f619b700 1 -- 172.21.15.116:0/1482333988 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa1f00d2110 msgr2=0x7fa1f014d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:50.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f619b700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa1f00d2110 0x7fa1f014d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f619b700 1 -- 172.21.15.116:0/1482333988 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa1f00cfbf0 msgr2=0x7fa1f0147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:50.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f619b700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa1f00cfbf0 0x7fa1f0147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f619b700 1 -- 172.21.15.116:0/1482333988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8009a70 con 0x7fa1f00b87a0 2023-05-12T09:08:50.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f699c700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa1f00d2110 0x7fa1f014d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:50.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.155+0000 7fa1f599a700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa1f00cfbf0 0x7fa1f0147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:50.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.156+0000 7fa1f619b700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00b87a0 0x7fa1f014f5e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c420 tx=0x7fa1ec00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:50.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.156+0000 7fa1e6ffd700 1 -- 172.21.15.116:0/1482333988 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec005d70 con 0x7fa1f00b87a0 2023-05-12T09:08:50.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.156+0000 7fa1e6ffd700 1 -- 172.21.15.116:0/1482333988 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec0070d0 con 0x7fa1f00b87a0 2023-05-12T09:08:50.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.156+0000 7fa1e6ffd700 1 -- 172.21.15.116:0/1482333988 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec007440 con 0x7fa1f00b87a0 2023-05-12T09:08:50.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.156+0000 7fa1f83ff700 1 -- 172.21.15.116:0/1482333988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f00cd980 con 0x7fa1f00b87a0 2023-05-12T09:08:50.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.156+0000 7fa1f83ff700 1 -- 172.21.15.116:0/1482333988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f00cd6a0 con 0x7fa1f00b87a0 2023-05-12T09:08:50.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.157+0000 7fa1f83ff700 1 -- 172.21.15.116:0/1482333988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f0167a90 con 0x7fa1f00b87a0 2023-05-12T09:08:50.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.158+0000 7fa1e6ffd700 1 -- 172.21.15.116:0/1482333988 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa1ec0075a0 con 0x7fa1f00b87a0 2023-05-12T09:08:50.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.159+0000 7fa1e6ffd700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa1d406ace0 0x7fa1d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.159+0000 7fa1e6ffd700 1 -- 172.21.15.116:0/1482333988 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa1ec088b40 con 0x7fa1f00b87a0 2023-05-12T09:08:50.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.159+0000 7fa1f599a700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa1d406ace0 0x7fa1d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.160+0000 7fa1f599a700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa1d406ace0 0x7fa1d406d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa1f014d240 tx=0x7fa1e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:50.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.163+0000 7fa1e6ffd700 1 -- 172.21.15.116:0/1482333988 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa1ec053960 con 0x7fa1f00b87a0 2023-05-12T09:08:50.360 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.357+0000 7fa1f83ff700 1 -- 172.21.15.116:0/1482333988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1f00cd450 con 0x7fa1f00b87a0 2023-05-12T09:08:50.361 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.359+0000 7fa1e6ffd700 1 -- 172.21.15.116:0/1482333988 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20182 (secure 0 0 0) 0x7fa1ec056f80 con 0x7fa1f00b87a0 2023-05-12T09:08:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:50.362 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":26,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:07:58.600212+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:07:08.752948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-12T09:07:09.510824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-12T09:07:12.586151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:08:50.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 -- 172.21.15.116:0/1482333988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa1d406ace0 msgr2=0x7fa1d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:50.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa1d406ace0 0x7fa1d406d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa1f014d240 tx=0x7fa1e0009040 comp rx=0 tx=0).stop 2023-05-12T09:08:50.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 -- 172.21.15.116:0/1482333988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00b87a0 msgr2=0x7fa1f014f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:50.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00b87a0 0x7fa1f014f5e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c420 tx=0x7fa1ec00c7e0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 -- 172.21.15.116:0/1482333988 shutdown_connections 2023-05-12T09:08:50.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa1d406ace0 0x7fa1d406d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa1f00d2110 0x7fa1f014d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1f00b87a0 0x7fa1f014f5e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 --2- 172.21.15.116:0/1482333988 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa1f00cfbf0 0x7fa1f0147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 -- 172.21.15.116:0/1482333988 >> 172.21.15.116:0/1482333988 conn(0x7fa1f0071b10 msgr2=0x7fa1f01601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:50.366 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 -- 172.21.15.116:0/1482333988 shutdown_connections 2023-05-12T09:08:50.366 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.361+0000 7fa1f83ff700 1 -- 172.21.15.116:0/1482333988 wait complete. 2023-05-12T09:08:50.381 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-12T09:08:50.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.563+0000 7f103c9ff700 1 Processor -- start 2023-05-12T09:08:50.567 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.564+0000 7f103c9ff700 1 -- start start 2023-05-12T09:08:50.568 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f103c9ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f10380ccf00 0x7f1038071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f103c9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f103815d690 0x7f10380cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f103c9ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f103806eb70 0x7f103806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f103c9ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103806a470 con 0x7f10380ccf00 2023-05-12T09:08:50.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f103c9ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10380cd810 con 0x7f103806eb70 2023-05-12T09:08:50.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f103c9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1038071a30 con 0x7f103815d690 2023-05-12T09:08:50.569 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f103659c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f10380ccf00 0x7f1038071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f103659c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f10380ccf00 0x7f1038071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39232/0 (socket says 172.21.15.116:39232) 2023-05-12T09:08:50.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f103659c700 1 -- 172.21.15.116:0/1200610633 learned_addr learned my addr 172.21.15.116:0/1200610633 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:50.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f102ffff700 1 --2- 172.21.15.116:0/1200610633 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f103815d690 0x7f10380cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.565+0000 7f1036d9d700 1 --2- 172.21.15.116:0/1200610633 >> v2:172.21.15.182:3300/0 conn(0x7f103806eb70 0x7f103806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.566+0000 7f103659c700 1 -- 172.21.15.116:0/1200610633 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f103815d690 msgr2=0x7f10380cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:50.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.566+0000 7f103659c700 1 --2- 172.21.15.116:0/1200610633 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f103815d690 0x7f10380cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.566+0000 7f103659c700 1 -- 172.21.15.116:0/1200610633 >> v2:172.21.15.182:3300/0 conn(0x7f103806eb70 msgr2=0x7f103806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:50.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.566+0000 7f103659c700 1 --2- 172.21.15.116:0/1200610633 >> v2:172.21.15.182:3300/0 conn(0x7f103806eb70 0x7f103806a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.566+0000 7f103659c700 1 -- 172.21.15.116:0/1200610633 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1038071d10 con 0x7f10380ccf00 2023-05-12T09:08:50.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.566+0000 7f103659c700 1 --2- 172.21.15.116:0/1200610633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 0x7f1038071450 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1038072b20 tx=0x7f1028009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e434c690fca236 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:50.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.566+0000 7f1035d9b700 1 -- 172.21.15.116:0/1200610633 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1028011830 con 0x7f10380ccf00 2023-05-12T09:08:50.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.566+0000 7f1035d9b700 1 -- 172.21.15.116:0/1200610633 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1028011990 con 0x7f10380ccf00 2023-05-12T09:08:50.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.566+0000 7f1035d9b700 1 -- 172.21.15.116:0/1200610633 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1028011d20 con 0x7f10380ccf00 2023-05-12T09:08:50.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.567+0000 7f103c9ff700 1 -- 172.21.15.116:0/1200610633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 msgr2=0x7f1038071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:50.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.567+0000 7f103c9ff700 1 --2- 172.21.15.116:0/1200610633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 0x7f1038071450 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1038072b20 tx=0x7f1028009bd0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.567+0000 7f103c9ff700 1 -- 172.21.15.116:0/1200610633 shutdown_connections 2023-05-12T09:08:50.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.567+0000 7f103c9ff700 1 --2- 172.21.15.116:0/1200610633 >> v2:172.21.15.182:3300/0 conn(0x7f103806eb70 0x7f103806a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.567+0000 7f103c9ff700 1 --2- 172.21.15.116:0/1200610633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 0x7f1038071450 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.567+0000 7f103c9ff700 1 --2- 172.21.15.116:0/1200610633 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f103815d690 0x7f10380cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.567+0000 7f103c9ff700 1 -- 172.21.15.116:0/1200610633 >> 172.21.15.116:0/1200610633 conn(0x7f10380cf330 msgr2=0x7f10380cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:50.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.567+0000 7f103c9ff700 1 -- 172.21.15.116:0/1200610633 shutdown_connections 2023-05-12T09:08:50.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.567+0000 7f103c9ff700 1 -- 172.21.15.116:0/1200610633 wait complete. 2023-05-12T09:08:50.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.569+0000 7f103c9ff700 1 Processor -- start 2023-05-12T09:08:50.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.569+0000 7f103c9ff700 1 -- start start 2023-05-12T09:08:50.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f103c9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f103806eb70 0x7f10381598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f103c9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 0x7f10380addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f103c9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f103815d690 0x7f10380ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f103c9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10380ac810 con 0x7f10380ccf00 2023-05-12T09:08:50.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f103c9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10380acaf0 con 0x7f103815d690 2023-05-12T09:08:50.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f103c9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10380acdd0 con 0x7f103806eb70 2023-05-12T09:08:50.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f102ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 0x7f10380addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f102ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 0x7f10380addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39246/0 (socket says 172.21.15.116:39246) 2023-05-12T09:08:50.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f102ffff700 1 -- 172.21.15.116:0/908691536 learned_addr learned my addr 172.21.15.116:0/908691536 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:50.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f1036d9d700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f103815d690 0x7f10380ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f103659c700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f103806eb70 0x7f10381598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f102ffff700 1 -- 172.21.15.116:0/908691536 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f103806eb70 msgr2=0x7f10381598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:50.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f102ffff700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f103806eb70 0x7f10381598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f102ffff700 1 -- 172.21.15.116:0/908691536 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f103815d690 msgr2=0x7f10380ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:50.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f102ffff700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f103815d690 0x7f10380ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:50.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.570+0000 7f102ffff700 1 -- 172.21.15.116:0/908691536 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028009550 con 0x7f10380ccf00 2023-05-12T09:08:50.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.571+0000 7f102ffff700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 0x7f10380addc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f102000e9b0 tx=0x7f102000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:50.577 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.571+0000 7f102effd700 1 -- 172.21.15.116:0/908691536 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020009710 con 0x7f10380ccf00 2023-05-12T09:08:50.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.571+0000 7f102effd700 1 -- 172.21.15.116:0/908691536 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102000ee50 con 0x7f10380ccf00 2023-05-12T09:08:50.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.571+0000 7f102effd700 1 -- 172.21.15.116:0/908691536 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000ca50 con 0x7f10380ccf00 2023-05-12T09:08:50.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.571+0000 7f103c9ff700 1 -- 172.21.15.116:0/908691536 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10380722d0 con 0x7f10380ccf00 2023-05-12T09:08:50.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.571+0000 7f103c9ff700 1 -- 172.21.15.116:0/908691536 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1038071ff0 con 0x7f10380ccf00 2023-05-12T09:08:50.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.572+0000 7f103c9ff700 1 -- 172.21.15.116:0/908691536 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103815db00 con 0x7f10380ccf00 2023-05-12T09:08:50.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.573+0000 7f102effd700 1 -- 172.21.15.116:0/908691536 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f102000cbb0 con 0x7f10380ccf00 2023-05-12T09:08:50.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.574+0000 7f102effd700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f101806ace0 0x7f101806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:50.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.574+0000 7f102effd700 1 -- 172.21.15.116:0/908691536 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f10200898b0 con 0x7f10380ccf00 2023-05-12T09:08:50.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.574+0000 7f103659c700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f101806ace0 0x7f101806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:50.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.575+0000 7f103659c700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f101806ace0 0x7f101806d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1028009c10 tx=0x7f1028008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:50.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.578+0000 7f102effd700 1 -- 172.21.15.116:0/908691536 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1020057f90 con 0x7f10380ccf00 2023-05-12T09:08:50.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:50.820+0000 7f103c9ff700 1 -- 172.21.15.116:0/908691536 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1038074430 con 0x7f10380ccf00 2023-05-12T09:08:51.789 INFO:tasks.ceph.mon.a.smithi116.stderr:2023-05-12T09:08:51.786+0000 7fe4dd5f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-12T09:08:51.796 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.794+0000 7f102effd700 1 -- 172.21.15.116:0/908691536 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1020021090 con 0x7f10380ccf00 2023-05-12T09:08:51.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 -- 172.21.15.116:0/908691536 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f101806ace0 msgr2=0x7f101806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:51.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f101806ace0 0x7f101806d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1028009c10 tx=0x7f1028008030 comp rx=0 tx=0).stop 2023-05-12T09:08:51.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 -- 172.21.15.116:0/908691536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 msgr2=0x7f10380addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:51.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 0x7f10380addc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f102000e9b0 tx=0x7f102000ecc0 comp rx=0 tx=0).stop 2023-05-12T09:08:51.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 -- 172.21.15.116:0/908691536 shutdown_connections 2023-05-12T09:08:51.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f103815d690 0x7f10380ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:51.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f101806ace0 0x7f101806d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:51.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f103806eb70 0x7f10381598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:51.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 --2- 172.21.15.116:0/908691536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10380ccf00 0x7f10380addc0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:51.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 -- 172.21.15.116:0/908691536 >> 172.21.15.116:0/908691536 conn(0x7f10380cf330 msgr2=0x7f10380c9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:51.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 -- 172.21.15.116:0/908691536 shutdown_connections 2023-05-12T09:08:51.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:51.797+0000 7f103c9ff700 1 -- 172.21.15.116:0/908691536 wait complete. 2023-05-12T09:08:51.802 INFO:teuthology.orchestra.run.smithi116.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-12T09:08:51.808 INFO:tasks.ceph.mds.b.smithi182.stderr: -6190> 2023-05-12T09:07:16.035+0000 7f5521ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-12T09:08:51.820 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-12T09:08:51.863 INFO:tasks.ceph.mds.b.smithi182.stdout:starting mds.b at 2023-05-12T09:08:52.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.007+0000 7f2a149ff700 1 Processor -- start 2023-05-12T09:08:52.010 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.007+0000 7f2a149ff700 1 -- start start 2023-05-12T09:08:52.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.008+0000 7f2a149ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a1015c590 0x7f2a10160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:52.011 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.008+0000 7f2a149ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2a100cf010 0x7f2a100cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:52.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.008+0000 7f2a149ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a100cd520 con 0x7f2a100cfd80 2023-05-12T09:08:52.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.008+0000 7f2a149ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a100d2640 con 0x7f2a100cf010 2023-05-12T09:08:52.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.008+0000 7f2a149ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a101610d0 con 0x7f2a1015c590 2023-05-12T09:08:52.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.008+0000 7f2a0dd9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2a100cf010 0x7f2a100cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:52.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.009+0000 7f2a0dd9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2a100cf010 0x7f2a100cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51196/0 (socket says 172.21.15.116:51196) 2023-05-12T09:08:52.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.009+0000 7f2a0dd9b700 1 -- 172.21.15.116:0/4060333283 learned_addr learned my addr 172.21.15.116:0/4060333283 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:52.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.009+0000 7f2a0e59c700 1 --2- 172.21.15.116:0/4060333283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a1015c590 0x7f2a10160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:52.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.009+0000 7f2a0dd9b700 1 -- 172.21.15.116:0/4060333283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a1015c590 msgr2=0x7f2a10160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:52.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.009+0000 7f2a0dd9b700 1 --2- 172.21.15.116:0/4060333283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a1015c590 0x7f2a10160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:52.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.009+0000 7f2a0dd9b700 1 -- 172.21.15.116:0/4060333283 >> v1:172.21.15.182:6789/0 conn(0x7f2a100cfd80 legacy=0x7f2a100d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:52.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.009+0000 7f2a0d59a700 1 -- 172.21.15.116:0/4060333283 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200202891 0 0) 0x7f2a100cd520 con 0x7f2a100cfd80 2023-05-12T09:08:52.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.009+0000 7f2a0dd9b700 1 -- 172.21.15.116:0/4060333283 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100d0200 con 0x7f2a100cf010 2023-05-12T09:08:52.014 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.009+0000 7f2a0dd9b700 1 --2- 172.21.15.116:0/4060333283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a100cf010 0x7f2a100cf840 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2a040098f0 tx=0x7f2a04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9151713eaeb4688 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:52.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.009+0000 7f2a0d59a700 1 -- 172.21.15.116:0/4060333283 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04011830 con 0x7f2a100cf010 2023-05-12T09:08:52.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.010+0000 7f2a0d59a700 1 -- 172.21.15.116:0/4060333283 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a04011990 con 0x7f2a100cf010 2023-05-12T09:08:52.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.010+0000 7f2a0d59a700 1 -- 172.21.15.116:0/4060333283 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04011d20 con 0x7f2a100cf010 2023-05-12T09:08:52.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.010+0000 7f2a149ff700 1 -- 172.21.15.116:0/4060333283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a100cf010 msgr2=0x7f2a100cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:52.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.010+0000 7f2a149ff700 1 --2- 172.21.15.116:0/4060333283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a100cf010 0x7f2a100cf840 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2a040098f0 tx=0x7f2a04009c00 comp rx=0 tx=0).stop 2023-05-12T09:08:52.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.010+0000 7f2a149ff700 1 -- 172.21.15.116:0/4060333283 shutdown_connections 2023-05-12T09:08:52.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.010+0000 7f2a149ff700 1 --2- 172.21.15.116:0/4060333283 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a1015c590 0x7f2a10160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:52.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.010+0000 7f2a149ff700 1 --2- 172.21.15.116:0/4060333283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a100cf010 0x7f2a100cf840 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:52.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.010+0000 7f2a149ff700 1 -- 172.21.15.116:0/4060333283 >> 172.21.15.116:0/4060333283 conn(0x7f2a10071b10 msgr2=0x7f2a10071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:52.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.010+0000 7f2a149ff700 1 -- 172.21.15.116:0/4060333283 shutdown_connections 2023-05-12T09:08:52.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.010+0000 7f2a149ff700 1 -- 172.21.15.116:0/4060333283 wait complete. 2023-05-12T09:08:52.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.012+0000 7f2a149ff700 1 Processor -- start 2023-05-12T09:08:52.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.013+0000 7f2a149ff700 1 -- start start 2023-05-12T09:08:52.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a149ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a100cf010 0x7f2a101f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:52.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a149ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2a100cfd80 0x7f2a10151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:52.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a149ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a1015c590 0x7f2a100b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:52.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a149ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100c6e90 con 0x7f2a1015c590 2023-05-12T09:08:52.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a149ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100c7170 con 0x7f2a100cfd80 2023-05-12T09:08:52.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a149ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100c7450 con 0x7f2a100cf010 2023-05-12T09:08:52.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a0ed9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a1015c590 0x7f2a100b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:52.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a0ed9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a1015c590 0x7f2a100b6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51208/0 (socket says 172.21.15.116:51208) 2023-05-12T09:08:52.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a0ed9d700 1 -- 172.21.15.116:0/3216953575 learned_addr learned my addr 172.21.15.116:0/3216953575 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:52.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a0dd9b700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2a100cfd80 0x7f2a10151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:52.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a0e59c700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a100cf010 0x7f2a101f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:52.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.014+0000 7f2a0ed9d700 1 -- 172.21.15.116:0/3216953575 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a100cf010 msgr2=0x7f2a101f3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:52.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f2a0ed9d700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a100cf010 0x7f2a101f3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:52.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f2a0ed9d700 1 -- 172.21.15.116:0/3216953575 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2a100cfd80 msgr2=0x7f2a10151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:52.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f2a0ed9d700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2a100cfd80 0x7f2a10151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:52.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f2a0ed9d700 1 -- 172.21.15.116:0/3216953575 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a04009550 con 0x7f2a1015c590 2023-05-12T09:08:52.020 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f2a0e59c700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a100cf010 0x7f2a101f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:52.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f2a0ed9d700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a1015c590 0x7f2a100b6740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800c810 tx=0x7f2a0800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:52.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f29feffd700 1 -- 172.21.15.116:0/3216953575 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08003e30 con 0x7f2a1015c590 2023-05-12T09:08:52.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f29feffd700 1 -- 172.21.15.116:0/3216953575 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a08005070 con 0x7f2a1015c590 2023-05-12T09:08:52.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f2a149ff700 1 -- 172.21.15.116:0/3216953575 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a100cf560 con 0x7f2a1015c590 2023-05-12T09:08:52.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f29feffd700 1 -- 172.21.15.116:0/3216953575 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08005420 con 0x7f2a1015c590 2023-05-12T09:08:52.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.015+0000 7f2a149ff700 1 -- 172.21.15.116:0/3216953575 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a100b23c0 con 0x7f2a1015c590 2023-05-12T09:08:52.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.016+0000 7f2a149ff700 1 -- 172.21.15.116:0/3216953575 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a100cd770 con 0x7f2a1015c590 2023-05-12T09:08:52.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.017+0000 7f29feffd700 1 -- 172.21.15.116:0/3216953575 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a08005580 con 0x7f2a1015c590 2023-05-12T09:08:52.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.018+0000 7f29feffd700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f29f006ace0 0x7f29f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:52.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.018+0000 7f29feffd700 1 -- 172.21.15.116:0/3216953575 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f2a08089580 con 0x7f2a1015c590 2023-05-12T09:08:52.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.018+0000 7f2a0e59c700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f29f006ace0 0x7f29f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:52.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.019+0000 7f2a0e59c700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f29f006ace0 0x7f29f006d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009b90 tx=0x7f2a00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:52.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.022+0000 7f29feffd700 1 -- 172.21.15.116:0/3216953575 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2a080542a0 con 0x7f2a1015c590 2023-05-12T09:08:52.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.254+0000 7f2a149ff700 1 -- 172.21.15.116:0/3216953575 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2a100b51f0 con 0x7f2a1015c590 2023-05-12T09:08:52.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.827+0000 7f29feffd700 1 -- 172.21.15.116:0/3216953575 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2a080578c0 con 0x7f2a1015c590 2023-05-12T09:08:52.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 -- 172.21.15.116:0/3216953575 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f29f006ace0 msgr2=0x7f29f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:52.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f29f006ace0 0x7f29f006d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009b90 tx=0x7f2a00008040 comp rx=0 tx=0).stop 2023-05-12T09:08:52.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 -- 172.21.15.116:0/3216953575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a1015c590 msgr2=0x7f2a100b6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:52.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a1015c590 0x7f2a100b6740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800c810 tx=0x7f2a0800cbd0 comp rx=0 tx=0).stop 2023-05-12T09:08:52.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 -- 172.21.15.116:0/3216953575 shutdown_connections 2023-05-12T09:08:52.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a1015c590 0x7f2a100b6740 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:52.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f29f006ace0 0x7f29f006d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:52.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2a100cf010 0x7f2a101f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:52.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 --2- 172.21.15.116:0/3216953575 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2a100cfd80 0x7f2a10151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:52.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 -- 172.21.15.116:0/3216953575 >> 172.21.15.116:0/3216953575 conn(0x7f2a10071b10 msgr2=0x7f2a100b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:52.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 -- 172.21.15.116:0/3216953575 shutdown_connections 2023-05-12T09:08:52.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:52.830+0000 7f2a149ff700 1 -- 172.21.15.116:0/3216953575 wait complete. 2023-05-12T09:08:52.853 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-12T09:08:53.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.042+0000 7f10189ff700 1 Processor -- start 2023-05-12T09:08:53.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.043+0000 7f10189ff700 1 -- start start 2023-05-12T09:08:53.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f10189ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f10140b87a0 0x7f10140cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:53.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f10189ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141601e0 0x7f1014160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:53.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f10189ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1014160ff0 con 0x7f1014160b70 2023-05-12T09:08:53.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f10189ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140d02d0 con 0x7f10140b87a0 2023-05-12T09:08:53.047 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f10189ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140d0cb0 con 0x7f10141601e0 2023-05-12T09:08:53.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f1012d9d700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1014160b70 0x7f10140d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60180/0 (socket says 172.21.15.116:60180) 2023-05-12T09:08:53.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f1012d9d700 1 -- 172.21.15.116:0/1356313388 learned_addr learned my addr 172.21.15.116:0/1356313388 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:53.049 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f101259c700 1 --2- 172.21.15.116:0/1356313388 >> v2:172.21.15.182:3300/0 conn(0x7f10140b87a0 0x7f10140cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:53.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928272061 0 0) 0x7f1014160ff0 con 0x7f1014160b70 2023-05-12T09:08:53.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f100bfff700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141601e0 0x7f1014160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:53.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.044+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10000035b0 con 0x7f1014160b70 2023-05-12T09:08:53.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1811283175 0 0) 0x7f10000035b0 con 0x7f1014160b70 2023-05-12T09:08:53.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141601e0 msgr2=0x7f1014160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:53.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141601e0 0x7f1014160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:53.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 >> v2:172.21.15.182:3300/0 conn(0x7f10140b87a0 msgr2=0x7f10140cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:53.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 --2- 172.21.15.116:0/1356313388 >> v2:172.21.15.182:3300/0 conn(0x7f10140b87a0 0x7f10140cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:53.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140cdc60 con 0x7f1014160b70 2023-05-12T09:08:53.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f100c0019f0 con 0x7f1014160b70 2023-05-12T09:08:53.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 >> v1:172.21.15.116:6789/0 conn(0x7f1014160b70 legacy=0x7f10140d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:53.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1000003a00 0x7f1000003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:53.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141601e0 0x7f1000004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:53.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1000004d90 0x7f1000005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:53.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140d02d0 con 0x7f1000004d90 2023-05-12T09:08:53.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100000ba10 con 0x7f1000003a00 2023-05-12T09:08:53.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100000bb50 con 0x7f10141601e0 2023-05-12T09:08:53.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f1012d9d700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1000004d90 0x7f1000005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:53.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f101259c700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1000003a00 0x7f1000003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:53.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.045+0000 7f100bfff700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141601e0 0x7f1000004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:53.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.046+0000 7f1012d9d700 1 -- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141601e0 msgr2=0x7f1000004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:53.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.046+0000 7f1012d9d700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141601e0 0x7f1000004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:53.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.046+0000 7f1012d9d700 1 -- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1000003a00 msgr2=0x7f1000003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:53.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.046+0000 7f1012d9d700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1000003a00 0x7f1000003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:53.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.046+0000 7f1012d9d700 1 -- 172.21.15.116:0/1356313388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10000035b0 con 0x7f1000004d90 2023-05-12T09:08:53.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.046+0000 7f1012d9d700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1000004d90 0x7f1000005200 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f100c00a860 tx=0x7f1000005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d22c7cfb84e9842 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:53.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.046+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c012600 con 0x7f1000004d90 2023-05-12T09:08:53.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.046+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c012780 con 0x7f1000004d90 2023-05-12T09:08:53.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.046+0000 7f1011d9b700 1 -- 172.21.15.116:0/1356313388 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c012b30 con 0x7f1000004d90 2023-05-12T09:08:53.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.047+0000 7f10189ff700 1 -- 172.21.15.116:0/1356313388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1000004d90 msgr2=0x7f1000005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:53.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.047+0000 7f10189ff700 1 --2- 172.21.15.116:0/1356313388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1000004d90 0x7f1000005200 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f100c00a860 tx=0x7f1000005880 comp rx=0 tx=0).stop 2023-05-12T09:08:53.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.047+0000 7f1012d9d700 1 -- 172.21.15.116:0/1356313388 reap_dead start 2023-05-12T09:08:53.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.047+0000 7f10189ff700 1 -- 172.21.15.116:0/1356313388 shutdown_connections 2023-05-12T09:08:53.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.047+0000 7f10189ff700 1 -- 172.21.15.116:0/1356313388 >> 172.21.15.116:0/1356313388 conn(0x7f1014071b10 msgr2=0x7f1014071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:53.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.047+0000 7f10189ff700 1 -- 172.21.15.116:0/1356313388 shutdown_connections 2023-05-12T09:08:53.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.047+0000 7f10189ff700 1 -- 172.21.15.116:0/1356313388 wait complete. 2023-05-12T09:08:53.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.048+0000 7f10189ff700 1 Processor -- start 2023-05-12T09:08:53.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.049+0000 7f10189ff700 1 -- start start 2023-05-12T09:08:53.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.049+0000 7f10189ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1000004d90 0x7f101415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:53.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.049+0000 7f10189ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f101415f010 0x7f1014150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:53.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.049+0000 7f10189ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141511b0 0x7f10140b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:53.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.049+0000 7f10189ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10141552d0 con 0x7f101415f010 2023-05-12T09:08:53.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.049+0000 7f10189ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1014152cb0 con 0x7f1000004d90 2023-05-12T09:08:53.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.049+0000 7f10189ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10141520a0 con 0x7f10141511b0 2023-05-12T09:08:53.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f100bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f101415f010 0x7f1014150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:53.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f100bfff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f101415f010 0x7f1014150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51234/0 (socket says 172.21.15.116:51234) 2023-05-12T09:08:53.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f100bfff700 1 -- 172.21.15.116:0/1555562238 learned_addr learned my addr 172.21.15.116:0/1555562238 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:53.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f101259c700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1000004d90 0x7f101415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:53.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f1012d9d700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141511b0 0x7f10140b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:53.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f100bfff700 1 -- 172.21.15.116:0/1555562238 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141511b0 msgr2=0x7f10140b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:53.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f100bfff700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141511b0 0x7f10140b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:53.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f100bfff700 1 -- 172.21.15.116:0/1555562238 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1000004d90 msgr2=0x7f101415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:53.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f100bfff700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1000004d90 0x7f101415ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:53.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f100bfff700 1 -- 172.21.15.116:0/1555562238 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140cd980 con 0x7f101415f010 2023-05-12T09:08:53.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f101259c700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1000004d90 0x7f101415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:53.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f1012d9d700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141511b0 0x7f10140b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:53.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f100bfff700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f101415f010 0x7f1014150c70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc011aa0 tx=0x7f0ffc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:53.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.050+0000 7f100affd700 1 -- 172.21.15.116:0/1555562238 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00f980 con 0x7f101415f010 2023-05-12T09:08:53.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.051+0000 7f100affd700 1 -- 172.21.15.116:0/1555562238 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00fae0 con 0x7f101415f010 2023-05-12T09:08:53.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.051+0000 7f10189ff700 1 -- 172.21.15.116:0/1555562238 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10140cd6a0 con 0x7f101415f010 2023-05-12T09:08:53.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.051+0000 7f100affd700 1 -- 172.21.15.116:0/1555562238 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00fe90 con 0x7f101415f010 2023-05-12T09:08:53.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.051+0000 7f10189ff700 1 -- 172.21.15.116:0/1555562238 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10140d2110 con 0x7f101415f010 2023-05-12T09:08:53.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.052+0000 7f10189ff700 1 -- 172.21.15.116:0/1555562238 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1014152e20 con 0x7f101415f010 2023-05-12T09:08:53.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.053+0000 7f100affd700 1 -- 172.21.15.116:0/1555562238 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ffc014440 con 0x7f101415f010 2023-05-12T09:08:53.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.053+0000 7f100affd700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0ff406ace0 0x7f0ff406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:53.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.053+0000 7f100affd700 1 -- 172.21.15.116:0/1555562238 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f0ffc08a090 con 0x7f101415f010 2023-05-12T09:08:53.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.054+0000 7f101259c700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0ff406ace0 0x7f0ff406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:53.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.054+0000 7f101259c700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0ff406ace0 0x7f0ff406d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f10141f59d0 tx=0x7f1004008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:53.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.058+0000 7f100affd700 1 -- 172.21.15.116:0/1555562238 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0ffc058870 con 0x7f101415f010 2023-05-12T09:08:53.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.249+0000 7f10189ff700 1 -- 172.21.15.116:0/1555562238 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1014074430 con 0x7f101415f010 2023-05-12T09:08:53.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.833+0000 7f100affd700 1 -- 172.21.15.116:0/1555562238 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0ffc058400 con 0x7f101415f010 2023-05-12T09:08:53.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 -- 172.21.15.116:0/1555562238 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0ff406ace0 msgr2=0x7f0ff406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:53.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0ff406ace0 0x7f0ff406d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f10141f59d0 tx=0x7f1004008040 comp rx=0 tx=0).stop 2023-05-12T09:08:53.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 -- 172.21.15.116:0/1555562238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f101415f010 msgr2=0x7f1014150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:53.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f101415f010 0x7f1014150c70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc011aa0 tx=0x7f0ffc011e60 comp rx=0 tx=0).stop 2023-05-12T09:08:53.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 -- 172.21.15.116:0/1555562238 shutdown_connections 2023-05-12T09:08:53.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0ff406ace0 0x7f0ff406d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:53.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f10141511b0 0x7f10140b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:53.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f1000004d90 0x7f101415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:53.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 --2- 172.21.15.116:0/1555562238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f101415f010 0x7f1014150c70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:53.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 -- 172.21.15.116:0/1555562238 >> 172.21.15.116:0/1555562238 conn(0x7f1014071b10 msgr2=0x7f101406bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:53.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.838+0000 7f10189ff700 1 -- 172.21.15.116:0/1555562238 shutdown_connections 2023-05-12T09:08:53.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:53.839+0000 7f10189ff700 1 -- 172.21.15.116:0/1555562238 wait complete. 2023-05-12T09:08:53.845 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_metadata' removed 2023-05-12T09:08:53.863 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-12T09:08:54.053 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.050+0000 7f98901ff700 1 Processor -- start 2023-05-12T09:08:54.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.050+0000 7f98901ff700 1 -- start start 2023-05-12T09:08:54.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f98901ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f98880cfbf0 0x7f98881608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:54.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f98901ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 0x7f98880d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:54.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f98901ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98880d0020 con 0x7f98880b87a0 2023-05-12T09:08:54.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f98901ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98880d02d0 con 0x7f98880cfbf0 2023-05-12T09:08:54.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f98901ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98880d0cb0 con 0x7f98880d1100 2023-05-12T09:08:54.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f988d79a700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f98880cfbf0 0x7f98881608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:54.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f988e79c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 0x7f98880d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:54.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f988e79c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 0x7f98880d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:55622/0 (socket says 172.21.15.116:55622) 2023-05-12T09:08:54.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f988d79a700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f98880cfbf0 0x7f98881608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.116:52346/0 (socket says 172.21.15.116:52346) 2023-05-12T09:08:54.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f988e79c700 1 -- 172.21.15.116:0/1142100376 learned_addr learned my addr 172.21.15.116:0/1142100376 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:54.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.052+0000 7f988df9b700 1 --1- 172.21.15.116:0/1142100376 >> v1:172.21.15.182:6789/0 conn(0x7f98880b87a0 0x7f98881601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.116:33120/0 (socket says 172.21.15.116:33120) 2023-05-12T09:08:54.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.053+0000 7f988d79a700 1 -- 172.21.15.116:0/1142100376 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 msgr2=0x7f98880d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:54.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.053+0000 7f988d79a700 1 --2- 172.21.15.116:0/1142100376 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 0x7f98880d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:54.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.053+0000 7f988d79a700 1 -- 172.21.15.116:0/1142100376 >> v1:172.21.15.182:6789/0 conn(0x7f98880b87a0 legacy=0x7f98881601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:54.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.053+0000 7f988d79a700 1 -- 172.21.15.116:0/1142100376 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98880cdc60 con 0x7f98880cfbf0 2023-05-12T09:08:54.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.053+0000 7f988e79c700 1 --2- 172.21.15.116:0/1142100376 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 0x7f98880d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:54.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.053+0000 7f988d79a700 1 --2- 172.21.15.116:0/1142100376 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f98880cfbf0 0x7f98881608f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9878009840 tx=0x7f9878009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f443d382d0daf98f server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:54.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.053+0000 7f988cf99700 1 -- 172.21.15.116:0/1142100376 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878011830 con 0x7f98880cfbf0 2023-05-12T09:08:54.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.053+0000 7f988cf99700 1 -- 172.21.15.116:0/1142100376 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9878011990 con 0x7f98880cfbf0 2023-05-12T09:08:54.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.053+0000 7f988cf99700 1 -- 172.21.15.116:0/1142100376 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878011d20 con 0x7f98880cfbf0 2023-05-12T09:08:54.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.054+0000 7f98901ff700 1 -- 172.21.15.116:0/1142100376 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f98880cfbf0 msgr2=0x7f98881608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:54.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.054+0000 7f98901ff700 1 --2- 172.21.15.116:0/1142100376 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f98880cfbf0 0x7f98881608f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9878009840 tx=0x7f9878009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:54.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.054+0000 7f98901ff700 1 -- 172.21.15.116:0/1142100376 shutdown_connections 2023-05-12T09:08:54.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.054+0000 7f98901ff700 1 --2- 172.21.15.116:0/1142100376 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 0x7f98880d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:54.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.054+0000 7f98901ff700 1 --2- 172.21.15.116:0/1142100376 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f98880cfbf0 0x7f98881608f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:54.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.054+0000 7f98901ff700 1 -- 172.21.15.116:0/1142100376 >> 172.21.15.116:0/1142100376 conn(0x7f9888071b10 msgr2=0x7f9888071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:54.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.054+0000 7f98901ff700 1 -- 172.21.15.116:0/1142100376 shutdown_connections 2023-05-12T09:08:54.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.054+0000 7f98901ff700 1 -- 172.21.15.116:0/1142100376 wait complete. 2023-05-12T09:08:54.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.055+0000 7f98901ff700 1 Processor -- start 2023-05-12T09:08:54.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.056+0000 7f98901ff700 1 -- start start 2023-05-12T09:08:54.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.056+0000 7f98901ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f98880b87a0 0x7f98881e88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:54.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f98901ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98880cfbf0 0x7f98880d2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:54.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f98901ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 0x7f98880d2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f98901ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988815d460 con 0x7f98880cfbf0 2023-05-12T09:08:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f98901ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988815d740 con 0x7f98880b87a0 2023-05-12T09:08:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f98901ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988815da20 con 0x7f98880d1100 2023-05-12T09:08:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f988d79a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98880cfbf0 0x7f98880d2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f988d79a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98880cfbf0 0x7f98880d2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51238/0 (socket says 172.21.15.116:51238) 2023-05-12T09:08:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f988d79a700 1 -- 172.21.15.116:0/3403917502 learned_addr learned my addr 172.21.15.116:0/3403917502 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:54.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f988df9b700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f98880b87a0 0x7f98881e88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:54.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f988e79c700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 0x7f98880d2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:54.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f988d79a700 1 -- 172.21.15.116:0/3403917502 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 msgr2=0x7f98880d2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:54.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f988d79a700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 0x7f98880d2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:54.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f988d79a700 1 -- 172.21.15.116:0/3403917502 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f98880b87a0 msgr2=0x7f98881e88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:54.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f988d79a700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f98880b87a0 0x7f98881e88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:54.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.057+0000 7f988d79a700 1 -- 172.21.15.116:0/3403917502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9880009b30 con 0x7f98880cfbf0 2023-05-12T09:08:54.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.058+0000 7f988d79a700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98880cfbf0 0x7f98880d2720 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9878009fd0 tx=0x7f9878004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:54.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.058+0000 7f987e7fc700 1 -- 172.21.15.116:0/3403917502 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98780036a0 con 0x7f98880cfbf0 2023-05-12T09:08:54.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.058+0000 7f987e7fc700 1 -- 172.21.15.116:0/3403917502 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987801f070 con 0x7f98880cfbf0 2023-05-12T09:08:54.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.058+0000 7f987e7fc700 1 -- 172.21.15.116:0/3403917502 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878003a60 con 0x7f98880cfbf0 2023-05-12T09:08:54.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.058+0000 7f98901ff700 1 -- 172.21.15.116:0/3403917502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98780094a0 con 0x7f98880cfbf0 2023-05-12T09:08:54.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.058+0000 7f98901ff700 1 -- 172.21.15.116:0/3403917502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98880cd980 con 0x7f98880cfbf0 2023-05-12T09:08:54.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.059+0000 7f98901ff700 1 -- 172.21.15.116:0/3403917502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98880cd6a0 con 0x7f98880cfbf0 2023-05-12T09:08:54.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.060+0000 7f987e7fc700 1 -- 172.21.15.116:0/3403917502 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9878003bc0 con 0x7f98880cfbf0 2023-05-12T09:08:54.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.061+0000 7f987e7fc700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f986c06ace0 0x7f986c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:54.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.061+0000 7f987e7fc700 1 -- 172.21.15.116:0/3403917502 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f9878021070 con 0x7f98880cfbf0 2023-05-12T09:08:54.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.061+0000 7f988df9b700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f986c06ace0 0x7f986c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:54.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.062+0000 7f988df9b700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f986c06ace0 0x7f986c06d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9884000f60 tx=0x7f9884007ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:54.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.065+0000 7f987e7fc700 1 -- 172.21.15.116:0/3403917502 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9878055d70 con 0x7f98880cfbf0 2023-05-12T09:08:54.269 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.266+0000 7f98901ff700 1 -- 172.21.15.116:0/3403917502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9888074430 con 0x7f98880cfbf0 2023-05-12T09:08:54.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.836+0000 7f987e7fc700 1 -- 172.21.15.116:0/3403917502 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f98780150d0 con 0x7f98880cfbf0 2023-05-12T09:08:54.845 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.841+0000 7f98901ff700 1 -- 172.21.15.116:0/3403917502 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f986c06ace0 msgr2=0x7f986c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:54.845 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.841+0000 7f98901ff700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f986c06ace0 0x7f986c06d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9884000f60 tx=0x7f9884007ed0 comp rx=0 tx=0).stop 2023-05-12T09:08:54.845 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.842+0000 7f98901ff700 1 -- 172.21.15.116:0/3403917502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98880cfbf0 msgr2=0x7f98880d2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:54.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.842+0000 7f98901ff700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98880cfbf0 0x7f98880d2720 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9878009fd0 tx=0x7f9878004750 comp rx=0 tx=0).stop 2023-05-12T09:08:54.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.842+0000 7f98901ff700 1 -- 172.21.15.116:0/3403917502 shutdown_connections 2023-05-12T09:08:54.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.842+0000 7f98901ff700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f986c06ace0 0x7f986c06d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:54.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.842+0000 7f98901ff700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f98880d1100 0x7f98880d2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:54.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.842+0000 7f98901ff700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f98880b87a0 0x7f98881e88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:54.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.842+0000 7f98901ff700 1 --2- 172.21.15.116:0/3403917502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98880cfbf0 0x7f98880d2720 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:54.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.842+0000 7f98901ff700 1 -- 172.21.15.116:0/3403917502 >> 172.21.15.116:0/3403917502 conn(0x7f9888071b10 msgr2=0x7f98880b3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:54.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.842+0000 7f98901ff700 1 -- 172.21.15.116:0/3403917502 shutdown_connections 2023-05-12T09:08:54.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:54.842+0000 7f98901ff700 1 -- 172.21.15.116:0/3403917502 wait complete. 2023-05-12T09:08:54.849 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_data' removed 2023-05-12T09:08:54.866 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-05-12T09:08:55.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.054+0000 7f6010fff700 1 Processor -- start 2023-05-12T09:08:55.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.054+0000 7f6010fff700 1 -- start start 2023-05-12T09:08:55.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.055+0000 7f6010fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f600c0cf010 0x7f600c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:55.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.055+0000 7f6010fff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f600c0cff50 0x7f600c0d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:55.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.055+0000 7f6010fff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c0cd520 con 0x7f600c15c590 2023-05-12T09:08:55.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.055+0000 7f6010fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c0d2640 con 0x7f600c0cf010 2023-05-12T09:08:55.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.055+0000 7f6010fff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c1610d0 con 0x7f600c0cff50 2023-05-12T09:08:55.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.055+0000 7f6009d9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f600c0cf010 0x7f600c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:55.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.055+0000 7f6009d9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f600c0cf010 0x7f600c160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51240/0 (socket says 172.21.15.116:51240) 2023-05-12T09:08:55.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.055+0000 7f6009d9b700 1 -- 172.21.15.116:0/2498261313 learned_addr learned my addr 172.21.15.116:0/2498261313 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:55.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.055+0000 7f600a59c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f600c15c590 0x7f600c0cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60192/0 (socket says 172.21.15.116:60192) 2023-05-12T09:08:55.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.056+0000 7f6009d9b700 1 -- 172.21.15.116:0/2498261313 >> v2:172.21.15.182:3300/0 conn(0x7f600c0cff50 msgr2=0x7f600c0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:55.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.056+0000 7f6009d9b700 1 --2- 172.21.15.116:0/2498261313 >> v2:172.21.15.182:3300/0 conn(0x7f600c0cff50 0x7f600c0d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.056+0000 7f6009d9b700 1 -- 172.21.15.116:0/2498261313 >> v1:172.21.15.116:6789/0 conn(0x7f600c15c590 legacy=0x7f600c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:55.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.056+0000 7f6009d9b700 1 -- 172.21.15.116:0/2498261313 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0b23c0 con 0x7f600c0cf010 2023-05-12T09:08:55.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.056+0000 7f6009d9b700 1 --2- 172.21.15.116:0/2498261313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c0cf010 0x7f600c160b90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f600c0b20b0 tx=0x7f6000009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a096ee4a2793714e server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:55.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.056+0000 7f600959a700 1 -- 172.21.15.116:0/2498261313 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600000b870 con 0x7f600c0cf010 2023-05-12T09:08:55.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.056+0000 7f600959a700 1 -- 172.21.15.116:0/2498261313 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600000b9d0 con 0x7f600c0cf010 2023-05-12T09:08:55.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.056+0000 7f600959a700 1 -- 172.21.15.116:0/2498261313 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600000bd60 con 0x7f600c0cf010 2023-05-12T09:08:55.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.057+0000 7f6010fff700 1 -- 172.21.15.116:0/2498261313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c0cf010 msgr2=0x7f600c160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:55.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.057+0000 7f6010fff700 1 --2- 172.21.15.116:0/2498261313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c0cf010 0x7f600c160b90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f600c0b20b0 tx=0x7f6000009bd0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.057+0000 7f6010fff700 1 -- 172.21.15.116:0/2498261313 shutdown_connections 2023-05-12T09:08:55.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.057+0000 7f6010fff700 1 --2- 172.21.15.116:0/2498261313 >> v2:172.21.15.182:3300/0 conn(0x7f600c0cff50 0x7f600c0d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.057+0000 7f6010fff700 1 --2- 172.21.15.116:0/2498261313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c0cf010 0x7f600c160b90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.057+0000 7f6010fff700 1 -- 172.21.15.116:0/2498261313 >> 172.21.15.116:0/2498261313 conn(0x7f600c071b10 msgr2=0x7f600c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:55.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.057+0000 7f6010fff700 1 -- 172.21.15.116:0/2498261313 shutdown_connections 2023-05-12T09:08:55.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.057+0000 7f6010fff700 1 -- 172.21.15.116:0/2498261313 wait complete. 2023-05-12T09:08:55.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.059+0000 7f6010fff700 1 Processor -- start 2023-05-12T09:08:55.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.059+0000 7f6010fff700 1 -- start start 2023-05-12T09:08:55.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f6010fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f600c0cf010 0x7f600c149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:55.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f6010fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f600c0cff50 0x7f600c1e88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:55.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f6010fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c15c590 0x7f600c1e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:55.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f6010fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c1e91d0 con 0x7f600c15c590 2023-05-12T09:08:55.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f6010fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c0c8520 con 0x7f600c0cff50 2023-05-12T09:08:55.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f6010fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c0c7bf0 con 0x7f600c0cf010 2023-05-12T09:08:55.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f600ad9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c15c590 0x7f600c1e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:55.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f600ad9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c15c590 0x7f600c1e6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51256/0 (socket says 172.21.15.116:51256) 2023-05-12T09:08:55.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f600ad9d700 1 -- 172.21.15.116:0/3775871627 learned_addr learned my addr 172.21.15.116:0/3775871627 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:55.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f6009d9b700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f600c0cff50 0x7f600c1e88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:55.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f600a59c700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f600c0cf010 0x7f600c149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:55.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f600ad9d700 1 -- 172.21.15.116:0/3775871627 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f600c0cf010 msgr2=0x7f600c149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:55.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f600ad9d700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f600c0cf010 0x7f600c149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f600ad9d700 1 -- 172.21.15.116:0/3775871627 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f600c0cff50 msgr2=0x7f600c1e88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:55.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f600ad9d700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f600c0cff50 0x7f600c1e88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f600ad9d700 1 -- 172.21.15.116:0/3775871627 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6000009550 con 0x7f600c15c590 2023-05-12T09:08:55.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.060+0000 7f600a59c700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f600c0cf010 0x7f600c149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:55.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.061+0000 7f600ad9d700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c15c590 0x7f600c1e6920 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f600400b970 tx=0x7f600400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:55.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.061+0000 7f5ffaffd700 1 -- 172.21.15.116:0/3775871627 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600400c930 con 0x7f600c15c590 2023-05-12T09:08:55.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.061+0000 7f5ffaffd700 1 -- 172.21.15.116:0/3775871627 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600400cab0 con 0x7f600c15c590 2023-05-12T09:08:55.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.061+0000 7f6010fff700 1 -- 172.21.15.116:0/3775871627 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600c0cd770 con 0x7f600c15c590 2023-05-12T09:08:55.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.061+0000 7f5ffaffd700 1 -- 172.21.15.116:0/3775871627 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600400ce60 con 0x7f600c15c590 2023-05-12T09:08:55.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.061+0000 7f6010fff700 1 -- 172.21.15.116:0/3775871627 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600c0cf560 con 0x7f600c15c590 2023-05-12T09:08:55.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.062+0000 7f6010fff700 1 -- 172.21.15.116:0/3775871627 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600c15c960 con 0x7f600c15c590 2023-05-12T09:08:55.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.063+0000 7f5ffaffd700 1 -- 172.21.15.116:0/3775871627 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f600401d3b0 con 0x7f600c15c590 2023-05-12T09:08:55.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.064+0000 7f5ffaffd700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5fec06ace0 0x7f5fec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:55.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.064+0000 7f5ffaffd700 1 -- 172.21.15.116:0/3775871627 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f6004006e40 con 0x7f600c15c590 2023-05-12T09:08:55.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.064+0000 7f600a59c700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5fec06ace0 0x7f5fec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:55.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.065+0000 7f600a59c700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5fec06ace0 0x7f5fec06d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc000f60 tx=0x7f5ffc007dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:55.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.068+0000 7f5ffaffd700 1 -- 172.21.15.116:0/3775871627 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f60040bb2d0 con 0x7f600c15c590 2023-05-12T09:08:55.270 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.267+0000 7f6010fff700 1 -- 172.21.15.116:0/3775871627 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f600c074430 con 0x7f600c15c590 2023-05-12T09:08:55.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.846+0000 7f5ffaffd700 1 -- 172.21.15.116:0/3775871627 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f60040190d0 con 0x7f600c15c590 2023-05-12T09:08:55.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 -- 172.21.15.116:0/3775871627 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5fec06ace0 msgr2=0x7f5fec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:55.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5fec06ace0 0x7f5fec06d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc000f60 tx=0x7f5ffc007dd0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 -- 172.21.15.116:0/3775871627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c15c590 msgr2=0x7f600c1e6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:55.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c15c590 0x7f600c1e6920 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f600400b970 tx=0x7f600400bc80 comp rx=0 tx=0).stop 2023-05-12T09:08:55.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 -- 172.21.15.116:0/3775871627 shutdown_connections 2023-05-12T09:08:55.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f600c15c590 0x7f600c1e6920 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f5fec06ace0 0x7f5fec06d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f600c0cf010 0x7f600c149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 --2- 172.21.15.116:0/3775871627 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f600c0cff50 0x7f600c1e88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:55.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 -- 172.21.15.116:0/3775871627 >> 172.21.15.116:0/3775871627 conn(0x7f600c071b10 msgr2=0x7f600c0d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:55.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 -- 172.21.15.116:0/3775871627 shutdown_connections 2023-05-12T09:08:55.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:55.851+0000 7f6010fff700 1 -- 172.21.15.116:0/3775871627 wait complete. 2023-05-12T09:08:55.856 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_data_ec' removed 2023-05-12T09:08:55.876 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-12T09:08:55.876 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-12T09:08:55.877 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-12T09:08:55.877 INFO:teuthology.orchestra.run:waiting for 300 2023-05-12T09:08:55.877 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-12T09:08:55.877 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-12T09:08:55.878 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-12T09:08:55.878 INFO:teuthology.orchestra.run:waiting for 300 2023-05-12T09:08:55.878 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-12T09:08:55.878 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-12T09:08:55.878 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-12T09:08:55.879 INFO:teuthology.orchestra.run:waiting for 300 2023-05-12T09:08:55.879 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-12T09:08:55.879 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-12T09:08:55.879 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-12T09:08:55.880 INFO:teuthology.orchestra.run:waiting for 300 2023-05-12T09:08:55.893 INFO:tasks.ceph.mds.a:Stopped 2023-05-12T09:08:55.893 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-12T09:08:55.894 INFO:tasks.ceph.mds.c:Stopped 2023-05-12T09:08:55.894 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-12T09:08:55.895 INFO:tasks.ceph.mds.d:Stopped 2023-05-12T09:08:55.896 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-12T09:08:55.896 INFO:tasks.ceph.mds.b:Stopped 2023-05-12T09:08:55.896 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-12T09:08:55.937 INFO:tasks.ceph.mds.a:Started 2023-05-12T09:08:55.937 DEBUG:teuthology.parallel:result is None 2023-05-12T09:08:55.939 INFO:tasks.ceph.mds.c:Started 2023-05-12T09:08:55.939 DEBUG:teuthology.parallel:result is None 2023-05-12T09:08:55.940 INFO:tasks.ceph.mds.d:Started 2023-05-12T09:08:55.940 DEBUG:teuthology.parallel:result is None 2023-05-12T09:08:55.942 INFO:tasks.ceph.mds.b:Started 2023-05-12T09:08:55.942 DEBUG:teuthology.parallel:result is None 2023-05-12T09:08:55.943 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-12T09:08:56.080 INFO:tasks.ceph.mds.a.smithi116.stdout:starting mds.a at 2023-05-12T09:08:56.080 INFO:tasks.ceph.mds.c.smithi116.stdout:starting mds.c at 2023-05-12T09:08:56.084 INFO:tasks.ceph.mds.d.smithi182.stdout:starting mds.d at 2023-05-12T09:08:56.084 INFO:tasks.ceph.mds.b.smithi182.stdout:starting mds.b at 2023-05-12T09:08:56.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.154+0000 7f0e9a9ff700 1 Processor -- start 2023-05-12T09:08:56.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.154+0000 7f0e9a9ff700 1 -- start start 2023-05-12T09:08:56.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.155+0000 7f0e9a9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e940adf70 0x7f0e940cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:56.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.155+0000 7f0e9a9ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e940cc9e0 con 0x7f0e9415cf10 2023-05-12T09:08:56.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.155+0000 7f0e9a9ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9415de20 con 0x7f0e940cd760 2023-05-12T09:08:56.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.155+0000 7f0e9a9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9415d860 con 0x7f0e940adf70 2023-05-12T09:08:56.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.155+0000 7f0e98f9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f0e9415cf10 0x7f0e9406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60208/0 (socket says 172.21.15.116:60208) 2023-05-12T09:08:56.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.155+0000 7f0e98f9c700 1 -- 172.21.15.116:0/3506774524 learned_addr learned my addr 172.21.15.116:0/3506774524 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:56.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.156+0000 7f0e937fe700 1 --2- 172.21.15.116:0/3506774524 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e940adf70 0x7f0e940cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:56.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.156+0000 7f0e92ffd700 1 -- 172.21.15.116:0/3506774524 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263894600 0 0) 0x7f0e940cc9e0 con 0x7f0e9415cf10 2023-05-12T09:08:56.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.156+0000 7f0e92ffd700 1 -- 172.21.15.116:0/3506774524 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e7c0035b0 con 0x7f0e9415cf10 2023-05-12T09:08:56.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.156+0000 7f0e92ffd700 1 -- 172.21.15.116:0/3506774524 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628220761 0 0) 0x7f0e9415de20 con 0x7f0e940cd760 2023-05-12T09:08:56.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.156+0000 7f0e92ffd700 1 -- 172.21.15.116:0/3506774524 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e940cc9e0 con 0x7f0e940cd760 2023-05-12T09:08:56.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.156+0000 7f0e937fe700 1 -- 172.21.15.116:0/3506774524 >> v1:172.21.15.182:6789/0 conn(0x7f0e940cd760 legacy=0x7f0e940cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:56.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.156+0000 7f0e937fe700 1 -- 172.21.15.116:0/3506774524 >> v1:172.21.15.116:6789/0 conn(0x7f0e9415cf10 legacy=0x7f0e9406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:56.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.156+0000 7f0e937fe700 1 -- 172.21.15.116:0/3506774524 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9415db40 con 0x7f0e940adf70 2023-05-12T09:08:56.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.156+0000 7f0e937fe700 1 --2- 172.21.15.116:0/3506774524 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e940adf70 0x7f0e940cce70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009850 tx=0x7f0e88009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eac1441ec1d08c9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:56.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.157+0000 7f0e92ffd700 1 -- 172.21.15.116:0/3506774524 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88005e30 con 0x7f0e940adf70 2023-05-12T09:08:56.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.157+0000 7f0e92ffd700 1 -- 172.21.15.116:0/3506774524 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e88006030 con 0x7f0e940adf70 2023-05-12T09:08:56.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.157+0000 7f0e92ffd700 1 -- 172.21.15.116:0/3506774524 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880063a0 con 0x7f0e940adf70 2023-05-12T09:08:56.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.157+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3506774524 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e940adf70 msgr2=0x7f0e940cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:56.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.157+0000 7f0e9a9ff700 1 --2- 172.21.15.116:0/3506774524 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e940adf70 0x7f0e940cce70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009850 tx=0x7f0e88009b60 comp rx=0 tx=0).stop 2023-05-12T09:08:56.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.157+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3506774524 shutdown_connections 2023-05-12T09:08:56.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.157+0000 7f0e9a9ff700 1 --2- 172.21.15.116:0/3506774524 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e940adf70 0x7f0e940cce70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:56.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.157+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3506774524 >> 172.21.15.116:0/3506774524 conn(0x7f0e940cf720 msgr2=0x7f0e940cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:56.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.157+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3506774524 shutdown_connections 2023-05-12T09:08:56.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.157+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3506774524 wait complete. 2023-05-12T09:08:56.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.159+0000 7f0e9a9ff700 1 Processor -- start 2023-05-12T09:08:56.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.159+0000 7f0e9a9ff700 1 -- start start 2023-05-12T09:08:56.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.160+0000 7f0e9a9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e940adf70 0x7f0e9406d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:56.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.160+0000 7f0e9a9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e940cd760 0x7f0e94155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:56.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.160+0000 7f0e9a9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e9415cf10 0x7f0e940ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:56.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.160+0000 7f0e9a9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940ac280 con 0x7f0e940cd760 2023-05-12T09:08:56.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.160+0000 7f0e9a9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94156250 con 0x7f0e940adf70 2023-05-12T09:08:56.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.160+0000 7f0e9a9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940ab950 con 0x7f0e9415cf10 2023-05-12T09:08:56.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.160+0000 7f0e937fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e940cd760 0x7f0e94155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:56.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.160+0000 7f0e937fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e940cd760 0x7f0e94155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51298/0 (socket says 172.21.15.116:51298) 2023-05-12T09:08:56.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.160+0000 7f0e937fe700 1 -- 172.21.15.116:0/3208082390 learned_addr learned my addr 172.21.15.116:0/3208082390 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:56.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e93fff700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e940adf70 0x7f0e9406d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:56.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e937fe700 1 -- 172.21.15.116:0/3208082390 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e9415cf10 msgr2=0x7f0e940ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:56.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e98f9c700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e9415cf10 0x7f0e940ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:56.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e937fe700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e9415cf10 0x7f0e940ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:56.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e937fe700 1 -- 172.21.15.116:0/3208082390 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e940adf70 msgr2=0x7f0e9406d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:56.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e937fe700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e940adf70 0x7f0e9406d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:56.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e937fe700 1 -- 172.21.15.116:0/3208082390 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88009430 con 0x7f0e940cd760 2023-05-12T09:08:56.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e93fff700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e940adf70 0x7f0e9406d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:56.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e98f9c700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e9415cf10 0x7f0e940ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:08:56.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e937fe700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e940cd760 0x7f0e94155240 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0e940708b0 tx=0x7f0e88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:56.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e90ff9700 1 -- 172.21.15.116:0/3208082390 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88025430 con 0x7f0e940cd760 2023-05-12T09:08:56.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e90ff9700 1 -- 172.21.15.116:0/3208082390 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e88020070 con 0x7f0e940cd760 2023-05-12T09:08:56.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e90ff9700 1 -- 172.21.15.116:0/3208082390 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880257d0 con 0x7f0e940cd760 2023-05-12T09:08:56.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.161+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3208082390 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e94071600 con 0x7f0e940cd760 2023-05-12T09:08:56.170 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.162+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3208082390 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e940cc670 con 0x7f0e940cd760 2023-05-12T09:08:56.170 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.162+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3208082390 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e940cd3b0 con 0x7f0e940cd760 2023-05-12T09:08:56.171 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.163+0000 7f0e90ff9700 1 -- 172.21.15.116:0/3208082390 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e88022030 con 0x7f0e940cd760 2023-05-12T09:08:56.171 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.164+0000 7f0e90ff9700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e8006ace0 0x7f0e8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:56.171 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.164+0000 7f0e90ff9700 1 -- 172.21.15.116:0/3208082390 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0e8808a7f0 con 0x7f0e940cd760 2023-05-12T09:08:56.171 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.165+0000 7f0e93fff700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e8006ace0 0x7f0e8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:56.171 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.165+0000 7f0e93fff700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e8006ace0 0x7f0e8006d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0e840011e0 tx=0x7f0e84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:56.172 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.169+0000 7f0e90ff9700 1 -- 172.21.15.116:0/3208082390 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0e88055a70 con 0x7f0e940cd760 2023-05-12T09:08:56.387 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:56.384+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3208082390 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0e940ac3c0 con 0x7f0e940cd760 2023-05-12T09:08:57.129 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.126+0000 7f0e90ff9700 1 -- 172.21.15.116:0/3208082390 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0e88059090 con 0x7f0e940cd760 2023-05-12T09:08:57.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.129+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3208082390 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e8006ace0 msgr2=0x7f0e8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.129+0000 7f0e9a9ff700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e8006ace0 0x7f0e8006d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0e840011e0 tx=0x7f0e84009040 comp rx=0 tx=0).stop 2023-05-12T09:08:57.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.129+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3208082390 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e940cd760 msgr2=0x7f0e94155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.129+0000 7f0e9a9ff700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e940cd760 0x7f0e94155240 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0e940708b0 tx=0x7f0e88004750 comp rx=0 tx=0).stop 2023-05-12T09:08:57.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.129+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3208082390 shutdown_connections 2023-05-12T09:08:57.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.129+0000 7f0e9a9ff700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e8006ace0 0x7f0e8006d190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.129+0000 7f0e9a9ff700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e9415cf10 0x7f0e940ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.134 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.129+0000 7f0e9a9ff700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e940adf70 0x7f0e9406d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.134 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.129+0000 7f0e9a9ff700 1 --2- 172.21.15.116:0/3208082390 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e940cd760 0x7f0e94155240 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.134 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.129+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3208082390 >> 172.21.15.116:0/3208082390 conn(0x7f0e940cf720 msgr2=0x7f0e940ca930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:57.134 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.130+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3208082390 shutdown_connections 2023-05-12T09:08:57.134 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.130+0000 7f0e9a9ff700 1 -- 172.21.15.116:0/3208082390 wait complete. 2023-05-12T09:08:57.135 INFO:teuthology.orchestra.run.smithi116.stderr: removed all blocklist entries 2023-05-12T09:08:57.151 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-12T09:08:57.336 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.333+0000 7f26653ff700 1 Processor -- start 2023-05-12T09:08:57.336 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.333+0000 7f26653ff700 1 -- start start 2023-05-12T09:08:57.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.334+0000 7f26653ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f266006aaf0 0x7f2660070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.334+0000 7f26653ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2660071030 0x7f266006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.334+0000 7f26653ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26600cb280 con 0x7f266015a5a0 2023-05-12T09:08:57.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.334+0000 7f26653ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266015a970 con 0x7f2660071030 2023-05-12T09:08:57.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.334+0000 7f26653ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600714b0 con 0x7f266006aaf0 2023-05-12T09:08:57.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.334+0000 7f265effd700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f266015a5a0 0x7f266006a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60220/0 (socket says 172.21.15.116:60220) 2023-05-12T09:08:57.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.334+0000 7f265effd700 1 -- 172.21.15.116:0/1914937414 learned_addr learned my addr 172.21.15.116:0/1914937414 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:57.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.334+0000 7f265f7fe700 1 --2- 172.21.15.116:0/1914937414 >> v2:172.21.15.116:3300/0 conn(0x7f2660071030 0x7f266006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265e7fc700 1 --2- 172.21.15.116:0/1914937414 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f266006aaf0 0x7f2660070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265dffb700 1 -- 172.21.15.116:0/1914937414 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108630390 0 0) 0x7f2650001110 con 0x7f266015a5a0 2023-05-12T09:08:57.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265dffb700 1 -- 172.21.15.116:0/1914937414 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26480035b0 con 0x7f266015a5a0 2023-05-12T09:08:57.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265f7fe700 1 -- 172.21.15.116:0/1914937414 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f266006aaf0 msgr2=0x7f2660070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:57.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265f7fe700 1 --2- 172.21.15.116:0/1914937414 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f266006aaf0 0x7f2660070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265f7fe700 1 -- 172.21.15.116:0/1914937414 >> v1:172.21.15.116:6789/0 conn(0x7f266015a5a0 legacy=0x7f266006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265f7fe700 1 -- 172.21.15.116:0/1914937414 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2660071700 con 0x7f2660071030 2023-05-12T09:08:57.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265f7fe700 1 --2- 172.21.15.116:0/1914937414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2660071030 0x7f266006d1a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2658009d90 tx=0x7f265800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa5cedcacca56e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:57.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265dffb700 1 -- 172.21.15.116:0/1914937414 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265800e070 con 0x7f2660071030 2023-05-12T09:08:57.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265dffb700 1 -- 172.21.15.116:0/1914937414 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265800bb20 con 0x7f2660071030 2023-05-12T09:08:57.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.335+0000 7f265dffb700 1 -- 172.21.15.116:0/1914937414 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658012430 con 0x7f2660071030 2023-05-12T09:08:57.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.336+0000 7f26653ff700 1 -- 172.21.15.116:0/1914937414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2660071030 msgr2=0x7f266006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.336+0000 7f26653ff700 1 --2- 172.21.15.116:0/1914937414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2660071030 0x7f266006d1a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2658009d90 tx=0x7f265800b330 comp rx=0 tx=0).stop 2023-05-12T09:08:57.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.336+0000 7f26653ff700 1 -- 172.21.15.116:0/1914937414 shutdown_connections 2023-05-12T09:08:57.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.336+0000 7f26653ff700 1 --2- 172.21.15.116:0/1914937414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2660071030 0x7f266006d1a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.336+0000 7f26653ff700 1 --2- 172.21.15.116:0/1914937414 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f266006aaf0 0x7f2660070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.336+0000 7f26653ff700 1 -- 172.21.15.116:0/1914937414 >> 172.21.15.116:0/1914937414 conn(0x7f26600cf720 msgr2=0x7f26600cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:57.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.336+0000 7f26653ff700 1 -- 172.21.15.116:0/1914937414 shutdown_connections 2023-05-12T09:08:57.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.336+0000 7f26653ff700 1 -- 172.21.15.116:0/1914937414 wait complete. 2023-05-12T09:08:57.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.338+0000 7f26653ff700 1 Processor -- start 2023-05-12T09:08:57.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.338+0000 7f26653ff700 1 -- start start 2023-05-12T09:08:57.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f26653ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f266006aaf0 0x7f2660155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f26653ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2660071030 0x7f266015c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f26653ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f266015a5a0 0x7f26600cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f26653ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600ac7c0 con 0x7f266015a5a0 2023-05-12T09:08:57.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f26653ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600acaa0 con 0x7f2660071030 2023-05-12T09:08:57.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f26653ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600acd80 con 0x7f266006aaf0 2023-05-12T09:08:57.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f265f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f266015a5a0 0x7f26600cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f265f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f266015a5a0 0x7f26600cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51316/0 (socket says 172.21.15.116:51316) 2023-05-12T09:08:57.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f265f7fe700 1 -- 172.21.15.116:0/2528840429 learned_addr learned my addr 172.21.15.116:0/2528840429 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:57.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f265effd700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f266006aaf0 0x7f2660155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.339+0000 7f265e7fc700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2660071030 0x7f266015c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f265f7fe700 1 -- 172.21.15.116:0/2528840429 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f266006aaf0 msgr2=0x7f2660155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f265f7fe700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f266006aaf0 0x7f2660155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f265f7fe700 1 -- 172.21.15.116:0/2528840429 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2660071030 msgr2=0x7f266015c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f265f7fe700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2660071030 0x7f266015c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f265f7fe700 1 -- 172.21.15.116:0/2528840429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2658009a70 con 0x7f266015a5a0 2023-05-12T09:08:57.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f265f7fe700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f266015a5a0 0x7f26600cd820 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2658014040 tx=0x7f2658004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:57.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f26477fe700 1 -- 172.21.15.116:0/2528840429 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26580129f0 con 0x7f266015a5a0 2023-05-12T09:08:57.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f26477fe700 1 -- 172.21.15.116:0/2528840429 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2658020070 con 0x7f266015a5a0 2023-05-12T09:08:57.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f26477fe700 1 -- 172.21.15.116:0/2528840429 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658012db0 con 0x7f266015a5a0 2023-05-12T09:08:57.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f26653ff700 1 -- 172.21.15.116:0/2528840429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266006c6c0 con 0x7f266015a5a0 2023-05-12T09:08:57.347 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.340+0000 7f26653ff700 1 -- 172.21.15.116:0/2528840429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26600719e0 con 0x7f266015a5a0 2023-05-12T09:08:57.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.341+0000 7f26653ff700 1 -- 172.21.15.116:0/2528840429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266006c9a0 con 0x7f266015a5a0 2023-05-12T09:08:57.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.342+0000 7f26477fe700 1 -- 172.21.15.116:0/2528840429 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2658004040 con 0x7f266015a5a0 2023-05-12T09:08:57.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.343+0000 7f26477fe700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f264c06ace0 0x7f264c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.343+0000 7f26477fe700 1 -- 172.21.15.116:0/2528840429 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2658022070 con 0x7f266015a5a0 2023-05-12T09:08:57.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.343+0000 7f265effd700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f264c06ace0 0x7f264c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.344+0000 7f265effd700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f264c06ace0 0x7f264c06d190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2650001270 tx=0x7f2650009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:57.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.347+0000 7f26477fe700 1 -- 172.21.15.116:0/2528840429 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2658056220 con 0x7f266015a5a0 2023-05-12T09:08:57.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.620+0000 7f26653ff700 1 -- 172.21.15.116:0/2528840429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f26600c37e0 con 0x7f266015a5a0 2023-05-12T09:08:57.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.621+0000 7f26477fe700 1 -- 172.21.15.116:0/2528840429 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f26600c37e0 con 0x7f266015a5a0 2023-05-12T09:08:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:08:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-05-12T09:08:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_dump": [ 2023-05-12T09:08:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mds.a", 2023-05-12T09:08:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCFAV5knyv0HhAA+XePiQqvMxnfYR+yOfudbg==", 2023-05-12T09:08:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2023-05-12T09:08:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow *", 2023-05-12T09:08:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow *", 2023-05-12T09:08:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mds.b", 2023-05-12T09:08:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCFAV5kj1R5NBAALVHNgQgMjSUunPGKS8yM2Q==", 2023-05-12T09:08:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2023-05-12T09:08:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow *", 2023-05-12T09:08:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow *", 2023-05-12T09:08:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mds.c", 2023-05-12T09:08:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCFAV5kCS+TKRAADCeMHCgcUsxE9Iijf6u2RA==", 2023-05-12T09:08:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2023-05-12T09:08:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow *", 2023-05-12T09:08:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow *", 2023-05-12T09:08:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mds.d", 2023-05-12T09:08:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCGAV5kWbLnAxAA4U72yQhgPsrqEXg4hTODxw==", 2023-05-12T09:08:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2023-05-12T09:08:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow *", 2023-05-12T09:08:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow *", 2023-05-12T09:08:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.0", 2023-05-12T09:08:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCJAV5kUNdyNRAAKmmQh3xDLMTWae3RWSV6Ug==", 2023-05-12T09:08:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2023-05-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2023-05-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.1", 2023-05-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCMAV5ku243OBAATyNYA1E0yXYDC1lBFeTWCQ==", 2023-05-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2023-05-12T09:08:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2023-05-12T09:08:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.2", 2023-05-12T09:08:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCPAV5kseYSOxAAwaPHFLjD4nL2boFN0js7hg==", 2023-05-12T09:08:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2023-05-12T09:08:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2023-05-12T09:08:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.3", 2023-05-12T09:08:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCTAV5kPK5IAhAAY5TbKM6lLkU4lvv7FuZFDg==", 2023-05-12T09:08:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2023-05-12T09:08:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2023-05-12T09:08:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.4", 2023-05-12T09:08:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCZAV5kMg4wGxAAZSFSHdVBNhbK5VUE69YdwQ==", 2023-05-12T09:08:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2023-05-12T09:08:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2023-05-12T09:08:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.5", 2023-05-12T09:08:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCcAV5k0M50IBAATnqlN/oBFXIwflJKZPpxDQ==", 2023-05-12T09:08:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2023-05-12T09:08:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2023-05-12T09:08:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.6", 2023-05-12T09:08:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCfAV5k0GbWJhAA4e8aeLD6w+/zrcP0IbbJqA==", 2023-05-12T09:08:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2023-05-12T09:08:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2023-05-12T09:08:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "osd.7", 2023-05-12T09:08:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCiAV5kLgXtLRAALJOHDthSL7I5XLS4PzsgLA==", 2023-05-12T09:08:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow profile osd", 2023-05-12T09:08:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile osd", 2023-05-12T09:08:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.0", 2023-05-12T09:08:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCGAV5k6b9ODRAA+Q01ixNIFwqKlPUUfO6alg==", 2023-05-12T09:08:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2023-05-12T09:08:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow r", 2023-05-12T09:08:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow rw", 2023-05-12T09:08:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow rwx" 2023-05-12T09:08:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.1", 2023-05-12T09:08:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCGAV5k04UcGxAArh2Fhcjg16KDQe6hzKaHxg==", 2023-05-12T09:08:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2023-05-12T09:08:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow r", 2023-05-12T09:08:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow rw", 2023-05-12T09:08:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow rwx" 2023-05-12T09:08:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.2", 2023-05-12T09:08:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCGAV5kCjgWFBAAqZG/4pP70B9jSzEoNJZdrw==", 2023-05-12T09:08:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2023-05-12T09:08:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow r", 2023-05-12T09:08:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow rw", 2023-05-12T09:08:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow rwx" 2023-05-12T09:08:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.3", 2023-05-12T09:08:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCGAV5kk6YGIhAAd7BpJidPjMShUekaTp9BBQ==", 2023-05-12T09:08:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow", 2023-05-12T09:08:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow r", 2023-05-12T09:08:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow rw", 2023-05-12T09:08:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow rwx" 2023-05-12T09:08:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.admin", 2023-05-12T09:08:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCEAV5kjeSqJxAAYIOfjwO95S7777UCRKuLAg==", 2023-05-12T09:08:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow *", 2023-05-12T09:08:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": "allow *", 2023-05-12T09:08:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow *", 2023-05-12T09:08:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-mds", 2023-05-12T09:08:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCqAV5kDEYwJxAA3UK/iB14z23ECuosSkGpqA==", 2023-05-12T09:08:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-mds" 2023-05-12T09:08:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-mgr", 2023-05-12T09:08:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCqAV5kQVEwJxAAJ3QN1cEnmVDE+SWMwEs3ow==", 2023-05-12T09:08:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-12T09:08:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-osd", 2023-05-12T09:08:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCqAV5k7lkwJxAAmY1k9nZKTIpAYboiEaVhvQ==", 2023-05-12T09:08:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-osd" 2023-05-12T09:08:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-rbd", 2023-05-12T09:08:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCqAV5kQGIwJxAAgYldxw3A9egxStLB3HuCEQ==", 2023-05-12T09:08:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-12T09:08:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-12T09:08:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCqAV5k9mowJxAAZphr5LKRHYiA7E5fQVztwQ==", 2023-05-12T09:08:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-12T09:08:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "client.bootstrap-rgw", 2023-05-12T09:08:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCqAV5khXUwJxAAvJnQyEHb1pnRIWo6DqcxLw==", 2023-05-12T09:08:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-12T09:08:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mgr.x", 2023-05-12T09:08:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCFAV5kJjTmFxAAuwDFdATx/ekdgl4Mi3Ffxg==", 2023-05-12T09:08:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow *", 2023-05-12T09:08:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile mgr", 2023-05-12T09:08:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:08:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:08:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "entity": "mgr.y", 2023-05-12T09:08:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "AQCFAV5kkOiGEBAApvnwqZdbB63Th503DTLm7g==", 2023-05-12T09:08:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": { 2023-05-12T09:08:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": "allow *", 2023-05-12T09:08:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "mon": "allow profile mgr", 2023-05-12T09:08:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": "allow *" 2023-05-12T09:08:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:08:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2023-05-12T09:08:57.654 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-05-12T09:08:57.655 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 -- 172.21.15.116:0/2528840429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f264c06ace0 msgr2=0x7f264c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.655 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f264c06ace0 0x7f264c06d190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2650001270 tx=0x7f2650009040 comp rx=0 tx=0).stop 2023-05-12T09:08:57.655 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 -- 172.21.15.116:0/2528840429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f266015a5a0 msgr2=0x7f26600cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f266015a5a0 0x7f26600cd820 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2658014040 tx=0x7f2658004ad0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 -- 172.21.15.116:0/2528840429 shutdown_connections 2023-05-12T09:08:57.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f266015a5a0 0x7f26600cd820 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f264c06ace0 0x7f264c06d190 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f266006aaf0 0x7f2660155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 --2- 172.21.15.116:0/2528840429 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2660071030 0x7f266015c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 -- 172.21.15.116:0/2528840429 >> 172.21.15.116:0/2528840429 conn(0x7f26600cf720 msgr2=0x7f2660157c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:57.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 -- 172.21.15.116:0/2528840429 shutdown_connections 2023-05-12T09:08:57.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.623+0000 7f26653ff700 1 -- 172.21.15.116:0/2528840429 wait complete. 2023-05-12T09:08:57.657 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-12T09:08:57.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.840+0000 7f97aebff700 1 Processor -- start 2023-05-12T09:08:57.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.840+0000 7f97aebff700 1 -- start start 2023-05-12T09:08:57.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.841+0000 7f97aebff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f97a8071200 0x7f97a8165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.841+0000 7f97aebff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a80cb280 con 0x7f97a806aaf0 2023-05-12T09:08:57.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.841+0000 7f97aebff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a8071700 con 0x7f97a815a5a0 2023-05-12T09:08:57.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.841+0000 7f97aebff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a815a970 con 0x7f97a8071200 2023-05-12T09:08:57.845 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.841+0000 7f97a7fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f97a806aaf0 0x7f97a8070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60230/0 (socket says 172.21.15.116:60230) 2023-05-12T09:08:57.845 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.841+0000 7f97ad19c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f97a8071200 0x7f97a8165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.845 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.841+0000 7f97a7fff700 1 -- 172.21.15.116:0/2191709950 learned_addr learned my addr 172.21.15.116:0/2191709950 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:57.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.842+0000 7f97ad19c700 1 -- 172.21.15.116:0/2191709950 >> v1:172.21.15.182:6789/0 conn(0x7f97a815a5a0 legacy=0x7f97a806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.842+0000 7f97ad19c700 1 -- 172.21.15.116:0/2191709950 >> v1:172.21.15.116:6789/0 conn(0x7f97a806aaf0 legacy=0x7f97a8070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.842+0000 7f97ad19c700 1 -- 172.21.15.116:0/2191709950 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a80719e0 con 0x7f97a8071200 2023-05-12T09:08:57.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.842+0000 7f97a77fe700 1 -- 172.21.15.116:0/2191709950 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958342677 0 0) 0x7f9794001290 con 0x7f97a806aaf0 2023-05-12T09:08:57.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.842+0000 7f97ad19c700 1 --2- 172.21.15.116:0/2191709950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a8071200 0x7f97a8165340 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009d90 tx=0x7f97a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2734168f7c9a9f7e server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:57.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.842+0000 7f97a77fe700 1 -- 172.21.15.116:0/2191709950 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a000e070 con 0x7f97a8071200 2023-05-12T09:08:57.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.842+0000 7f97a77fe700 1 -- 172.21.15.116:0/2191709950 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a000bbd0 con 0x7f97a8071200 2023-05-12T09:08:57.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.842+0000 7f97a77fe700 1 -- 172.21.15.116:0/2191709950 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0012430 con 0x7f97a8071200 2023-05-12T09:08:57.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.843+0000 7f97aebff700 1 -- 172.21.15.116:0/2191709950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a8071200 msgr2=0x7f97a8165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.843+0000 7f97aebff700 1 --2- 172.21.15.116:0/2191709950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a8071200 0x7f97a8165340 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009d90 tx=0x7f97a000b330 comp rx=0 tx=0).stop 2023-05-12T09:08:57.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.843+0000 7f97aebff700 1 -- 172.21.15.116:0/2191709950 shutdown_connections 2023-05-12T09:08:57.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.843+0000 7f97aebff700 1 --2- 172.21.15.116:0/2191709950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a8071200 0x7f97a8165340 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.843+0000 7f97aebff700 1 -- 172.21.15.116:0/2191709950 >> 172.21.15.116:0/2191709950 conn(0x7f97a80cf720 msgr2=0x7f97a80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:57.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.843+0000 7f97aebff700 1 -- 172.21.15.116:0/2191709950 shutdown_connections 2023-05-12T09:08:57.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.843+0000 7f97aebff700 1 -- 172.21.15.116:0/2191709950 wait complete. 2023-05-12T09:08:57.849 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.845+0000 7f97aebff700 1 Processor -- start 2023-05-12T09:08:57.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.845+0000 7f97aebff700 1 -- start start 2023-05-12T09:08:57.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.845+0000 7f97aebff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a806aaf0 0x7f97a80cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97aebff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97a8071200 0x7f97a80c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97aebff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f97a815a5a0 0x7f97a8155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97aebff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80cdc80 con 0x7f97a806aaf0 2023-05-12T09:08:57.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97aebff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80cd6c0 con 0x7f97a815a5a0 2023-05-12T09:08:57.850 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97aebff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80cd9a0 con 0x7f97a8071200 2023-05-12T09:08:57.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97ac99b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a806aaf0 0x7f97a80cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97ac99b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a806aaf0 0x7f97a80cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51342/0 (socket says 172.21.15.116:51342) 2023-05-12T09:08:57.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97ac99b700 1 -- 172.21.15.116:0/1323175544 learned_addr learned my addr 172.21.15.116:0/1323175544 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:57.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97ad19c700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f97a815a5a0 0x7f97a8155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97a7fff700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97a8071200 0x7f97a80c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97ac99b700 1 -- 172.21.15.116:0/1323175544 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97a8071200 msgr2=0x7f97a80c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.851 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97ac99b700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97a8071200 0x7f97a80c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97ac99b700 1 -- 172.21.15.116:0/1323175544 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f97a815a5a0 msgr2=0x7f97a8155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:57.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97ac99b700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f97a815a5a0 0x7f97a8155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:57.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97ac99b700 1 -- 172.21.15.116:0/1323175544 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0009a70 con 0x7f97a806aaf0 2023-05-12T09:08:57.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.846+0000 7f97ac99b700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a806aaf0 0x7f97a80cdfb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f979c00c450 tx=0x7f979c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:57.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.847+0000 7f97a57fa700 1 -- 172.21.15.116:0/1323175544 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c0052d0 con 0x7f97a806aaf0 2023-05-12T09:08:57.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.847+0000 7f97a57fa700 1 -- 172.21.15.116:0/1323175544 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c005430 con 0x7f97a806aaf0 2023-05-12T09:08:57.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.847+0000 7f97aebff700 1 -- 172.21.15.116:0/1323175544 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a806c9a0 con 0x7f97a806aaf0 2023-05-12T09:08:57.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.847+0000 7f97a57fa700 1 -- 172.21.15.116:0/1323175544 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c0038c0 con 0x7f97a806aaf0 2023-05-12T09:08:57.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.847+0000 7f97aebff700 1 -- 172.21.15.116:0/1323175544 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a806c6c0 con 0x7f97a806aaf0 2023-05-12T09:08:57.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.848+0000 7f97aebff700 1 -- 172.21.15.116:0/1323175544 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a806cc80 con 0x7f97a806aaf0 2023-05-12T09:08:57.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.849+0000 7f97a57fa700 1 -- 172.21.15.116:0/1323175544 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f979c003a20 con 0x7f97a806aaf0 2023-05-12T09:08:57.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.850+0000 7f97a57fa700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f978c06ace0 0x7f978c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:57.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.850+0000 7f97a57fa700 1 -- 172.21.15.116:0/1323175544 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f979c0886a0 con 0x7f97a806aaf0 2023-05-12T09:08:57.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.850+0000 7f97a7fff700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f978c06ace0 0x7f978c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:57.854 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.851+0000 7f97a7fff700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f978c06ace0 0x7f978c06d190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f97a80c3c60 tx=0x7f9794009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:57.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:57.854+0000 7f97a57fa700 1 -- 172.21.15.116:0/1323175544 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f979c053830 con 0x7f97a806aaf0 2023-05-12T09:08:58.125 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.122+0000 7f97aebff700 1 -- 172.21.15.116:0/1323175544 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f97a80cbcf0 con 0x7f97a806aaf0 2023-05-12T09:08:58.129 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.126+0000 7f97a57fa700 1 -- 172.21.15.116:0/1323175544 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f979c056e50 con 0x7f97a806aaf0 2023-05-12T09:08:58.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 -- 172.21.15.116:0/1323175544 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f978c06ace0 msgr2=0x7f978c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f978c06ace0 0x7f978c06d190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f97a80c3c60 tx=0x7f9794009040 comp rx=0 tx=0).stop 2023-05-12T09:08:58.132 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 -- 172.21.15.116:0/1323175544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a806aaf0 msgr2=0x7f97a80cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a806aaf0 0x7f97a80cdfb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f979c00c450 tx=0x7f979c00c810 comp rx=0 tx=0).stop 2023-05-12T09:08:58.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 -- 172.21.15.116:0/1323175544 shutdown_connections 2023-05-12T09:08:58.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f97a815a5a0 0x7f97a8155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a806aaf0 0x7f97a80cdfb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f978c06ace0 0x7f978c06d190 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 --2- 172.21.15.116:0/1323175544 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f97a8071200 0x7f97a80c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.133 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 -- 172.21.15.116:0/1323175544 >> 172.21.15.116:0/1323175544 conn(0x7f97a80cf720 msgr2=0x7f97a806a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:58.134 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 -- 172.21.15.116:0/1323175544 shutdown_connections 2023-05-12T09:08:58.134 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.128+0000 7f97aebff700 1 -- 172.21.15.116:0/1323175544 wait complete. 2023-05-12T09:08:58.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-12T09:08:58.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.329+0000 7f0e5dbff700 1 Processor -- start 2023-05-12T09:08:58.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.330+0000 7f0e5dbff700 1 -- start start 2023-05-12T09:08:58.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e5dbff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0e580b87a0 0x7f0e580cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e5dbff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0e581601e0 0x7f0e58160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e5dbff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580cdc60 con 0x7f0e58160b70 2023-05-12T09:08:58.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e5dbff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580d02d0 con 0x7f0e581601e0 2023-05-12T09:08:58.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e5dbff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580d0cb0 con 0x7f0e580b87a0 2023-05-12T09:08:58.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e57fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f0e58160b70 0x7f0e580d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60244/0 (socket says 172.21.15.116:60244) 2023-05-12T09:08:58.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e56ffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0e581601e0 0x7f0e58160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:58.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e57fff700 1 -- 172.21.15.116:0/2140766445 learned_addr learned my addr 172.21.15.116:0/2140766445 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:58.336 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e577fe700 1 --2- 172.21.15.116:0/2140766445 >> v2:172.21.15.182:3300/0 conn(0x7f0e580b87a0 0x7f0e580cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:58.336 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e567fc700 1 -- 172.21.15.116:0/2140766445 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644033306 0 0) 0x7f0e580cdc60 con 0x7f0e58160b70 2023-05-12T09:08:58.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e567fc700 1 -- 172.21.15.116:0/2140766445 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e400035b0 con 0x7f0e58160b70 2023-05-12T09:08:58.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e56ffd700 1 -- 172.21.15.116:0/2140766445 >> v2:172.21.15.182:3300/0 conn(0x7f0e580b87a0 msgr2=0x7f0e580cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:58.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e56ffd700 1 --2- 172.21.15.116:0/2140766445 >> v2:172.21.15.182:3300/0 conn(0x7f0e580b87a0 0x7f0e580cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e56ffd700 1 -- 172.21.15.116:0/2140766445 >> v1:172.21.15.116:6789/0 conn(0x7f0e58160b70 legacy=0x7f0e580d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.331+0000 7f0e56ffd700 1 -- 172.21.15.116:0/2140766445 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580cd6a0 con 0x7f0e581601e0 2023-05-12T09:08:58.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.332+0000 7f0e56ffd700 1 --2- 172.21.15.116:0/2140766445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 0x7f0e58160630 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0e580b4ac0 tx=0x7f0e4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53a08da1551eab1 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:58.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.332+0000 7f0e567fc700 1 -- 172.21.15.116:0/2140766445 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c011830 con 0x7f0e581601e0 2023-05-12T09:08:58.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.332+0000 7f0e567fc700 1 -- 172.21.15.116:0/2140766445 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c011990 con 0x7f0e581601e0 2023-05-12T09:08:58.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.332+0000 7f0e567fc700 1 -- 172.21.15.116:0/2140766445 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c011d20 con 0x7f0e581601e0 2023-05-12T09:08:58.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.332+0000 7f0e5dbff700 1 -- 172.21.15.116:0/2140766445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 msgr2=0x7f0e58160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.332+0000 7f0e5dbff700 1 --2- 172.21.15.116:0/2140766445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 0x7f0e58160630 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0e580b4ac0 tx=0x7f0e4c009b50 comp rx=0 tx=0).stop 2023-05-12T09:08:58.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.332+0000 7f0e5dbff700 1 -- 172.21.15.116:0/2140766445 shutdown_connections 2023-05-12T09:08:58.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.332+0000 7f0e5dbff700 1 --2- 172.21.15.116:0/2140766445 >> v2:172.21.15.182:3300/0 conn(0x7f0e580b87a0 0x7f0e580cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.332+0000 7f0e5dbff700 1 --2- 172.21.15.116:0/2140766445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 0x7f0e58160630 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.333+0000 7f0e5dbff700 1 -- 172.21.15.116:0/2140766445 >> 172.21.15.116:0/2140766445 conn(0x7f0e58071b10 msgr2=0x7f0e58071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:58.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.333+0000 7f0e5dbff700 1 -- 172.21.15.116:0/2140766445 shutdown_connections 2023-05-12T09:08:58.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.333+0000 7f0e5dbff700 1 -- 172.21.15.116:0/2140766445 wait complete. 2023-05-12T09:08:58.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.334+0000 7f0e5dbff700 1 Processor -- start 2023-05-12T09:08:58.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.334+0000 7f0e5dbff700 1 -- start start 2023-05-12T09:08:58.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.335+0000 7f0e5dbff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e580b87a0 0x7f0e581f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.335+0000 7f0e5dbff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 0x7f0e58151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.335+0000 7f0e5dbff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e58160b70 0x7f0e580b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.335+0000 7f0e5dbff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580b4620 con 0x7f0e581601e0 2023-05-12T09:08:58.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.335+0000 7f0e5dbff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580cbdd0 con 0x7f0e580b87a0 2023-05-12T09:08:58.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.335+0000 7f0e5dbff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580cb7c0 con 0x7f0e58160b70 2023-05-12T09:08:58.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.335+0000 7f0e56ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 0x7f0e58151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:58.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.335+0000 7f0e56ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 0x7f0e58151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51362/0 (socket says 172.21.15.116:51362) 2023-05-12T09:08:58.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.335+0000 7f0e56ffd700 1 -- 172.21.15.116:0/1397404293 learned_addr learned my addr 172.21.15.116:0/1397404293 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:58.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.336+0000 7f0e56ffd700 1 -- 172.21.15.116:0/1397404293 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e58160b70 msgr2=0x7f0e580b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.336+0000 7f0e56ffd700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e58160b70 0x7f0e580b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.336+0000 7f0e56ffd700 1 -- 172.21.15.116:0/1397404293 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e580b87a0 msgr2=0x7f0e581f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.336+0000 7f0e56ffd700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e580b87a0 0x7f0e581f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.336+0000 7f0e56ffd700 1 -- 172.21.15.116:0/1397404293 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0094a0 con 0x7f0e581601e0 2023-05-12T09:08:58.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.336+0000 7f0e56ffd700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 0x7f0e58151090 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0097c0 tx=0x7f0e4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:58.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.336+0000 7f0e3ffff700 1 -- 172.21.15.116:0/1397404293 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0036a0 con 0x7f0e581601e0 2023-05-12T09:08:58.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.336+0000 7f0e3ffff700 1 -- 172.21.15.116:0/1397404293 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c01e070 con 0x7f0e581601e0 2023-05-12T09:08:58.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.336+0000 7f0e5dbff700 1 -- 172.21.15.116:0/1397404293 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e58160f90 con 0x7f0e581601e0 2023-05-12T09:08:58.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.336+0000 7f0e3ffff700 1 -- 172.21.15.116:0/1397404293 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c003a60 con 0x7f0e581601e0 2023-05-12T09:08:58.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.337+0000 7f0e5dbff700 1 -- 172.21.15.116:0/1397404293 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e580cd980 con 0x7f0e581601e0 2023-05-12T09:08:58.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.337+0000 7f0e5dbff700 1 -- 172.21.15.116:0/1397404293 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e580d2110 con 0x7f0e581601e0 2023-05-12T09:08:58.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.338+0000 7f0e3ffff700 1 -- 172.21.15.116:0/1397404293 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e4c003bc0 con 0x7f0e581601e0 2023-05-12T09:08:58.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.339+0000 7f0e3ffff700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e4406ace0 0x7f0e4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.339+0000 7f0e3ffff700 1 -- 172.21.15.116:0/1397404293 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0e4c08a250 con 0x7f0e581601e0 2023-05-12T09:08:58.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.340+0000 7f0e577fe700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e4406ace0 0x7f0e4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:58.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.340+0000 7f0e577fe700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e4406ace0 0x7f0e4406d190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e480097f0 tx=0x7f0e48008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:58.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.344+0000 7f0e3ffff700 1 -- 172.21.15.116:0/1397404293 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0e4c055500 con 0x7f0e581601e0 2023-05-12T09:08:58.617 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.614+0000 7f0e5dbff700 1 -- 172.21.15.116:0/1397404293 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0e580cb620 con 0x7f0e581601e0 2023-05-12T09:08:58.621 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.618+0000 7f0e3ffff700 1 -- 172.21.15.116:0/1397404293 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0e580cb620 con 0x7f0e581601e0 2023-05-12T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 -- 172.21.15.116:0/1397404293 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e4406ace0 msgr2=0x7f0e4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e4406ace0 0x7f0e4406d190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e480097f0 tx=0x7f0e48008040 comp rx=0 tx=0).stop 2023-05-12T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 -- 172.21.15.116:0/1397404293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 msgr2=0x7f0e58151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 0x7f0e58151090 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0097c0 tx=0x7f0e4c004750 comp rx=0 tx=0).stop 2023-05-12T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 -- 172.21.15.116:0/1397404293 shutdown_connections 2023-05-12T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0e4406ace0 0x7f0e4406d190 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0e58160b70 0x7f0e580b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0e580b87a0 0x7f0e581f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 --2- 172.21.15.116:0/1397404293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e581601e0 0x7f0e58151090 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 -- 172.21.15.116:0/1397404293 >> 172.21.15.116:0/1397404293 conn(0x7f0e58071b10 msgr2=0x7f0e580b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 -- 172.21.15.116:0/1397404293 shutdown_connections 2023-05-12T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.621+0000 7f0e5dbff700 1 -- 172.21.15.116:0/1397404293 wait complete. 2023-05-12T09:08:58.641 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-12T09:08:58.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.822+0000 7fef521ff700 1 Processor -- start 2023-05-12T09:08:58.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.823+0000 7fef521ff700 1 -- start start 2023-05-12T09:08:58.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef521ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef4c0cf010 0x7fef4c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef521ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fef4c0cff50 0x7fef4c0d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef521ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c0cd520 con 0x7fef4c15c590 2023-05-12T09:08:58.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef521ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4c0d2640 con 0x7fef4c0cff50 2023-05-12T09:08:58.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef521ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c1610d0 con 0x7fef4c0cf010 2023-05-12T09:08:58.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef4bfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fef4c0cff50 0x7fef4c0d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:58.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef4bfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fef4c0cff50 0x7fef4c0d2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51364/0 (socket says 172.21.15.116:51364) 2023-05-12T09:08:58.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef4bfff700 1 -- 172.21.15.116:0/1758489365 learned_addr learned my addr 172.21.15.116:0/1758489365 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:58.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef43fff700 1 --2- 172.21.15.116:0/1758489365 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef4c0cf010 0x7fef4c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:58.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef4bfff700 1 -- 172.21.15.116:0/1758489365 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef4c0cf010 msgr2=0x7fef4c160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:58.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef4bfff700 1 --2- 172.21.15.116:0/1758489365 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef4c0cf010 0x7fef4c160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef4bfff700 1 -- 172.21.15.116:0/1758489365 >> v1:172.21.15.182:6789/0 conn(0x7fef4c15c590 legacy=0x7fef4c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:58.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.824+0000 7fef4bfff700 1 -- 172.21.15.116:0/1758489365 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c0b23c0 con 0x7fef4c0cff50 2023-05-12T09:08:58.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.825+0000 7fef4bfff700 1 --2- 172.21.15.116:0/1758489365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 0x7fef4c0d2ad0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fef44009e50 tx=0x7fef4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64abdd7d0c06aca4 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:58.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.825+0000 7fef4affd700 1 -- 172.21.15.116:0/1758489365 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4400e070 con 0x7fef4c0cff50 2023-05-12T09:08:58.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.825+0000 7fef4affd700 1 -- 172.21.15.116:0/1758489365 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4400b9c0 con 0x7fef4c0cff50 2023-05-12T09:08:58.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.825+0000 7fef4affd700 1 -- 172.21.15.116:0/1758489365 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4400bd70 con 0x7fef4c0cff50 2023-05-12T09:08:58.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.825+0000 7fef521ff700 1 -- 172.21.15.116:0/1758489365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 msgr2=0x7fef4c0d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.825+0000 7fef521ff700 1 --2- 172.21.15.116:0/1758489365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 0x7fef4c0d2ad0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fef44009e50 tx=0x7fef4400b330 comp rx=0 tx=0).stop 2023-05-12T09:08:58.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.826+0000 7fef521ff700 1 -- 172.21.15.116:0/1758489365 shutdown_connections 2023-05-12T09:08:58.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.826+0000 7fef521ff700 1 --2- 172.21.15.116:0/1758489365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 0x7fef4c0d2ad0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.826+0000 7fef521ff700 1 --2- 172.21.15.116:0/1758489365 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef4c0cf010 0x7fef4c160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.826+0000 7fef521ff700 1 -- 172.21.15.116:0/1758489365 >> 172.21.15.116:0/1758489365 conn(0x7fef4c071b10 msgr2=0x7fef4c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:58.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.826+0000 7fef521ff700 1 -- 172.21.15.116:0/1758489365 shutdown_connections 2023-05-12T09:08:58.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.826+0000 7fef521ff700 1 -- 172.21.15.116:0/1758489365 wait complete. 2023-05-12T09:08:58.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.827+0000 7fef521ff700 1 Processor -- start 2023-05-12T09:08:58.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.827+0000 7fef521ff700 1 -- start start 2023-05-12T09:08:58.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.828+0000 7fef521ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef4c0cf010 0x7fef4c155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.828+0000 7fef521ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 0x7fef4c1f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.828+0000 7fef521ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef4c15c590 0x7fef4c15f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.828+0000 7fef521ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c1f2630 con 0x7fef4c0cff50 2023-05-12T09:08:58.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.828+0000 7fef521ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c15cbe0 con 0x7fef4c15c590 2023-05-12T09:08:58.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.828+0000 7fef521ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c15cec0 con 0x7fef4c0cf010 2023-05-12T09:08:58.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.828+0000 7fef43fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 0x7fef4c1f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:58.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef43fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 0x7fef4c1f3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51378/0 (socket says 172.21.15.116:51378) 2023-05-12T09:08:58.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef43fff700 1 -- 172.21.15.116:0/4044322795 learned_addr learned my addr 172.21.15.116:0/4044322795 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef4b7fe700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef4c0cf010 0x7fef4c155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef4bfff700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef4c15c590 0x7fef4c15f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef43fff700 1 -- 172.21.15.116:0/4044322795 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef4c0cf010 msgr2=0x7fef4c155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef43fff700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef4c0cf010 0x7fef4c155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef43fff700 1 -- 172.21.15.116:0/4044322795 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef4c15c590 msgr2=0x7fef4c15f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef43fff700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef4c15c590 0x7fef4c15f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef43fff700 1 -- 172.21.15.116:0/4044322795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44009b30 con 0x7fef4c0cff50 2023-05-12T09:08:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef43fff700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 0x7fef4c1f3450 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fef3400e810 tx=0x7fef3400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef48ff9700 1 -- 172.21.15.116:0/4044322795 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3400c070 con 0x7fef4c0cff50 2023-05-12T09:08:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef48ff9700 1 -- 172.21.15.116:0/4044322795 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef34013610 con 0x7fef4c0cff50 2023-05-12T09:08:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef521ff700 1 -- 172.21.15.116:0/4044322795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4c0cd770 con 0x7fef4c0cff50 2023-05-12T09:08:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.829+0000 7fef48ff9700 1 -- 172.21.15.116:0/4044322795 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef340139c0 con 0x7fef4c0cff50 2023-05-12T09:08:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.830+0000 7fef521ff700 1 -- 172.21.15.116:0/4044322795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4c0cf560 con 0x7fef4c0cff50 2023-05-12T09:08:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.830+0000 7fef521ff700 1 -- 172.21.15.116:0/4044322795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4c15c960 con 0x7fef4c0cff50 2023-05-12T09:08:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.831+0000 7fef48ff9700 1 -- 172.21.15.116:0/4044322795 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef34013b20 con 0x7fef4c0cff50 2023-05-12T09:08:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.832+0000 7fef48ff9700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef2c06ace0 0x7fef2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.833+0000 7fef48ff9700 1 -- 172.21.15.116:0/4044322795 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fef34088fe0 con 0x7fef4c0cff50 2023-05-12T09:08:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.833+0000 7fef4b7fe700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef2c06ace0 0x7fef2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:58.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.833+0000 7fef4b7fe700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef2c06ace0 0x7fef2c06d190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fef3c007fd0 tx=0x7fef3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:58.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:58.836+0000 7fef48ff9700 1 -- 172.21.15.116:0/4044322795 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fef34057d00 con 0x7fef4c0cff50 2023-05-12T09:08:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.108+0000 7fef521ff700 1 -- 172.21.15.116:0/4044322795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fef4c0b51f0 con 0x7fef4c0cff50 2023-05-12T09:08:59.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.112+0000 7fef48ff9700 1 -- 172.21.15.116:0/4044322795 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fef34057890 con 0x7fef4c0cff50 2023-05-12T09:08:59.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 -- 172.21.15.116:0/4044322795 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef2c06ace0 msgr2=0x7fef2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef2c06ace0 0x7fef2c06d190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fef3c007fd0 tx=0x7fef3c009040 comp rx=0 tx=0).stop 2023-05-12T09:08:59.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 -- 172.21.15.116:0/4044322795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 msgr2=0x7fef4c1f3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 0x7fef4c1f3450 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fef3400e810 tx=0x7fef3400eb20 comp rx=0 tx=0).stop 2023-05-12T09:08:59.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 -- 172.21.15.116:0/4044322795 shutdown_connections 2023-05-12T09:08:59.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef4c15c590 0x7fef4c15f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef2c06ace0 0x7fef2c06d190 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef4c0cf010 0x7fef4c155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 --2- 172.21.15.116:0/4044322795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef4c0cff50 0x7fef4c1f3450 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 -- 172.21.15.116:0/4044322795 >> 172.21.15.116:0/4044322795 conn(0x7fef4c071b10 msgr2=0x7fef4c1601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:59.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 -- 172.21.15.116:0/4044322795 shutdown_connections 2023-05-12T09:08:59.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.115+0000 7fef521ff700 1 -- 172.21.15.116:0/4044322795 wait complete. 2023-05-12T09:08:59.134 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-12T09:08:59.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.317+0000 7f7c08dff700 1 Processor -- start 2023-05-12T09:08:59.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.317+0000 7f7c08dff700 1 -- start start 2023-05-12T09:08:59.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.318+0000 7f7c08dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f7c0406cdd0 0x7f7c0406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.318+0000 7f7c08dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c040ca890 con 0x7f7c04158da0 2023-05-12T09:08:59.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.318+0000 7f7c08dff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c040cd860 con 0x7f7c041589d0 2023-05-12T09:08:59.321 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.318+0000 7f7c08dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c040ca5b0 con 0x7f7c0406cdd0 2023-05-12T09:08:59.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.318+0000 7f7c01d9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f7c04158da0 0x7f7c0406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60252/0 (socket says 172.21.15.116:60252) 2023-05-12T09:08:59.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.318+0000 7f7c01d9b700 1 -- 172.21.15.116:0/2050678643 learned_addr learned my addr 172.21.15.116:0/2050678643 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:59.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c02d9d700 1 --2- 172.21.15.116:0/2050678643 >> v2:172.21.15.182:3300/0 conn(0x7f7c0406cdd0 0x7f7c0406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077144065 0 0) 0x7f7c040ca890 con 0x7f7c04158da0 2023-05-12T09:08:59.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bec0035b0 con 0x7f7c04158da0 2023-05-12T09:08:59.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2209121850 0 0) 0x7f7bec0035b0 con 0x7f7c04158da0 2023-05-12T09:08:59.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 >> v2:172.21.15.182:3300/0 conn(0x7f7c0406cdd0 msgr2=0x7f7c0406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:59.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 --2- 172.21.15.116:0/2050678643 >> v2:172.21.15.182:3300/0 conn(0x7f7c0406cdd0 0x7f7c0406a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 >> v1:172.21.15.182:6789/0 conn(0x7f7c041589d0 legacy=0x7f7c040cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040cc670 con 0x7f7c04158da0 2023-05-12T09:08:59.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f7bf80017f0 con 0x7f7c04158da0 2023-05-12T09:08:59.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 >> v1:172.21.15.116:6789/0 conn(0x7f7c04158da0 legacy=0x7f7c0406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7bec003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7bec0043a0 0x7f7bec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7bec004fe0 0x7f7bec010020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040ca5b0 con 0x7f7bec003a50 2023-05-12T09:08:59.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec010560 con 0x7f7bec004fe0 2023-05-12T09:08:59.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec0106f0 con 0x7f7bec0043a0 2023-05-12T09:08:59.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.319+0000 7f7c0259c700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7bec003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c02d9d700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7bec004fe0 0x7f7bec010020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.326 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c01d9b700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7bec0043a0 0x7f7bec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c0259c700 1 -- 172.21.15.116:0/2050678643 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7bec0043a0 msgr2=0x7f7bec004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:59.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c0259c700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7bec0043a0 0x7f7bec004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c0259c700 1 -- 172.21.15.116:0/2050678643 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7bec004fe0 msgr2=0x7f7bec010020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:59.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c0259c700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7bec004fe0 0x7f7bec010020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c0259c700 1 -- 172.21.15.116:0/2050678643 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec0035b0 con 0x7f7bec003a50 2023-05-12T09:08:59.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c02d9d700 1 -- 172.21.15.116:0/2050678643 reap_dead start 2023-05-12T09:08:59.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c01d9b700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7bec0043a0 0x7f7bec004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:08:59.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c0259c700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7bec003e60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4001820 tx=0x7f7bec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3822b147fabfd3b1 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:59.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4005220 con 0x7f7bec003a50 2023-05-12T09:08:59.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf4005380 con 0x7f7bec003a50 2023-05-12T09:08:59.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.320+0000 7f7c0159a700 1 -- 172.21.15.116:0/2050678643 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4006aa0 con 0x7f7bec003a50 2023-05-12T09:08:59.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.321+0000 7f7c08dff700 1 -- 172.21.15.116:0/2050678643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 msgr2=0x7f7bec003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.321+0000 7f7c08dff700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7bec003e60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4001820 tx=0x7f7bec005880 comp rx=0 tx=0).stop 2023-05-12T09:08:59.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.321+0000 7f7c08dff700 1 -- 172.21.15.116:0/2050678643 shutdown_connections 2023-05-12T09:08:59.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.321+0000 7f7c08dff700 1 --2- 172.21.15.116:0/2050678643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7bec003e60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.321+0000 7f7c08dff700 1 -- 172.21.15.116:0/2050678643 >> 172.21.15.116:0/2050678643 conn(0x7f7c040cf720 msgr2=0x7f7c040cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:59.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.321+0000 7f7c08dff700 1 -- 172.21.15.116:0/2050678643 shutdown_connections 2023-05-12T09:08:59.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.321+0000 7f7c08dff700 1 -- 172.21.15.116:0/2050678643 wait complete. 2023-05-12T09:08:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.323+0000 7f7c08dff700 1 Processor -- start 2023-05-12T09:08:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.323+0000 7f7c08dff700 1 -- start start 2023-05-12T09:08:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.324+0000 7f7c08dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7c04071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.324+0000 7f7c08dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7c040c5ad0 0x7f7c0414f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.324+0000 7f7c08dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7c040b0560 0x7f7c040b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.324+0000 7f7c08dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040b0f10 con 0x7f7bec003a50 2023-05-12T09:08:59.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.324+0000 7f7c08dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c71f0 con 0x7f7c040c5ad0 2023-05-12T09:08:59.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.324+0000 7f7c08dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c7680 con 0x7f7c040b0560 2023-05-12T09:08:59.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.324+0000 7f7c0259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7c04071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c0259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7c04071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51390/0 (socket says 172.21.15.116:51390) 2023-05-12T09:08:59.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c0259c700 1 -- 172.21.15.116:0/2638949431 learned_addr learned my addr 172.21.15.116:0/2638949431 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:59.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c01d9b700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7c040c5ad0 0x7f7c0414f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c02d9d700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7c040b0560 0x7f7c040b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c0259c700 1 -- 172.21.15.116:0/2638949431 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7c040b0560 msgr2=0x7f7c040b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c0259c700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7c040b0560 0x7f7c040b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c0259c700 1 -- 172.21.15.116:0/2638949431 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7c040c5ad0 msgr2=0x7f7c0414f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c0259c700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7c040c5ad0 0x7f7c0414f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c0259c700 1 -- 172.21.15.116:0/2638949431 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040ccc30 con 0x7f7bec003a50 2023-05-12T09:08:59.333 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c0259c700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7c04071480 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4014040 tx=0x7f7bf4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7bf2ffd700 1 -- 172.21.15.116:0/2638949431 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4006c70 con 0x7f7bec003a50 2023-05-12T09:08:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7bf2ffd700 1 -- 172.21.15.116:0/2638949431 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf4005570 con 0x7f7bec003a50 2023-05-12T09:08:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7bf2ffd700 1 -- 172.21.15.116:0/2638949431 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4007030 con 0x7f7bec003a50 2023-05-12T09:08:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.325+0000 7f7c08dff700 1 -- 172.21.15.116:0/2638949431 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c040cc950 con 0x7f7bec003a50 2023-05-12T09:08:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.326+0000 7f7c08dff700 1 -- 172.21.15.116:0/2638949431 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c040cd150 con 0x7f7bec003a50 2023-05-12T09:08:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.326+0000 7f7c08dff700 1 -- 172.21.15.116:0/2638949431 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c040b4a10 con 0x7f7bec003a50 2023-05-12T09:08:59.334 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.327+0000 7f7bf2ffd700 1 -- 172.21.15.116:0/2638949431 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7bf4007190 con 0x7f7bec003a50 2023-05-12T09:08:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.328+0000 7f7bf2ffd700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7be406ace0 0x7f7be406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.328+0000 7f7bf2ffd700 1 -- 172.21.15.116:0/2638949431 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7bf408a090 con 0x7f7bec003a50 2023-05-12T09:08:59.335 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.328+0000 7f7c01d9b700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7be406ace0 0x7f7be406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.329+0000 7f7c01d9b700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7be406ace0 0x7f7be406d190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7c040c5260 tx=0x7f7bf8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:59.336 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.332+0000 7f7bf2ffd700 1 -- 172.21.15.116:0/2638949431 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7bf4055340 con 0x7f7bec003a50 2023-05-12T09:08:59.606 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.603+0000 7f7c08dff700 1 -- 172.21.15.116:0/2638949431 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7c040c74d0 con 0x7f7bec003a50 2023-05-12T09:08:59.611 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.608+0000 7f7bf2ffd700 1 -- 172.21.15.116:0/2638949431 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7bf40220a0 con 0x7f7bec003a50 2023-05-12T09:08:59.613 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 -- 172.21.15.116:0/2638949431 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7be406ace0 msgr2=0x7f7be406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7be406ace0 0x7f7be406d190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7c040c5260 tx=0x7f7bf8009040 comp rx=0 tx=0).stop 2023-05-12T09:08:59.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 -- 172.21.15.116:0/2638949431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 msgr2=0x7f7c04071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.614 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7c04071480 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4014040 tx=0x7f7bf4001120 comp rx=0 tx=0).stop 2023-05-12T09:08:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 -- 172.21.15.116:0/2638949431 shutdown_connections 2023-05-12T09:08:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7be406ace0 0x7f7be406d190 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7c040b0560 0x7f7c040b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.615 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bec003a50 0x7f7c04071480 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.616 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 --2- 172.21.15.116:0/2638949431 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7c040c5ad0 0x7f7c0414f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.616 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 -- 172.21.15.116:0/2638949431 >> 172.21.15.116:0/2638949431 conn(0x7f7c040cf720 msgr2=0x7f7c04153240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:59.616 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 -- 172.21.15.116:0/2638949431 shutdown_connections 2023-05-12T09:08:59.617 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.610+0000 7f7c08dff700 1 -- 172.21.15.116:0/2638949431 wait complete. 2023-05-12T09:08:59.630 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-12T09:08:59.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.817+0000 7f2586bff700 1 Processor -- start 2023-05-12T09:08:59.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.818+0000 7f2586bff700 1 -- start start 2023-05-12T09:08:59.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f2586bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f25800cf010 0x7f2580160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f2586bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f25800cff50 0x7f25800d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f2586bff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25800cd520 con 0x7f258015c590 2023-05-12T09:08:59.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f2586bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25800d2640 con 0x7f25800cf010 2023-05-12T09:08:59.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f2586bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25801610d0 con 0x7f25800cff50 2023-05-12T09:08:59.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f258499b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f258015c590 0x7f25800cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60268/0 (socket says 172.21.15.116:60268) 2023-05-12T09:08:59.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f258499b700 1 -- 172.21.15.116:0/2458326193 learned_addr learned my addr 172.21.15.116:0/2458326193 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:08:59.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f257ffff700 1 --2- 172.21.15.116:0/2458326193 >> v2:172.21.15.182:3300/0 conn(0x7f25800cf010 0x7f2580160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f258519c700 1 --2- 172.21.15.116:0/2458326193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f25800cff50 0x7f25800d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f257f7fe700 1 -- 172.21.15.116:0/2458326193 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561358220 0 0) 0x7f25800cd520 con 0x7f258015c590 2023-05-12T09:08:59.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.819+0000 7f257f7fe700 1 -- 172.21.15.116:0/2458326193 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25700035b0 con 0x7f258015c590 2023-05-12T09:08:59.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.820+0000 7f258519c700 1 -- 172.21.15.116:0/2458326193 >> v2:172.21.15.182:3300/0 conn(0x7f25800cf010 msgr2=0x7f2580160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:08:59.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.820+0000 7f257f7fe700 1 -- 172.21.15.116:0/2458326193 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 138637331 0 0) 0x7f25700035b0 con 0x7f258015c590 2023-05-12T09:08:59.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.820+0000 7f258519c700 1 --2- 172.21.15.116:0/2458326193 >> v2:172.21.15.182:3300/0 conn(0x7f25800cf010 0x7f2580160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.820+0000 7f258519c700 1 -- 172.21.15.116:0/2458326193 >> v1:172.21.15.116:6789/0 conn(0x7f258015c590 legacy=0x7f25800cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.820+0000 7f258519c700 1 -- 172.21.15.116:0/2458326193 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800b23c0 con 0x7f25800cff50 2023-05-12T09:08:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.820+0000 7f257ffff700 1 --2- 172.21.15.116:0/2458326193 >> v2:172.21.15.182:3300/0 conn(0x7f25800cf010 0x7f2580160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.820+0000 7f258519c700 1 --2- 172.21.15.116:0/2458326193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f25800cff50 0x7f25800d2ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2578009d90 tx=0x7f257800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df95d48dcd1790e1 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.820+0000 7f257f7fe700 1 -- 172.21.15.116:0/2458326193 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257800e070 con 0x7f25800cff50 2023-05-12T09:08:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.820+0000 7f257f7fe700 1 -- 172.21.15.116:0/2458326193 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2578003a20 con 0x7f25800cff50 2023-05-12T09:08:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.820+0000 7f257f7fe700 1 -- 172.21.15.116:0/2458326193 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574001670 con 0x7f25800cff50 2023-05-12T09:08:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.821+0000 7f2586bff700 1 -- 172.21.15.116:0/2458326193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f25800cff50 msgr2=0x7f25800d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.821+0000 7f2586bff700 1 --2- 172.21.15.116:0/2458326193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f25800cff50 0x7f25800d2ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2578009d90 tx=0x7f257800b330 comp rx=0 tx=0).stop 2023-05-12T09:08:59.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.821+0000 7f2586bff700 1 -- 172.21.15.116:0/2458326193 shutdown_connections 2023-05-12T09:08:59.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.821+0000 7f2586bff700 1 --2- 172.21.15.116:0/2458326193 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f25800cff50 0x7f25800d2ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.821+0000 7f2586bff700 1 --2- 172.21.15.116:0/2458326193 >> v2:172.21.15.182:3300/0 conn(0x7f25800cf010 0x7f2580160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.821+0000 7f2586bff700 1 -- 172.21.15.116:0/2458326193 >> 172.21.15.116:0/2458326193 conn(0x7f2580071b10 msgr2=0x7f2580071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:08:59.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.821+0000 7f2586bff700 1 -- 172.21.15.116:0/2458326193 shutdown_connections 2023-05-12T09:08:59.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.821+0000 7f2586bff700 1 -- 172.21.15.116:0/2458326193 wait complete. 2023-05-12T09:08:59.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.823+0000 7f2586bff700 1 Processor -- start 2023-05-12T09:08:59.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.823+0000 7f2586bff700 1 -- start start 2023-05-12T09:08:59.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f2586bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25800cf010 0x7f25800b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f2586bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f25800cff50 0x7f258015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f2586bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f258015c590 0x7f258015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f2586bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25800b7650 con 0x7f25800cf010 2023-05-12T09:08:59.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f2586bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25800b7930 con 0x7f25800cff50 2023-05-12T09:08:59.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f2586bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25800b7c10 con 0x7f258015c590 2023-05-12T09:08:59.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f258499b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25800cf010 0x7f25800b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f258499b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25800cf010 0x7f25800b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51402/0 (socket says 172.21.15.116:51402) 2023-05-12T09:08:59.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f258499b700 1 -- 172.21.15.116:0/1740741438 learned_addr learned my addr 172.21.15.116:0/1740741438 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:08:59.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f258519c700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f258015c590 0x7f258015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f257ffff700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f25800cff50 0x7f258015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.824+0000 7f258499b700 1 -- 172.21.15.116:0/1740741438 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f258015c590 msgr2=0x7f258015d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f258499b700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f258015c590 0x7f258015d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f258499b700 1 -- 172.21.15.116:0/1740741438 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f25800cff50 msgr2=0x7f258015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:08:59.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f258499b700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f25800cff50 0x7f258015cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:08:59.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f258499b700 1 -- 172.21.15.116:0/1740741438 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c0094a0 con 0x7f25800cf010 2023-05-12T09:08:59.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f258519c700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f258015c590 0x7f258015d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:08:59.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f258499b700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25800cf010 0x7f25800b6d50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f257400c550 tx=0x7f257400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:59.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f257d7fa700 1 -- 172.21.15.116:0/1740741438 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574004c80 con 0x7f25800cf010 2023-05-12T09:08:59.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f257d7fa700 1 -- 172.21.15.116:0/1740741438 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574004de0 con 0x7f25800cf010 2023-05-12T09:08:59.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f2586bff700 1 -- 172.21.15.116:0/1740741438 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2578009a70 con 0x7f25800cf010 2023-05-12T09:08:59.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f257d7fa700 1 -- 172.21.15.116:0/1740741438 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740072f0 con 0x7f25800cf010 2023-05-12T09:08:59.832 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.825+0000 7f2586bff700 1 -- 172.21.15.116:0/1740741438 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25800cd770 con 0x7f25800cf010 2023-05-12T09:08:59.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.826+0000 7f2586bff700 1 -- 172.21.15.116:0/1740741438 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25800cf560 con 0x7f25800cf010 2023-05-12T09:08:59.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.827+0000 7f257d7fa700 1 -- 172.21.15.116:0/1740741438 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2574007450 con 0x7f25800cf010 2023-05-12T09:08:59.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.828+0000 7f257d7fa700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f256406ace0 0x7f256406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:08:59.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.828+0000 7f257d7fa700 1 -- 172.21.15.116:0/1740741438 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2574088e90 con 0x7f25800cf010 2023-05-12T09:08:59.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.829+0000 7f257ffff700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f256406ace0 0x7f256406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:08:59.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.829+0000 7f257ffff700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f256406ace0 0x7f256406d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f256c009cd0 tx=0x7f256c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:08:59.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:08:59.832+0000 7f257d7fa700 1 -- 172.21.15.116:0/1740741438 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f25740541e0 con 0x7f25800cf010 2023-05-12T09:09:00.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.104+0000 7f2586bff700 1 -- 172.21.15.116:0/1740741438 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f258015c960 con 0x7f25800cf010 2023-05-12T09:09:00.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.109+0000 7f257d7fa700 1 -- 172.21.15.116:0/1740741438 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2574007700 con 0x7f25800cf010 2023-05-12T09:09:00.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 -- 172.21.15.116:0/1740741438 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f256406ace0 msgr2=0x7f256406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f256406ace0 0x7f256406d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f256c009cd0 tx=0x7f256c009210 comp rx=0 tx=0).stop 2023-05-12T09:09:00.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 -- 172.21.15.116:0/1740741438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25800cf010 msgr2=0x7f25800b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25800cf010 0x7f25800b6d50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f257400c550 tx=0x7f257400c860 comp rx=0 tx=0).stop 2023-05-12T09:09:00.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 -- 172.21.15.116:0/1740741438 shutdown_connections 2023-05-12T09:09:00.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f256406ace0 0x7f256406d190 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f258015c590 0x7f258015d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25800cf010 0x7f25800b6d50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 --2- 172.21.15.116:0/1740741438 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f25800cff50 0x7f258015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 -- 172.21.15.116:0/1740741438 >> 172.21.15.116:0/1740741438 conn(0x7f2580071b10 msgr2=0x7f25800d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:00.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 -- 172.21.15.116:0/1740741438 shutdown_connections 2023-05-12T09:09:00.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.111+0000 7f2586bff700 1 -- 172.21.15.116:0/1740741438 wait complete. 2023-05-12T09:09:00.131 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-12T09:09:00.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.315+0000 7f7a179ff700 1 Processor -- start 2023-05-12T09:09:00.318 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.315+0000 7f7a179ff700 1 -- start start 2023-05-12T09:09:00.319 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.316+0000 7f7a179ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f7a100cd790 0x7f7a100ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.319 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.316+0000 7f7a179ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100b1d50 0x7f7a1006b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.319 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.316+0000 7f7a179ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1006a5f0 con 0x7f7a100cdb60 2023-05-12T09:09:00.319 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.316+0000 7f7a179ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1006a840 con 0x7f7a100cd790 2023-05-12T09:09:00.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.316+0000 7f7a179ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1006ab20 con 0x7f7a100b1d50 2023-05-12T09:09:00.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.316+0000 7f7a14f9a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f7a100cdb60 0x7f7a100b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60282/0 (socket says 172.21.15.116:60282) 2023-05-12T09:09:00.320 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.316+0000 7f7a14f9a700 1 -- 172.21.15.116:0/712257042 learned_addr learned my addr 172.21.15.116:0/712257042 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:00.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.317+0000 7f7a15f9c700 1 --2- 172.21.15.116:0/712257042 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100b1d50 0x7f7a1006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.322 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.317+0000 7f7a1579b700 1 --2- 172.21.15.116:0/712257042 >> v2:172.21.15.182:3300/0 conn(0x7f7a100cd790 0x7f7a100ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.317+0000 7f7a07fff700 1 -- 172.21.15.116:0/712257042 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895955614 0 0) 0x7f7a1006a5f0 con 0x7f7a100cdb60 2023-05-12T09:09:00.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.317+0000 7f7a07fff700 1 -- 172.21.15.116:0/712257042 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79fc0035b0 con 0x7f7a100cdb60 2023-05-12T09:09:00.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.317+0000 7f7a15f9c700 1 -- 172.21.15.116:0/712257042 >> v2:172.21.15.182:3300/0 conn(0x7f7a100cd790 msgr2=0x7f7a100ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:00.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.317+0000 7f7a15f9c700 1 --2- 172.21.15.116:0/712257042 >> v2:172.21.15.182:3300/0 conn(0x7f7a100cd790 0x7f7a100ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.317+0000 7f7a15f9c700 1 -- 172.21.15.116:0/712257042 >> v1:172.21.15.116:6789/0 conn(0x7f7a100cdb60 legacy=0x7f7a100b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.317+0000 7f7a15f9c700 1 -- 172.21.15.116:0/712257042 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1006ae00 con 0x7f7a100b1d50 2023-05-12T09:09:00.323 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.317+0000 7f7a1579b700 1 --2- 172.21.15.116:0/712257042 >> v2:172.21.15.182:3300/0 conn(0x7f7a100cd790 0x7f7a100ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:09:00.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.317+0000 7f7a15f9c700 1 --2- 172.21.15.116:0/712257042 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100b1d50 0x7f7a1006b600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009dc0 tx=0x7f7a0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eda5a3ba74b2aa5 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:00.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a07fff700 1 -- 172.21.15.116:0/712257042 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800e070 con 0x7f7a100b1d50 2023-05-12T09:09:00.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a07fff700 1 -- 172.21.15.116:0/712257042 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0800bae0 con 0x7f7a100b1d50 2023-05-12T09:09:00.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a07fff700 1 -- 172.21.15.116:0/712257042 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800be90 con 0x7f7a100b1d50 2023-05-12T09:09:00.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a179ff700 1 -- 172.21.15.116:0/712257042 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100b1d50 msgr2=0x7f7a1006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a179ff700 1 --2- 172.21.15.116:0/712257042 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100b1d50 0x7f7a1006b600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009dc0 tx=0x7f7a0800b330 comp rx=0 tx=0).stop 2023-05-12T09:09:00.324 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a179ff700 1 -- 172.21.15.116:0/712257042 shutdown_connections 2023-05-12T09:09:00.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a179ff700 1 --2- 172.21.15.116:0/712257042 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100b1d50 0x7f7a1006b600 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a179ff700 1 --2- 172.21.15.116:0/712257042 >> v2:172.21.15.182:3300/0 conn(0x7f7a100cd790 0x7f7a100ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a179ff700 1 -- 172.21.15.116:0/712257042 >> 172.21.15.116:0/712257042 conn(0x7f7a1006e980 msgr2=0x7f7a100cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:00.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a179ff700 1 -- 172.21.15.116:0/712257042 shutdown_connections 2023-05-12T09:09:00.325 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.318+0000 7f7a179ff700 1 -- 172.21.15.116:0/712257042 wait complete. 2023-05-12T09:09:00.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.320+0000 7f7a179ff700 1 Processor -- start 2023-05-12T09:09:00.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.320+0000 7f7a179ff700 1 -- start start 2023-05-12T09:09:00.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a179ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7a100b1d50 0x7f7a100af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a179ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a100cd790 0x7f7a100b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.327 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a179ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100cdb60 0x7f7a100b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a179ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10152930 con 0x7f7a100cd790 2023-05-12T09:09:00.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a179ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100b1030 con 0x7f7a100b1d50 2023-05-12T09:09:00.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a179ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100b0ba0 con 0x7f7a100cdb60 2023-05-12T09:09:00.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a14f9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a100cd790 0x7f7a100b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a14f9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a100cd790 0x7f7a100b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51412/0 (socket says 172.21.15.116:51412) 2023-05-12T09:09:00.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a14f9a700 1 -- 172.21.15.116:0/274055006 learned_addr learned my addr 172.21.15.116:0/274055006 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:00.328 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a1579b700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7a100b1d50 0x7f7a100af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.321+0000 7f7a15f9c700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100cdb60 0x7f7a100b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a14f9a700 1 -- 172.21.15.116:0/274055006 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100cdb60 msgr2=0x7f7a100b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a14f9a700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100cdb60 0x7f7a100b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a14f9a700 1 -- 172.21.15.116:0/274055006 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7a100b1d50 msgr2=0x7f7a100af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a14f9a700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7a100b1d50 0x7f7a100af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a14f9a700 1 -- 172.21.15.116:0/274055006 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c0094a0 con 0x7f7a100cd790 2023-05-12T09:09:00.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a1579b700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7a100b1d50 0x7f7a100af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:09:00.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a14f9a700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a100cd790 0x7f7a100b29f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000c730 tx=0x7f7a0000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:00.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a05ffb700 1 -- 172.21.15.116:0/274055006 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00005d70 con 0x7f7a100cd790 2023-05-12T09:09:00.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a05ffb700 1 -- 172.21.15.116:0/274055006 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a000070d0 con 0x7f7a100cd790 2023-05-12T09:09:00.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a179ff700 1 -- 172.21.15.116:0/274055006 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a08009a70 con 0x7f7a100cd790 2023-05-12T09:09:00.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a05ffb700 1 -- 172.21.15.116:0/274055006 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00007440 con 0x7f7a100cd790 2023-05-12T09:09:00.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.322+0000 7f7a179ff700 1 -- 172.21.15.116:0/274055006 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a100ce000 con 0x7f7a100cd790 2023-05-12T09:09:00.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.323+0000 7f7a179ff700 1 -- 172.21.15.116:0/274055006 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1006b0e0 con 0x7f7a100cd790 2023-05-12T09:09:00.330 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.324+0000 7f7a05ffb700 1 -- 172.21.15.116:0/274055006 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a000075a0 con 0x7f7a100cd790 2023-05-12T09:09:00.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.325+0000 7f7a05ffb700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f79f406ace0 0x7f79f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.325+0000 7f7a05ffb700 1 -- 172.21.15.116:0/274055006 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7a00088760 con 0x7f7a100cd790 2023-05-12T09:09:00.331 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.325+0000 7f7a1579b700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f79f406ace0 0x7f79f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.326+0000 7f7a1579b700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f79f406ace0 0x7f79f406d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009d20 tx=0x7f7a0c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:00.332 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.329+0000 7f7a05ffb700 1 -- 172.21.15.116:0/274055006 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7a00053a30 con 0x7f7a100cd790 2023-05-12T09:09:00.601 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.598+0000 7f7a179ff700 1 -- 172.21.15.116:0/274055006 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f7a1015ca20 con 0x7f7a100cd790 2023-05-12T09:09:00.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.602+0000 7f7a05ffb700 1 -- 172.21.15.116:0/274055006 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7a00057050 con 0x7f7a100cd790 2023-05-12T09:09:00.608 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 -- 172.21.15.116:0/274055006 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f79f406ace0 msgr2=0x7f79f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.608 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f79f406ace0 0x7f79f406d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009d20 tx=0x7f7a0c008040 comp rx=0 tx=0).stop 2023-05-12T09:09:00.608 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 -- 172.21.15.116:0/274055006 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a100cd790 msgr2=0x7f7a100b29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.608 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a100cd790 0x7f7a100b29f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000c730 tx=0x7f7a0000caf0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 -- 172.21.15.116:0/274055006 shutdown_connections 2023-05-12T09:09:00.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f79f406ace0 0x7f79f406d190 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a100cdb60 0x7f7a100b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7a100b1d50 0x7f7a100af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 --2- 172.21.15.116:0/274055006 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a100cd790 0x7f7a100b29f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 -- 172.21.15.116:0/274055006 >> 172.21.15.116:0/274055006 conn(0x7f7a1006e980 msgr2=0x7f7a100ca850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:00.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 -- 172.21.15.116:0/274055006 shutdown_connections 2023-05-12T09:09:00.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.605+0000 7f7a179ff700 1 -- 172.21.15.116:0/274055006 wait complete. 2023-05-12T09:09:00.625 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:09:00.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.808+0000 7f06c55ff700 1 Processor -- start 2023-05-12T09:09:00.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.808+0000 7f06c55ff700 1 -- start start 2023-05-12T09:09:00.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.809+0000 7f06c55ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f06c015a5a0 0x7f06c006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.809+0000 7f06c55ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f06c006a920 0x7f06c0070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.809+0000 7f06c55ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c00cb280 con 0x7f06c0071030 2023-05-12T09:09:00.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.809+0000 7f06c55ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c006adc0 con 0x7f06c015a5a0 2023-05-12T09:09:00.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.809+0000 7f06c55ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c015a970 con 0x7f06c006a920 2023-05-12T09:09:00.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.809+0000 7f06beffd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f06c015a5a0 0x7f06c006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.809+0000 7f06bf7fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f06c0071030 0x7f06c015dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60288/0 (socket says 172.21.15.116:60288) 2023-05-12T09:09:00.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.809+0000 7f06bf7fe700 1 -- 172.21.15.116:0/3035197572 learned_addr learned my addr 172.21.15.116:0/3035197572 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:00.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.809+0000 7f06b7fff700 1 --2- 172.21.15.116:0/3035197572 >> v2:172.21.15.182:3300/0 conn(0x7f06c006a920 0x7f06c0070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.810+0000 7f06beffd700 1 -- 172.21.15.116:0/3035197572 >> v2:172.21.15.182:3300/0 conn(0x7f06c006a920 msgr2=0x7f06c0070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:00.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.810+0000 7f06beffd700 1 --2- 172.21.15.116:0/3035197572 >> v2:172.21.15.182:3300/0 conn(0x7f06c006a920 0x7f06c0070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.810+0000 7f06beffd700 1 -- 172.21.15.116:0/3035197572 >> v1:172.21.15.116:6789/0 conn(0x7f06c0071030 legacy=0x7f06c015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.810+0000 7f06beffd700 1 -- 172.21.15.116:0/3035197572 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0071470 con 0x7f06c015a5a0 2023-05-12T09:09:00.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.810+0000 7f06be7fc700 1 -- 172.21.15.116:0/3035197572 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307364964 0 0) 0x7f06b8001490 con 0x7f06c0071030 2023-05-12T09:09:00.815 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.810+0000 7f06beffd700 1 --2- 172.21.15.116:0/3035197572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 0x7f06c006a3e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f06c006f0c0 tx=0x7f06b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67e41c0bc2841b5 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:00.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.810+0000 7f06be7fc700 1 -- 172.21.15.116:0/3035197572 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0011830 con 0x7f06c015a5a0 2023-05-12T09:09:00.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.810+0000 7f06be7fc700 1 -- 172.21.15.116:0/3035197572 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0011990 con 0x7f06c015a5a0 2023-05-12T09:09:00.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.810+0000 7f06be7fc700 1 -- 172.21.15.116:0/3035197572 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0011d20 con 0x7f06c015a5a0 2023-05-12T09:09:00.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.811+0000 7f06c55ff700 1 -- 172.21.15.116:0/3035197572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 msgr2=0x7f06c006a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.811+0000 7f06c55ff700 1 --2- 172.21.15.116:0/3035197572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 0x7f06c006a3e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f06c006f0c0 tx=0x7f06b0009b50 comp rx=0 tx=0).stop 2023-05-12T09:09:00.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.811+0000 7f06c55ff700 1 -- 172.21.15.116:0/3035197572 shutdown_connections 2023-05-12T09:09:00.816 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.811+0000 7f06c55ff700 1 --2- 172.21.15.116:0/3035197572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 0x7f06c006a3e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.811+0000 7f06c55ff700 1 --2- 172.21.15.116:0/3035197572 >> v2:172.21.15.182:3300/0 conn(0x7f06c006a920 0x7f06c0070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.811+0000 7f06c55ff700 1 -- 172.21.15.116:0/3035197572 >> 172.21.15.116:0/3035197572 conn(0x7f06c00cf720 msgr2=0x7f06c00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:00.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.811+0000 7f06c55ff700 1 -- 172.21.15.116:0/3035197572 shutdown_connections 2023-05-12T09:09:00.817 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.811+0000 7f06c55ff700 1 -- 172.21.15.116:0/3035197572 wait complete. 2023-05-12T09:09:00.818 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.813+0000 7f06c55ff700 1 Processor -- start 2023-05-12T09:09:00.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.814+0000 7f06c55ff700 1 -- start start 2023-05-12T09:09:00.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06c55ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06c006a920 0x7f06c00c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06c55ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06c0071030 0x7f06c0157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06c55ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 0x7f06c01587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06c55ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0156c00 con 0x7f06c015a5a0 2023-05-12T09:09:00.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06c55ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0157cb0 con 0x7f06c006a920 2023-05-12T09:09:00.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06c55ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0156480 con 0x7f06c0071030 2023-05-12T09:09:00.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06bf7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 0x7f06c01587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06bf7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 0x7f06c01587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51424/0 (socket says 172.21.15.116:51424) 2023-05-12T09:09:00.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06bf7fe700 1 -- 172.21.15.116:0/107001804 learned_addr learned my addr 172.21.15.116:0/107001804 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:00.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06beffd700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06c006a920 0x7f06c00c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06b7fff700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06c0071030 0x7f06c0157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06bf7fe700 1 -- 172.21.15.116:0/107001804 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06c0071030 msgr2=0x7f06c0157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06bf7fe700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06c0071030 0x7f06c0157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06bf7fe700 1 -- 172.21.15.116:0/107001804 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06c006a920 msgr2=0x7f06c00c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:00.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06bf7fe700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06c006a920 0x7f06c00c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:00.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06bf7fe700 1 -- 172.21.15.116:0/107001804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b00094a0 con 0x7f06c015a5a0 2023-05-12T09:09:00.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06beffd700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06c006a920 0x7f06c00c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:00.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06b7fff700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06c0071030 0x7f06c0157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:00.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.815+0000 7f06bf7fe700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 0x7f06c01587e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f06b800cca0 tx=0x7f06b800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:00.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.816+0000 7f06b77fe700 1 -- 172.21.15.116:0/107001804 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b800cea0 con 0x7f06c015a5a0 2023-05-12T09:09:00.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.816+0000 7f06b77fe700 1 -- 172.21.15.116:0/107001804 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b800ade0 con 0x7f06c015a5a0 2023-05-12T09:09:00.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.816+0000 7f06c55ff700 1 -- 172.21.15.116:0/107001804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c00719e0 con 0x7f06c015a5a0 2023-05-12T09:09:00.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.816+0000 7f06b77fe700 1 -- 172.21.15.116:0/107001804 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8007310 con 0x7f06c015a5a0 2023-05-12T09:09:00.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.816+0000 7f06c55ff700 1 -- 172.21.15.116:0/107001804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c0071700 con 0x7f06c015a5a0 2023-05-12T09:09:00.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.817+0000 7f06c55ff700 1 -- 172.21.15.116:0/107001804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c006c6c0 con 0x7f06c015a5a0 2023-05-12T09:09:00.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.818+0000 7f06b77fe700 1 -- 172.21.15.116:0/107001804 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06b8007470 con 0x7f06c015a5a0 2023-05-12T09:09:00.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.819+0000 7f06b77fe700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06a006ace0 0x7f06a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:00.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.819+0000 7f06b77fe700 1 -- 172.21.15.116:0/107001804 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f06b8088c40 con 0x7f06c015a5a0 2023-05-12T09:09:00.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.819+0000 7f06beffd700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06a006ace0 0x7f06a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:00.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.820+0000 7f06beffd700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06a006ace0 0x7f06a006d190 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f06b0000c00 tx=0x7f06b001c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:00.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:00.824+0000 7f06b77fe700 1 -- 172.21.15.116:0/107001804 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f06b8053f90 con 0x7f06c015a5a0 2023-05-12T09:09:01.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.019+0000 7f06c55ff700 1 -- 172.21.15.116:0/107001804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06c0074460 con 0x7f06c015a5a0 2023-05-12T09:09:01.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.020+0000 7f06b77fe700 1 -- 172.21.15.116:0/107001804 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+14810 (secure 0 0 0) 0x7f06b8018090 con 0x7f06c015a5a0 2023-05-12T09:09:01.023 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:01.024 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":35,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:08:57.123386+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:09:01.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.022+0000 7f06c55ff700 1 -- 172.21.15.116:0/107001804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06a006ace0 msgr2=0x7f06a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.022+0000 7f06c55ff700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06a006ace0 0x7f06a006d190 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f06b0000c00 tx=0x7f06b001c040 comp rx=0 tx=0).stop 2023-05-12T09:09:01.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.022+0000 7f06c55ff700 1 -- 172.21.15.116:0/107001804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 msgr2=0x7f06c01587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.022+0000 7f06c55ff700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 0x7f06c01587e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f06b800cca0 tx=0x7f06b800a340 comp rx=0 tx=0).stop 2023-05-12T09:09:01.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.023+0000 7f06c55ff700 1 -- 172.21.15.116:0/107001804 shutdown_connections 2023-05-12T09:09:01.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.023+0000 7f06c55ff700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06c015a5a0 0x7f06c01587e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.023+0000 7f06c55ff700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f06c006a920 0x7f06c00c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.023+0000 7f06c55ff700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f06a006ace0 0x7f06a006d190 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.023+0000 7f06c55ff700 1 --2- 172.21.15.116:0/107001804 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f06c0071030 0x7f06c0157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.023+0000 7f06c55ff700 1 -- 172.21.15.116:0/107001804 >> 172.21.15.116:0/107001804 conn(0x7f06c00cf720 msgr2=0x7f06c00b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:01.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.023+0000 7f06c55ff700 1 -- 172.21.15.116:0/107001804 shutdown_connections 2023-05-12T09:09:01.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.023+0000 7f06c55ff700 1 -- 172.21.15.116:0/107001804 wait complete. 2023-05-12T09:09:01.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-05-12T09:07:03.219127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-05-12T09:07:03.622639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-12T09:09:01.044 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-12T09:09:01.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.227+0000 7fd80afff700 1 Processor -- start 2023-05-12T09:09:01.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.227+0000 7fd80afff700 1 -- start start 2023-05-12T09:09:01.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.228+0000 7fd80afff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd8040cfbf0 0x7fd8041608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.228+0000 7fd80afff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040d0020 con 0x7fd8040d1100 2023-05-12T09:09:01.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.228+0000 7fd80afff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040cdc60 con 0x7fd8040b87a0 2023-05-12T09:09:01.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.228+0000 7fd80afff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040d02d0 con 0x7fd8040cfbf0 2023-05-12T09:09:01.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.229+0000 7fd803fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd8040cfbf0 0x7fd8041608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.229+0000 7fd80959c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd8040d1100 0x7fd8040d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60298/0 (socket says 172.21.15.116:60298) 2023-05-12T09:09:01.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.229+0000 7fd80959c700 1 -- 172.21.15.116:0/1130105307 learned_addr learned my addr 172.21.15.116:0/1130105307 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:01.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.229+0000 7fd803fff700 1 -- 172.21.15.116:0/1130105307 >> v1:172.21.15.182:6789/0 conn(0x7fd8040b87a0 legacy=0x7fd8041601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.229+0000 7fd803fff700 1 -- 172.21.15.116:0/1130105307 >> v1:172.21.15.116:6789/0 conn(0x7fd8040d1100 legacy=0x7fd8040d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.229+0000 7fd803fff700 1 -- 172.21.15.116:0/1130105307 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040cd6a0 con 0x7fd8040cfbf0 2023-05-12T09:09:01.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.229+0000 7fd8037fe700 1 -- 172.21.15.116:0/1130105307 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955595146 0 0) 0x7fd8040d0020 con 0x7fd8040d1100 2023-05-12T09:09:01.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.229+0000 7fd803fff700 1 --2- 172.21.15.116:0/1130105307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040cfbf0 0x7fd8041608f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009840 tx=0x7fd7f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2389a41bb55698 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:01.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.230+0000 7fd8037fe700 1 -- 172.21.15.116:0/1130105307 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0011830 con 0x7fd8040cfbf0 2023-05-12T09:09:01.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.230+0000 7fd8037fe700 1 -- 172.21.15.116:0/1130105307 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f0011990 con 0x7fd8040cfbf0 2023-05-12T09:09:01.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.230+0000 7fd8037fe700 1 -- 172.21.15.116:0/1130105307 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0011d20 con 0x7fd8040cfbf0 2023-05-12T09:09:01.235 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.230+0000 7fd80afff700 1 -- 172.21.15.116:0/1130105307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040cfbf0 msgr2=0x7fd8041608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.235 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.230+0000 7fd80afff700 1 --2- 172.21.15.116:0/1130105307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040cfbf0 0x7fd8041608f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009840 tx=0x7fd7f0009b50 comp rx=0 tx=0).stop 2023-05-12T09:09:01.235 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.230+0000 7fd80afff700 1 -- 172.21.15.116:0/1130105307 shutdown_connections 2023-05-12T09:09:01.235 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.230+0000 7fd80afff700 1 --2- 172.21.15.116:0/1130105307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040cfbf0 0x7fd8041608f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.236 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.230+0000 7fd80afff700 1 -- 172.21.15.116:0/1130105307 >> 172.21.15.116:0/1130105307 conn(0x7fd804071b10 msgr2=0x7fd804071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:01.236 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.230+0000 7fd80afff700 1 -- 172.21.15.116:0/1130105307 shutdown_connections 2023-05-12T09:09:01.236 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.230+0000 7fd80afff700 1 -- 172.21.15.116:0/1130105307 wait complete. 2023-05-12T09:09:01.236 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.232+0000 7fd80afff700 1 Processor -- start 2023-05-12T09:09:01.236 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.232+0000 7fd80afff700 1 -- start start 2023-05-12T09:09:01.237 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd80afff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040b87a0 0x7fd80415e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd80afff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd8040cfbf0 0x7fd80414c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd80afff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8040d1100 0x7fd80415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd80afff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80414cb40 con 0x7fd8040b87a0 2023-05-12T09:09:01.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd80afff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80415ee40 con 0x7fd8040d1100 2023-05-12T09:09:01.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd80afff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80415f120 con 0x7fd8040cfbf0 2023-05-12T09:09:01.238 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd808d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040b87a0 0x7fd80415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd808d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040b87a0 0x7fd80415e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51434/0 (socket says 172.21.15.116:51434) 2023-05-12T09:09:01.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd808d9b700 1 -- 172.21.15.116:0/67812025 learned_addr learned my addr 172.21.15.116:0/67812025 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:01.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd80959c700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8040d1100 0x7fd80415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.233+0000 7fd803fff700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd8040cfbf0 0x7fd80414c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.239 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd808d9b700 1 -- 172.21.15.116:0/67812025 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd8040cfbf0 msgr2=0x7fd80414c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd808d9b700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd8040cfbf0 0x7fd80414c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd808d9b700 1 -- 172.21.15.116:0/67812025 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8040d1100 msgr2=0x7fd80415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd808d9b700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8040d1100 0x7fd80415c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd808d9b700 1 -- 172.21.15.116:0/67812025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00094a0 con 0x7fd8040b87a0 2023-05-12T09:09:01.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd808d9b700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040b87a0 0x7fd80415e840 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800c4e0 tx=0x7fd7f800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:01.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd8017fa700 1 -- 172.21.15.116:0/67812025 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80052d0 con 0x7fd8040b87a0 2023-05-12T09:09:01.240 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd8017fa700 1 -- 172.21.15.116:0/67812025 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8005430 con 0x7fd8040b87a0 2023-05-12T09:09:01.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd80afff700 1 -- 172.21.15.116:0/67812025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd804160e30 con 0x7fd8040b87a0 2023-05-12T09:09:01.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd8017fa700 1 -- 172.21.15.116:0/67812025 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80038c0 con 0x7fd8040b87a0 2023-05-12T09:09:01.241 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.234+0000 7fd80afff700 1 -- 172.21.15.116:0/67812025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8040cd980 con 0x7fd8040b87a0 2023-05-12T09:09:01.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.235+0000 7fd80afff700 1 -- 172.21.15.116:0/67812025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd804160fc0 con 0x7fd8040b87a0 2023-05-12T09:09:01.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.236+0000 7fd8017fa700 1 -- 172.21.15.116:0/67812025 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7f8003a20 con 0x7fd8040b87a0 2023-05-12T09:09:01.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.237+0000 7fd8017fa700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd7e806ace0 0x7fd7e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.237+0000 7fd8017fa700 1 -- 172.21.15.116:0/67812025 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd7f80886b0 con 0x7fd8040b87a0 2023-05-12T09:09:01.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.238+0000 7fd803fff700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd7e806ace0 0x7fd7e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.242 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.238+0000 7fd803fff700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd7e806ace0 0x7fd7e806d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00090b0 tx=0x7fd7f0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:01.244 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.241+0000 7fd8017fa700 1 -- 172.21.15.116:0/67812025 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd7f80538d0 con 0x7fd8040b87a0 2023-05-12T09:09:01.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.435+0000 7fd80afff700 1 -- 172.21.15.116:0/67812025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8040b52f0 con 0x7fd8040b87a0 2023-05-12T09:09:01.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.435+0000 7fd8017fa700 1 -- 172.21.15.116:0/67812025 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd7f8056ef0 con 0x7fd8040b87a0 2023-05-12T09:09:01.439 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 8 2023-05-12T09:09:01.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 -- 172.21.15.116:0/67812025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd7e806ace0 msgr2=0x7fd7e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd7e806ace0 0x7fd7e806d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00090b0 tx=0x7fd7f0008030 comp rx=0 tx=0).stop 2023-05-12T09:09:01.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 -- 172.21.15.116:0/67812025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040b87a0 msgr2=0x7fd80415e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040b87a0 0x7fd80415e840 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800c4e0 tx=0x7fd7f800c7f0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 -- 172.21.15.116:0/67812025 shutdown_connections 2023-05-12T09:09:01.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fd8040d1100 0x7fd80415c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8040b87a0 0x7fd80415e840 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fd7e806ace0 0x7fd7e806d190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 --2- 172.21.15.116:0/67812025 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fd8040cfbf0 0x7fd80414c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 -- 172.21.15.116:0/67812025 >> 172.21.15.116:0/67812025 conn(0x7fd804071b10 msgr2=0x7fd8040b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:01.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 -- 172.21.15.116:0/67812025 shutdown_connections 2023-05-12T09:09:01.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.438+0000 7fd80afff700 1 -- 172.21.15.116:0/67812025 wait complete. 2023-05-12T09:09:01.457 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-12T09:09:01.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.641+0000 7fb661dff700 1 Processor -- start 2023-05-12T09:09:01.644 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.641+0000 7fb661dff700 1 -- start start 2023-05-12T09:09:01.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.642+0000 7fb661dff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fb65c0cf010 0x7fb65c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.642+0000 7fb661dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb65c0cff50 0x7fb65c0d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.642+0000 7fb661dff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65c0cd520 con 0x7fb65c15c590 2023-05-12T09:09:01.646 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.642+0000 7fb661dff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65c0d2640 con 0x7fb65c0cf010 2023-05-12T09:09:01.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.642+0000 7fb661dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c1610d0 con 0x7fb65c0cff50 2023-05-12T09:09:01.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.642+0000 7fb65b7fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb65c15c590 0x7fb65c0cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:60306/0 (socket says 172.21.15.116:60306) 2023-05-12T09:09:01.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.643+0000 7fb65b7fe700 1 -- 172.21.15.116:0/710943097 learned_addr learned my addr 172.21.15.116:0/710943097 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:01.647 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.643+0000 7fb65affd700 1 --2- 172.21.15.116:0/710943097 >> v2:172.21.15.182:3300/0 conn(0x7fb65c0cf010 0x7fb65c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.643+0000 7fb65bfff700 1 --2- 172.21.15.116:0/710943097 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb65c0cff50 0x7fb65c0d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.643+0000 7fb65a7fc700 1 -- 172.21.15.116:0/710943097 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766921402 0 0) 0x7fb65c0cd520 con 0x7fb65c15c590 2023-05-12T09:09:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.643+0000 7fb65a7fc700 1 -- 172.21.15.116:0/710943097 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6440035b0 con 0x7fb65c15c590 2023-05-12T09:09:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.643+0000 7fb65affd700 1 -- 172.21.15.116:0/710943097 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb65c0cff50 msgr2=0x7fb65c0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.643+0000 7fb65affd700 1 --2- 172.21.15.116:0/710943097 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb65c0cff50 0x7fb65c0d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.643+0000 7fb65affd700 1 -- 172.21.15.116:0/710943097 >> v1:172.21.15.116:6789/0 conn(0x7fb65c15c590 legacy=0x7fb65c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.648 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.643+0000 7fb65affd700 1 -- 172.21.15.116:0/710943097 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c0b23c0 con 0x7fb65c0cf010 2023-05-12T09:09:01.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb65affd700 1 --2- 172.21.15.116:0/710943097 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb65c0cf010 0x7fb65c160b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb650009840 tx=0x7fb650009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76011411299682d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:01.650 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb65a7fc700 1 -- 172.21.15.116:0/710943097 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650011830 con 0x7fb65c0cf010 2023-05-12T09:09:01.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb65a7fc700 1 -- 172.21.15.116:0/710943097 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb650011990 con 0x7fb65c0cf010 2023-05-12T09:09:01.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb65a7fc700 1 -- 172.21.15.116:0/710943097 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650011d20 con 0x7fb65c0cf010 2023-05-12T09:09:01.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb661dff700 1 -- 172.21.15.116:0/710943097 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb65c0cf010 msgr2=0x7fb65c160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb661dff700 1 --2- 172.21.15.116:0/710943097 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb65c0cf010 0x7fb65c160b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb650009840 tx=0x7fb650009b50 comp rx=0 tx=0).stop 2023-05-12T09:09:01.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb661dff700 1 -- 172.21.15.116:0/710943097 shutdown_connections 2023-05-12T09:09:01.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb661dff700 1 --2- 172.21.15.116:0/710943097 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb65c0cff50 0x7fb65c0d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.651 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb661dff700 1 --2- 172.21.15.116:0/710943097 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb65c0cf010 0x7fb65c160b90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb661dff700 1 -- 172.21.15.116:0/710943097 >> 172.21.15.116:0/710943097 conn(0x7fb65c071b10 msgr2=0x7fb65c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb661dff700 1 -- 172.21.15.116:0/710943097 shutdown_connections 2023-05-12T09:09:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.644+0000 7fb661dff700 1 -- 172.21.15.116:0/710943097 wait complete. 2023-05-12T09:09:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.646+0000 7fb661dff700 1 Processor -- start 2023-05-12T09:09:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.646+0000 7fb661dff700 1 -- start start 2023-05-12T09:09:01.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.647+0000 7fb661dff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb65c0cf010 0x7fb65c1f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.647+0000 7fb661dff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65c0cff50 0x7fb65c1f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.647+0000 7fb661dff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb65c15c590 0x7fb65c0c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.647+0000 7fb661dff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c0b7160 con 0x7fb65c0cff50 2023-05-12T09:09:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.647+0000 7fb661dff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c0c9750 con 0x7fb65c0cf010 2023-05-12T09:09:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.647+0000 7fb661dff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c0c9a30 con 0x7fb65c15c590 2023-05-12T09:09:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.647+0000 7fb65affd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65c0cff50 0x7fb65c1f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.647+0000 7fb65affd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65c0cff50 0x7fb65c1f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51436/0 (socket says 172.21.15.116:51436) 2023-05-12T09:09:01.654 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.647+0000 7fb65affd700 1 -- 172.21.15.116:0/103402568 learned_addr learned my addr 172.21.15.116:0/103402568 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:01.655 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb65bfff700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb65c15c590 0x7fb65c0c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb65b7fe700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb65c0cf010 0x7fb65c1f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb65affd700 1 -- 172.21.15.116:0/103402568 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb65c15c590 msgr2=0x7fb65c0c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb65affd700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb65c15c590 0x7fb65c0c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb65affd700 1 -- 172.21.15.116:0/103402568 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb65c0cf010 msgr2=0x7fb65c1f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb65affd700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb65c0cf010 0x7fb65c1f5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb65affd700 1 -- 172.21.15.116:0/103402568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6500094a0 con 0x7fb65c0cff50 2023-05-12T09:09:01.656 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb65b7fe700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb65c0cf010 0x7fb65c1f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb65affd700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65c0cff50 0x7fb65c1f60e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb6500090b0 tx=0x7fb650004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb643fff700 1 -- 172.21.15.116:0/103402568 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6500036a0 con 0x7fb65c0cff50 2023-05-12T09:09:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb643fff700 1 -- 172.21.15.116:0/103402568 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65001f070 con 0x7fb65c0cff50 2023-05-12T09:09:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb661dff700 1 -- 172.21.15.116:0/103402568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65c0cd770 con 0x7fb65c0cff50 2023-05-12T09:09:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb643fff700 1 -- 172.21.15.116:0/103402568 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650003a40 con 0x7fb65c0cff50 2023-05-12T09:09:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.648+0000 7fb661dff700 1 -- 172.21.15.116:0/103402568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65c0cf560 con 0x7fb65c0cff50 2023-05-12T09:09:01.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.649+0000 7fb661dff700 1 -- 172.21.15.116:0/103402568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65c15c960 con 0x7fb65c0cff50 2023-05-12T09:09:01.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.650+0000 7fb643fff700 1 -- 172.21.15.116:0/103402568 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb650003ba0 con 0x7fb65c0cff50 2023-05-12T09:09:01.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.651+0000 7fb643fff700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb64806ace0 0x7fb64806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:01.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.651+0000 7fb643fff700 1 -- 172.21.15.116:0/103402568 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb650021070 con 0x7fb65c0cff50 2023-05-12T09:09:01.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.651+0000 7fb65b7fe700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb64806ace0 0x7fb64806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:01.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.652+0000 7fb65b7fe700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb64806ace0 0x7fb64806d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0011e0 tx=0x7fb64c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:01.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.656+0000 7fb643fff700 1 -- 172.21.15.116:0/103402568 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb650055da0 con 0x7fb65c0cff50 2023-05-12T09:09:01.852 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.849+0000 7fb661dff700 1 -- 172.21.15.116:0/103402568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb65c0b72a0 con 0x7fb65c0cff50 2023-05-12T09:09:01.853 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.850+0000 7fb643fff700 1 -- 172.21.15.116:0/103402568 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6500150a0 con 0x7fb65c0cff50 2023-05-12T09:09:01.853 INFO:teuthology.orchestra.run.smithi116.stdout:pg_num: 1 2023-05-12T09:09:01.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 -- 172.21.15.116:0/103402568 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb64806ace0 msgr2=0x7fb64806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb64806ace0 0x7fb64806d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0011e0 tx=0x7fb64c009040 comp rx=0 tx=0).stop 2023-05-12T09:09:01.855 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 -- 172.21.15.116:0/103402568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65c0cff50 msgr2=0x7fb65c1f60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:01.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65c0cff50 0x7fb65c1f60e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb6500090b0 tx=0x7fb650004750 comp rx=0 tx=0).stop 2023-05-12T09:09:01.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 -- 172.21.15.116:0/103402568 shutdown_connections 2023-05-12T09:09:01.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fb64806ace0 0x7fb64806d190 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb65c15c590 0x7fb65c0c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb65c0cf010 0x7fb65c1f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 --2- 172.21.15.116:0/103402568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65c0cff50 0x7fb65c1f60e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:01.856 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 -- 172.21.15.116:0/103402568 >> 172.21.15.116:0/103402568 conn(0x7fb65c071b10 msgr2=0x7fb65c071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:01.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 -- 172.21.15.116:0/103402568 shutdown_connections 2023-05-12T09:09:01.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:01.852+0000 7fb661dff700 1 -- 172.21.15.116:0/103402568 wait complete. 2023-05-12T09:09:01.874 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-12T09:09:02.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.055+0000 7efca7fff700 1 Processor -- start 2023-05-12T09:09:02.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.056+0000 7efca7fff700 1 -- start start 2023-05-12T09:09:02.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca7fff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7efca00d0130 0x7efca00cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca7fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efca00cbf90 0x7efca00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca7fff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca00b26f0 con 0x7efca006b4f0 2023-05-12T09:09:02.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca7fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca00cf890 con 0x7efca00cbf90 2023-05-12T09:09:02.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca7fff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca00cfb60 con 0x7efca00d0130 2023-05-12T09:09:02.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca659c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efca00cbf90 0x7efca00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca659c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efca00cbf90 0x7efca00cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35592/0 (socket says 172.21.15.116:35592) 2023-05-12T09:09:02.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca659c700 1 -- 172.21.15.116:0/3203019805 learned_addr learned my addr 172.21.15.116:0/3203019805 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:02.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca559a700 1 --2- 172.21.15.116:0/3203019805 >> v2:172.21.15.182:3300/0 conn(0x7efca00d0130 0x7efca00cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca659c700 1 -- 172.21.15.116:0/3203019805 >> v2:172.21.15.182:3300/0 conn(0x7efca00d0130 msgr2=0x7efca00cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:02.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca659c700 1 --2- 172.21.15.116:0/3203019805 >> v2:172.21.15.182:3300/0 conn(0x7efca00d0130 0x7efca00cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.057+0000 7efca659c700 1 -- 172.21.15.116:0/3203019805 >> v1:172.21.15.182:6789/0 conn(0x7efca006b4f0 legacy=0x7efca006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:02.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.058+0000 7efca659c700 1 -- 172.21.15.116:0/3203019805 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca00cfe40 con 0x7efca00cbf90 2023-05-12T09:09:02.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.058+0000 7efca559a700 1 --2- 172.21.15.116:0/3203019805 >> v2:172.21.15.182:3300/0 conn(0x7efca00d0130 0x7efca00cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:02.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.058+0000 7efca659c700 1 --2- 172.21.15.116:0/3203019805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca00cbf90 0x7efca00cc410 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efc98009e50 tx=0x7efc9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56a74e12a989916 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:02.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.058+0000 7efca4d99700 1 -- 172.21.15.116:0/3203019805 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800e070 con 0x7efca00cbf90 2023-05-12T09:09:02.063 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.058+0000 7efca4d99700 1 -- 172.21.15.116:0/3203019805 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc98003a20 con 0x7efca00cbf90 2023-05-12T09:09:02.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.058+0000 7efca4d99700 1 -- 172.21.15.116:0/3203019805 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98003dd0 con 0x7efca00cbf90 2023-05-12T09:09:02.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.059+0000 7efca7fff700 1 -- 172.21.15.116:0/3203019805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca00cbf90 msgr2=0x7efca00cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.059+0000 7efca7fff700 1 --2- 172.21.15.116:0/3203019805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca00cbf90 0x7efca00cc410 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efc98009e50 tx=0x7efc9800b330 comp rx=0 tx=0).stop 2023-05-12T09:09:02.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.059+0000 7efca7fff700 1 -- 172.21.15.116:0/3203019805 shutdown_connections 2023-05-12T09:09:02.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.059+0000 7efca7fff700 1 --2- 172.21.15.116:0/3203019805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca00cbf90 0x7efca00cc410 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.059+0000 7efca7fff700 1 --2- 172.21.15.116:0/3203019805 >> v2:172.21.15.182:3300/0 conn(0x7efca00d0130 0x7efca00cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.059+0000 7efca7fff700 1 -- 172.21.15.116:0/3203019805 >> 172.21.15.116:0/3203019805 conn(0x7efca009a090 msgr2=0x7efca00d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.059+0000 7efca7fff700 1 -- 172.21.15.116:0/3203019805 shutdown_connections 2023-05-12T09:09:02.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.059+0000 7efca7fff700 1 -- 172.21.15.116:0/3203019805 wait complete. 2023-05-12T09:09:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.060+0000 7efca7fff700 1 Processor -- start 2023-05-12T09:09:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.061+0000 7efca7fff700 1 -- start start 2023-05-12T09:09:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.061+0000 7efca7fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca006b4f0 0x7efca00c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.061+0000 7efca7fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efca00cbf90 0x7efca0151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.061+0000 7efca7fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efca00d0130 0x7efca01e5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.061+0000 7efca7fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca015c7e0 con 0x7efca006b4f0 2023-05-12T09:09:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.061+0000 7efca7fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca00c4e70 con 0x7efca00cbf90 2023-05-12T09:09:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.061+0000 7efca7fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca00caa40 con 0x7efca00d0130 2023-05-12T09:09:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca5d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca006b4f0 0x7efca00c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca5d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca006b4f0 0x7efca00c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35596/0 (socket says 172.21.15.116:35596) 2023-05-12T09:09:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca5d9b700 1 -- 172.21.15.116:0/3065691044 learned_addr learned my addr 172.21.15.116:0/3065691044 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca559a700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efca00cbf90 0x7efca0151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.068 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca659c700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efca00d0130 0x7efca01e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca5d9b700 1 -- 172.21.15.116:0/3065691044 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efca00d0130 msgr2=0x7efca01e5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca5d9b700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efca00d0130 0x7efca01e5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca5d9b700 1 -- 172.21.15.116:0/3065691044 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efca00cbf90 msgr2=0x7efca0151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca5d9b700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efca00cbf90 0x7efca0151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca5d9b700 1 -- 172.21.15.116:0/3065691044 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98009b30 con 0x7efca006b4f0 2023-05-12T09:09:02.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.062+0000 7efca5d9b700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca006b4f0 0x7efca00c7e90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00b4a0 tx=0x7efc9c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:02.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.063+0000 7efc967fc700 1 -- 172.21.15.116:0/3065691044 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c011830 con 0x7efca006b4f0 2023-05-12T09:09:02.069 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.063+0000 7efc967fc700 1 -- 172.21.15.116:0/3065691044 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c011990 con 0x7efca006b4f0 2023-05-12T09:09:02.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.063+0000 7efca7fff700 1 -- 172.21.15.116:0/3065691044 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca00cb790 con 0x7efca006b4f0 2023-05-12T09:09:02.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.063+0000 7efc967fc700 1 -- 172.21.15.116:0/3065691044 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c011d40 con 0x7efca006b4f0 2023-05-12T09:09:02.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.063+0000 7efca7fff700 1 -- 172.21.15.116:0/3065691044 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca00cb4b0 con 0x7efca006b4f0 2023-05-12T09:09:02.070 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.064+0000 7efca7fff700 1 -- 172.21.15.116:0/3065691044 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca00cba70 con 0x7efca006b4f0 2023-05-12T09:09:02.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.065+0000 7efc967fc700 1 -- 172.21.15.116:0/3065691044 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efc9c01a400 con 0x7efca006b4f0 2023-05-12T09:09:02.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.066+0000 7efc967fc700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efc8406ace0 0x7efc8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.066+0000 7efc967fc700 1 -- 172.21.15.116:0/3065691044 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efc9c088dc0 con 0x7efca006b4f0 2023-05-12T09:09:02.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.066+0000 7efca559a700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efc8406ace0 0x7efc8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.071 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.067+0000 7efca559a700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efc8406ace0 0x7efc8406d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efca0151ae0 tx=0x7efc90008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:02.073 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.070+0000 7efc967fc700 1 -- 172.21.15.116:0/3065691044 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efc9c054120 con 0x7efca006b4f0 2023-05-12T09:09:02.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.269+0000 7efca7fff700 1 -- 172.21.15.116:0/3065691044 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efca0074430 con 0x7efca006b4f0 2023-05-12T09:09:02.272 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.269+0000 7efc967fc700 1 -- 172.21.15.116:0/3065691044 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+126 (secure 0 0 0) 0x7efc9c015090 con 0x7efca006b4f0 2023-05-12T09:09:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:02.273 INFO:teuthology.orchestra.run.smithi116.stdout:[ 2023-05-12T09:09:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:09:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: "poolnum": 1, 2023-05-12T09:09:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: "poolname": "rbd" 2023-05-12T09:09:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:09:02.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2023-05-12T09:09:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "poolnum": 2, 2023-05-12T09:09:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: "poolname": ".mgr" 2023-05-12T09:09:02.274 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:09:02.274 INFO:teuthology.orchestra.run.smithi116.stdout:] 2023-05-12T09:09:02.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.271+0000 7efca7fff700 1 -- 172.21.15.116:0/3065691044 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efc8406ace0 msgr2=0x7efc8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efc8406ace0 0x7efc8406d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efca0151ae0 tx=0x7efc90008040 comp rx=0 tx=0).stop 2023-05-12T09:09:02.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 -- 172.21.15.116:0/3065691044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca006b4f0 msgr2=0x7efca00c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca006b4f0 0x7efca00c7e90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00b4a0 tx=0x7efc9c00b7b0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.275 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 -- 172.21.15.116:0/3065691044 shutdown_connections 2023-05-12T09:09:02.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efc8406ace0 0x7efc8406d190 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efca00d0130 0x7efca01e5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efca006b4f0 0x7efca00c7e90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 --2- 172.21.15.116:0/3065691044 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efca00cbf90 0x7efca0151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 -- 172.21.15.116:0/3065691044 >> 172.21.15.116:0/3065691044 conn(0x7efca009a090 msgr2=0x7efca00b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:02.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 -- 172.21.15.116:0/3065691044 shutdown_connections 2023-05-12T09:09:02.276 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.272+0000 7efca7fff700 1 -- 172.21.15.116:0/3065691044 wait complete. 2023-05-12T09:09:02.291 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-12T09:09:02.292 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-12T09:09:02.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.476+0000 7efea07ff700 1 Processor -- start 2023-05-12T09:09:02.479 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.476+0000 7efea07ff700 1 -- start start 2023-05-12T09:09:02.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.477+0000 7efea07ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7efe980b87a0 0x7efe980cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.477+0000 7efea07ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 0x7efe980d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.477+0000 7efea07ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980cdc60 con 0x7efe981601e0 2023-05-12T09:09:02.480 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.477+0000 7efea07ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe980d02d0 con 0x7efe980b87a0 2023-05-12T09:09:02.481 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.477+0000 7efea07ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe980d0cb0 con 0x7efe98160d40 2023-05-12T09:09:02.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.477+0000 7efe9dd9a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7efe981601e0 0x7efe98160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59562/0 (socket says 172.21.15.116:59562) 2023-05-12T09:09:02.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9dd9a700 1 -- 172.21.15.116:0/868726501 learned_addr learned my addr 172.21.15.116:0/868726501 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:02.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9e59b700 1 --2- 172.21.15.116:0/868726501 >> v2:172.21.15.182:3300/0 conn(0x7efe980b87a0 0x7efe980cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9ed9c700 1 --2- 172.21.15.116:0/868726501 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 0x7efe980d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9d599700 1 -- 172.21.15.116:0/868726501 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615951380 0 0) 0x7efe980cdc60 con 0x7efe981601e0 2023-05-12T09:09:02.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9d599700 1 -- 172.21.15.116:0/868726501 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe840035b0 con 0x7efe981601e0 2023-05-12T09:09:02.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9e59b700 1 -- 172.21.15.116:0/868726501 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 msgr2=0x7efe980d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:02.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9e59b700 1 --2- 172.21.15.116:0/868726501 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 0x7efe980d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9e59b700 1 -- 172.21.15.116:0/868726501 >> v1:172.21.15.116:6789/0 conn(0x7efe981601e0 legacy=0x7efe98160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.483 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9e59b700 1 -- 172.21.15.116:0/868726501 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980cd6a0 con 0x7efe980b87a0 2023-05-12T09:09:02.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9ed9c700 1 --2- 172.21.15.116:0/868726501 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 0x7efe980d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:09:02.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.478+0000 7efe9e59b700 1 --2- 172.21.15.116:0/868726501 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe980b87a0 0x7efe980cfbf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efe94009840 tx=0x7efe94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=841221d8f49226be server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:02.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.479+0000 7efe9d599700 1 -- 172.21.15.116:0/868726501 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94011830 con 0x7efe980b87a0 2023-05-12T09:09:02.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.479+0000 7efe9d599700 1 -- 172.21.15.116:0/868726501 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe94011990 con 0x7efe980b87a0 2023-05-12T09:09:02.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.479+0000 7efe9d599700 1 -- 172.21.15.116:0/868726501 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94011d20 con 0x7efe980b87a0 2023-05-12T09:09:02.484 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.479+0000 7efea07ff700 1 -- 172.21.15.116:0/868726501 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe980b87a0 msgr2=0x7efe980cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.479+0000 7efea07ff700 1 --2- 172.21.15.116:0/868726501 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe980b87a0 0x7efe980cfbf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efe94009840 tx=0x7efe94009b50 comp rx=0 tx=0).stop 2023-05-12T09:09:02.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.479+0000 7efea07ff700 1 -- 172.21.15.116:0/868726501 shutdown_connections 2023-05-12T09:09:02.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.479+0000 7efea07ff700 1 --2- 172.21.15.116:0/868726501 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 0x7efe980d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.479+0000 7efea07ff700 1 --2- 172.21.15.116:0/868726501 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe980b87a0 0x7efe980cfbf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.479+0000 7efea07ff700 1 -- 172.21.15.116:0/868726501 >> 172.21.15.116:0/868726501 conn(0x7efe98071b10 msgr2=0x7efe98071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:02.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.479+0000 7efea07ff700 1 -- 172.21.15.116:0/868726501 shutdown_connections 2023-05-12T09:09:02.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.480+0000 7efea07ff700 1 -- 172.21.15.116:0/868726501 wait complete. 2023-05-12T09:09:02.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.481+0000 7efea07ff700 1 Processor -- start 2023-05-12T09:09:02.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.481+0000 7efea07ff700 1 -- start start 2023-05-12T09:09:02.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.482+0000 7efea07ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe980b87a0 0x7efe980c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.482+0000 7efea07ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe981601e0 0x7efe98149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.482+0000 7efea07ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 0x7efe981e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.482+0000 7efea07ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9814cbe0 con 0x7efe981601e0 2023-05-12T09:09:02.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.482+0000 7efea07ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c7940 con 0x7efe980b87a0 2023-05-12T09:09:02.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.482+0000 7efea07ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c8760 con 0x7efe98160d40 2023-05-12T09:09:02.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.482+0000 7efe9dd9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe981601e0 0x7efe98149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9dd9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe981601e0 0x7efe98149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35606/0 (socket says 172.21.15.116:35606) 2023-05-12T09:09:02.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9dd9a700 1 -- 172.21.15.116:0/855195858 learned_addr learned my addr 172.21.15.116:0/855195858 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:02.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9e59b700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe980b87a0 0x7efe980c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9ed9c700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 0x7efe981e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9dd9a700 1 -- 172.21.15.116:0/855195858 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 msgr2=0x7efe981e62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9dd9a700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 0x7efe981e62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9dd9a700 1 -- 172.21.15.116:0/855195858 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe980b87a0 msgr2=0x7efe980c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9dd9a700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe980b87a0 0x7efe980c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9dd9a700 1 -- 172.21.15.116:0/855195858 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe90009a70 con 0x7efe981601e0 2023-05-12T09:09:02.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9ed9c700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 0x7efe981e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:09:02.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe9dd9a700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe981601e0 0x7efe98149d00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c700 tx=0x7efe8800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:02.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe8effd700 1 -- 172.21.15.116:0/855195858 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88005d70 con 0x7efe981601e0 2023-05-12T09:09:02.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe8effd700 1 -- 172.21.15.116:0/855195858 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe880070d0 con 0x7efe981601e0 2023-05-12T09:09:02.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efea07ff700 1 -- 172.21.15.116:0/855195858 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe940094a0 con 0x7efe981601e0 2023-05-12T09:09:02.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.483+0000 7efe8effd700 1 -- 172.21.15.116:0/855195858 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88007460 con 0x7efe981601e0 2023-05-12T09:09:02.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.484+0000 7efea07ff700 1 -- 172.21.15.116:0/855195858 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe980d1640 con 0x7efe981601e0 2023-05-12T09:09:02.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.485+0000 7efea07ff700 1 -- 172.21.15.116:0/855195858 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe980cd980 con 0x7efe981601e0 2023-05-12T09:09:02.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.486+0000 7efe8effd700 1 -- 172.21.15.116:0/855195858 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe880075c0 con 0x7efe981601e0 2023-05-12T09:09:02.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.487+0000 7efe8effd700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7c06ace0 0x7efe7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:02.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.487+0000 7efe8effd700 1 -- 172.21.15.116:0/855195858 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efe88088830 con 0x7efe981601e0 2023-05-12T09:09:02.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.487+0000 7efe9e59b700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7c06ace0 0x7efe7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:02.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.487+0000 7efe9e59b700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7c06ace0 0x7efe7c06d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe94000c00 tx=0x7efe94008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:02.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.491+0000 7efe8effd700 1 -- 172.21.15.116:0/855195858 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efe88053af0 con 0x7efe981601e0 2023-05-12T09:09:02.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.689+0000 7efea07ff700 1 -- 172.21.15.116:0/855195858 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efe980d17d0 con 0x7efe981601e0 2023-05-12T09:09:02.876 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.873+0000 7efe8effd700 1 -- 172.21.15.116:0/855195858 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7efe88057110 con 0x7efe981601e0 2023-05-12T09:09:02.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.876+0000 7efea07ff700 1 -- 172.21.15.116:0/855195858 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7c06ace0 msgr2=0x7efe7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.876+0000 7efea07ff700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7c06ace0 0x7efe7c06d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe94000c00 tx=0x7efe94008030 comp rx=0 tx=0).stop 2023-05-12T09:09:02.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.876+0000 7efea07ff700 1 -- 172.21.15.116:0/855195858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe981601e0 msgr2=0x7efe98149d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:02.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.876+0000 7efea07ff700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe981601e0 0x7efe98149d00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c700 tx=0x7efe8800ca10 comp rx=0 tx=0).stop 2023-05-12T09:09:02.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.877+0000 7efea07ff700 1 -- 172.21.15.116:0/855195858 shutdown_connections 2023-05-12T09:09:02.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.877+0000 7efea07ff700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7efe7c06ace0 0x7efe7c06d190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.877+0000 7efea07ff700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7efe98160d40 0x7efe981e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.877+0000 7efea07ff700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7efe980b87a0 0x7efe980c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.877+0000 7efea07ff700 1 --2- 172.21.15.116:0/855195858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe981601e0 0x7efe98149d00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:02.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.877+0000 7efea07ff700 1 -- 172.21.15.116:0/855195858 >> 172.21.15.116:0/855195858 conn(0x7efe98071b10 msgr2=0x7efe9815c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:02.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.877+0000 7efea07ff700 1 -- 172.21.15.116:0/855195858 shutdown_connections 2023-05-12T09:09:02.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:02.878+0000 7efea07ff700 1 -- 172.21.15.116:0/855195858 wait complete. 2023-05-12T09:09:02.885 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_metadata' created 2023-05-12T09:09:02.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-12T09:09:03.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.089+0000 7f0edb9ff700 1 Processor -- start 2023-05-12T09:09:03.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.090+0000 7f0edb9ff700 1 -- start start 2023-05-12T09:09:03.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0edb9ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f0ed40b87a0 0x7f0ed40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:03.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0edb9ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0ed41601e0 0x7f0ed4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:03.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0edb9ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed40cdc60 con 0x7f0ed4160b70 2023-05-12T09:09:03.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0edb9ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed40d02d0 con 0x7f0ed41601e0 2023-05-12T09:09:03.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0edb9ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed40d0cb0 con 0x7f0ed40b87a0 2023-05-12T09:09:03.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0ed8f9a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0ed41601e0 0x7f0ed4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:03.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0ed8f9a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0ed41601e0 0x7f0ed4160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35610/0 (socket says 172.21.15.116:35610) 2023-05-12T09:09:03.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0ed8f9a700 1 -- 172.21.15.116:0/164332881 learned_addr learned my addr 172.21.15.116:0/164332881 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:03.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0ed979b700 1 --2- 172.21.15.116:0/164332881 >> v2:172.21.15.182:3300/0 conn(0x7f0ed40b87a0 0x7f0ed40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:03.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0ed8f9a700 1 -- 172.21.15.116:0/164332881 >> v2:172.21.15.182:3300/0 conn(0x7f0ed40b87a0 msgr2=0x7f0ed40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:03.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0ed8f9a700 1 --2- 172.21.15.116:0/164332881 >> v2:172.21.15.182:3300/0 conn(0x7f0ed40b87a0 0x7f0ed40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:03.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0ed8f9a700 1 -- 172.21.15.116:0/164332881 >> v1:172.21.15.182:6789/0 conn(0x7f0ed4160b70 legacy=0x7f0ed40d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:03.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.091+0000 7f0ed8f9a700 1 -- 172.21.15.116:0/164332881 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed40cd6a0 con 0x7f0ed41601e0 2023-05-12T09:09:03.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.092+0000 7f0ed8f9a700 1 --2- 172.21.15.116:0/164332881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed41601e0 0x7f0ed4160630 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b4ac0 tx=0x7f0ec4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35aa825e4400c52a server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:03.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.092+0000 7f0ecbfff700 1 -- 172.21.15.116:0/164332881 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4011830 con 0x7f0ed41601e0 2023-05-12T09:09:03.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.092+0000 7f0ecbfff700 1 -- 172.21.15.116:0/164332881 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec4011990 con 0x7f0ed41601e0 2023-05-12T09:09:03.098 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.092+0000 7f0ecbfff700 1 -- 172.21.15.116:0/164332881 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4011d20 con 0x7f0ed41601e0 2023-05-12T09:09:03.100 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.092+0000 7f0edb9ff700 1 -- 172.21.15.116:0/164332881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed41601e0 msgr2=0x7f0ed4160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:03.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.092+0000 7f0edb9ff700 1 --2- 172.21.15.116:0/164332881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed41601e0 0x7f0ed4160630 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b4ac0 tx=0x7f0ec4009c00 comp rx=0 tx=0).stop 2023-05-12T09:09:03.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.092+0000 7f0edb9ff700 1 -- 172.21.15.116:0/164332881 shutdown_connections 2023-05-12T09:09:03.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.092+0000 7f0edb9ff700 1 --2- 172.21.15.116:0/164332881 >> v2:172.21.15.182:3300/0 conn(0x7f0ed40b87a0 0x7f0ed40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:03.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.092+0000 7f0edb9ff700 1 --2- 172.21.15.116:0/164332881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed41601e0 0x7f0ed4160630 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:03.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.093+0000 7f0edb9ff700 1 -- 172.21.15.116:0/164332881 >> 172.21.15.116:0/164332881 conn(0x7f0ed4071b10 msgr2=0x7f0ed4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:03.101 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.093+0000 7f0edb9ff700 1 -- 172.21.15.116:0/164332881 shutdown_connections 2023-05-12T09:09:03.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.093+0000 7f0edb9ff700 1 -- 172.21.15.116:0/164332881 wait complete. 2023-05-12T09:09:03.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.094+0000 7f0edb9ff700 1 Processor -- start 2023-05-12T09:09:03.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.094+0000 7f0edb9ff700 1 -- start start 2023-05-12T09:09:03.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.095+0000 7f0edb9ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0ed40b87a0 0x7f0ed4150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:03.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.095+0000 7f0edb9ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0ed41601e0 0x7f0ed40c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:03.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.095+0000 7f0edb9ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4160b70 0x7f0ed415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:03.102 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.095+0000 7f0edb9ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40cc7c0 con 0x7f0ed4160b70 2023-05-12T09:09:03.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.095+0000 7f0edb9ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4151420 con 0x7f0ed40b87a0 2023-05-12T09:09:03.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.095+0000 7f0edb9ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed415dc70 con 0x7f0ed41601e0 2023-05-12T09:09:03.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.095+0000 7f0ed9f9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4160b70 0x7f0ed415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:03.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ed9f9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4160b70 0x7f0ed415cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35622/0 (socket says 172.21.15.116:35622) 2023-05-12T09:09:03.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ed9f9c700 1 -- 172.21.15.116:0/2065044159 learned_addr learned my addr 172.21.15.116:0/2065044159 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:03.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ed9f9c700 1 -- 172.21.15.116:0/2065044159 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0ed41601e0 msgr2=0x7f0ed40c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:03.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ed9f9c700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0ed41601e0 0x7f0ed40c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:03.103 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ed9f9c700 1 -- 172.21.15.116:0/2065044159 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0ed40b87a0 msgr2=0x7f0ed4150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:03.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ed979b700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0ed40b87a0 0x7f0ed4150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:03.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ed9f9c700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0ed40b87a0 0x7f0ed4150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:03.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ed9f9c700 1 -- 172.21.15.116:0/2065044159 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4009550 con 0x7f0ed4160b70 2023-05-12T09:09:03.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ed979b700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0ed40b87a0 0x7f0ed4150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:03.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ed9f9c700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4160b70 0x7f0ed415cd10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00cb50 tx=0x7f0ecc00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:03.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ec9ffb700 1 -- 172.21.15.116:0/2065044159 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc003c00 con 0x7f0ed4160b70 2023-05-12T09:09:03.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ec9ffb700 1 -- 172.21.15.116:0/2065044159 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc003d60 con 0x7f0ed4160b70 2023-05-12T09:09:03.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0ec9ffb700 1 -- 172.21.15.116:0/2065044159 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00ab70 con 0x7f0ed4160b70 2023-05-12T09:09:03.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.096+0000 7f0edb9ff700 1 -- 172.21.15.116:0/2065044159 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed4160f90 con 0x7f0ed4160b70 2023-05-12T09:09:03.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.097+0000 7f0edb9ff700 1 -- 172.21.15.116:0/2065044159 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed40cd980 con 0x7f0ed4160b70 2023-05-12T09:09:03.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.097+0000 7f0edb9ff700 1 -- 172.21.15.116:0/2065044159 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed40d2110 con 0x7f0ed4160b70 2023-05-12T09:09:03.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.099+0000 7f0ec9ffb700 1 -- 172.21.15.116:0/2065044159 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ecc00acd0 con 0x7f0ed4160b70 2023-05-12T09:09:03.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.099+0000 7f0ec9ffb700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0eb806ace0 0x7f0eb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:03.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.100+0000 7f0ec9ffb700 1 -- 172.21.15.116:0/2065044159 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f0ecc089e90 con 0x7f0ed4160b70 2023-05-12T09:09:03.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.100+0000 7f0ed979b700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0eb806ace0 0x7f0eb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:03.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.100+0000 7f0ed979b700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0eb806ace0 0x7f0eb806d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009b60 tx=0x7f0ed0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:03.107 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.103+0000 7f0ec9ffb700 1 -- 172.21.15.116:0/2065044159 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0ecc055050 con 0x7f0ed4160b70 2023-05-12T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.293+0000 7f0edb9ff700 1 -- 172.21.15.116:0/2065044159 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0ed4074430 con 0x7f0ed4160b70 2023-05-12T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.877+0000 7f0ec9ffb700 1 -- 172.21.15.116:0/2065044159 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0ecc058670 con 0x7f0ed4160b70 2023-05-12T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.883+0000 7f0edb9ff700 1 -- 172.21.15.116:0/2065044159 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0eb806ace0 msgr2=0x7f0eb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.883+0000 7f0edb9ff700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0eb806ace0 0x7f0eb806d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009b60 tx=0x7f0ed0008040 comp rx=0 tx=0).stop 2023-05-12T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.883+0000 7f0edb9ff700 1 -- 172.21.15.116:0/2065044159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4160b70 msgr2=0x7f0ed415cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.883+0000 7f0edb9ff700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4160b70 0x7f0ed415cd10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00cb50 tx=0x7f0ecc00cf10 comp rx=0 tx=0).stop 2023-05-12T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.884+0000 7f0edb9ff700 1 -- 172.21.15.116:0/2065044159 shutdown_connections 2023-05-12T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.884+0000 7f0edb9ff700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4160b70 0x7f0ed415cd10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.884+0000 7f0edb9ff700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f0ed40b87a0 0x7f0ed4150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.884+0000 7f0edb9ff700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f0eb806ace0 0x7f0eb806d190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.884+0000 7f0edb9ff700 1 --2- 172.21.15.116:0/2065044159 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f0ed41601e0 0x7f0ed40c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.884+0000 7f0edb9ff700 1 -- 172.21.15.116:0/2065044159 >> 172.21.15.116:0/2065044159 conn(0x7f0ed4071b10 msgr2=0x7f0ed415b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.888+0000 7f0edb9ff700 1 -- 172.21.15.116:0/2065044159 shutdown_connections 2023-05-12T09:09:03.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:03.888+0000 7f0edb9ff700 1 -- 172.21.15.116:0/2065044159 wait complete. 2023-05-12T09:09:03.896 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cephfs_data' created 2023-05-12T09:09:03.918 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-12T09:09:04.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.103+0000 7f2883bff700 1 Processor -- start 2023-05-12T09:09:04.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.103+0000 7f2883bff700 1 -- start start 2023-05-12T09:09:04.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f2883bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f287c0b87a0 0x7f287c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f2883bff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f287c1601e0 0x7f287c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f2883bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f287c160b70 0x7f287c0d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f2883bff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c0d02d0 con 0x7f287c1601e0 2023-05-12T09:09:04.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f2883bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c0d0cb0 con 0x7f287c160b70 2023-05-12T09:09:04.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f2883bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0b2730 con 0x7f287c0b87a0 2023-05-12T09:09:04.109 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288119a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f287c1601e0 0x7f287c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288199b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f287c0b87a0 0x7f287c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288119a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f287c1601e0 0x7f287c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35624/0 (socket says 172.21.15.116:35624) 2023-05-12T09:09:04.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288119a700 1 -- 172.21.15.116:0/4157040478 learned_addr learned my addr 172.21.15.116:0/4157040478 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:04.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288219c700 1 --2- 172.21.15.116:0/4157040478 >> v2:172.21.15.182:3300/0 conn(0x7f287c160b70 0x7f287c0d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288119a700 1 -- 172.21.15.116:0/4157040478 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f287c0b87a0 msgr2=0x7f287c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:04.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288119a700 1 --2- 172.21.15.116:0/4157040478 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f287c0b87a0 0x7f287c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.110 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288119a700 1 -- 172.21.15.116:0/4157040478 >> v2:172.21.15.182:3300/0 conn(0x7f287c160b70 msgr2=0x7f287c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:04.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288119a700 1 --2- 172.21.15.116:0/4157040478 >> v2:172.21.15.182:3300/0 conn(0x7f287c160b70 0x7f287c0d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288119a700 1 -- 172.21.15.116:0/4157040478 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c160ff0 con 0x7f287c1601e0 2023-05-12T09:09:04.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.105+0000 7f288219c700 1 --2- 172.21.15.116:0/4157040478 >> v2:172.21.15.182:3300/0 conn(0x7f287c160b70 0x7f287c0d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:09:04.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.106+0000 7f288119a700 1 --2- 172.21.15.116:0/4157040478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 0x7f287c160630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f287c08be30 tx=0x7f286c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c62736475944c0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:04.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.106+0000 7f2880999700 1 -- 172.21.15.116:0/4157040478 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c011830 con 0x7f287c1601e0 2023-05-12T09:09:04.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.106+0000 7f2880999700 1 -- 172.21.15.116:0/4157040478 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c011990 con 0x7f287c1601e0 2023-05-12T09:09:04.111 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.106+0000 7f2880999700 1 -- 172.21.15.116:0/4157040478 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c011d20 con 0x7f287c1601e0 2023-05-12T09:09:04.112 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.106+0000 7f2883bff700 1 -- 172.21.15.116:0/4157040478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 msgr2=0x7f287c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.106+0000 7f2883bff700 1 --2- 172.21.15.116:0/4157040478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 0x7f287c160630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f287c08be30 tx=0x7f286c009bd0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.107+0000 7f2883bff700 1 -- 172.21.15.116:0/4157040478 shutdown_connections 2023-05-12T09:09:04.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.107+0000 7f2883bff700 1 --2- 172.21.15.116:0/4157040478 >> v2:172.21.15.182:3300/0 conn(0x7f287c160b70 0x7f287c0d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.107+0000 7f2883bff700 1 --2- 172.21.15.116:0/4157040478 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f287c0b87a0 0x7f287c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.107+0000 7f2883bff700 1 --2- 172.21.15.116:0/4157040478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 0x7f287c160630 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.113 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.107+0000 7f2883bff700 1 -- 172.21.15.116:0/4157040478 >> 172.21.15.116:0/4157040478 conn(0x7f287c071b10 msgr2=0x7f287c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:04.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.107+0000 7f2883bff700 1 -- 172.21.15.116:0/4157040478 shutdown_connections 2023-05-12T09:09:04.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.107+0000 7f2883bff700 1 -- 172.21.15.116:0/4157040478 wait complete. 2023-05-12T09:09:04.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.109+0000 7f2883bff700 1 Processor -- start 2023-05-12T09:09:04.114 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.109+0000 7f2883bff700 1 -- start start 2023-05-12T09:09:04.115 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.110+0000 7f2883bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f287c0b87a0 0x7f287c1f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.110+0000 7f2883bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 0x7f287c0b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.110+0000 7f2883bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f287c160b70 0x7f287c0b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.110+0000 7f2883bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c154ca0 con 0x7f287c1601e0 2023-05-12T09:09:04.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.110+0000 7f2883bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1f1e70 con 0x7f287c160b70 2023-05-12T09:09:04.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.110+0000 7f2883bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c15f060 con 0x7f287c0b87a0 2023-05-12T09:09:04.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288119a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 0x7f287c0b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.116 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288119a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 0x7f287c0b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35630/0 (socket says 172.21.15.116:35630) 2023-05-12T09:09:04.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288119a700 1 -- 172.21.15.116:0/3055665454 learned_addr learned my addr 172.21.15.116:0/3055665454 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:04.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288219c700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f287c160b70 0x7f287c0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288199b700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f287c0b87a0 0x7f287c1f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288119a700 1 -- 172.21.15.116:0/3055665454 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f287c0b87a0 msgr2=0x7f287c1f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288119a700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f287c0b87a0 0x7f287c1f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288119a700 1 -- 172.21.15.116:0/3055665454 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f287c160b70 msgr2=0x7f287c0b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288119a700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f287c160b70 0x7f287c0b7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288119a700 1 -- 172.21.15.116:0/3055665454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009550 con 0x7f287c1601e0 2023-05-12T09:09:04.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f288119a700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 0x7f287c0b6d30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f286c009c10 tx=0x7f286c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:04.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.111+0000 7f28727fc700 1 -- 172.21.15.116:0/3055665454 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c004240 con 0x7f287c1601e0 2023-05-12T09:09:04.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.112+0000 7f28727fc700 1 -- 172.21.15.116:0/3055665454 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c01f070 con 0x7f287c1601e0 2023-05-12T09:09:04.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.112+0000 7f28727fc700 1 -- 172.21.15.116:0/3055665454 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0036a0 con 0x7f287c1601e0 2023-05-12T09:09:04.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.112+0000 7f2883bff700 1 -- 172.21.15.116:0/3055665454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c0cd6a0 con 0x7f287c1601e0 2023-05-12T09:09:04.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.112+0000 7f2883bff700 1 -- 172.21.15.116:0/3055665454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c0cdc60 con 0x7f287c1601e0 2023-05-12T09:09:04.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.113+0000 7f2883bff700 1 -- 172.21.15.116:0/3055665454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c0cd980 con 0x7f287c1601e0 2023-05-12T09:09:04.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.114+0000 7f28727fc700 1 -- 172.21.15.116:0/3055665454 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f286c021030 con 0x7f287c1601e0 2023-05-12T09:09:04.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.115+0000 7f28727fc700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f286006ace0 0x7f286006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.119 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.115+0000 7f28727fc700 1 -- 172.21.15.116:0/3055665454 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f286c08a770 con 0x7f287c1601e0 2023-05-12T09:09:04.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.115+0000 7f288199b700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f286006ace0 0x7f286006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.120 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.116+0000 7f288199b700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f286006ace0 0x7f286006d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2878009ac0 tx=0x7f2878009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:04.122 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.119+0000 7f28727fc700 1 -- 172.21.15.116:0/3055665454 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f286c055730 con 0x7f287c1601e0 2023-05-12T09:09:04.357 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.354+0000 7f2883bff700 1 -- 172.21.15.116:0/3055665454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f287c1f2040 con 0x7f287c1601e0 2023-05-12T09:09:04.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.362+0000 7f28727fc700 1 -- 172.21.15.116:0/3055665454 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f287c1f2040 con 0x7f287c1601e0 2023-05-12T09:09:04.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.372+0000 7f2883bff700 1 -- 172.21.15.116:0/3055665454 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f286006ace0 msgr2=0x7f286006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.372+0000 7f2883bff700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f286006ace0 0x7f286006d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2878009ac0 tx=0x7f2878009210 comp rx=0 tx=0).stop 2023-05-12T09:09:04.376 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.372+0000 7f2883bff700 1 -- 172.21.15.116:0/3055665454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 msgr2=0x7f287c0b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.372+0000 7f2883bff700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 0x7f287c0b6d30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f286c009c10 tx=0x7f286c004750 comp rx=0 tx=0).stop 2023-05-12T09:09:04.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.373+0000 7f2883bff700 1 -- 172.21.15.116:0/3055665454 shutdown_connections 2023-05-12T09:09:04.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.373+0000 7f2883bff700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f287c160b70 0x7f287c0b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.373+0000 7f2883bff700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f286006ace0 0x7f286006d190 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2878009ac0 tx=0x7f2878009210 comp rx=0 tx=0).stop 2023-05-12T09:09:04.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.373+0000 7f2883bff700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f287c0b87a0 0x7f287c1f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.373+0000 7f2883bff700 1 --2- 172.21.15.116:0/3055665454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c1601e0 0x7f287c0b6d30 secure :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f286c009c10 tx=0x7f286c004750 comp rx=0 tx=0).stop 2023-05-12T09:09:04.377 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.373+0000 7f2883bff700 1 -- 172.21.15.116:0/3055665454 >> 172.21.15.116:0/3055665454 conn(0x7f287c071b10 msgr2=0x7f287c0d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:04.388 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.385+0000 7f2883bff700 1 -- 172.21.15.116:0/3055665454 shutdown_connections 2023-05-12T09:09:04.390 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.387+0000 7f2883bff700 1 -- 172.21.15.116:0/3055665454 wait complete. 2023-05-12T09:09:04.397 INFO:teuthology.orchestra.run.smithi116.stderr:new fs with metadata pool 6 and data pool 7 2023-05-12T09:09:04.414 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:09:04.598 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.594+0000 7f945e7ff700 1 Processor -- start 2023-05-12T09:09:04.598 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.595+0000 7f945e7ff700 1 -- start start 2023-05-12T09:09:04.601 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.596+0000 7f945e7ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f94581589d0 0x7f94580cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.602 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.596+0000 7f945e7ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94580ca890 con 0x7f94580cd690 2023-05-12T09:09:04.602 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.596+0000 7f945e7ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94580ca5b0 con 0x7f945806cdd0 2023-05-12T09:09:04.602 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.596+0000 7f945e7ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94580cc670 con 0x7f94581589d0 2023-05-12T09:09:04.603 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.596+0000 7f94577fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f94580cd690 0x7f945806c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59578/0 (socket says 172.21.15.116:59578) 2023-05-12T09:09:04.603 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.596+0000 7f94577fe700 1 -- 172.21.15.116:0/3517331821 learned_addr learned my addr 172.21.15.116:0/3517331821 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:04.603 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.596+0000 7f9457fff700 1 --2- 172.21.15.116:0/3517331821 >> v2:172.21.15.182:3300/0 conn(0x7f94581589d0 0x7f94580cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.603 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.596+0000 7f9456ffd700 1 -- 172.21.15.116:0/3517331821 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968500657 0 0) 0x7f94580ca890 con 0x7f94580cd690 2023-05-12T09:09:04.604 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.597+0000 7f9456ffd700 1 -- 172.21.15.116:0/3517331821 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94400035b0 con 0x7f94580cd690 2023-05-12T09:09:04.604 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.597+0000 7f9456ffd700 1 -- 172.21.15.116:0/3517331821 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937035037 0 0) 0x7f94580ca5b0 con 0x7f945806cdd0 2023-05-12T09:09:04.604 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.597+0000 7f9456ffd700 1 -- 172.21.15.116:0/3517331821 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94580ca890 con 0x7f945806cdd0 2023-05-12T09:09:04.604 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.597+0000 7f9457fff700 1 -- 172.21.15.116:0/3517331821 >> v1:172.21.15.182:6789/0 conn(0x7f945806cdd0 legacy=0x7f945806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.597+0000 7f9457fff700 1 -- 172.21.15.116:0/3517331821 >> v1:172.21.15.116:6789/0 conn(0x7f94580cd690 legacy=0x7f945806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.597+0000 7f9457fff700 1 -- 172.21.15.116:0/3517331821 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94580cc950 con 0x7f94581589d0 2023-05-12T09:09:04.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.597+0000 7f9457fff700 1 --2- 172.21.15.116:0/3517331821 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94581589d0 0x7f94580cd150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9448009840 tx=0x7f9448009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff69c12cf272885 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:04.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.597+0000 7f9456ffd700 1 -- 172.21.15.116:0/3517331821 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448011830 con 0x7f94581589d0 2023-05-12T09:09:04.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.597+0000 7f9456ffd700 1 -- 172.21.15.116:0/3517331821 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9448011990 con 0x7f94581589d0 2023-05-12T09:09:04.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.597+0000 7f9456ffd700 1 -- 172.21.15.116:0/3517331821 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448011d20 con 0x7f94581589d0 2023-05-12T09:09:04.605 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.598+0000 7f945e7ff700 1 -- 172.21.15.116:0/3517331821 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94581589d0 msgr2=0x7f94580cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.606 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.598+0000 7f945e7ff700 1 --2- 172.21.15.116:0/3517331821 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94581589d0 0x7f94580cd150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9448009840 tx=0x7f9448009b50 comp rx=0 tx=0).stop 2023-05-12T09:09:04.606 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.598+0000 7f945e7ff700 1 -- 172.21.15.116:0/3517331821 shutdown_connections 2023-05-12T09:09:04.606 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.598+0000 7f945e7ff700 1 --2- 172.21.15.116:0/3517331821 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94581589d0 0x7f94580cd150 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.606 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.598+0000 7f945e7ff700 1 -- 172.21.15.116:0/3517331821 >> 172.21.15.116:0/3517331821 conn(0x7f94580cf720 msgr2=0x7f94580cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:04.606 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.598+0000 7f945e7ff700 1 -- 172.21.15.116:0/3517331821 shutdown_connections 2023-05-12T09:09:04.606 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.598+0000 7f945e7ff700 1 -- 172.21.15.116:0/3517331821 wait complete. 2023-05-12T09:09:04.608 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.600+0000 7f945e7ff700 1 Processor -- start 2023-05-12T09:09:04.608 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.600+0000 7f945e7ff700 1 -- start start 2023-05-12T09:09:04.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f945e7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f945806cdd0 0x7f94580c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f945e7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f94580cd690 0x7f94580b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f945e7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94581589d0 0x7f94580ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f945e7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94580c3dc0 con 0x7f945806cdd0 2023-05-12T09:09:04.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f945e7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94580c40a0 con 0x7f94581589d0 2023-05-12T09:09:04.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f945e7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94580c4380 con 0x7f94580cd690 2023-05-12T09:09:04.609 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f9457fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f945806cdd0 0x7f94580c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.610 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f9457fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f945806cdd0 0x7f94580c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35640/0 (socket says 172.21.15.116:35640) 2023-05-12T09:09:04.610 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f9457fff700 1 -- 172.21.15.116:0/3402281290 learned_addr learned my addr 172.21.15.116:0/3402281290 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:04.610 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f94577fe700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f94580cd690 0x7f94580b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.610 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f945cd9c700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94581589d0 0x7f94580ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.610 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f9457fff700 1 -- 172.21.15.116:0/3402281290 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f94580cd690 msgr2=0x7f94580b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.610 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f9457fff700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f94580cd690 0x7f94580b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.610 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f9457fff700 1 -- 172.21.15.116:0/3402281290 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94581589d0 msgr2=0x7f94580ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.610 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f9457fff700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94581589d0 0x7f94580ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.611 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f9457fff700 1 -- 172.21.15.116:0/3402281290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480094a0 con 0x7f945806cdd0 2023-05-12T09:09:04.611 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.601+0000 7f9457fff700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f945806cdd0 0x7f94580c2f20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9448014040 tx=0x7f9448004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:04.611 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.602+0000 7f9454ff9700 1 -- 172.21.15.116:0/3402281290 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944801a860 con 0x7f945806cdd0 2023-05-12T09:09:04.611 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.602+0000 7f9454ff9700 1 -- 172.21.15.116:0/3402281290 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944801a9c0 con 0x7f945806cdd0 2023-05-12T09:09:04.611 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.602+0000 7f945e7ff700 1 -- 172.21.15.116:0/3402281290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945806aaf0 con 0x7f945806cdd0 2023-05-12T09:09:04.611 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.602+0000 7f9454ff9700 1 -- 172.21.15.116:0/3402281290 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944801ad30 con 0x7f945806cdd0 2023-05-12T09:09:04.611 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.602+0000 7f945e7ff700 1 -- 172.21.15.116:0/3402281290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94580ccc30 con 0x7f945806cdd0 2023-05-12T09:09:04.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.603+0000 7f945e7ff700 1 -- 172.21.15.116:0/3402281290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945806ac80 con 0x7f945806cdd0 2023-05-12T09:09:04.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.604+0000 7f9454ff9700 1 -- 172.21.15.116:0/3402281290 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9448022070 con 0x7f945806cdd0 2023-05-12T09:09:04.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.605+0000 7f9454ff9700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f944406ace0 0x7f944406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:04.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.605+0000 7f9454ff9700 1 -- 172.21.15.116:0/3402281290 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f944808a730 con 0x7f945806cdd0 2023-05-12T09:09:04.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.605+0000 7f94577fe700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f944406ace0 0x7f944406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:04.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.605+0000 7f94577fe700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f944406ace0 0x7f944406d190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f944c001000 tx=0x7f944c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:04.613 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.609+0000 7f9454ff9700 1 -- 172.21.15.116:0/3402281290 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9448055690 con 0x7f945806cdd0 2023-05-12T09:09:04.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.803+0000 7f945e7ff700 1 -- 172.21.15.116:0/3402281290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94580b4a10 con 0x7f945806cdd0 2023-05-12T09:09:04.807 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.805+0000 7f9454ff9700 1 -- 172.21.15.116:0/3402281290 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18479 (secure 0 0 0) 0x7f9448058cb0 con 0x7f945806cdd0 2023-05-12T09:09:04.808 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:04.808 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":38,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:09:04.356048+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:09:02.727234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-12T09:09:03.331565+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:09:04.810 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 -- 172.21.15.116:0/3402281290 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f944406ace0 msgr2=0x7f944406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f944406ace0 0x7f944406d190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f944c001000 tx=0x7f944c009040 comp rx=0 tx=0).stop 2023-05-12T09:09:04.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 -- 172.21.15.116:0/3402281290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f945806cdd0 msgr2=0x7f94580c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:04.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f945806cdd0 0x7f94580c2f20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9448014040 tx=0x7f9448004750 comp rx=0 tx=0).stop 2023-05-12T09:09:04.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 -- 172.21.15.116:0/3402281290 shutdown_connections 2023-05-12T09:09:04.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f94581589d0 0x7f94580ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f945806cdd0 0x7f94580c2f20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.811 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f944406ace0 0x7f944406d190 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 --2- 172.21.15.116:0/3402281290 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f94580cd690 0x7f94580b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:04.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 -- 172.21.15.116:0/3402281290 >> 172.21.15.116:0/3402281290 conn(0x7f94580cf720 msgr2=0x7f94580712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:04.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 -- 172.21.15.116:0/3402281290 shutdown_connections 2023-05-12T09:09:04.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:04.807+0000 7f945e7ff700 1 -- 172.21.15.116:0/3402281290 wait complete. 2023-05-12T09:09:04.828 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:09:05.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.009+0000 7f6f1d7ff700 1 Processor -- start 2023-05-12T09:09:05.012 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.009+0000 7f6f1d7ff700 1 -- start start 2023-05-12T09:09:05.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.010+0000 7f6f1d7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f1806aaf0 0x7f6f18070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.010+0000 7f6f1d7ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f180cb280 con 0x7f6f18071030 2023-05-12T09:09:05.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.010+0000 7f6f1d7ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f180714b0 con 0x7f6f1815a5a0 2023-05-12T09:09:05.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.010+0000 7f6f1d7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1815a970 con 0x7f6f1806aaf0 2023-05-12T09:09:05.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.010+0000 7f6f177fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f6f18071030 0x7f6f1806d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59588/0 (socket says 172.21.15.116:59588) 2023-05-12T09:09:05.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.010+0000 7f6f177fe700 1 -- 172.21.15.116:0/3435835715 learned_addr learned my addr 172.21.15.116:0/3435835715 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:05.015 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.010+0000 7f6f167fc700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f1806aaf0 0x7f6f18070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201789906 0 0) 0x7f6f10001490 con 0x7f6f18071030 2023-05-12T09:09:05.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f000035b0 con 0x7f6f18071030 2023-05-12T09:09:05.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074029791 0 0) 0x7f6f180714b0 con 0x7f6f1815a5a0 2023-05-12T09:09:05.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f10001490 con 0x7f6f1815a5a0 2023-05-12T09:09:05.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3248521883 0 0) 0x7f6f000035b0 con 0x7f6f18071030 2023-05-12T09:09:05.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f1806aaf0 msgr2=0x7f6f18070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:05.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f1806aaf0 0x7f6f18070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 >> v1:172.21.15.182:6789/0 conn(0x7f6f1815a5a0 legacy=0x7f6f1806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18071700 con 0x7f6f18071030 2023-05-12T09:09:05.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f6f10001b80 con 0x7f6f18071030 2023-05-12T09:09:05.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 >> v1:172.21.15.116:6789/0 conn(0x7f6f18071030 legacy=0x7f6f1806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f1806aaf0 0x7f6f00003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f00004170 0x7f6f00004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6f00004d90 0x7f6f00005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1815a970 con 0x7f6f00004170 2023-05-12T09:09:05.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0000bb20 con 0x7f6f00004d90 2023-05-12T09:09:05.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0000bce0 con 0x7f6f1806aaf0 2023-05-12T09:09:05.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.011+0000 7f6f167fc700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f00004170 0x7f6f00004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f16ffd700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f1806aaf0 0x7f6f00003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f177fe700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6f00004d90 0x7f6f00005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f167fc700 1 -- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f1806aaf0 msgr2=0x7f6f00003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:05.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f167fc700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f1806aaf0 0x7f6f00003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f167fc700 1 -- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6f00004d90 msgr2=0x7f6f00005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:05.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f167fc700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6f00004d90 0x7f6f00005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f167fc700 1 -- 172.21.15.116:0/3435835715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f000035b0 con 0x7f6f00004170 2023-05-12T09:09:05.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f167fc700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f00004170 0x7f6f00004850 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009b10 tx=0x7f6f00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fe3e4bc95fa2b4 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:05.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c005a20 con 0x7f6f00004170 2023-05-12T09:09:05.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c005b80 con 0x7f6f00004170 2023-05-12T09:09:05.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.012+0000 7f6f15ffb700 1 -- 172.21.15.116:0/3435835715 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00e6c0 con 0x7f6f00004170 2023-05-12T09:09:05.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.013+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/3435835715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f00004170 msgr2=0x7f6f00004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.013+0000 7f6f1d7ff700 1 --2- 172.21.15.116:0/3435835715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f00004170 0x7f6f00004850 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009b10 tx=0x7f6f00005880 comp rx=0 tx=0).stop 2023-05-12T09:09:05.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.013+0000 7f6f177fe700 1 -- 172.21.15.116:0/3435835715 reap_dead start 2023-05-12T09:09:05.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.013+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/3435835715 shutdown_connections 2023-05-12T09:09:05.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.013+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/3435835715 >> 172.21.15.116:0/3435835715 conn(0x7f6f180cf720 msgr2=0x7f6f180cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:05.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.013+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/3435835715 shutdown_connections 2023-05-12T09:09:05.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.013+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/3435835715 wait complete. 2023-05-12T09:09:05.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.015+0000 7f6f1d7ff700 1 Processor -- start 2023-05-12T09:09:05.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.015+0000 7f6f1d7ff700 1 -- start start 2023-05-12T09:09:05.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f1d7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6f00004170 0x7f6f181557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f1d7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f180b2910 0x7f6f18154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f1d7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f180c7940 0x7f6f180c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f1d7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180b3160 con 0x7f6f180b2910 2023-05-12T09:09:05.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f1d7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180b3440 con 0x7f6f00004170 2023-05-12T09:09:05.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f1d7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180b3720 con 0x7f6f180c7940 2023-05-12T09:09:05.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f167fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f180b2910 0x7f6f18154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f167fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f180b2910 0x7f6f18154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35662/0 (socket says 172.21.15.116:35662) 2023-05-12T09:09:05.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f167fc700 1 -- 172.21.15.116:0/231278682 learned_addr learned my addr 172.21.15.116:0/231278682 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:05.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f16ffd700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6f00004170 0x7f6f181557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f177fe700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f180c7940 0x7f6f180c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f167fc700 1 -- 172.21.15.116:0/231278682 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f180c7940 msgr2=0x7f6f180c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f167fc700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f180c7940 0x7f6f180c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f167fc700 1 -- 172.21.15.116:0/231278682 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6f00004170 msgr2=0x7f6f181557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f167fc700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6f00004170 0x7f6f181557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.016+0000 7f6f167fc700 1 -- 172.21.15.116:0/231278682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1806c6c0 con 0x7f6f180b2910 2023-05-12T09:09:05.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.017+0000 7f6f167fc700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f180b2910 0x7f6f18154f90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000baf0 tx=0x7f6f0c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:05.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.017+0000 7f6eff7fe700 1 -- 172.21.15.116:0/231278682 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c020070 con 0x7f6f180b2910 2023-05-12T09:09:05.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.017+0000 7f6eff7fe700 1 -- 172.21.15.116:0/231278682 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c004030 con 0x7f6f180b2910 2023-05-12T09:09:05.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.017+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/231278682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f180719e0 con 0x7f6f180b2910 2023-05-12T09:09:05.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.017+0000 7f6eff7fe700 1 -- 172.21.15.116:0/231278682 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c004220 con 0x7f6f180b2910 2023-05-12T09:09:05.025 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.017+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/231278682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1806c9a0 con 0x7f6f180b2910 2023-05-12T09:09:05.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.018+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/231278682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f180cbcf0 con 0x7f6f180b2910 2023-05-12T09:09:05.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.019+0000 7f6eff7fe700 1 -- 172.21.15.116:0/231278682 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f0c004380 con 0x7f6f180b2910 2023-05-12T09:09:05.026 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.020+0000 7f6eff7fe700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6f0406ace0 0x7f6f0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.020+0000 7f6eff7fe700 1 -- 172.21.15.116:0/231278682 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6f0c08a630 con 0x7f6f180b2910 2023-05-12T09:09:05.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.020+0000 7f6f16ffd700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6f0406ace0 0x7f6f0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.021+0000 7f6f16ffd700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6f0406ace0 0x7f6f0406d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6f180ce780 tx=0x7f6f08009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:05.027 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.024+0000 7f6eff7fe700 1 -- 172.21.15.116:0/231278682 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6f0c055590 con 0x7f6f180b2910 2023-05-12T09:09:05.223 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.220+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/231278682 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f18072f20 con 0x7f6f180b2910 2023-05-12T09:09:05.224 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.222+0000 7f6eff7fe700 1 -- 172.21.15.116:0/231278682 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18479 (secure 0 0 0) 0x7f6f0c058bb0 con 0x7f6f180b2910 2023-05-12T09:09:05.225 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:05.225 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":38,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:09:04.356048+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:09:02.727234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-12T09:09:03.331565+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:09:05.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/231278682 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6f0406ace0 msgr2=0x7f6f0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6f0406ace0 0x7f6f0406d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6f180ce780 tx=0x7f6f08009040 comp rx=0 tx=0).stop 2023-05-12T09:09:05.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/231278682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f180b2910 msgr2=0x7f6f18154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f180b2910 0x7f6f18154f90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000baf0 tx=0x7f6f0c0047c0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/231278682 shutdown_connections 2023-05-12T09:09:05.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f6f0406ace0 0x7f6f0406d190 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f6f180c7940 0x7f6f180c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f6f00004170 0x7f6f181557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 --2- 172.21.15.116:0/231278682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f180b2910 0x7f6f18154f90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/231278682 >> 172.21.15.116:0/231278682 conn(0x7f6f180cf720 msgr2=0x7f6f180ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:05.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/231278682 shutdown_connections 2023-05-12T09:09:05.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.224+0000 7f6f1d7ff700 1 -- 172.21.15.116:0/231278682 wait complete. 2023-05-12T09:09:05.245 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-12T09:09:05.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.431+0000 7f52c23ff700 1 Processor -- start 2023-05-12T09:09:05.434 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.431+0000 7f52c23ff700 1 -- start start 2023-05-12T09:09:05.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.432+0000 7f52c23ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15c590 0x7f52bc160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.432+0000 7f52c23ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc0cd520 con 0x7f52bc0cff50 2023-05-12T09:09:05.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.432+0000 7f52c23ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc0d2640 con 0x7f52bc0cf010 2023-05-12T09:09:05.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.432+0000 7f52c23ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc1610d0 con 0x7f52bc15c590 2023-05-12T09:09:05.435 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.432+0000 7f52c099c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f52bc0cff50 0x7f52bc0d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59596/0 (socket says 172.21.15.116:59596) 2023-05-12T09:09:05.436 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.432+0000 7f52c099c700 1 -- 172.21.15.116:0/1987167512 learned_addr learned my addr 172.21.15.116:0/1987167512 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:05.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52bbfff700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15c590 0x7f52bc160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220657591 0 0) 0x7f52bc0cd520 con 0x7f52bc0cff50 2023-05-12T09:09:05.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52a40035b0 con 0x7f52bc0cff50 2023-05-12T09:09:05.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2792574971 0 0) 0x7f52a40035b0 con 0x7f52bc0cff50 2023-05-12T09:09:05.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15c590 msgr2=0x7f52bc160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:05.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15c590 0x7f52bc160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 >> v1:172.21.15.182:6789/0 conn(0x7f52bc0cf010 legacy=0x7f52bc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0b23c0 con 0x7f52bc0cff50 2023-05-12T09:09:05.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f52b40019f0 con 0x7f52bc0cff50 2023-05-12T09:09:05.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 >> v1:172.21.15.116:6789/0 conn(0x7f52bc0cff50 legacy=0x7f52bc0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a4003a30 0x7f52a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15c590 0x7f52a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52a4004d90 0x7f52a4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc1610d0 con 0x7f52a4004d90 2023-05-12T09:09:05.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a400ba10 con 0x7f52a4003a30 2023-05-12T09:09:05.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a400bba0 con 0x7f52bc15c590 2023-05-12T09:09:05.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52c099c700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52a4004d90 0x7f52a4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.433+0000 7f52bbfff700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a4003a30 0x7f52a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.434+0000 7f52bb7fe700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15c590 0x7f52a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.434+0000 7f52c099c700 1 -- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15c590 msgr2=0x7f52a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:05.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.434+0000 7f52c099c700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15c590 0x7f52a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.434+0000 7f52c099c700 1 -- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a4003a30 msgr2=0x7f52a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:05.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.434+0000 7f52c099c700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a4003a30 0x7f52a4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.434+0000 7f52c099c700 1 -- 172.21.15.116:0/1987167512 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40035b0 con 0x7f52a4004d90 2023-05-12T09:09:05.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.434+0000 7f52c099c700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52a4004d90 0x7f52a4005200 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f52b400a7d0 tx=0x7f52a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964ec6794257f158 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:05.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.434+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4012600 con 0x7f52a4004d90 2023-05-12T09:09:05.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.434+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b4012760 con 0x7f52a4004d90 2023-05-12T09:09:05.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.434+0000 7f52baffd700 1 -- 172.21.15.116:0/1987167512 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4012b10 con 0x7f52a4004d90 2023-05-12T09:09:05.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.435+0000 7f52c23ff700 1 -- 172.21.15.116:0/1987167512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52a4004d90 msgr2=0x7f52a4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.435+0000 7f52c23ff700 1 --2- 172.21.15.116:0/1987167512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52a4004d90 0x7f52a4005200 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f52b400a7d0 tx=0x7f52a4005880 comp rx=0 tx=0).stop 2023-05-12T09:09:05.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.435+0000 7f52c099c700 1 -- 172.21.15.116:0/1987167512 reap_dead start 2023-05-12T09:09:05.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.435+0000 7f52c23ff700 1 -- 172.21.15.116:0/1987167512 shutdown_connections 2023-05-12T09:09:05.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.435+0000 7f52c23ff700 1 -- 172.21.15.116:0/1987167512 >> 172.21.15.116:0/1987167512 conn(0x7f52bc071b10 msgr2=0x7f52bc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:05.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.435+0000 7f52c23ff700 1 -- 172.21.15.116:0/1987167512 shutdown_connections 2023-05-12T09:09:05.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.435+0000 7f52c23ff700 1 -- 172.21.15.116:0/1987167512 wait complete. 2023-05-12T09:09:05.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.437+0000 7f52c23ff700 1 Processor -- start 2023-05-12T09:09:05.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.437+0000 7f52c23ff700 1 -- start start 2023-05-12T09:09:05.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c23ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a4004d90 0x7f52bc15b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c23ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15af00 0x7f52bc15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c23ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52bc0c8000 0x7f52bc0b7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c23ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0c7b70 con 0x7f52bc0c8000 2023-05-12T09:09:05.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c23ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0b72e0 con 0x7f52a4004d90 2023-05-12T09:09:05.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c23ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0b7020 con 0x7f52bc15af00 2023-05-12T09:09:05.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c099c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52bc0c8000 0x7f52bc0b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c099c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52bc0c8000 0x7f52bc0b7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35680/0 (socket says 172.21.15.116:35680) 2023-05-12T09:09:05.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c099c700 1 -- 172.21.15.116:0/1345679019 learned_addr learned my addr 172.21.15.116:0/1345679019 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:05.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52bbfff700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a4004d90 0x7f52bc15b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52bb7fe700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15af00 0x7f52bc15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c099c700 1 -- 172.21.15.116:0/1345679019 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15af00 msgr2=0x7f52bc15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c099c700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15af00 0x7f52bc15a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c099c700 1 -- 172.21.15.116:0/1345679019 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a4004d90 msgr2=0x7f52bc15b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:05.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c099c700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a4004d90 0x7f52bc15b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:05.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.438+0000 7f52c099c700 1 -- 172.21.15.116:0/1345679019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0cd770 con 0x7f52bc0c8000 2023-05-12T09:09:05.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.439+0000 7f52c099c700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52bc0c8000 0x7f52bc0b7620 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f52a4005800 tx=0x7f52b4001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:05.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.439+0000 7f52b8ff9700 1 -- 172.21.15.116:0/1345679019 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b40019b0 con 0x7f52bc0c8000 2023-05-12T09:09:05.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.439+0000 7f52b8ff9700 1 -- 172.21.15.116:0/1345679019 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b401e430 con 0x7f52bc0c8000 2023-05-12T09:09:05.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.439+0000 7f52c23ff700 1 -- 172.21.15.116:0/1345679019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc0cf560 con 0x7f52bc0c8000 2023-05-12T09:09:05.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.439+0000 7f52b8ff9700 1 -- 172.21.15.116:0/1345679019 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b401e7e0 con 0x7f52bc0c8000 2023-05-12T09:09:05.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.439+0000 7f52c23ff700 1 -- 172.21.15.116:0/1345679019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc15c960 con 0x7f52bc0c8000 2023-05-12T09:09:05.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.440+0000 7f52c23ff700 1 -- 172.21.15.116:0/1345679019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc0d3890 con 0x7f52bc0c8000 2023-05-12T09:09:05.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.441+0000 7f52b8ff9700 1 -- 172.21.15.116:0/1345679019 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52b401e940 con 0x7f52bc0c8000 2023-05-12T09:09:05.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.442+0000 7f52b8ff9700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f52a806ace0 0x7f52a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:05.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.443+0000 7f52b8ff9700 1 -- 172.21.15.116:0/1345679019 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f52b408b7f0 con 0x7f52bc0c8000 2023-05-12T09:09:05.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.443+0000 7f52bbfff700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f52a806ace0 0x7f52a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:05.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.443+0000 7f52bbfff700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f52a806ace0 0x7f52a806d190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009c60 tx=0x7f52ac009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:05.449 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.447+0000 7f52b8ff9700 1 -- 172.21.15.116:0/1345679019 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f52b4056750 con 0x7f52bc0c8000 2023-05-12T09:09:05.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:05.685+0000 7f52c23ff700 1 -- 172.21.15.116:0/1345679019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f52bc0b51f0 con 0x7f52bc0c8000 2023-05-12T09:09:06.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.487+0000 7f52b8ff9700 1 -- 172.21.15.116:0/1345679019 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f52b4059d70 con 0x7f52bc0c8000 2023-05-12T09:09:06.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 -- 172.21.15.116:0/1345679019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f52a806ace0 msgr2=0x7f52a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:06.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f52a806ace0 0x7f52a806d190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009c60 tx=0x7f52ac009210 comp rx=0 tx=0).stop 2023-05-12T09:09:06.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 -- 172.21.15.116:0/1345679019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52bc0c8000 msgr2=0x7f52bc0b7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:06.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52bc0c8000 0x7f52bc0b7620 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f52a4005800 tx=0x7f52b4001d00 comp rx=0 tx=0).stop 2023-05-12T09:09:06.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 -- 172.21.15.116:0/1345679019 shutdown_connections 2023-05-12T09:09:06.495 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52bc0c8000 0x7f52bc0b7620 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:06.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a4004d90 0x7f52bc15b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:06.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f52a806ace0 0x7f52a806d190 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:06.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 --2- 172.21.15.116:0/1345679019 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52bc15af00 0x7f52bc15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:06.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 -- 172.21.15.116:0/1345679019 >> 172.21.15.116:0/1345679019 conn(0x7f52bc071b10 msgr2=0x7f52bc15bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:06.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 -- 172.21.15.116:0/1345679019 shutdown_connections 2023-05-12T09:09:06.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.491+0000 7f52c23ff700 1 -- 172.21.15.116:0/1345679019 wait complete. 2023-05-12T09:09:06.514 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-12T09:09:06.515 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-12T09:09:06.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.703+0000 7fa8b4bff700 1 Processor -- start 2023-05-12T09:09:06.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.704+0000 7fa8b4bff700 1 -- start start 2023-05-12T09:09:06.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.705+0000 7fa8b4bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8b015c590 0x7fa8b0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:06.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.705+0000 7fa8b4bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fa8b00cf010 0x7fa8b00cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:06.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.705+0000 7fa8b4bff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00cd520 con 0x7fa8b00cfd80 2023-05-12T09:09:06.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.705+0000 7fa8b4bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b00d2640 con 0x7fa8b00cf010 2023-05-12T09:09:06.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.705+0000 7fa8b4bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b01610d0 con 0x7fa8b015c590 2023-05-12T09:09:06.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.705+0000 7fa8aed9d700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa8b00cfd80 0x7fa8b00d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59600/0 (socket says 172.21.15.116:59600) 2023-05-12T09:09:06.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.705+0000 7fa8aed9d700 1 -- 172.21.15.116:0/1735066522 learned_addr learned my addr 172.21.15.116:0/1735066522 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:06.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.705+0000 7fa8ae59c700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8b015c590 0x7fa8b0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:06.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.705+0000 7fa8a7fff700 1 --2- 172.21.15.116:0/1735066522 >> v2:172.21.15.182:3300/0 conn(0x7fa8b00cf010 0x7fa8b00cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:06.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.705+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076648606 0 0) 0x7fa8b00cd520 con 0x7fa8b00cfd80 2023-05-12T09:09:06.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa89c0035b0 con 0x7fa8b00cfd80 2023-05-12T09:09:06.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1612784890 0 0) 0x7fa89c0035b0 con 0x7fa8b00cfd80 2023-05-12T09:09:06.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8b015c590 msgr2=0x7fa8b0160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:06.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8b015c590 0x7fa8b0160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:06.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 >> v2:172.21.15.182:3300/0 conn(0x7fa8b00cf010 msgr2=0x7fa8b00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:06.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 --2- 172.21.15.116:0/1735066522 >> v2:172.21.15.182:3300/0 conn(0x7fa8b00cf010 0x7fa8b00cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:06.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00d0200 con 0x7fa8b00cfd80 2023-05-12T09:09:06.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7fa8a80019f0 con 0x7fa8b00cfd80 2023-05-12T09:09:06.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 >> v1:172.21.15.116:6789/0 conn(0x7fa8b00cfd80 legacy=0x7fa8b00d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:06.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa89c003a00 0x7fa89c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:06.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8b015c590 0x7fa89c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:06.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa89c004d90 0x7fa89c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:06.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00d2640 con 0x7fa89c004d90 2023-05-12T09:09:06.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b01610d0 con 0x7fa89c003a00 2023-05-12T09:09:06.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c00ba10 con 0x7fa8b015c590 2023-05-12T09:09:06.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8a7fff700 1 --2- 172.21.15.116:0/1735066522 >> v2:172.21.15.182:3300/0 conn(0x7fa8b00cf010 0x7fa8b00cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:09:06.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8aed9d700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa89c004d90 0x7fa89c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:06.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8ae59c700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa89c003a00 0x7fa89c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:06.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.706+0000 7fa8a7fff700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8b015c590 0x7fa89c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:06.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.707+0000 7fa8aed9d700 1 -- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8b015c590 msgr2=0x7fa89c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:06.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.707+0000 7fa8aed9d700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa8b015c590 0x7fa89c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:06.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.707+0000 7fa8aed9d700 1 -- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa89c003a00 msgr2=0x7fa89c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:06.715 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.707+0000 7fa8aed9d700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa89c003a00 0x7fa89c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:06.715 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.707+0000 7fa8aed9d700 1 -- 172.21.15.116:0/1735066522 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0035b0 con 0x7fa89c004d90 2023-05-12T09:09:06.715 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.707+0000 7fa8aed9d700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa89c004d90 0x7fa89c005200 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800a830 tx=0x7fa89c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7db5dd4066ff8c6 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:06.715 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.707+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8012600 con 0x7fa89c004d90 2023-05-12T09:09:06.715 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.707+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8012760 con 0x7fa89c004d90 2023-05-12T09:09:06.716 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.707+0000 7fa8add9b700 1 -- 172.21.15.116:0/1735066522 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8012b10 con 0x7fa89c004d90 2023-05-12T09:09:06.716 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.708+0000 7fa8b4bff700 1 -- 172.21.15.116:0/1735066522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa89c004d90 msgr2=0x7fa89c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:06.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.708+0000 7fa8b4bff700 1 --2- 172.21.15.116:0/1735066522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa89c004d90 0x7fa89c005200 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800a830 tx=0x7fa89c005880 comp rx=0 tx=0).stop 2023-05-12T09:09:06.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.708+0000 7fa8aed9d700 1 -- 172.21.15.116:0/1735066522 reap_dead start 2023-05-12T09:09:06.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.708+0000 7fa8b4bff700 1 -- 172.21.15.116:0/1735066522 shutdown_connections 2023-05-12T09:09:06.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.708+0000 7fa8b4bff700 1 -- 172.21.15.116:0/1735066522 >> 172.21.15.116:0/1735066522 conn(0x7fa8b0071b10 msgr2=0x7fa8b0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:06.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.708+0000 7fa8b4bff700 1 -- 172.21.15.116:0/1735066522 shutdown_connections 2023-05-12T09:09:06.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.708+0000 7fa8b4bff700 1 -- 172.21.15.116:0/1735066522 wait complete. 2023-05-12T09:09:06.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.709+0000 7fa8b4bff700 1 Processor -- start 2023-05-12T09:09:06.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.710+0000 7fa8b4bff700 1 -- start start 2023-05-12T09:09:06.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.710+0000 7fa8b4bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa89c004d90 0x7fa8b0146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:06.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.710+0000 7fa8b4bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa8b01550c0 0x7fa8b0145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:06.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.710+0000 7fa8b4bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b0145780 0x7fa8b01472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:06.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8b4bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0145c00 con 0x7fa8b0145780 2023-05-12T09:09:06.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8b4bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0145ee0 con 0x7fa8b01550c0 2023-05-12T09:09:06.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8b4bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b01461c0 con 0x7fa89c004d90 2023-05-12T09:09:06.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8aed9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b0145780 0x7fa8b01472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:06.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8aed9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b0145780 0x7fa8b01472d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35702/0 (socket says 172.21.15.116:35702) 2023-05-12T09:09:06.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8aed9d700 1 -- 172.21.15.116:0/110693935 learned_addr learned my addr 172.21.15.116:0/110693935 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:06.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8a7fff700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa8b01550c0 0x7fa8b0145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:06.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8aed9d700 1 -- 172.21.15.116:0/110693935 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa89c004d90 msgr2=0x7fa8b0146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:06.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8ae59c700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa89c004d90 0x7fa8b0146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:06.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8aed9d700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa89c004d90 0x7fa8b0146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:06.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8aed9d700 1 -- 172.21.15.116:0/110693935 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa8b01550c0 msgr2=0x7fa8b0145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:06.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8aed9d700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa8b01550c0 0x7fa8b0145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:06.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8aed9d700 1 -- 172.21.15.116:0/110693935 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00cf560 con 0x7fa8b0145780 2023-05-12T09:09:06.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8ae59c700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa89c004d90 0x7fa8b0146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:06.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.711+0000 7fa8aed9d700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b0145780 0x7fa8b01472d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8015040 tx=0x7fa8b00d25b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:06.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.712+0000 7fa8a6ffd700 1 -- 172.21.15.116:0/110693935 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a801e610 con 0x7fa8b0145780 2023-05-12T09:09:06.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.712+0000 7fa8a6ffd700 1 -- 172.21.15.116:0/110693935 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a801e770 con 0x7fa8b0145780 2023-05-12T09:09:06.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.712+0000 7fa8b4bff700 1 -- 172.21.15.116:0/110693935 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b00b23c0 con 0x7fa8b0145780 2023-05-12T09:09:06.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.712+0000 7fa8a6ffd700 1 -- 172.21.15.116:0/110693935 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a801eb20 con 0x7fa8b0145780 2023-05-12T09:09:06.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.712+0000 7fa8b4bff700 1 -- 172.21.15.116:0/110693935 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b00cd770 con 0x7fa8b0145780 2023-05-12T09:09:06.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.713+0000 7fa8b4bff700 1 -- 172.21.15.116:0/110693935 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b00b51f0 con 0x7fa8b0145780 2023-05-12T09:09:06.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.714+0000 7fa8a6ffd700 1 -- 172.21.15.116:0/110693935 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8a8019030 con 0x7fa8b0145780 2023-05-12T09:09:06.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.715+0000 7fa8a6ffd700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa89006ace0 0x7fa89006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:06.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.715+0000 7fa8a6ffd700 1 -- 172.21.15.116:0/110693935 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa8a808b380 con 0x7fa8b0145780 2023-05-12T09:09:06.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.715+0000 7fa8ae59c700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa89006ace0 0x7fa89006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:06.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.715+0000 7fa8ae59c700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa89006ace0 0x7fa89006d190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009ae0 tx=0x7fa8a0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:06.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.719+0000 7fa8a6ffd700 1 -- 172.21.15.116:0/110693935 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa8a8056400 con 0x7fa8b0145780 2023-05-12T09:09:06.860 INFO:tasks.ceph.mds.a.smithi116.stderr:2023-05-12T09:09:06.858+0000 7fa60d1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-12T09:09:06.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:06.957+0000 7fa8b4bff700 1 -- 172.21.15.116:0/110693935 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa8b00b51f0 con 0x7fa8b0145780 2023-05-12T09:09:07.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.493+0000 7fa8a6ffd700 1 -- 172.21.15.116:0/110693935 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa8a80170c0 con 0x7fa8b0145780 2023-05-12T09:09:07.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 -- 172.21.15.116:0/110693935 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa89006ace0 msgr2=0x7fa89006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:07.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa89006ace0 0x7fa89006d190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009ae0 tx=0x7fa8a0008040 comp rx=0 tx=0).stop 2023-05-12T09:09:07.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 -- 172.21.15.116:0/110693935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b0145780 msgr2=0x7fa8b01472d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:07.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b0145780 0x7fa8b01472d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8015040 tx=0x7fa8b00d25b0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 -- 172.21.15.116:0/110693935 shutdown_connections 2023-05-12T09:09:07.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b0145780 0x7fa8b01472d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fa89006ace0 0x7fa89006d190 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa89c004d90 0x7fa8b0146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 --2- 172.21.15.116:0/110693935 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa8b01550c0 0x7fa8b0145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 -- 172.21.15.116:0/110693935 >> 172.21.15.116:0/110693935 conn(0x7fa8b0071b10 msgr2=0x7fa8b00b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:07.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 -- 172.21.15.116:0/110693935 shutdown_connections 2023-05-12T09:09:07.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.495+0000 7fa8b4bff700 1 -- 172.21.15.116:0/110693935 wait complete. 2023-05-12T09:09:07.515 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-12T09:09:07.516 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:09:07.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.697+0000 7ff8ffdff700 1 Processor -- start 2023-05-12T09:09:07.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.697+0000 7ff8ffdff700 1 -- start start 2023-05-12T09:09:07.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.698+0000 7ff8ffdff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7ff8f815c590 0x7ff8f8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:07.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.698+0000 7ff8ffdff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cf010 0x7ff8f80cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.698+0000 7ff8ffdff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f80cd520 con 0x7ff8f80cfd80 2023-05-12T09:09:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.698+0000 7ff8ffdff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f80d2640 con 0x7ff8f815c590 2023-05-12T09:09:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.698+0000 7ff8ffdff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f81610d0 con 0x7ff8f80cf010 2023-05-12T09:09:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fe39c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff8f80cfd80 0x7ff8f80d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59604/0 (socket says 172.21.15.116:59604) 2023-05-12T09:09:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fe39c700 1 -- 172.21.15.116:0/1549969024 learned_addr learned my addr 172.21.15.116:0/1549969024 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fdb9b700 1 --2- 172.21.15.116:0/1549969024 >> v2:172.21.15.182:3300/0 conn(0x7ff8f815c590 0x7ff8f8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:07.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fd39a700 1 --2- 172.21.15.116:0/1549969024 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cf010 0x7ff8f80cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:07.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fcb99700 1 -- 172.21.15.116:0/1549969024 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173030985 0 0) 0x7ff8f80cd520 con 0x7ff8f80cfd80 2023-05-12T09:09:07.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fcb99700 1 -- 172.21.15.116:0/1549969024 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e40035b0 con 0x7ff8f80cfd80 2023-05-12T09:09:07.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fd39a700 1 -- 172.21.15.116:0/1549969024 >> v2:172.21.15.182:3300/0 conn(0x7ff8f815c590 msgr2=0x7ff8f8160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:07.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fd39a700 1 --2- 172.21.15.116:0/1549969024 >> v2:172.21.15.182:3300/0 conn(0x7ff8f815c590 0x7ff8f8160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fd39a700 1 -- 172.21.15.116:0/1549969024 >> v1:172.21.15.116:6789/0 conn(0x7ff8f80cfd80 legacy=0x7ff8f80d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:07.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fd39a700 1 -- 172.21.15.116:0/1549969024 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f80d0200 con 0x7ff8f80cf010 2023-05-12T09:09:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.699+0000 7ff8fdb9b700 1 --2- 172.21.15.116:0/1549969024 >> v2:172.21.15.182:3300/0 conn(0x7ff8f815c590 0x7ff8f8160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:09:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.700+0000 7ff8fd39a700 1 --2- 172.21.15.116:0/1549969024 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cf010 0x7ff8f80cf840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009840 tx=0x7ff8e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c01ccb18479f6c server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.700+0000 7ff8fcb99700 1 -- 172.21.15.116:0/1549969024 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8011830 con 0x7ff8f80cf010 2023-05-12T09:09:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.700+0000 7ff8fcb99700 1 -- 172.21.15.116:0/1549969024 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e8011990 con 0x7ff8f80cf010 2023-05-12T09:09:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.700+0000 7ff8fcb99700 1 -- 172.21.15.116:0/1549969024 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8011d20 con 0x7ff8f80cf010 2023-05-12T09:09:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.700+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1549969024 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cf010 msgr2=0x7ff8f80cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.700+0000 7ff8ffdff700 1 --2- 172.21.15.116:0/1549969024 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cf010 0x7ff8f80cf840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009840 tx=0x7ff8e8009b50 comp rx=0 tx=0).stop 2023-05-12T09:09:07.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.701+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1549969024 shutdown_connections 2023-05-12T09:09:07.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.701+0000 7ff8ffdff700 1 --2- 172.21.15.116:0/1549969024 >> v2:172.21.15.182:3300/0 conn(0x7ff8f815c590 0x7ff8f8160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.701+0000 7ff8ffdff700 1 --2- 172.21.15.116:0/1549969024 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cf010 0x7ff8f80cf840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.701+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1549969024 >> 172.21.15.116:0/1549969024 conn(0x7ff8f8071b10 msgr2=0x7ff8f8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:07.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.701+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1549969024 shutdown_connections 2023-05-12T09:09:07.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.701+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1549969024 wait complete. 2023-05-12T09:09:07.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.702+0000 7ff8ffdff700 1 Processor -- start 2023-05-12T09:09:07.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.702+0000 7ff8ffdff700 1 -- start start 2023-05-12T09:09:07.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.703+0000 7ff8ffdff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f80cf010 0x7ff8f8158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:07.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.703+0000 7ff8ffdff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cfd80 0x7ff8f815e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:07.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.703+0000 7ff8ffdff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f815c590 0x7ff8f815d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:07.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.703+0000 7ff8ffdff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f815ecb0 con 0x7ff8f815c590 2023-05-12T09:09:07.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.703+0000 7ff8ffdff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f815cb00 con 0x7ff8f80cf010 2023-05-12T09:09:07.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.703+0000 7ff8ffdff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f815e9d0 con 0x7ff8f80cfd80 2023-05-12T09:09:07.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fe39c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f815c590 0x7ff8f815d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:07.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fe39c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f815c590 0x7ff8f815d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35704/0 (socket says 172.21.15.116:35704) 2023-05-12T09:09:07.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fe39c700 1 -- 172.21.15.116:0/1036384062 learned_addr learned my addr 172.21.15.116:0/1036384062 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:07.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fd39a700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cfd80 0x7ff8f815e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:07.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fdb9b700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f80cf010 0x7ff8f8158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fe39c700 1 -- 172.21.15.116:0/1036384062 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cfd80 msgr2=0x7ff8f815e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fe39c700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cfd80 0x7ff8f815e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fe39c700 1 -- 172.21.15.116:0/1036384062 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f80cf010 msgr2=0x7ff8f8158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fe39c700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f80cf010 0x7ff8f8158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fe39c700 1 -- 172.21.15.116:0/1036384062 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40094a0 con 0x7ff8f815c590 2023-05-12T09:09:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.704+0000 7ff8fe39c700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f815c590 0x7ff8f815d5a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000cb40 tx=0x7ff8f000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.705+0000 7ff8ee7fc700 1 -- 172.21.15.116:0/1036384062 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f000a9e0 con 0x7ff8f815c590 2023-05-12T09:09:07.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.705+0000 7ff8ee7fc700 1 -- 172.21.15.116:0/1036384062 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f000ab40 con 0x7ff8f815c590 2023-05-12T09:09:07.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.705+0000 7ff8ee7fc700 1 -- 172.21.15.116:0/1036384062 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0012400 con 0x7ff8f815c590 2023-05-12T09:09:07.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.705+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1036384062 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e80094a0 con 0x7ff8f815c590 2023-05-12T09:09:07.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.705+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1036384062 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f80cf560 con 0x7ff8f815c590 2023-05-12T09:09:07.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.706+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1036384062 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f80cd770 con 0x7ff8f815c590 2023-05-12T09:09:07.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.707+0000 7ff8ee7fc700 1 -- 172.21.15.116:0/1036384062 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8f001b3b0 con 0x7ff8f815c590 2023-05-12T09:09:07.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.708+0000 7ff8ee7fc700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8dc06ad10 0x7ff8dc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:07.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.708+0000 7ff8ee7fc700 1 -- 172.21.15.116:0/1036384062 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff8f0089170 con 0x7ff8f815c590 2023-05-12T09:09:07.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.708+0000 7ff8fdb9b700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8dc06ad10 0x7ff8dc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:07.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.709+0000 7ff8fdb9b700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8dc06ad10 0x7ff8dc06d1c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009cd0 tx=0x7ff8f4009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:07.715 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.712+0000 7ff8ee7fc700 1 -- 172.21.15.116:0/1036384062 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff8f00540f0 con 0x7ff8f815c590 2023-05-12T09:09:07.952 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.949+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1036384062 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8f815c960 con 0x7ff8f815c590 2023-05-12T09:09:07.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.950+0000 7ff8ee7fc700 1 -- 172.21.15.116:0/1036384062 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7ff8f815c960 con 0x7ff8f815c590 2023-05-12T09:09:07.953 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:07.953 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6834/593435655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":593435655},{"type":"v1","addr":"172.21.15.182:6834","nonce":593435655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/842957183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6833","nonce":842957183},{"type":"v1","addr":"172.21.15.182:6835","nonce":842957183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2126365264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2126365264},{"type":"v1","addr":"172.21.15.116:6836","nonce":2126365264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:09:04.356393+0000","modified":"2023-05-12T09:09:07.489713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6837/1678737826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":1678737826},{"type":"v1","addr":"172.21.15.116:6837","nonce":1678737826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-12T09:09:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1036384062 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8dc06ad10 msgr2=0x7ff8dc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:07.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8dc06ad10 0x7ff8dc06d1c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009cd0 tx=0x7ff8f4009210 comp rx=0 tx=0).stop 2023-05-12T09:09:07.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1036384062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f815c590 msgr2=0x7ff8f815d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:07.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f815c590 0x7ff8f815d5a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000cb40 tx=0x7ff8f000ce50 comp rx=0 tx=0).stop 2023-05-12T09:09:07.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1036384062 shutdown_connections 2023-05-12T09:09:07.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8f815c590 0x7ff8f815d5a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff8f80cf010 0x7ff8f8158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff8dc06ad10 0x7ff8dc06d1c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 --2- 172.21.15.116:0/1036384062 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff8f80cfd80 0x7ff8f815e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:07.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1036384062 >> 172.21.15.116:0/1036384062 conn(0x7ff8f8071b10 msgr2=0x7ff8f80d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:07.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1036384062 shutdown_connections 2023-05-12T09:09:07.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:07.952+0000 7ff8ffdff700 1 -- 172.21.15.116:0/1036384062 wait complete. 2023-05-12T09:09:07.957 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 17 2023-05-12T09:09:07.972 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-12T09:09:08.156 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.153+0000 7f476f1ff700 1 Processor -- start 2023-05-12T09:09:08.157 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.154+0000 7f476f1ff700 1 -- start start 2023-05-12T09:09:08.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f476f1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f476815a280 0x7f476815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.158 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f476f1ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f47680cd640 0x7f47680cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f476f1ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f47680d00b0 0x7f47680d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f476f1ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476815d6e0 con 0x7f47680cd640 2023-05-12T09:09:08.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f476f1ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476815d9c0 con 0x7f47680d00b0 2023-05-12T09:09:08.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f476f1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476815dca0 con 0x7f476815a280 2023-05-12T09:09:08.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f4767fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f47680cd640 0x7f47680cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f4767fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f47680cd640 0x7f47680cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35712/0 (socket says 172.21.15.116:35712) 2023-05-12T09:09:08.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f4767fff700 1 -- 172.21.15.116:0/726724230 learned_addr learned my addr 172.21.15.116:0/726724230 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:08.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f476cf9b700 1 --2- 172.21.15.116:0/726724230 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f476815a280 0x7f476815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.155+0000 7f476d79c700 1 --2- 172.21.15.116:0/726724230 >> v2:172.21.15.182:3300/0 conn(0x7f47680d00b0 0x7f47680d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.156+0000 7f4767fff700 1 -- 172.21.15.116:0/726724230 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f476815a280 msgr2=0x7f476815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:08.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.156+0000 7f4767fff700 1 --2- 172.21.15.116:0/726724230 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f476815a280 0x7f476815cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.160 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.156+0000 7f4767fff700 1 -- 172.21.15.116:0/726724230 >> v2:172.21.15.182:3300/0 conn(0x7f47680d00b0 msgr2=0x7f47680d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:08.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.156+0000 7f4767fff700 1 --2- 172.21.15.116:0/726724230 >> v2:172.21.15.182:3300/0 conn(0x7f47680d00b0 0x7f47680d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.161 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.156+0000 7f4767fff700 1 -- 172.21.15.116:0/726724230 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47680cf370 con 0x7f47680cd640 2023-05-12T09:09:08.162 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.156+0000 7f4767fff700 1 --2- 172.21.15.116:0/726724230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 0x7f47680cfb70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f47680b2a00 tx=0x7f4754009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f178aa260bf66acf server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:08.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.156+0000 7f47677fe700 1 -- 172.21.15.116:0/726724230 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754011830 con 0x7f47680cd640 2023-05-12T09:09:08.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.156+0000 7f47677fe700 1 -- 172.21.15.116:0/726724230 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4754011990 con 0x7f47680cd640 2023-05-12T09:09:08.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.156+0000 7f47677fe700 1 -- 172.21.15.116:0/726724230 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754011d20 con 0x7f47680cd640 2023-05-12T09:09:08.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.157+0000 7f476f1ff700 1 -- 172.21.15.116:0/726724230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 msgr2=0x7f47680cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:08.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.157+0000 7f476f1ff700 1 --2- 172.21.15.116:0/726724230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 0x7f47680cfb70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f47680b2a00 tx=0x7f4754009bd0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.157+0000 7f476f1ff700 1 -- 172.21.15.116:0/726724230 shutdown_connections 2023-05-12T09:09:08.163 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.157+0000 7f476f1ff700 1 --2- 172.21.15.116:0/726724230 >> v2:172.21.15.182:3300/0 conn(0x7f47680d00b0 0x7f47680d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.157+0000 7f476f1ff700 1 --2- 172.21.15.116:0/726724230 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f476815a280 0x7f476815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.157+0000 7f476f1ff700 1 --2- 172.21.15.116:0/726724230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 0x7f47680cfb70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.157+0000 7f476f1ff700 1 -- 172.21.15.116:0/726724230 >> 172.21.15.116:0/726724230 conn(0x7f4768066260 msgr2=0x7f4768071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.157+0000 7f476f1ff700 1 -- 172.21.15.116:0/726724230 shutdown_connections 2023-05-12T09:09:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.157+0000 7f476f1ff700 1 -- 172.21.15.116:0/726724230 wait complete. 2023-05-12T09:09:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.158+0000 7f476f1ff700 1 Processor -- start 2023-05-12T09:09:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.159+0000 7f476f1ff700 1 -- start start 2023-05-12T09:09:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.159+0000 7f476f1ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 0x7f47680b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.159+0000 7f476f1ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47680d00b0 0x7f47680b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.159+0000 7f476f1ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f476815a280 0x7f476815c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.159+0000 7f476f1ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47680b15f0 con 0x7f47680cd640 2023-05-12T09:09:08.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.159+0000 7f476f1ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47681f2bf0 con 0x7f47680d00b0 2023-05-12T09:09:08.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.159+0000 7f476f1ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47681f22c0 con 0x7f476815a280 2023-05-12T09:09:08.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476cf9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 0x7f47680b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.165 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476cf9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 0x7f47680b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35726/0 (socket says 172.21.15.116:35726) 2023-05-12T09:09:08.166 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476cf9b700 1 -- 172.21.15.116:0/3054699925 learned_addr learned my addr 172.21.15.116:0/3054699925 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476d79c700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f476815a280 0x7f476815c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f4767fff700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47680d00b0 0x7f47680b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476cf9b700 1 -- 172.21.15.116:0/3054699925 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f476815a280 msgr2=0x7f476815c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476cf9b700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f476815a280 0x7f476815c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476cf9b700 1 -- 172.21.15.116:0/3054699925 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47680d00b0 msgr2=0x7f47680b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476cf9b700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47680d00b0 0x7f47680b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476cf9b700 1 -- 172.21.15.116:0/3054699925 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754009550 con 0x7f47680cd640 2023-05-12T09:09:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476cf9b700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 0x7f47680b10b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f475c00e870 tx=0x7f475c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f47657fa700 1 -- 172.21.15.116:0/3054699925 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c009590 con 0x7f47680cd640 2023-05-12T09:09:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f47657fa700 1 -- 172.21.15.116:0/3054699925 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00ee70 con 0x7f47680cd640 2023-05-12T09:09:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f47657fa700 1 -- 172.21.15.116:0/3054699925 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00ca50 con 0x7f47680cd640 2023-05-12T09:09:08.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.160+0000 7f476f1ff700 1 -- 172.21.15.116:0/3054699925 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476815a650 con 0x7f47680cd640 2023-05-12T09:09:08.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.161+0000 7f476f1ff700 1 -- 172.21.15.116:0/3054699925 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47680cf650 con 0x7f47680cd640 2023-05-12T09:09:08.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.162+0000 7f476f1ff700 1 -- 172.21.15.116:0/3054699925 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476815b960 con 0x7f47680cd640 2023-05-12T09:09:08.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.162+0000 7f47657fa700 1 -- 172.21.15.116:0/3054699925 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f475c00cbb0 con 0x7f47680cd640 2023-05-12T09:09:08.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.163+0000 7f47657fa700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f474c06ace0 0x7f474c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.164+0000 7f47657fa700 1 -- 172.21.15.116:0/3054699925 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f475c0895a0 con 0x7f47680cd640 2023-05-12T09:09:08.169 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.164+0000 7f4767fff700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f474c06ace0 0x7f474c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.170 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.164+0000 7f4767fff700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f474c06ace0 0x7f474c06d190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4754009c10 tx=0x7f4754008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:08.170 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.168+0000 7f47657fa700 1 -- 172.21.15.116:0/3054699925 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f475c057f90 con 0x7f47680cd640 2023-05-12T09:09:08.364 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.361+0000 7f476f1ff700 1 -- 172.21.15.116:0/3054699925 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47681f2ed0 con 0x7f47680cd640 2023-05-12T09:09:08.365 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.362+0000 7f47657fa700 1 -- 172.21.15.116:0/3054699925 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18466 (secure 0 0 0) 0x7f475c00ce60 con 0x7f47680cd640 2023-05-12T09:09:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:08.366 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":39,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","created":"2023-05-12T09:06:50.656994+0000","modified":"2023-05-12T09:09:05.359037+0000","last_up_change":"2023-05-12T09:07:02.690568+0000","last_in_change":"2023-05-12T09:06:54.048302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-05-12T09:07:03.219127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-05-12T09:07:03.622639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-12T09:09:02.727234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-12T09:09:03.331565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a895b977-4507-46be-abf8-494fe2e88561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6810","nonce":179733737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6813","nonce":179733737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6820","nonce":179733737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":179733737},{"type":"v1","addr":"172.21.15.116:6817","nonce":179733737}]},"public_addr":"172.21.15.116:6810/179733737","cluster_addr":"172.21.15.116:6813/179733737","heartbeat_back_addr":"172.21.15.116:6820/179733737","heartbeat_front_addr":"172.21.15.116:6817/179733737","state":["exists","up"]},{"osd":1,"uuid":"d19ccfdf-9409-41c5-807b-8a27593f3e51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6809","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6811","nonce":2195307728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6816","nonce":2195307728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6823","nonce":2195307728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2195307728},{"type":"v1","addr":"172.21.15.116:6821","nonce":2195307728}]},"public_addr":"172.21.15.116:6811/2195307728","cluster_addr":"172.21.15.116:6816/2195307728","heartbeat_back_addr":"172.21.15.116:6823/2195307728","heartbeat_front_addr":"172.21.15.116:6821/2195307728","state":["exists","up"]},{"osd":2,"uuid":"15b1f7d0-6853-4d4d-ac87-adc73d48b055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6825","nonce":4207784314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6827","nonce":4207784314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6831","nonce":4207784314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":4207784314},{"type":"v1","addr":"172.21.15.116:6829","nonce":4207784314}]},"public_addr":"172.21.15.116:6825/4207784314","cluster_addr":"172.21.15.116:6827/4207784314","heartbeat_back_addr":"172.21.15.116:6831/4207784314","heartbeat_front_addr":"172.21.15.116:6829/4207784314","state":["exists","up"]},{"osd":3,"uuid":"e8e98cd8-d7fd-4307-ad89-c70964d64c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6801","nonce":1873865019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6803","nonce":1873865019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6807","nonce":1873865019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1873865019},{"type":"v1","addr":"172.21.15.116:6805","nonce":1873865019}]},"public_addr":"172.21.15.116:6801/1873865019","cluster_addr":"172.21.15.116:6803/1873865019","heartbeat_back_addr":"172.21.15.116:6807/1873865019","heartbeat_front_addr":"172.21.15.116:6805/1873865019","state":["exists","up"]},{"osd":4,"uuid":"73ace088-82d8-4fba-9170-09b4d10f7b87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6818","nonce":716845104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6823","nonce":716845104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6831","nonce":716845104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":716845104},{"type":"v1","addr":"172.21.15.182:6828","nonce":716845104}]},"public_addr":"172.21.15.182:6818/716845104","cluster_addr":"172.21.15.182:6823/716845104","heartbeat_back_addr":"172.21.15.182:6831/716845104","heartbeat_front_addr":"172.21.15.182:6828/716845104","state":["exists","up"]},{"osd":5,"uuid":"2c936693-f8a7-4184-8198-a1c9fe3bd3a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6801","nonce":2534244617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6803","nonce":2534244617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6807","nonce":2534244617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":2534244617},{"type":"v1","addr":"172.21.15.182:6805","nonce":2534244617}]},"public_addr":"172.21.15.182:6801/2534244617","cluster_addr":"172.21.15.182:6803/2534244617","heartbeat_back_addr":"172.21.15.182:6807/2534244617","heartbeat_front_addr":"172.21.15.182:6805/2534244617","state":["exists","up"]},{"osd":6,"uuid":"fb07de79-ab57-4163-9fc4-850e2af91d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6817","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6819","nonce":2483408776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6821","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6822","nonce":2483408776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6827","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6829","nonce":2483408776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":2483408776},{"type":"v1","addr":"172.21.15.182:6825","nonce":2483408776}]},"public_addr":"172.21.15.182:6819/2483408776","cluster_addr":"172.21.15.182:6822/2483408776","heartbeat_back_addr":"172.21.15.182:6829/2483408776","heartbeat_front_addr":"172.21.15.182:6825/2483408776","state":["exists","up"]},{"osd":7,"uuid":"34996781-b72a-4aa1-88b2-9945c6dcd356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6809","nonce":273358957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6811","nonce":273358957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6815","nonce":273358957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":273358957},{"type":"v1","addr":"172.21.15.182:6813","nonce":273358957}]},"public_addr":"172.21.15.182:6809/273358957","cluster_addr":"172.21.15.182:6811/273358957","heartbeat_back_addr":"172.21.15.182:6815/273358957","heartbeat_front_addr":"172.21.15.182:6813/273358957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.375624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.344210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.378798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.391301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.354733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.104681+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.371635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-12T09:06:59.329226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-12T09:09:08.368 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 -- 172.21.15.116:0/3054699925 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f474c06ace0 msgr2=0x7f474c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:08.368 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f474c06ace0 0x7f474c06d190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4754009c10 tx=0x7f4754008030 comp rx=0 tx=0).stop 2023-05-12T09:09:08.368 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 -- 172.21.15.116:0/3054699925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 msgr2=0x7f47680b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:08.368 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 0x7f47680b10b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f475c00e870 tx=0x7f475c00ec30 comp rx=0 tx=0).stop 2023-05-12T09:09:08.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 -- 172.21.15.116:0/3054699925 shutdown_connections 2023-05-12T09:09:08.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f474c06ace0 0x7f474c06d190 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f476815a280 0x7f476815c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47680cd640 0x7f47680b10b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 --2- 172.21.15.116:0/3054699925 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47680d00b0 0x7f47680b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 -- 172.21.15.116:0/3054699925 >> 172.21.15.116:0/3054699925 conn(0x7f4768066260 msgr2=0x7f47681602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:08.369 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 -- 172.21.15.116:0/3054699925 shutdown_connections 2023-05-12T09:09:08.370 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.365+0000 7f476f1ff700 1 -- 172.21.15.116:0/3054699925 wait complete. 2023-05-12T09:09:08.385 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-12T09:09:08.386 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-12T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.567+0000 7f62c03ff700 1 Processor -- start 2023-05-12T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.567+0000 7f62c03ff700 1 -- start start 2023-05-12T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62c03ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f62b815c590 0x7f62b8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62c03ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cf010 0x7f62b80cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62c03ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f62b80cfd80 0x7f62b80d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62c03ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b80cd520 con 0x7f62b80cfd80 2023-05-12T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62c03ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b80d2640 con 0x7f62b815c590 2023-05-12T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62c03ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81610d0 con 0x7f62b80cf010 2023-05-12T09:09:08.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62be99c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f62b80cfd80 0x7f62b80d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62be99c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f62b80cfd80 0x7f62b80d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35740/0 (socket says 172.21.15.116:35740) 2023-05-12T09:09:08.573 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62be99c700 1 -- 172.21.15.116:0/3419974653 learned_addr learned my addr 172.21.15.116:0/3419974653 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:08.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62be19b700 1 --2- 172.21.15.116:0/3419974653 >> v2:172.21.15.182:3300/0 conn(0x7f62b815c590 0x7f62b8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.568+0000 7f62bd99a700 1 --2- 172.21.15.116:0/3419974653 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cf010 0x7f62b80cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.569+0000 7f62be99c700 1 -- 172.21.15.116:0/3419974653 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cf010 msgr2=0x7f62b80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:08.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.569+0000 7f62be99c700 1 --2- 172.21.15.116:0/3419974653 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cf010 0x7f62b80cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.569+0000 7f62be99c700 1 -- 172.21.15.116:0/3419974653 >> v2:172.21.15.182:3300/0 conn(0x7f62b815c590 msgr2=0x7f62b8160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:08.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.569+0000 7f62be99c700 1 --2- 172.21.15.116:0/3419974653 >> v2:172.21.15.182:3300/0 conn(0x7f62b815c590 0x7f62b8160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.574 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.569+0000 7f62be99c700 1 -- 172.21.15.116:0/3419974653 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80d0200 con 0x7f62b80cfd80 2023-05-12T09:09:08.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.569+0000 7f62be99c700 1 --2- 172.21.15.116:0/3419974653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cfd80 0x7f62b80d0aa0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f62b80d0a50 tx=0x7f62b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e93fb017039aa22 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:08.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.569+0000 7f62bd199700 1 -- 172.21.15.116:0/3419974653 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b000e070 con 0x7f62b80cfd80 2023-05-12T09:09:08.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.569+0000 7f62bd199700 1 -- 172.21.15.116:0/3419974653 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b000b910 con 0x7f62b80cfd80 2023-05-12T09:09:08.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.569+0000 7f62bd199700 1 -- 172.21.15.116:0/3419974653 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b000bcc0 con 0x7f62b80cfd80 2023-05-12T09:09:08.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.570+0000 7f62c03ff700 1 -- 172.21.15.116:0/3419974653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cfd80 msgr2=0x7f62b80d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:08.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.570+0000 7f62c03ff700 1 --2- 172.21.15.116:0/3419974653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cfd80 0x7f62b80d0aa0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f62b80d0a50 tx=0x7f62b000b330 comp rx=0 tx=0).stop 2023-05-12T09:09:08.575 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.570+0000 7f62c03ff700 1 -- 172.21.15.116:0/3419974653 shutdown_connections 2023-05-12T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.570+0000 7f62c03ff700 1 --2- 172.21.15.116:0/3419974653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cfd80 0x7f62b80d0aa0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.570+0000 7f62c03ff700 1 --2- 172.21.15.116:0/3419974653 >> v2:172.21.15.182:3300/0 conn(0x7f62b815c590 0x7f62b8160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.570+0000 7f62c03ff700 1 --2- 172.21.15.116:0/3419974653 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cf010 0x7f62b80cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.570+0000 7f62c03ff700 1 -- 172.21.15.116:0/3419974653 >> 172.21.15.116:0/3419974653 conn(0x7f62b8071b10 msgr2=0x7f62b8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.570+0000 7f62c03ff700 1 -- 172.21.15.116:0/3419974653 shutdown_connections 2023-05-12T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.570+0000 7f62c03ff700 1 -- 172.21.15.116:0/3419974653 wait complete. 2023-05-12T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.572+0000 7f62c03ff700 1 Processor -- start 2023-05-12T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.573+0000 7f62c03ff700 1 -- start start 2023-05-12T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62c03ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cf010 0x7f62b814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62c03ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cfd80 0x7f62b815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62c03ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62b815c590 0x7f62b80b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62c03ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81e74b0 con 0x7f62b80cf010 2023-05-12T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62c03ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81e7020 con 0x7f62b815c590 2023-05-12T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62c03ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b815b6d0 con 0x7f62b80cfd80 2023-05-12T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62be19b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cf010 0x7f62b814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62be19b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cf010 0x7f62b814e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35756/0 (socket says 172.21.15.116:35756) 2023-05-12T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62be19b700 1 -- 172.21.15.116:0/670221042 learned_addr learned my addr 172.21.15.116:0/670221042 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62be19b700 1 -- 172.21.15.116:0/670221042 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cfd80 msgr2=0x7f62b815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62be99c700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62b815c590 0x7f62b80b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62bd99a700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cfd80 0x7f62b815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62be19b700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cfd80 0x7f62b815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62be19b700 1 -- 172.21.15.116:0/670221042 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62b815c590 msgr2=0x7f62b80b7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62be19b700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62b815c590 0x7f62b80b7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62be19b700 1 -- 172.21.15.116:0/670221042 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b0009b30 con 0x7f62b80cf010 2023-05-12T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62be99c700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62b815c590 0x7f62b80b7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.574+0000 7f62bd99a700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cfd80 0x7f62b815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.575+0000 7f62be19b700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cf010 0x7f62b814e4b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f62b400e870 tx=0x7f62b400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.575+0000 7f62aeffd700 1 -- 172.21.15.116:0/670221042 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4009590 con 0x7f62b80cf010 2023-05-12T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.575+0000 7f62aeffd700 1 -- 172.21.15.116:0/670221042 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b400ee70 con 0x7f62b80cf010 2023-05-12T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.575+0000 7f62c03ff700 1 -- 172.21.15.116:0/670221042 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b80cf560 con 0x7f62b80cf010 2023-05-12T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.575+0000 7f62aeffd700 1 -- 172.21.15.116:0/670221042 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400c9f0 con 0x7f62b80cf010 2023-05-12T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.575+0000 7f62c03ff700 1 -- 172.21.15.116:0/670221042 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b80b23c0 con 0x7f62b80cf010 2023-05-12T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.576+0000 7f62c03ff700 1 -- 172.21.15.116:0/670221042 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b80cd770 con 0x7f62b80cf010 2023-05-12T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.577+0000 7f62aeffd700 1 -- 172.21.15.116:0/670221042 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62b400cb50 con 0x7f62b80cf010 2023-05-12T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.578+0000 7f62aeffd700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f629c06ad10 0x7f629c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.578+0000 7f62aeffd700 1 -- 172.21.15.116:0/670221042 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f62b4089810 con 0x7f62b80cf010 2023-05-12T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.578+0000 7f62bd99a700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f629c06ad10 0x7f629c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.579+0000 7f62bd99a700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f629c06ad10 0x7f629c06d1c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f62b81e7850 tx=0x7f62a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.583+0000 7f62aeffd700 1 -- 172.21.15.116:0/670221042 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f62b4058200 con 0x7f62b80cf010 2023-05-12T09:09:08.777 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.774+0000 7f62c03ff700 1 -- 172.21.15.116:0/670221042 --> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62b81e7300 con 0x7f629c06ad10 2023-05-12T09:09:08.787 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.784+0000 7f62aeffd700 1 -- 172.21.15.116:0/670221042 <== mgr.4106 v2:172.21.15.116:6832/3989593778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298984 (secure 0 0 0) 0x7f62b81e7300 con 0x7f629c06ad10 2023-05-12T09:09:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:08.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 -- 172.21.15.116:0/670221042 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f629c06ad10 msgr2=0x7f629c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:08.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f629c06ad10 0x7f629c06d1c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f62b81e7850 tx=0x7f62a8008040 comp rx=0 tx=0).stop 2023-05-12T09:09:08.792 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 -- 172.21.15.116:0/670221042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cf010 msgr2=0x7f62b814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:08.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cf010 0x7f62b814e4b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f62b400e870 tx=0x7f62b400ec30 comp rx=0 tx=0).stop 2023-05-12T09:09:08.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 -- 172.21.15.116:0/670221042 shutdown_connections 2023-05-12T09:09:08.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f62b815c590 0x7f62b80b7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62b80cf010 0x7f62b814e4b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.793 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f629c06ad10 0x7f629c06d1c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 --2- 172.21.15.116:0/670221042 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f62b80cfd80 0x7f62b815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:08.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 -- 172.21.15.116:0/670221042 >> 172.21.15.116:0/670221042 conn(0x7f62b8071b10 msgr2=0x7f62b80b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:08.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 -- 172.21.15.116:0/670221042 shutdown_connections 2023-05-12T09:09:08.794 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:08.788+0000 7f62c03ff700 1 -- 172.21.15.116:0/670221042 wait complete. 2023-05-12T09:09:08.794 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2023-05-12T09:09:08.808 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-05-12T09:09:07.593738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69624,"kb_used_data":4344,"kb_used_omap":0,"kb_used_meta":65216,"kb_avail":754905096,"statfs":{"total":773094113280,"available":773022818304,"internally_reserved":0,"allocated":4448256,"data_stored":2615135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66781184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.721791"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877225+0000","last_change":"2023-05-12T09:09:02.877225+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877225+0000","last_undegraded":"2023-05-12T09:09:02.877225+0000","last_fullsized":"2023-05-12T09:09:02.877225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.878725+0000","last_change":"2023-05-12T09:09:02.878725+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.878725+0000","last_undegraded":"2023-05-12T09:09:02.878725+0000","last_fullsized":"2023-05-12T09:09:02.878725+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.882702+0000","last_change":"2023-05-12T09:09:02.882702+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.882702+0000","last_undegraded":"2023-05-12T09:09:02.882702+0000","last_fullsized":"2023-05-12T09:09:02.882702+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880861+0000","last_change":"2023-05-12T09:09:02.880861+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880861+0000","last_undegraded":"2023-05-12T09:09:02.880861+0000","last_fullsized":"2023-05-12T09:09:02.880861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877040+0000","last_change":"2023-05-12T09:09:02.877040+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877040+0000","last_undegraded":"2023-05-12T09:09:02.877040+0000","last_fullsized":"2023-05-12T09:09:02.877040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.879163+0000","last_change":"2023-05-12T09:09:02.879163+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.879163+0000","last_undegraded":"2023-05-12T09:09:02.879163+0000","last_fullsized":"2023-05-12T09:09:02.879163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.884446+0000","last_change":"2023-05-12T09:09:02.884446+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.884446+0000","last_undegraded":"2023-05-12T09:09:02.884446+0000","last_fullsized":"2023-05-12T09:09:02.884446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.881199+0000","last_change":"2023-05-12T09:09:02.881199+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.881199+0000","last_undegraded":"2023-05-12T09:09:02.881199+0000","last_fullsized":"2023-05-12T09:09:02.881199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.878843+0000","last_change":"2023-05-12T09:09:02.878843+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.878843+0000","last_undegraded":"2023-05-12T09:09:02.878843+0000","last_fullsized":"2023-05-12T09:09:02.878843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880224+0000","last_change":"2023-05-12T09:09:02.880224+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880224+0000","last_undegraded":"2023-05-12T09:09:02.880224+0000","last_fullsized":"2023-05-12T09:09:02.880224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.881315+0000","last_change":"2023-05-12T09:09:02.881315+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.881315+0000","last_undegraded":"2023-05-12T09:09:02.881315+0000","last_fullsized":"2023-05-12T09:09:02.881315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.875308+0000","last_change":"2023-05-12T09:09:02.875308+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.875308+0000","last_undegraded":"2023-05-12T09:09:02.875308+0000","last_fullsized":"2023-05-12T09:09:02.875308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877860+0000","last_change":"2023-05-12T09:09:02.877860+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877860+0000","last_undegraded":"2023-05-12T09:09:02.877860+0000","last_fullsized":"2023-05-12T09:09:02.877860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880640+0000","last_change":"2023-05-12T09:09:02.880640+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880640+0000","last_undegraded":"2023-05-12T09:09:02.880640+0000","last_fullsized":"2023-05-12T09:09:02.880640+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877019+0000","last_change":"2023-05-12T09:09:02.877019+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877019+0000","last_undegraded":"2023-05-12T09:09:02.877019+0000","last_fullsized":"2023-05-12T09:09:02.877019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880792+0000","last_change":"2023-05-12T09:09:02.880792+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880792+0000","last_undegraded":"2023-05-12T09:09:02.880792+0000","last_fullsized":"2023-05-12T09:09:02.880792+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.875338+0000","last_change":"2023-05-12T09:09:02.875338+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.875338+0000","last_undegraded":"2023-05-12T09:09:02.875338+0000","last_fullsized":"2023-05-12T09:09:02.875338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.879220+0000","last_change":"2023-05-12T09:09:02.879220+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.879220+0000","last_undegraded":"2023-05-12T09:09:02.879220+0000","last_fullsized":"2023-05-12T09:09:02.879220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.884666+0000","last_change":"2023-05-12T09:09:02.884666+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.884666+0000","last_undegraded":"2023-05-12T09:09:02.884666+0000","last_fullsized":"2023-05-12T09:09:02.884666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877105+0000","last_change":"2023-05-12T09:09:02.877105+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877105+0000","last_undegraded":"2023-05-12T09:09:02.877105+0000","last_fullsized":"2023-05-12T09:09:02.877105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877489+0000","last_change":"2023-05-12T09:09:02.877489+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877489+0000","last_undegraded":"2023-05-12T09:09:02.877489+0000","last_fullsized":"2023-05-12T09:09:02.877489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.884519+0000","last_change":"2023-05-12T09:09:02.884519+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.884519+0000","last_undegraded":"2023-05-12T09:09:02.884519+0000","last_fullsized":"2023-05-12T09:09:02.884519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880231+0000","last_change":"2023-05-12T09:09:02.880231+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880231+0000","last_undegraded":"2023-05-12T09:09:02.880231+0000","last_fullsized":"2023-05-12T09:09:02.880231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.881158+0000","last_change":"2023-05-12T09:09:02.881158+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.881158+0000","last_undegraded":"2023-05-12T09:09:02.881158+0000","last_fullsized":"2023-05-12T09:09:02.881158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.878610+0000","last_change":"2023-05-12T09:09:02.878610+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.878610+0000","last_undegraded":"2023-05-12T09:09:02.878610+0000","last_fullsized":"2023-05-12T09:09:02.878610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.879649+0000","last_change":"2023-05-12T09:07:04.835422+0000","last_active":"2023-05-12T09:09:02.879649+0000","last_peered":"2023-05-12T09:09:02.879649+0000","last_clean":"2023-05-12T09:09:02.879649+0000","last_became_active":"2023-05-12T09:07:04.834944+0000","last_became_peered":"2023-05-12T09:07:04.834944+0000","last_unstale":"2023-05-12T09:09:02.879649+0000","last_undegraded":"2023-05-12T09:09:02.879649+0000","last_fullsized":"2023-05-12T09:09:02.879649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:29:24.273386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880677+0000","last_change":"2023-05-12T09:09:02.880677+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880677+0000","last_undegraded":"2023-05-12T09:09:02.880677+0000","last_fullsized":"2023-05-12T09:09:02.880677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.878623+0000","last_change":"2023-05-12T09:07:04.828759+0000","last_active":"2023-05-12T09:09:02.878623+0000","last_peered":"2023-05-12T09:09:02.878623+0000","last_clean":"2023-05-12T09:09:02.878623+0000","last_became_active":"2023-05-12T09:07:04.828460+0000","last_became_peered":"2023-05-12T09:07:04.828460+0000","last_unstale":"2023-05-12T09:09:02.878623+0000","last_undegraded":"2023-05-12T09:09:02.878623+0000","last_fullsized":"2023-05-12T09:09:02.878623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:35:33.028873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.882248+0000","last_change":"2023-05-12T09:09:02.882248+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.882248+0000","last_undegraded":"2023-05-12T09:09:02.882248+0000","last_fullsized":"2023-05-12T09:09:02.882248+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.883051+0000","last_change":"2023-05-12T09:07:04.830658+0000","last_active":"2023-05-12T09:09:02.883051+0000","last_peered":"2023-05-12T09:09:02.883051+0000","last_clean":"2023-05-12T09:09:02.883051+0000","last_became_active":"2023-05-12T09:07:04.830354+0000","last_became_peered":"2023-05-12T09:07:04.830354+0000","last_unstale":"2023-05-12T09:09:02.883051+0000","last_undegraded":"2023-05-12T09:09:02.883051+0000","last_fullsized":"2023-05-12T09:09:02.883051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:09.569523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":189,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.882383+0000","last_change":"2023-05-12T09:07:04.830850+0000","last_active":"2023-05-12T09:09:02.882383+0000","last_peered":"2023-05-12T09:09:02.882383+0000","last_clean":"2023-05-12T09:09:02.882383+0000","last_became_active":"2023-05-12T09:07:04.829577+0000","last_became_peered":"2023-05-12T09:07:04.829577+0000","last_unstale":"2023-05-12T09:09:02.882383+0000","last_undegraded":"2023-05-12T09:09:02.882383+0000","last_fullsized":"2023-05-12T09:09:02.882383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:09.569523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880722+0000","last_change":"2023-05-12T09:09:02.880722+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880722+0000","last_undegraded":"2023-05-12T09:09:02.880722+0000","last_fullsized":"2023-05-12T09:09:02.880722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.882187+0000","last_change":"2023-05-12T09:07:05.258677+0000","last_active":"2023-05-12T09:09:02.882187+0000","last_peered":"2023-05-12T09:09:02.882187+0000","last_clean":"2023-05-12T09:09:02.882187+0000","last_became_active":"2023-05-12T09:07:05.258372+0000","last_became_peered":"2023-05-12T09:07:05.258372+0000","last_unstale":"2023-05-12T09:09:02.882187+0000","last_undegraded":"2023-05-12T09:09:02.882187+0000","last_fullsized":"2023-05-12T09:09:02.882187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:31.600721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.884629+0000","last_change":"2023-05-12T09:09:02.884629+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.884629+0000","last_undegraded":"2023-05-12T09:09:02.884629+0000","last_fullsized":"2023-05-12T09:09:02.884629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.882230+0000","last_change":"2023-05-12T09:07:05.258599+0000","last_active":"2023-05-12T09:09:02.882230+0000","last_peered":"2023-05-12T09:09:02.882230+0000","last_clean":"2023-05-12T09:09:02.882230+0000","last_became_active":"2023-05-12T09:07:05.258301+0000","last_became_peered":"2023-05-12T09:07:05.258301+0000","last_unstale":"2023-05-12T09:09:02.882230+0000","last_undegraded":"2023-05-12T09:09:02.882230+0000","last_fullsized":"2023-05-12T09:09:02.882230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:08:04.454291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877121+0000","last_change":"2023-05-12T09:09:02.877121+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877121+0000","last_undegraded":"2023-05-12T09:09:02.877121+0000","last_fullsized":"2023-05-12T09:09:02.877121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.885512+0000","last_change":"2023-05-12T09:07:05.258734+0000","last_active":"2023-05-12T09:09:02.885512+0000","last_peered":"2023-05-12T09:09:02.885512+0000","last_clean":"2023-05-12T09:09:02.885512+0000","last_became_active":"2023-05-12T09:07:05.258376+0000","last_became_peered":"2023-05-12T09:07:05.258376+0000","last_unstale":"2023-05-12T09:09:02.885512+0000","last_undegraded":"2023-05-12T09:09:02.885512+0000","last_fullsized":"2023-05-12T09:09:02.885512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:31.600721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.882203+0000","last_change":"2023-05-12T09:09:02.882203+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.882203+0000","last_undegraded":"2023-05-12T09:09:02.882203+0000","last_fullsized":"2023-05-12T09:09:02.882203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.877378+0000","last_change":"2023-05-12T09:07:05.258598+0000","last_active":"2023-05-12T09:09:02.877378+0000","last_peered":"2023-05-12T09:09:02.877378+0000","last_clean":"2023-05-12T09:09:02.877378+0000","last_became_active":"2023-05-12T09:07:05.258280+0000","last_became_peered":"2023-05-12T09:07:05.258280+0000","last_unstale":"2023-05-12T09:09:02.877378+0000","last_undegraded":"2023-05-12T09:09:02.877378+0000","last_fullsized":"2023-05-12T09:09:02.877378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:23:58.769376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880369+0000","last_change":"2023-05-12T09:09:02.880369+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880369+0000","last_undegraded":"2023-05-12T09:09:02.880369+0000","last_fullsized":"2023-05-12T09:09:02.880369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.877367+0000","last_change":"2023-05-12T09:07:04.830787+0000","last_active":"2023-05-12T09:09:02.877367+0000","last_peered":"2023-05-12T09:09:02.877367+0000","last_clean":"2023-05-12T09:09:02.877367+0000","last_became_active":"2023-05-12T09:07:04.830492+0000","last_became_peered":"2023-05-12T09:07:04.830492+0000","last_unstale":"2023-05-12T09:09:02.877367+0000","last_undegraded":"2023-05-12T09:09:02.877367+0000","last_fullsized":"2023-05-12T09:09:02.877367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:30:02.338742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9492,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362348,"statfs":{"total":96636764160,"available":96627044352,"internally_reserved":0,"allocated":995328,"data_stored":766122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.497}]},{"osd":1,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.4560000000000004,"5min":4.4560000000000004,"15min":4.4560000000000004},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5620000000000003,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":174393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":6.9550000000000001,"5min":6.9550000000000001,"15min":6.9550000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.9370000000000003,"5min":5.9370000000000003,"15min":5.9370000000000003},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":7.024,"5min":7.024,"15min":7.024},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.96,"5min":5.96,"15min":5.96},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.41899999999999998}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.62},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9568,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362272,"statfs":{"total":96636764160,"available":96626966528,"internally_reserved":0,"allocated":1007616,"data_stored":772612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.377},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.441}]},{"osd":4,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.502},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.5640000000000001,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8476,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363364,"statfs":{"total":96636764160,"available":96628084736,"internally_reserved":0,"allocated":413696,"data_stored":182244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":6.8220000000000001,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":11.914,"5min":11.914,"15min":11.914},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.8470000000000004,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":12.064,"5min":12.064,"15min":12.064},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":6.7229999999999999,"5min":6.7229999999999999,"15min":6.7229999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":12.034000000000001,"5min":12.034000000000001,"15min":12.034000000000001},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":6.7910000000000004,"5min":6.7910000000000004,"15min":6.7910000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":11.968,"5min":11.968,"15min":11.968},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":6.7599999999999998,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":6.867,"5min":6.867,"15min":6.867},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":12.004,"5min":12.004,"15min":12.004},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":174393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.498},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.42799999999999999}]},{"osd":3,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.79700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8476,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363364,"statfs":{"total":96636764160,"available":96628084736,"internally_reserved":0,"allocated":413696,"data_stored":182244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.497}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.318},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8540,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363300,"statfs":{"total":96636764160,"available":96628019200,"internally_reserved":0,"allocated":413696,"data_stored":182244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":8.7530000000000001,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":8.7710000000000008,"5min":8.7710000000000008,"15min":8.7710000000000008},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.532,"5min":4.532,"15min":4.532},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.625},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8408,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363432,"statfs":{"total":96636764160,"available":96628154368,"internally_reserved":0,"allocated":409600,"data_stored":180883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.748},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.629}]},{"osd":3,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-12T09:09:08.816 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-12T09:09:09.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.028+0000 7ff7c49ff700 1 Processor -- start 2023-05-12T09:09:09.031 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.028+0000 7ff7c49ff700 1 -- start start 2023-05-12T09:09:09.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.029+0000 7ff7c49ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c00adf70 0x7ff7c00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.029+0000 7ff7c49ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c00cc9e0 con 0x7ff7c00cd760 2023-05-12T09:09:09.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.029+0000 7ff7c49ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c015de20 con 0x7ff7c015cf10 2023-05-12T09:09:09.032 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.029+0000 7ff7c49ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c015d860 con 0x7ff7c00adf70 2023-05-12T09:09:09.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.029+0000 7ff7be59c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff7c00cd760 0x7ff7c00cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59606/0 (socket says 172.21.15.116:59606) 2023-05-12T09:09:09.033 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.029+0000 7ff7be59c700 1 -- 172.21.15.116:0/1200017387 learned_addr learned my addr 172.21.15.116:0/1200017387 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:09.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.030+0000 7ff7bdd9b700 1 --2- 172.21.15.116:0/1200017387 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c00adf70 0x7ff7c00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.030+0000 7ff7bd59a700 1 -- 172.21.15.116:0/1200017387 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886548025 0 0) 0x7ff7c00cc9e0 con 0x7ff7c00cd760 2023-05-12T09:09:09.034 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.030+0000 7ff7bd59a700 1 -- 172.21.15.116:0/1200017387 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a80035b0 con 0x7ff7c00cd760 2023-05-12T09:09:09.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.030+0000 7ff7bd59a700 1 -- 172.21.15.116:0/1200017387 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695626044 0 0) 0x7ff7c015de20 con 0x7ff7c015cf10 2023-05-12T09:09:09.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.030+0000 7ff7bd59a700 1 -- 172.21.15.116:0/1200017387 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c00cc9e0 con 0x7ff7c015cf10 2023-05-12T09:09:09.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.030+0000 7ff7bd59a700 1 -- 172.21.15.116:0/1200017387 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3239325331 0 0) 0x7ff7a80035b0 con 0x7ff7c00cd760 2023-05-12T09:09:09.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.030+0000 7ff7bdd9b700 1 -- 172.21.15.116:0/1200017387 >> v1:172.21.15.182:6789/0 conn(0x7ff7c015cf10 legacy=0x7ff7c006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.030+0000 7ff7bdd9b700 1 -- 172.21.15.116:0/1200017387 >> v1:172.21.15.116:6789/0 conn(0x7ff7c00cd760 legacy=0x7ff7c00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.030+0000 7ff7bdd9b700 1 -- 172.21.15.116:0/1200017387 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c015db40 con 0x7ff7c00adf70 2023-05-12T09:09:09.035 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.030+0000 7ff7bdd9b700 1 --2- 172.21.15.116:0/1200017387 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c00adf70 0x7ff7c00cce70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009850 tx=0x7ff7b4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58de5a4cf87ce303 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:09.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.031+0000 7ff7bd59a700 1 -- 172.21.15.116:0/1200017387 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0001670 con 0x7ff7c00adf70 2023-05-12T09:09:09.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.031+0000 7ff7bd59a700 1 -- 172.21.15.116:0/1200017387 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4005c30 con 0x7ff7c00adf70 2023-05-12T09:09:09.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.031+0000 7ff7bd59a700 1 -- 172.21.15.116:0/1200017387 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4004030 con 0x7ff7c00adf70 2023-05-12T09:09:09.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.031+0000 7ff7c49ff700 1 -- 172.21.15.116:0/1200017387 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c00adf70 msgr2=0x7ff7c00cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.031+0000 7ff7c49ff700 1 --2- 172.21.15.116:0/1200017387 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c00adf70 0x7ff7c00cce70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009850 tx=0x7ff7b4009b60 comp rx=0 tx=0).stop 2023-05-12T09:09:09.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.031+0000 7ff7c49ff700 1 -- 172.21.15.116:0/1200017387 shutdown_connections 2023-05-12T09:09:09.036 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.031+0000 7ff7c49ff700 1 --2- 172.21.15.116:0/1200017387 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c00adf70 0x7ff7c00cce70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.031+0000 7ff7c49ff700 1 -- 172.21.15.116:0/1200017387 >> 172.21.15.116:0/1200017387 conn(0x7ff7c00cf720 msgr2=0x7ff7c00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:09.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.031+0000 7ff7c49ff700 1 -- 172.21.15.116:0/1200017387 shutdown_connections 2023-05-12T09:09:09.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.031+0000 7ff7c49ff700 1 -- 172.21.15.116:0/1200017387 wait complete. 2023-05-12T09:09:09.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.033+0000 7ff7c49ff700 1 Processor -- start 2023-05-12T09:09:09.037 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.034+0000 7ff7c49ff700 1 -- start start 2023-05-12T09:09:09.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7c49ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff7c00adf70 0x7ff7c00b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7c49ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7c00cd760 0x7ff7c014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.039 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7c49ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c015cf10 0x7ff7c00c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7c49ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00b3a10 con 0x7ff7c00cd760 2023-05-12T09:09:09.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7c49ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c014f4e0 con 0x7ff7c00adf70 2023-05-12T09:09:09.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7c49ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00b3e30 con 0x7ff7c015cf10 2023-05-12T09:09:09.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7bdd9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7c00cd760 0x7ff7c014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7bdd9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7c00cd760 0x7ff7c014efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35762/0 (socket says 172.21.15.116:35762) 2023-05-12T09:09:09.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7bdd9b700 1 -- 172.21.15.116:0/2216457253 learned_addr learned my addr 172.21.15.116:0/2216457253 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:09.040 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7bed9d700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c015cf10 0x7ff7c00c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.035+0000 7ff7be59c700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff7c00adf70 0x7ff7c00b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7bdd9b700 1 -- 172.21.15.116:0/2216457253 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c015cf10 msgr2=0x7ff7c00c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7bdd9b700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c015cf10 0x7ff7c00c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7bdd9b700 1 -- 172.21.15.116:0/2216457253 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff7c00adf70 msgr2=0x7ff7c00b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7bdd9b700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff7c00adf70 0x7ff7c00b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7bdd9b700 1 -- 172.21.15.116:0/2216457253 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4009430 con 0x7ff7c00cd760 2023-05-12T09:09:09.041 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7bdd9b700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7c00cd760 0x7ff7c014efa0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4004000 tx=0x7ff7b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:09.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7aeffd700 1 -- 172.21.15.116:0/2216457253 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4003ab0 con 0x7ff7c00cd760 2023-05-12T09:09:09.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7aeffd700 1 -- 172.21.15.116:0/2216457253 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4003c10 con 0x7ff7c00cd760 2023-05-12T09:09:09.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7aeffd700 1 -- 172.21.15.116:0/2216457253 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4011420 con 0x7ff7c00cd760 2023-05-12T09:09:09.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7c49ff700 1 -- 172.21.15.116:0/2216457253 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c0071600 con 0x7ff7c00cd760 2023-05-12T09:09:09.042 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.036+0000 7ff7c49ff700 1 -- 172.21.15.116:0/2216457253 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c00cc670 con 0x7ff7c00cd760 2023-05-12T09:09:09.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.037+0000 7ff7c49ff700 1 -- 172.21.15.116:0/2216457253 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c00b3b50 con 0x7ff7c00cd760 2023-05-12T09:09:09.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.038+0000 7ff7aeffd700 1 -- 172.21.15.116:0/2216457253 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7b4018030 con 0x7ff7c00cd760 2023-05-12T09:09:09.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.039+0000 7ff7aeffd700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff7a006ace0 0x7ff7a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.043 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.039+0000 7ff7aeffd700 1 -- 172.21.15.116:0/2216457253 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff7b408a810 con 0x7ff7c00cd760 2023-05-12T09:09:09.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.039+0000 7ff7be59c700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff7a006ace0 0x7ff7a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.040+0000 7ff7be59c700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff7a006ace0 0x7ff7a006d190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff7c006ccf0 tx=0x7ff7b0001d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:09.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.043+0000 7ff7aeffd700 1 -- 172.21.15.116:0/2216457253 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff7c00b3b50 con 0x7ff7c00cd760 2023-05-12T09:09:09.235 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.232+0000 7ff7c49ff700 1 -- 172.21.15.116:0/2216457253 --> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7c00b3b50 con 0x7ff7a006ace0 2023-05-12T09:09:09.243 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.240+0000 7ff7aeffd700 1 -- 172.21.15.116:0/2216457253 <== mgr.4106 v2:172.21.15.116:6832/3989593778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298984 (secure 0 0 0) 0x7ff7c00b3b50 con 0x7ff7a006ace0 2023-05-12T09:09:09.246 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:09.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 -- 172.21.15.116:0/2216457253 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff7a006ace0 msgr2=0x7ff7a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff7a006ace0 0x7ff7a006d190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff7c006ccf0 tx=0x7ff7b0001d80 comp rx=0 tx=0).stop 2023-05-12T09:09:09.248 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 -- 172.21.15.116:0/2216457253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7c00cd760 msgr2=0x7ff7c014efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7c00cd760 0x7ff7c014efa0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4004000 tx=0x7ff7b4004750 comp rx=0 tx=0).stop 2023-05-12T09:09:09.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 -- 172.21.15.116:0/2216457253 shutdown_connections 2023-05-12T09:09:09.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff7a006ace0 0x7ff7a006d190 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff7c015cf10 0x7ff7c00c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff7c00adf70 0x7ff7c00b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 --2- 172.21.15.116:0/2216457253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7c00cd760 0x7ff7c014efa0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 -- 172.21.15.116:0/2216457253 >> 172.21.15.116:0/2216457253 conn(0x7ff7c00cf720 msgr2=0x7ff7c015a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:09.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 -- 172.21.15.116:0/2216457253 shutdown_connections 2023-05-12T09:09:09.250 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.244+0000 7ff7c49ff700 1 -- 172.21.15.116:0/2216457253 wait complete. 2023-05-12T09:09:09.250 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2023-05-12T09:09:09.264 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-05-12T09:09:07.593738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69624,"kb_used_data":4344,"kb_used_omap":0,"kb_used_meta":65216,"kb_avail":754905096,"statfs":{"total":773094113280,"available":773022818304,"internally_reserved":0,"allocated":4448256,"data_stored":2615135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66781184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.721791"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877225+0000","last_change":"2023-05-12T09:09:02.877225+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877225+0000","last_undegraded":"2023-05-12T09:09:02.877225+0000","last_fullsized":"2023-05-12T09:09:02.877225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.878725+0000","last_change":"2023-05-12T09:09:02.878725+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.878725+0000","last_undegraded":"2023-05-12T09:09:02.878725+0000","last_fullsized":"2023-05-12T09:09:02.878725+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.882702+0000","last_change":"2023-05-12T09:09:02.882702+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.882702+0000","last_undegraded":"2023-05-12T09:09:02.882702+0000","last_fullsized":"2023-05-12T09:09:02.882702+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880861+0000","last_change":"2023-05-12T09:09:02.880861+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880861+0000","last_undegraded":"2023-05-12T09:09:02.880861+0000","last_fullsized":"2023-05-12T09:09:02.880861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877040+0000","last_change":"2023-05-12T09:09:02.877040+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877040+0000","last_undegraded":"2023-05-12T09:09:02.877040+0000","last_fullsized":"2023-05-12T09:09:02.877040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.879163+0000","last_change":"2023-05-12T09:09:02.879163+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.879163+0000","last_undegraded":"2023-05-12T09:09:02.879163+0000","last_fullsized":"2023-05-12T09:09:02.879163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.884446+0000","last_change":"2023-05-12T09:09:02.884446+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.884446+0000","last_undegraded":"2023-05-12T09:09:02.884446+0000","last_fullsized":"2023-05-12T09:09:02.884446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.881199+0000","last_change":"2023-05-12T09:09:02.881199+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.881199+0000","last_undegraded":"2023-05-12T09:09:02.881199+0000","last_fullsized":"2023-05-12T09:09:02.881199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.878843+0000","last_change":"2023-05-12T09:09:02.878843+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.878843+0000","last_undegraded":"2023-05-12T09:09:02.878843+0000","last_fullsized":"2023-05-12T09:09:02.878843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880224+0000","last_change":"2023-05-12T09:09:02.880224+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880224+0000","last_undegraded":"2023-05-12T09:09:02.880224+0000","last_fullsized":"2023-05-12T09:09:02.880224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.881315+0000","last_change":"2023-05-12T09:09:02.881315+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.881315+0000","last_undegraded":"2023-05-12T09:09:02.881315+0000","last_fullsized":"2023-05-12T09:09:02.881315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.875308+0000","last_change":"2023-05-12T09:09:02.875308+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.875308+0000","last_undegraded":"2023-05-12T09:09:02.875308+0000","last_fullsized":"2023-05-12T09:09:02.875308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877860+0000","last_change":"2023-05-12T09:09:02.877860+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877860+0000","last_undegraded":"2023-05-12T09:09:02.877860+0000","last_fullsized":"2023-05-12T09:09:02.877860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880640+0000","last_change":"2023-05-12T09:09:02.880640+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880640+0000","last_undegraded":"2023-05-12T09:09:02.880640+0000","last_fullsized":"2023-05-12T09:09:02.880640+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877019+0000","last_change":"2023-05-12T09:09:02.877019+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877019+0000","last_undegraded":"2023-05-12T09:09:02.877019+0000","last_fullsized":"2023-05-12T09:09:02.877019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880792+0000","last_change":"2023-05-12T09:09:02.880792+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880792+0000","last_undegraded":"2023-05-12T09:09:02.880792+0000","last_fullsized":"2023-05-12T09:09:02.880792+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.875338+0000","last_change":"2023-05-12T09:09:02.875338+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.875338+0000","last_undegraded":"2023-05-12T09:09:02.875338+0000","last_fullsized":"2023-05-12T09:09:02.875338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.879220+0000","last_change":"2023-05-12T09:09:02.879220+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.879220+0000","last_undegraded":"2023-05-12T09:09:02.879220+0000","last_fullsized":"2023-05-12T09:09:02.879220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.884666+0000","last_change":"2023-05-12T09:09:02.884666+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.884666+0000","last_undegraded":"2023-05-12T09:09:02.884666+0000","last_fullsized":"2023-05-12T09:09:02.884666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877105+0000","last_change":"2023-05-12T09:09:02.877105+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877105+0000","last_undegraded":"2023-05-12T09:09:02.877105+0000","last_fullsized":"2023-05-12T09:09:02.877105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877489+0000","last_change":"2023-05-12T09:09:02.877489+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877489+0000","last_undegraded":"2023-05-12T09:09:02.877489+0000","last_fullsized":"2023-05-12T09:09:02.877489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.884519+0000","last_change":"2023-05-12T09:09:02.884519+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.884519+0000","last_undegraded":"2023-05-12T09:09:02.884519+0000","last_fullsized":"2023-05-12T09:09:02.884519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880231+0000","last_change":"2023-05-12T09:09:02.880231+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880231+0000","last_undegraded":"2023-05-12T09:09:02.880231+0000","last_fullsized":"2023-05-12T09:09:02.880231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.881158+0000","last_change":"2023-05-12T09:09:02.881158+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.881158+0000","last_undegraded":"2023-05-12T09:09:02.881158+0000","last_fullsized":"2023-05-12T09:09:02.881158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.878610+0000","last_change":"2023-05-12T09:09:02.878610+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.878610+0000","last_undegraded":"2023-05-12T09:09:02.878610+0000","last_fullsized":"2023-05-12T09:09:02.878610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.879649+0000","last_change":"2023-05-12T09:07:04.835422+0000","last_active":"2023-05-12T09:09:02.879649+0000","last_peered":"2023-05-12T09:09:02.879649+0000","last_clean":"2023-05-12T09:09:02.879649+0000","last_became_active":"2023-05-12T09:07:04.834944+0000","last_became_peered":"2023-05-12T09:07:04.834944+0000","last_unstale":"2023-05-12T09:09:02.879649+0000","last_undegraded":"2023-05-12T09:09:02.879649+0000","last_fullsized":"2023-05-12T09:09:02.879649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:29:24.273386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880677+0000","last_change":"2023-05-12T09:09:02.880677+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880677+0000","last_undegraded":"2023-05-12T09:09:02.880677+0000","last_fullsized":"2023-05-12T09:09:02.880677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.878623+0000","last_change":"2023-05-12T09:07:04.828759+0000","last_active":"2023-05-12T09:09:02.878623+0000","last_peered":"2023-05-12T09:09:02.878623+0000","last_clean":"2023-05-12T09:09:02.878623+0000","last_became_active":"2023-05-12T09:07:04.828460+0000","last_became_peered":"2023-05-12T09:07:04.828460+0000","last_unstale":"2023-05-12T09:09:02.878623+0000","last_undegraded":"2023-05-12T09:09:02.878623+0000","last_fullsized":"2023-05-12T09:09:02.878623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:35:33.028873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.882248+0000","last_change":"2023-05-12T09:09:02.882248+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.882248+0000","last_undegraded":"2023-05-12T09:09:02.882248+0000","last_fullsized":"2023-05-12T09:09:02.882248+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.883051+0000","last_change":"2023-05-12T09:07:04.830658+0000","last_active":"2023-05-12T09:09:02.883051+0000","last_peered":"2023-05-12T09:09:02.883051+0000","last_clean":"2023-05-12T09:09:02.883051+0000","last_became_active":"2023-05-12T09:07:04.830354+0000","last_became_peered":"2023-05-12T09:07:04.830354+0000","last_unstale":"2023-05-12T09:09:02.883051+0000","last_undegraded":"2023-05-12T09:09:02.883051+0000","last_fullsized":"2023-05-12T09:09:02.883051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:09.569523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":189,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.882383+0000","last_change":"2023-05-12T09:07:04.830850+0000","last_active":"2023-05-12T09:09:02.882383+0000","last_peered":"2023-05-12T09:09:02.882383+0000","last_clean":"2023-05-12T09:09:02.882383+0000","last_became_active":"2023-05-12T09:07:04.829577+0000","last_became_peered":"2023-05-12T09:07:04.829577+0000","last_unstale":"2023-05-12T09:09:02.882383+0000","last_undegraded":"2023-05-12T09:09:02.882383+0000","last_fullsized":"2023-05-12T09:09:02.882383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:54:09.569523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880722+0000","last_change":"2023-05-12T09:09:02.880722+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880722+0000","last_undegraded":"2023-05-12T09:09:02.880722+0000","last_fullsized":"2023-05-12T09:09:02.880722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.882187+0000","last_change":"2023-05-12T09:07:05.258677+0000","last_active":"2023-05-12T09:09:02.882187+0000","last_peered":"2023-05-12T09:09:02.882187+0000","last_clean":"2023-05-12T09:09:02.882187+0000","last_became_active":"2023-05-12T09:07:05.258372+0000","last_became_peered":"2023-05-12T09:07:05.258372+0000","last_unstale":"2023-05-12T09:09:02.882187+0000","last_undegraded":"2023-05-12T09:09:02.882187+0000","last_fullsized":"2023-05-12T09:09:02.882187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:31.600721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.884629+0000","last_change":"2023-05-12T09:09:02.884629+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.884629+0000","last_undegraded":"2023-05-12T09:09:02.884629+0000","last_fullsized":"2023-05-12T09:09:02.884629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.882230+0000","last_change":"2023-05-12T09:07:05.258599+0000","last_active":"2023-05-12T09:09:02.882230+0000","last_peered":"2023-05-12T09:09:02.882230+0000","last_clean":"2023-05-12T09:09:02.882230+0000","last_became_active":"2023-05-12T09:07:05.258301+0000","last_became_peered":"2023-05-12T09:07:05.258301+0000","last_unstale":"2023-05-12T09:09:02.882230+0000","last_undegraded":"2023-05-12T09:09:02.882230+0000","last_fullsized":"2023-05-12T09:09:02.882230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:08:04.454291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.877121+0000","last_change":"2023-05-12T09:09:02.877121+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.877121+0000","last_undegraded":"2023-05-12T09:09:02.877121+0000","last_fullsized":"2023-05-12T09:09:02.877121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.885512+0000","last_change":"2023-05-12T09:07:05.258734+0000","last_active":"2023-05-12T09:09:02.885512+0000","last_peered":"2023-05-12T09:09:02.885512+0000","last_clean":"2023-05-12T09:09:02.885512+0000","last_became_active":"2023-05-12T09:07:05.258376+0000","last_became_peered":"2023-05-12T09:07:05.258376+0000","last_unstale":"2023-05-12T09:09:02.885512+0000","last_undegraded":"2023-05-12T09:09:02.885512+0000","last_fullsized":"2023-05-12T09:09:02.885512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:22:31.600721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.882203+0000","last_change":"2023-05-12T09:09:02.882203+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.882203+0000","last_undegraded":"2023-05-12T09:09:02.882203+0000","last_fullsized":"2023-05-12T09:09:02.882203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.877378+0000","last_change":"2023-05-12T09:07:05.258598+0000","last_active":"2023-05-12T09:09:02.877378+0000","last_peered":"2023-05-12T09:09:02.877378+0000","last_clean":"2023-05-12T09:09:02.877378+0000","last_became_active":"2023-05-12T09:07:05.258280+0000","last_became_peered":"2023-05-12T09:07:05.258280+0000","last_unstale":"2023-05-12T09:09:02.877378+0000","last_undegraded":"2023-05-12T09:09:02.877378+0000","last_fullsized":"2023-05-12T09:09:02.877378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:23:58.769376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-12T09:09:03.871566+0000","last_change":"2023-05-12T09:09:03.871566+0000","last_active":"2023-05-12T09:09:03.871566+0000","last_peered":"2023-05-12T09:09:03.871566+0000","last_clean":"2023-05-12T09:09:03.871566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:03.871566+0000","last_undegraded":"2023-05-12T09:09:03.871566+0000","last_fullsized":"2023-05-12T09:09:03.871566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-05-12T09:09:02.880369+0000","last_change":"2023-05-12T09:09:02.880369+0000","last_active":"2023-05-12T09:09:02.869355+0000","last_peered":"2023-05-12T09:09:02.869355+0000","last_clean":"2023-05-12T09:09:02.869355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-12T09:09:02.880369+0000","last_undegraded":"2023-05-12T09:09:02.880369+0000","last_fullsized":"2023-05-12T09:09:02.880369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-05-12T09:09:02.877367+0000","last_change":"2023-05-12T09:07:04.830787+0000","last_active":"2023-05-12T09:09:02.877367+0000","last_peered":"2023-05-12T09:09:02.877367+0000","last_clean":"2023-05-12T09:09:02.877367+0000","last_became_active":"2023-05-12T09:07:04.830492+0000","last_became_peered":"2023-05-12T09:07:04.830492+0000","last_unstale":"2023-05-12T09:09:02.877367+0000","last_undegraded":"2023-05-12T09:09:02.877367+0000","last_fullsized":"2023-05-12T09:09:02.877367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:30:02.338742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9492,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362348,"statfs":{"total":96636764160,"available":96627044352,"internally_reserved":0,"allocated":995328,"data_stored":766122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.497}]},{"osd":1,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.4560000000000004,"5min":4.4560000000000004,"15min":4.4560000000000004},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5620000000000003,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":174393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":6.9550000000000001,"5min":6.9550000000000001,"15min":6.9550000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.9370000000000003,"5min":5.9370000000000003,"15min":5.9370000000000003},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":7.024,"5min":7.024,"15min":7.024},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.96,"5min":5.96,"15min":5.96},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.41899999999999998}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.62},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9568,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362272,"statfs":{"total":96636764160,"available":96626966528,"internally_reserved":0,"allocated":1007616,"data_stored":772612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.377},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.441}]},{"osd":4,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.502},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.5640000000000001,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri May 12 09:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8476,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363364,"statfs":{"total":96636764160,"available":96628084736,"internally_reserved":0,"allocated":413696,"data_stored":182244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":6.8220000000000001,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":11.914,"5min":11.914,"15min":11.914},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.8470000000000004,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":12.064,"5min":12.064,"15min":12.064},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":6.7229999999999999,"5min":6.7229999999999999,"15min":6.7229999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":12.034000000000001,"5min":12.034000000000001,"15min":12.034000000000001},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":6.7910000000000004,"5min":6.7910000000000004,"15min":6.7910000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":11.968,"5min":11.968,"15min":11.968},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":6.7599999999999998,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":6.867,"5min":6.867,"15min":6.867},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":12.004,"5min":12.004,"15min":12.004},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":174393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.498},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.42799999999999999}]},{"osd":3,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.79700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8476,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363364,"statfs":{"total":96636764160,"available":96628084736,"internally_reserved":0,"allocated":413696,"data_stored":182244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.497}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.318},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8540,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363300,"statfs":{"total":96636764160,"available":96628019200,"internally_reserved":0,"allocated":413696,"data_stored":182244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":8.7530000000000001,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":8.7710000000000008,"5min":8.7710000000000008,"15min":8.7710000000000008},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.532,"5min":4.532,"15min":4.532},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.625},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8408,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363432,"statfs":{"total":96636764160,"available":96628154368,"internally_reserved":0,"allocated":409600,"data_stored":180883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.748},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.629}]},{"osd":3,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri May 12 09:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-12T09:09:09.272 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-12T09:09:09.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.484+0000 7f2afadff700 1 Processor -- start 2023-05-12T09:09:09.488 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.485+0000 7f2afadff700 1 -- start start 2023-05-12T09:09:09.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2afadff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2af40cfbf0 0x7f2af41608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2afadff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f2af40d1100 0x7f2af40d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.489 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2afadff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af40d0020 con 0x7f2af40b87a0 2023-05-12T09:09:09.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2afadff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af40d02d0 con 0x7f2af40cfbf0 2023-05-12T09:09:09.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2afadff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af40d0cb0 con 0x7f2af40d1100 2023-05-12T09:09:09.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2af8b9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f2af40b87a0 0x7f2af41601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59608/0 (socket says 172.21.15.116:59608) 2023-05-12T09:09:09.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2af3fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2af40cfbf0 0x7f2af41608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2af8b9b700 1 -- 172.21.15.116:0/2838340765 learned_addr learned my addr 172.21.15.116:0/2838340765 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:09.490 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2af939c700 1 --2- 172.21.15.116:0/2838340765 >> v2:172.21.15.182:3300/0 conn(0x7f2af40d1100 0x7f2af40d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2af3fff700 1 -- 172.21.15.116:0/2838340765 >> v2:172.21.15.182:3300/0 conn(0x7f2af40d1100 msgr2=0x7f2af40d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:09.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2af3fff700 1 --2- 172.21.15.116:0/2838340765 >> v2:172.21.15.182:3300/0 conn(0x7f2af40d1100 0x7f2af40d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2af3fff700 1 -- 172.21.15.116:0/2838340765 >> v1:172.21.15.116:6789/0 conn(0x7f2af40b87a0 legacy=0x7f2af41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.486+0000 7f2af37fe700 1 -- 172.21.15.116:0/2838340765 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183392848 0 0) 0x7f2af40d0020 con 0x7f2af40b87a0 2023-05-12T09:09:09.491 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.487+0000 7f2af3fff700 1 -- 172.21.15.116:0/2838340765 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af40cdc60 con 0x7f2af40cfbf0 2023-05-12T09:09:09.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.487+0000 7f2af3fff700 1 --2- 172.21.15.116:0/2838340765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40cfbf0 0x7f2af41608f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2af40d0820 tx=0x7f2ae0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef493ac3a46b61 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:09.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.487+0000 7f2af37fe700 1 -- 172.21.15.116:0/2838340765 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0011830 con 0x7f2af40cfbf0 2023-05-12T09:09:09.492 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.487+0000 7f2af37fe700 1 -- 172.21.15.116:0/2838340765 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae0011990 con 0x7f2af40cfbf0 2023-05-12T09:09:09.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.487+0000 7f2af37fe700 1 -- 172.21.15.116:0/2838340765 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0011d20 con 0x7f2af40cfbf0 2023-05-12T09:09:09.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.487+0000 7f2afadff700 1 -- 172.21.15.116:0/2838340765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40cfbf0 msgr2=0x7f2af41608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.487+0000 7f2afadff700 1 --2- 172.21.15.116:0/2838340765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40cfbf0 0x7f2af41608f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2af40d0820 tx=0x7f2ae0009b50 comp rx=0 tx=0).stop 2023-05-12T09:09:09.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.488+0000 7f2afadff700 1 -- 172.21.15.116:0/2838340765 shutdown_connections 2023-05-12T09:09:09.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.488+0000 7f2afadff700 1 --2- 172.21.15.116:0/2838340765 >> v2:172.21.15.182:3300/0 conn(0x7f2af40d1100 0x7f2af40d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.488+0000 7f2afadff700 1 --2- 172.21.15.116:0/2838340765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40cfbf0 0x7f2af41608f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.493 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.488+0000 7f2afadff700 1 -- 172.21.15.116:0/2838340765 >> 172.21.15.116:0/2838340765 conn(0x7f2af4071b10 msgr2=0x7f2af4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:09.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.488+0000 7f2afadff700 1 -- 172.21.15.116:0/2838340765 shutdown_connections 2023-05-12T09:09:09.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.488+0000 7f2afadff700 1 -- 172.21.15.116:0/2838340765 wait complete. 2023-05-12T09:09:09.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.489+0000 7f2afadff700 1 Processor -- start 2023-05-12T09:09:09.494 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.489+0000 7f2afadff700 1 -- start start 2023-05-12T09:09:09.496 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.490+0000 7f2afadff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2af40b87a0 0x7f2af415b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.490+0000 7f2afadff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2af40cfbf0 0x7f2af40c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.490+0000 7f2afadff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40d1100 0x7f2af40c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.490+0000 7f2afadff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40d30c0 con 0x7f2af40d1100 2023-05-12T09:09:09.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.490+0000 7f2afadff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af41f2be0 con 0x7f2af40b87a0 2023-05-12T09:09:09.497 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.490+0000 7f2afadff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af41f2ec0 con 0x7f2af40cfbf0 2023-05-12T09:09:09.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af939c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40d1100 0x7f2af40c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af939c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40d1100 0x7f2af40c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35772/0 (socket says 172.21.15.116:35772) 2023-05-12T09:09:09.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af939c700 1 -- 172.21.15.116:0/3658217257 learned_addr learned my addr 172.21.15.116:0/3658217257 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:09.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af8b9b700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2af40b87a0 0x7f2af415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af3fff700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2af40cfbf0 0x7f2af40c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.498 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af939c700 1 -- 172.21.15.116:0/3658217257 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2af40cfbf0 msgr2=0x7f2af40c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af939c700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2af40cfbf0 0x7f2af40c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af939c700 1 -- 172.21.15.116:0/3658217257 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2af40b87a0 msgr2=0x7f2af415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af939c700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2af40b87a0 0x7f2af415b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.499 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af939c700 1 -- 172.21.15.116:0/3658217257 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae00094a0 con 0x7f2af40d1100 2023-05-12T09:09:09.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af939c700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40d1100 0x7f2af40c8a40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00efc0 tx=0x7f2aec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:09.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.491+0000 7f2af17fa700 1 -- 172.21.15.116:0/3658217257 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec009ea0 con 0x7f2af40d1100 2023-05-12T09:09:09.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.492+0000 7f2af17fa700 1 -- 172.21.15.116:0/3658217257 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00f040 con 0x7f2af40d1100 2023-05-12T09:09:09.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.492+0000 7f2af17fa700 1 -- 172.21.15.116:0/3658217257 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00ced0 con 0x7f2af40d1100 2023-05-12T09:09:09.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.492+0000 7f2afadff700 1 -- 172.21.15.116:0/3658217257 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af40cd980 con 0x7f2af40d1100 2023-05-12T09:09:09.500 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.492+0000 7f2afadff700 1 -- 172.21.15.116:0/3658217257 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af40cd6a0 con 0x7f2af40d1100 2023-05-12T09:09:09.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.493+0000 7f2afadff700 1 -- 172.21.15.116:0/3658217257 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af4160e30 con 0x7f2af40d1100 2023-05-12T09:09:09.501 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.493+0000 7f2af17fa700 1 -- 172.21.15.116:0/3658217257 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2aec014480 con 0x7f2af40d1100 2023-05-12T09:09:09.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.494+0000 7f2af17fa700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2ad806ace0 0x7f2ad806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.495+0000 7f2af17fa700 1 -- 172.21.15.116:0/3658217257 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2aec089dd0 con 0x7f2af40d1100 2023-05-12T09:09:09.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.495+0000 7f2af8b9b700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2ad806ace0 0x7f2ad806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.495+0000 7f2af8b9b700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2ad806ace0 0x7f2ad806d190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000f60 tx=0x7f2ae8007e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:09.502 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.499+0000 7f2af17fa700 1 -- 172.21.15.116:0/3658217257 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2aec054d30 con 0x7f2af40d1100 2023-05-12T09:09:09.694 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.691+0000 7f2afadff700 1 -- 172.21.15.116:0/3658217257 --> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2af4074430 con 0x7f2ad806ace0 2023-05-12T09:09:09.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.699+0000 7f2af17fa700 1 -- 172.21.15.116:0/3658217257 <== mgr.4106 v2:172.21.15.116:6832/3989593778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311267 (secure 0 0 0) 0x7f2af4074430 con 0x7f2ad806ace0 2023-05-12T09:09:09.706 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:09.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 -- 172.21.15.116:0/3658217257 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2ad806ace0 msgr2=0x7f2ad806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2ad806ace0 0x7f2ad806d190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000f60 tx=0x7f2ae8007e70 comp rx=0 tx=0).stop 2023-05-12T09:09:09.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 -- 172.21.15.116:0/3658217257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40d1100 msgr2=0x7f2af40c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40d1100 0x7f2af40c8a40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00efc0 tx=0x7f2aec00c3a0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 -- 172.21.15.116:0/3658217257 shutdown_connections 2023-05-12T09:09:09.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2af40d1100 0x7f2af40c8a40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2af40b87a0 0x7f2af415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f2ad806ace0 0x7f2ad806d190 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 --2- 172.21.15.116:0/3658217257 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2af40cfbf0 0x7f2af40c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 -- 172.21.15.116:0/3658217257 >> 172.21.15.116:0/3658217257 conn(0x7f2af4071b10 msgr2=0x7f2af40b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:09.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 -- 172.21.15.116:0/3658217257 shutdown_connections 2023-05-12T09:09:09.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.704+0000 7f2afadff700 1 -- 172.21.15.116:0/3658217257 wait complete. 2023-05-12T09:09:09.709 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2023-05-12T09:09:09.724 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-05-12T09:09:09.594039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71292,"kb_used_data":4732,"kb_used_omap":0,"kb_used_meta":66496,"kb_avail":754903428,"statfs":{"total":773094113280,"available":773021110272,"internally_reserved":0,"allocated":4845568,"data_stored":2810217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68091904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000864"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525644+0000","last_change":"2023-05-12T09:09:04.386504+0000","last_active":"2023-05-12T09:09:05.525644+0000","last_peered":"2023-05-12T09:09:05.525644+0000","last_clean":"2023-05-12T09:09:05.525644+0000","last_became_active":"2023-05-12T09:09:04.386247+0000","last_became_peered":"2023-05-12T09:09:04.386247+0000","last_unstale":"2023-05-12T09:09:05.525644+0000","last_undegraded":"2023-05-12T09:09:05.525644+0000","last_fullsized":"2023-05-12T09:09:05.525644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:12:31.106955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524972+0000","last_change":"2023-05-12T09:09:04.382931+0000","last_active":"2023-05-12T09:09:05.524972+0000","last_peered":"2023-05-12T09:09:05.524972+0000","last_clean":"2023-05-12T09:09:05.524972+0000","last_became_active":"2023-05-12T09:09:04.382666+0000","last_became_peered":"2023-05-12T09:09:04.382666+0000","last_unstale":"2023-05-12T09:09:05.524972+0000","last_undegraded":"2023-05-12T09:09:05.524972+0000","last_fullsized":"2023-05-12T09:09:05.524972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:20:41.081497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526540+0000","last_change":"2023-05-12T09:09:04.384475+0000","last_active":"2023-05-12T09:09:05.526540+0000","last_peered":"2023-05-12T09:09:05.526540+0000","last_clean":"2023-05-12T09:09:05.526540+0000","last_became_active":"2023-05-12T09:09:04.384193+0000","last_became_peered":"2023-05-12T09:09:04.384193+0000","last_unstale":"2023-05-12T09:09:05.526540+0000","last_undegraded":"2023-05-12T09:09:05.526540+0000","last_fullsized":"2023-05-12T09:09:05.526540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:27:56.479049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524357+0000","last_change":"2023-05-12T09:09:04.392312+0000","last_active":"2023-05-12T09:09:05.524357+0000","last_peered":"2023-05-12T09:09:05.524357+0000","last_clean":"2023-05-12T09:09:05.524357+0000","last_became_active":"2023-05-12T09:09:04.392058+0000","last_became_peered":"2023-05-12T09:09:04.392058+0000","last_unstale":"2023-05-12T09:09:05.524357+0000","last_undegraded":"2023-05-12T09:09:05.524357+0000","last_fullsized":"2023-05-12T09:09:05.524357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:57:27.622878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524918+0000","last_change":"2023-05-12T09:09:04.377823+0000","last_active":"2023-05-12T09:09:05.524918+0000","last_peered":"2023-05-12T09:09:05.524918+0000","last_clean":"2023-05-12T09:09:05.524918+0000","last_became_active":"2023-05-12T09:09:04.377580+0000","last_became_peered":"2023-05-12T09:09:04.377580+0000","last_unstale":"2023-05-12T09:09:05.524918+0000","last_undegraded":"2023-05-12T09:09:05.524918+0000","last_fullsized":"2023-05-12T09:09:05.524918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:40:40.702906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368750+0000","last_change":"2023-05-12T09:09:04.380240+0000","last_active":"2023-05-12T09:09:05.368750+0000","last_peered":"2023-05-12T09:09:05.368750+0000","last_clean":"2023-05-12T09:09:05.368750+0000","last_became_active":"2023-05-12T09:09:04.379567+0000","last_became_peered":"2023-05-12T09:09:04.379567+0000","last_unstale":"2023-05-12T09:09:05.368750+0000","last_undegraded":"2023-05-12T09:09:05.368750+0000","last_fullsized":"2023-05-12T09:09:05.368750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:27:23.814861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525192+0000","last_change":"2023-05-12T09:09:04.387166+0000","last_active":"2023-05-12T09:09:05.525192+0000","last_peered":"2023-05-12T09:09:05.525192+0000","last_clean":"2023-05-12T09:09:05.525192+0000","last_became_active":"2023-05-12T09:09:04.386855+0000","last_became_peered":"2023-05-12T09:09:04.386855+0000","last_unstale":"2023-05-12T09:09:05.525192+0000","last_undegraded":"2023-05-12T09:09:05.525192+0000","last_fullsized":"2023-05-12T09:09:05.525192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:51:41.124501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524129+0000","last_change":"2023-05-12T09:09:04.381056+0000","last_active":"2023-05-12T09:09:05.524129+0000","last_peered":"2023-05-12T09:09:05.524129+0000","last_clean":"2023-05-12T09:09:05.524129+0000","last_became_active":"2023-05-12T09:09:04.380828+0000","last_became_peered":"2023-05-12T09:09:04.380828+0000","last_unstale":"2023-05-12T09:09:05.524129+0000","last_undegraded":"2023-05-12T09:09:05.524129+0000","last_fullsized":"2023-05-12T09:09:05.524129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:01:52.267927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524531+0000","last_change":"2023-05-12T09:09:04.380020+0000","last_active":"2023-05-12T09:09:05.524531+0000","last_peered":"2023-05-12T09:09:05.524531+0000","last_clean":"2023-05-12T09:09:05.524531+0000","last_became_active":"2023-05-12T09:09:04.379753+0000","last_became_peered":"2023-05-12T09:09:04.379753+0000","last_unstale":"2023-05-12T09:09:05.524531+0000","last_undegraded":"2023-05-12T09:09:05.524531+0000","last_fullsized":"2023-05-12T09:09:05.524531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:09:41.115391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524310+0000","last_change":"2023-05-12T09:09:04.382219+0000","last_active":"2023-05-12T09:09:05.524310+0000","last_peered":"2023-05-12T09:09:05.524310+0000","last_clean":"2023-05-12T09:09:05.524310+0000","last_became_active":"2023-05-12T09:09:04.381527+0000","last_became_peered":"2023-05-12T09:09:04.381527+0000","last_unstale":"2023-05-12T09:09:05.524310+0000","last_undegraded":"2023-05-12T09:09:05.524310+0000","last_fullsized":"2023-05-12T09:09:05.524310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:01:51.907572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524369+0000","last_change":"2023-05-12T09:09:04.375935+0000","last_active":"2023-05-12T09:09:05.524369+0000","last_peered":"2023-05-12T09:09:05.524369+0000","last_clean":"2023-05-12T09:09:05.524369+0000","last_became_active":"2023-05-12T09:09:04.375665+0000","last_became_peered":"2023-05-12T09:09:04.375665+0000","last_unstale":"2023-05-12T09:09:05.524369+0000","last_undegraded":"2023-05-12T09:09:05.524369+0000","last_fullsized":"2023-05-12T09:09:05.524369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:22:01.450509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525276+0000","last_change":"2023-05-12T09:09:04.378328+0000","last_active":"2023-05-12T09:09:05.525276+0000","last_peered":"2023-05-12T09:09:05.525276+0000","last_clean":"2023-05-12T09:09:05.525276+0000","last_became_active":"2023-05-12T09:09:04.377980+0000","last_became_peered":"2023-05-12T09:09:04.377980+0000","last_unstale":"2023-05-12T09:09:05.525276+0000","last_undegraded":"2023-05-12T09:09:05.525276+0000","last_fullsized":"2023-05-12T09:09:05.525276+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:56:43.536448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370026+0000","last_change":"2023-05-12T09:09:04.387230+0000","last_active":"2023-05-12T09:09:05.370026+0000","last_peered":"2023-05-12T09:09:05.370026+0000","last_clean":"2023-05-12T09:09:05.370026+0000","last_became_active":"2023-05-12T09:09:04.386807+0000","last_became_peered":"2023-05-12T09:09:04.386807+0000","last_unstale":"2023-05-12T09:09:05.370026+0000","last_undegraded":"2023-05-12T09:09:05.370026+0000","last_fullsized":"2023-05-12T09:09:05.370026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:43:23.522527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524272+0000","last_change":"2023-05-12T09:09:04.379528+0000","last_active":"2023-05-12T09:09:05.524272+0000","last_peered":"2023-05-12T09:09:05.524272+0000","last_clean":"2023-05-12T09:09:05.524272+0000","last_became_active":"2023-05-12T09:09:04.379240+0000","last_became_peered":"2023-05-12T09:09:04.379240+0000","last_unstale":"2023-05-12T09:09:05.524272+0000","last_undegraded":"2023-05-12T09:09:05.524272+0000","last_fullsized":"2023-05-12T09:09:05.524272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:25:33.795660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368644+0000","last_change":"2023-05-12T09:09:04.386139+0000","last_active":"2023-05-12T09:09:05.368644+0000","last_peered":"2023-05-12T09:09:05.368644+0000","last_clean":"2023-05-12T09:09:05.368644+0000","last_became_active":"2023-05-12T09:09:04.385890+0000","last_became_peered":"2023-05-12T09:09:04.385890+0000","last_unstale":"2023-05-12T09:09:05.368644+0000","last_undegraded":"2023-05-12T09:09:05.368644+0000","last_fullsized":"2023-05-12T09:09:05.368644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:59:12.005243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368483+0000","last_change":"2023-05-12T09:09:04.381594+0000","last_active":"2023-05-12T09:09:05.368483+0000","last_peered":"2023-05-12T09:09:05.368483+0000","last_clean":"2023-05-12T09:09:05.368483+0000","last_became_active":"2023-05-12T09:09:04.381306+0000","last_became_peered":"2023-05-12T09:09:04.381306+0000","last_unstale":"2023-05-12T09:09:05.368483+0000","last_undegraded":"2023-05-12T09:09:05.368483+0000","last_fullsized":"2023-05-12T09:09:05.368483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:47:29.018998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526249+0000","last_change":"2023-05-12T09:09:04.390854+0000","last_active":"2023-05-12T09:09:05.526249+0000","last_peered":"2023-05-12T09:09:05.526249+0000","last_clean":"2023-05-12T09:09:05.526249+0000","last_became_active":"2023-05-12T09:09:04.390598+0000","last_became_peered":"2023-05-12T09:09:04.390598+0000","last_unstale":"2023-05-12T09:09:05.526249+0000","last_undegraded":"2023-05-12T09:09:05.526249+0000","last_fullsized":"2023-05-12T09:09:05.526249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:51:32.345508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526369+0000","last_change":"2023-05-12T09:09:04.384388+0000","last_active":"2023-05-12T09:09:05.526369+0000","last_peered":"2023-05-12T09:09:05.526369+0000","last_clean":"2023-05-12T09:09:05.526369+0000","last_became_active":"2023-05-12T09:09:04.383867+0000","last_became_peered":"2023-05-12T09:09:04.383867+0000","last_unstale":"2023-05-12T09:09:05.526369+0000","last_undegraded":"2023-05-12T09:09:05.526369+0000","last_fullsized":"2023-05-12T09:09:05.526369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:28:46.039724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368751+0000","last_change":"2023-05-12T09:09:04.381162+0000","last_active":"2023-05-12T09:09:05.368751+0000","last_peered":"2023-05-12T09:09:05.368751+0000","last_clean":"2023-05-12T09:09:05.368751+0000","last_became_active":"2023-05-12T09:09:04.379970+0000","last_became_peered":"2023-05-12T09:09:04.379970+0000","last_unstale":"2023-05-12T09:09:05.368751+0000","last_undegraded":"2023-05-12T09:09:05.368751+0000","last_fullsized":"2023-05-12T09:09:05.368751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:05:49.166270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370096+0000","last_change":"2023-05-12T09:09:04.377471+0000","last_active":"2023-05-12T09:09:05.370096+0000","last_peered":"2023-05-12T09:09:05.370096+0000","last_clean":"2023-05-12T09:09:05.370096+0000","last_became_active":"2023-05-12T09:09:04.377206+0000","last_became_peered":"2023-05-12T09:09:04.377206+0000","last_unstale":"2023-05-12T09:09:05.370096+0000","last_undegraded":"2023-05-12T09:09:05.370096+0000","last_fullsized":"2023-05-12T09:09:05.370096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:19:11.089930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368896+0000","last_change":"2023-05-12T09:09:04.388538+0000","last_active":"2023-05-12T09:09:05.368896+0000","last_peered":"2023-05-12T09:09:05.368896+0000","last_clean":"2023-05-12T09:09:05.368896+0000","last_became_active":"2023-05-12T09:09:04.388265+0000","last_became_peered":"2023-05-12T09:09:04.388265+0000","last_unstale":"2023-05-12T09:09:05.368896+0000","last_undegraded":"2023-05-12T09:09:05.368896+0000","last_fullsized":"2023-05-12T09:09:05.368896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:20:12.211222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524324+0000","last_change":"2023-05-12T09:09:04.381121+0000","last_active":"2023-05-12T09:09:05.524324+0000","last_peered":"2023-05-12T09:09:05.524324+0000","last_clean":"2023-05-12T09:09:05.524324+0000","last_became_active":"2023-05-12T09:09:04.380885+0000","last_became_peered":"2023-05-12T09:09:04.380885+0000","last_unstale":"2023-05-12T09:09:05.524324+0000","last_undegraded":"2023-05-12T09:09:05.524324+0000","last_fullsized":"2023-05-12T09:09:05.524324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:47:08.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368441+0000","last_change":"2023-05-12T09:09:04.376351+0000","last_active":"2023-05-12T09:09:05.368441+0000","last_peered":"2023-05-12T09:09:05.368441+0000","last_clean":"2023-05-12T09:09:05.368441+0000","last_became_active":"2023-05-12T09:09:04.376088+0000","last_became_peered":"2023-05-12T09:09:04.376088+0000","last_unstale":"2023-05-12T09:09:05.368441+0000","last_undegraded":"2023-05-12T09:09:05.368441+0000","last_fullsized":"2023-05-12T09:09:05.368441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:30:56.733268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368461+0000","last_change":"2023-05-12T09:09:04.376338+0000","last_active":"2023-05-12T09:09:05.368461+0000","last_peered":"2023-05-12T09:09:05.368461+0000","last_clean":"2023-05-12T09:09:05.368461+0000","last_became_active":"2023-05-12T09:09:04.376069+0000","last_became_peered":"2023-05-12T09:09:04.376069+0000","last_unstale":"2023-05-12T09:09:05.368461+0000","last_undegraded":"2023-05-12T09:09:05.368461+0000","last_fullsized":"2023-05-12T09:09:05.368461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:37:18.764062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369092+0000","last_change":"2023-05-12T09:09:04.378099+0000","last_active":"2023-05-12T09:09:05.369092+0000","last_peered":"2023-05-12T09:09:05.369092+0000","last_clean":"2023-05-12T09:09:05.369092+0000","last_became_active":"2023-05-12T09:09:04.377827+0000","last_became_peered":"2023-05-12T09:09:04.377827+0000","last_unstale":"2023-05-12T09:09:05.369092+0000","last_undegraded":"2023-05-12T09:09:05.369092+0000","last_fullsized":"2023-05-12T09:09:05.369092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:27:31.699297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370362+0000","last_change":"2023-05-12T09:09:04.384513+0000","last_active":"2023-05-12T09:09:05.370362+0000","last_peered":"2023-05-12T09:09:05.370362+0000","last_clean":"2023-05-12T09:09:05.370362+0000","last_became_active":"2023-05-12T09:09:04.384269+0000","last_became_peered":"2023-05-12T09:09:04.384269+0000","last_unstale":"2023-05-12T09:09:05.370362+0000","last_undegraded":"2023-05-12T09:09:05.370362+0000","last_fullsized":"2023-05-12T09:09:05.370362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:07:17.973275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526255+0000","last_change":"2023-05-12T09:09:04.390308+0000","last_active":"2023-05-12T09:09:05.526255+0000","last_peered":"2023-05-12T09:09:05.526255+0000","last_clean":"2023-05-12T09:09:05.526255+0000","last_became_active":"2023-05-12T09:09:04.390036+0000","last_became_peered":"2023-05-12T09:09:04.390036+0000","last_unstale":"2023-05-12T09:09:05.526255+0000","last_undegraded":"2023-05-12T09:09:05.526255+0000","last_fullsized":"2023-05-12T09:09:05.526255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:25:06.887710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524874+0000","last_change":"2023-05-12T09:09:04.382137+0000","last_active":"2023-05-12T09:09:05.524874+0000","last_peered":"2023-05-12T09:09:05.524874+0000","last_clean":"2023-05-12T09:09:05.524874+0000","last_became_active":"2023-05-12T09:09:04.381653+0000","last_became_peered":"2023-05-12T09:09:04.381653+0000","last_unstale":"2023-05-12T09:09:05.524874+0000","last_undegraded":"2023-05-12T09:09:05.524874+0000","last_fullsized":"2023-05-12T09:09:05.524874+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:45:21.983499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368698+0000","last_change":"2023-05-12T09:09:04.379182+0000","last_active":"2023-05-12T09:09:05.368698+0000","last_peered":"2023-05-12T09:09:05.368698+0000","last_clean":"2023-05-12T09:09:05.368698+0000","last_became_active":"2023-05-12T09:09:04.378909+0000","last_became_peered":"2023-05-12T09:09:04.378909+0000","last_unstale":"2023-05-12T09:09:05.368698+0000","last_undegraded":"2023-05-12T09:09:05.368698+0000","last_fullsized":"2023-05-12T09:09:05.368698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:01.201284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526107+0000","last_change":"2023-05-12T09:09:04.376810+0000","last_active":"2023-05-12T09:09:05.526107+0000","last_peered":"2023-05-12T09:09:05.526107+0000","last_clean":"2023-05-12T09:09:05.526107+0000","last_became_active":"2023-05-12T09:09:04.376113+0000","last_became_peered":"2023-05-12T09:09:04.376113+0000","last_unstale":"2023-05-12T09:09:05.526107+0000","last_undegraded":"2023-05-12T09:09:05.526107+0000","last_fullsized":"2023-05-12T09:09:05.526107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:14:31.845272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368794+0000","last_change":"2023-05-12T09:09:04.390251+0000","last_active":"2023-05-12T09:09:05.368794+0000","last_peered":"2023-05-12T09:09:05.368794+0000","last_clean":"2023-05-12T09:09:05.368794+0000","last_became_active":"2023-05-12T09:09:04.389960+0000","last_became_peered":"2023-05-12T09:09:04.389960+0000","last_unstale":"2023-05-12T09:09:05.368794+0000","last_undegraded":"2023-05-12T09:09:05.368794+0000","last_fullsized":"2023-05-12T09:09:05.368794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:18:06.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369879+0000","last_change":"2023-05-12T09:09:04.378906+0000","last_active":"2023-05-12T09:09:05.369879+0000","last_peered":"2023-05-12T09:09:05.369879+0000","last_clean":"2023-05-12T09:09:05.369879+0000","last_became_active":"2023-05-12T09:09:04.378653+0000","last_became_peered":"2023-05-12T09:09:04.378653+0000","last_unstale":"2023-05-12T09:09:05.369879+0000","last_undegraded":"2023-05-12T09:09:05.369879+0000","last_fullsized":"2023-05-12T09:09:05.369879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:17:26.362380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524733+0000","last_change":"2023-05-12T09:09:04.388485+0000","last_active":"2023-05-12T09:09:05.524733+0000","last_peered":"2023-05-12T09:09:05.524733+0000","last_clean":"2023-05-12T09:09:05.524733+0000","last_became_active":"2023-05-12T09:09:04.388199+0000","last_became_peered":"2023-05-12T09:09:04.388199+0000","last_unstale":"2023-05-12T09:09:05.524733+0000","last_undegraded":"2023-05-12T09:09:05.524733+0000","last_fullsized":"2023-05-12T09:09:05.524733+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:45:21.983499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369280+0000","last_change":"2023-05-12T09:09:03.900712+0000","last_active":"2023-05-12T09:09:05.369280+0000","last_peered":"2023-05-12T09:09:05.369280+0000","last_clean":"2023-05-12T09:09:05.369280+0000","last_became_active":"2023-05-12T09:09:03.900526+0000","last_became_peered":"2023-05-12T09:09:03.900526+0000","last_unstale":"2023-05-12T09:09:05.369280+0000","last_undegraded":"2023-05-12T09:09:05.369280+0000","last_fullsized":"2023-05-12T09:09:05.369280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:29:38.904769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368950+0000","last_change":"2023-05-12T09:09:04.382106+0000","last_active":"2023-05-12T09:09:05.368950+0000","last_peered":"2023-05-12T09:09:05.368950+0000","last_clean":"2023-05-12T09:09:05.368950+0000","last_became_active":"2023-05-12T09:09:04.381786+0000","last_became_peered":"2023-05-12T09:09:04.381786+0000","last_unstale":"2023-05-12T09:09:05.368950+0000","last_undegraded":"2023-05-12T09:09:05.368950+0000","last_fullsized":"2023-05-12T09:09:05.368950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:16:42.179276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526584+0000","last_change":"2023-05-12T09:09:03.902057+0000","last_active":"2023-05-12T09:09:05.526584+0000","last_peered":"2023-05-12T09:09:05.526584+0000","last_clean":"2023-05-12T09:09:05.526584+0000","last_became_active":"2023-05-12T09:09:03.901685+0000","last_became_peered":"2023-05-12T09:09:03.901685+0000","last_unstale":"2023-05-12T09:09:05.526584+0000","last_undegraded":"2023-05-12T09:09:05.526584+0000","last_fullsized":"2023-05-12T09:09:05.526584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:45:33.502711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525096+0000","last_change":"2023-05-12T09:09:04.389493+0000","last_active":"2023-05-12T09:09:05.525096+0000","last_peered":"2023-05-12T09:09:05.525096+0000","last_clean":"2023-05-12T09:09:05.525096+0000","last_became_active":"2023-05-12T09:09:04.389173+0000","last_became_peered":"2023-05-12T09:09:04.389173+0000","last_unstale":"2023-05-12T09:09:05.525096+0000","last_undegraded":"2023-05-12T09:09:05.525096+0000","last_fullsized":"2023-05-12T09:09:05.525096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:08.417440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524696+0000","last_change":"2023-05-12T09:09:03.898834+0000","last_active":"2023-05-12T09:09:05.524696+0000","last_peered":"2023-05-12T09:09:05.524696+0000","last_clean":"2023-05-12T09:09:05.524696+0000","last_became_active":"2023-05-12T09:09:03.898530+0000","last_became_peered":"2023-05-12T09:09:03.898530+0000","last_unstale":"2023-05-12T09:09:05.524696+0000","last_undegraded":"2023-05-12T09:09:05.524696+0000","last_fullsized":"2023-05-12T09:09:05.524696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:43:55.973079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524683+0000","last_change":"2023-05-12T09:09:04.383685+0000","last_active":"2023-05-12T09:09:05.524683+0000","last_peered":"2023-05-12T09:09:05.524683+0000","last_clean":"2023-05-12T09:09:05.524683+0000","last_became_active":"2023-05-12T09:09:04.383282+0000","last_became_peered":"2023-05-12T09:09:04.383282+0000","last_unstale":"2023-05-12T09:09:05.524683+0000","last_undegraded":"2023-05-12T09:09:05.524683+0000","last_fullsized":"2023-05-12T09:09:05.524683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:40:40.702906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525420+0000","last_change":"2023-05-12T09:09:03.901767+0000","last_active":"2023-05-12T09:09:05.525420+0000","last_peered":"2023-05-12T09:09:05.525420+0000","last_clean":"2023-05-12T09:09:05.525420+0000","last_became_active":"2023-05-12T09:09:03.901442+0000","last_became_peered":"2023-05-12T09:09:03.901442+0000","last_unstale":"2023-05-12T09:09:05.525420+0000","last_undegraded":"2023-05-12T09:09:05.525420+0000","last_fullsized":"2023-05-12T09:09:05.525420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:52:40.761299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526252+0000","last_change":"2023-05-12T09:09:04.376992+0000","last_active":"2023-05-12T09:09:05.526252+0000","last_peered":"2023-05-12T09:09:05.526252+0000","last_clean":"2023-05-12T09:09:05.526252+0000","last_became_active":"2023-05-12T09:09:04.375692+0000","last_became_peered":"2023-05-12T09:09:04.375692+0000","last_unstale":"2023-05-12T09:09:05.526252+0000","last_undegraded":"2023-05-12T09:09:05.526252+0000","last_fullsized":"2023-05-12T09:09:05.526252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:32:40.239050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369408+0000","last_change":"2023-05-12T09:09:03.903591+0000","last_active":"2023-05-12T09:09:05.369408+0000","last_peered":"2023-05-12T09:09:05.369408+0000","last_clean":"2023-05-12T09:09:05.369408+0000","last_became_active":"2023-05-12T09:09:03.903005+0000","last_became_peered":"2023-05-12T09:09:03.903005+0000","last_unstale":"2023-05-12T09:09:05.369408+0000","last_undegraded":"2023-05-12T09:09:05.369408+0000","last_fullsized":"2023-05-12T09:09:05.369408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:31:23.672158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524840+0000","last_change":"2023-05-12T09:09:04.375860+0000","last_active":"2023-05-12T09:09:05.524840+0000","last_peered":"2023-05-12T09:09:05.524840+0000","last_clean":"2023-05-12T09:09:05.524840+0000","last_became_active":"2023-05-12T09:09:04.375603+0000","last_became_peered":"2023-05-12T09:09:04.375603+0000","last_unstale":"2023-05-12T09:09:05.524840+0000","last_undegraded":"2023-05-12T09:09:05.524840+0000","last_fullsized":"2023-05-12T09:09:05.524840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:28:51.124741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526353+0000","last_change":"2023-05-12T09:09:03.906356+0000","last_active":"2023-05-12T09:09:05.526353+0000","last_peered":"2023-05-12T09:09:05.526353+0000","last_clean":"2023-05-12T09:09:05.526353+0000","last_became_active":"2023-05-12T09:09:03.906036+0000","last_became_peered":"2023-05-12T09:09:03.906036+0000","last_unstale":"2023-05-12T09:09:05.526353+0000","last_undegraded":"2023-05-12T09:09:05.526353+0000","last_fullsized":"2023-05-12T09:09:05.526353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:47:26.343563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524571+0000","last_change":"2023-05-12T09:09:04.381281+0000","last_active":"2023-05-12T09:09:05.524571+0000","last_peered":"2023-05-12T09:09:05.524571+0000","last_clean":"2023-05-12T09:09:05.524571+0000","last_became_active":"2023-05-12T09:09:04.380108+0000","last_became_peered":"2023-05-12T09:09:04.380108+0000","last_unstale":"2023-05-12T09:09:05.524571+0000","last_undegraded":"2023-05-12T09:09:05.524571+0000","last_fullsized":"2023-05-12T09:09:05.524571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:50.791537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524740+0000","last_change":"2023-05-12T09:09:03.898492+0000","last_active":"2023-05-12T09:09:05.524740+0000","last_peered":"2023-05-12T09:09:05.524740+0000","last_clean":"2023-05-12T09:09:05.524740+0000","last_became_active":"2023-05-12T09:09:03.898190+0000","last_became_peered":"2023-05-12T09:09:03.898190+0000","last_unstale":"2023-05-12T09:09:05.524740+0000","last_undegraded":"2023-05-12T09:09:05.524740+0000","last_fullsized":"2023-05-12T09:09:05.524740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:28.145368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368445+0000","last_change":"2023-05-12T09:09:04.377136+0000","last_active":"2023-05-12T09:09:05.368445+0000","last_peered":"2023-05-12T09:09:05.368445+0000","last_clean":"2023-05-12T09:09:05.368445+0000","last_became_active":"2023-05-12T09:09:04.376865+0000","last_became_peered":"2023-05-12T09:09:04.376865+0000","last_unstale":"2023-05-12T09:09:05.368445+0000","last_undegraded":"2023-05-12T09:09:05.368445+0000","last_fullsized":"2023-05-12T09:09:05.368445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:48:51.992494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524585+0000","last_change":"2023-05-12T09:09:03.890845+0000","last_active":"2023-05-12T09:09:05.524585+0000","last_peered":"2023-05-12T09:09:05.524585+0000","last_clean":"2023-05-12T09:09:05.524585+0000","last_became_active":"2023-05-12T09:09:03.890331+0000","last_became_peered":"2023-05-12T09:09:03.890331+0000","last_unstale":"2023-05-12T09:09:05.524585+0000","last_undegraded":"2023-05-12T09:09:05.524585+0000","last_fullsized":"2023-05-12T09:09:05.524585+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:47.563461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526577+0000","last_change":"2023-05-12T09:09:04.384151+0000","last_active":"2023-05-12T09:09:05.526577+0000","last_peered":"2023-05-12T09:09:05.526577+0000","last_clean":"2023-05-12T09:09:05.526577+0000","last_became_active":"2023-05-12T09:09:04.383500+0000","last_became_peered":"2023-05-12T09:09:04.383500+0000","last_unstale":"2023-05-12T09:09:05.526577+0000","last_undegraded":"2023-05-12T09:09:05.526577+0000","last_fullsized":"2023-05-12T09:09:05.526577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:45:09.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526460+0000","last_change":"2023-05-12T09:09:03.903662+0000","last_active":"2023-05-12T09:09:05.526460+0000","last_peered":"2023-05-12T09:09:05.526460+0000","last_clean":"2023-05-12T09:09:05.526460+0000","last_became_active":"2023-05-12T09:09:03.903397+0000","last_became_peered":"2023-05-12T09:09:03.903397+0000","last_unstale":"2023-05-12T09:09:05.526460+0000","last_undegraded":"2023-05-12T09:09:05.526460+0000","last_fullsized":"2023-05-12T09:09:05.526460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:34:25.163055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525765+0000","last_change":"2023-05-12T09:09:04.391085+0000","last_active":"2023-05-12T09:09:05.525765+0000","last_peered":"2023-05-12T09:09:05.525765+0000","last_clean":"2023-05-12T09:09:05.525765+0000","last_became_active":"2023-05-12T09:09:04.390794+0000","last_became_peered":"2023-05-12T09:09:04.390794+0000","last_unstale":"2023-05-12T09:09:05.525765+0000","last_undegraded":"2023-05-12T09:09:05.525765+0000","last_fullsized":"2023-05-12T09:09:05.525765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:00:18.511857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524554+0000","last_change":"2023-05-12T09:09:03.894465+0000","last_active":"2023-05-12T09:09:05.524554+0000","last_peered":"2023-05-12T09:09:05.524554+0000","last_clean":"2023-05-12T09:09:05.524554+0000","last_became_active":"2023-05-12T09:09:03.894109+0000","last_became_peered":"2023-05-12T09:09:03.894109+0000","last_unstale":"2023-05-12T09:09:05.524554+0000","last_undegraded":"2023-05-12T09:09:05.524554+0000","last_fullsized":"2023-05-12T09:09:05.524554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:17:48.837620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369135+0000","last_change":"2023-05-12T09:09:04.382147+0000","last_active":"2023-05-12T09:09:05.369135+0000","last_peered":"2023-05-12T09:09:05.369135+0000","last_clean":"2023-05-12T09:09:05.369135+0000","last_became_active":"2023-05-12T09:09:04.381902+0000","last_became_peered":"2023-05-12T09:09:04.381902+0000","last_unstale":"2023-05-12T09:09:05.369135+0000","last_undegraded":"2023-05-12T09:09:05.369135+0000","last_fullsized":"2023-05-12T09:09:05.369135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:17:49.851641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525876+0000","last_change":"2023-05-12T09:09:03.905365+0000","last_active":"2023-05-12T09:09:05.525876+0000","last_peered":"2023-05-12T09:09:05.525876+0000","last_clean":"2023-05-12T09:09:05.525876+0000","last_became_active":"2023-05-12T09:09:03.905121+0000","last_became_peered":"2023-05-12T09:09:03.905121+0000","last_unstale":"2023-05-12T09:09:05.525876+0000","last_undegraded":"2023-05-12T09:09:05.525876+0000","last_fullsized":"2023-05-12T09:09:05.525876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:37:59.723440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525423+0000","last_change":"2023-05-12T09:09:04.389953+0000","last_active":"2023-05-12T09:09:05.525423+0000","last_peered":"2023-05-12T09:09:05.525423+0000","last_clean":"2023-05-12T09:09:05.525423+0000","last_became_active":"2023-05-12T09:09:04.389660+0000","last_became_peered":"2023-05-12T09:09:04.389660+0000","last_unstale":"2023-05-12T09:09:05.525423+0000","last_undegraded":"2023-05-12T09:09:05.525423+0000","last_fullsized":"2023-05-12T09:09:05.525423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:12:11.321847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370186+0000","last_change":"2023-05-12T09:09:03.903025+0000","last_active":"2023-05-12T09:09:05.370186+0000","last_peered":"2023-05-12T09:09:05.370186+0000","last_clean":"2023-05-12T09:09:05.370186+0000","last_became_active":"2023-05-12T09:09:03.902746+0000","last_became_peered":"2023-05-12T09:09:03.902746+0000","last_unstale":"2023-05-12T09:09:05.370186+0000","last_undegraded":"2023-05-12T09:09:05.370186+0000","last_fullsized":"2023-05-12T09:09:05.370186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:35:59.060606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368500+0000","last_change":"2023-05-12T09:09:04.381403+0000","last_active":"2023-05-12T09:09:05.368500+0000","last_peered":"2023-05-12T09:09:05.368500+0000","last_clean":"2023-05-12T09:09:05.368500+0000","last_became_active":"2023-05-12T09:09:04.381065+0000","last_became_peered":"2023-05-12T09:09:04.381065+0000","last_unstale":"2023-05-12T09:09:05.368500+0000","last_undegraded":"2023-05-12T09:09:05.368500+0000","last_fullsized":"2023-05-12T09:09:05.368500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:39:54.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369012+0000","last_change":"2023-05-12T09:09:03.897457+0000","last_active":"2023-05-12T09:09:05.369012+0000","last_peered":"2023-05-12T09:09:05.369012+0000","last_clean":"2023-05-12T09:09:05.369012+0000","last_became_active":"2023-05-12T09:09:03.897208+0000","last_became_peered":"2023-05-12T09:09:03.897208+0000","last_unstale":"2023-05-12T09:09:05.369012+0000","last_undegraded":"2023-05-12T09:09:05.369012+0000","last_fullsized":"2023-05-12T09:09:05.369012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:36:58.128983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524926+0000","last_change":"2023-05-12T09:09:04.382791+0000","last_active":"2023-05-12T09:09:05.524926+0000","last_peered":"2023-05-12T09:09:05.524926+0000","last_clean":"2023-05-12T09:09:05.524926+0000","last_became_active":"2023-05-12T09:09:04.382364+0000","last_became_peered":"2023-05-12T09:09:04.382364+0000","last_unstale":"2023-05-12T09:09:05.524926+0000","last_undegraded":"2023-05-12T09:09:05.524926+0000","last_fullsized":"2023-05-12T09:09:05.524926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:21:19.580512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525800+0000","last_change":"2023-05-12T09:09:03.901200+0000","last_active":"2023-05-12T09:09:05.525800+0000","last_peered":"2023-05-12T09:09:05.525800+0000","last_clean":"2023-05-12T09:09:05.525800+0000","last_became_active":"2023-05-12T09:09:03.900868+0000","last_became_peered":"2023-05-12T09:09:03.900868+0000","last_unstale":"2023-05-12T09:09:05.525800+0000","last_undegraded":"2023-05-12T09:09:05.525800+0000","last_fullsized":"2023-05-12T09:09:05.525800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:20:48.285000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368613+0000","last_change":"2023-05-12T09:09:04.382637+0000","last_active":"2023-05-12T09:09:05.368613+0000","last_peered":"2023-05-12T09:09:05.368613+0000","last_clean":"2023-05-12T09:09:05.368613+0000","last_became_active":"2023-05-12T09:09:04.381521+0000","last_became_peered":"2023-05-12T09:09:04.381521+0000","last_unstale":"2023-05-12T09:09:05.368613+0000","last_undegraded":"2023-05-12T09:09:05.368613+0000","last_fullsized":"2023-05-12T09:09:05.368613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:29.854507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368910+0000","last_change":"2023-05-12T09:09:03.895812+0000","last_active":"2023-05-12T09:09:05.368910+0000","last_peered":"2023-05-12T09:09:05.368910+0000","last_clean":"2023-05-12T09:09:05.368910+0000","last_became_active":"2023-05-12T09:09:03.895537+0000","last_became_peered":"2023-05-12T09:09:03.895537+0000","last_unstale":"2023-05-12T09:09:05.368910+0000","last_undegraded":"2023-05-12T09:09:05.368910+0000","last_fullsized":"2023-05-12T09:09:05.368910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:39:44.374210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525492+0000","last_change":"2023-05-12T09:09:04.380481+0000","last_active":"2023-05-12T09:09:05.525492+0000","last_peered":"2023-05-12T09:09:05.525492+0000","last_clean":"2023-05-12T09:09:05.525492+0000","last_became_active":"2023-05-12T09:09:04.380206+0000","last_became_peered":"2023-05-12T09:09:04.380206+0000","last_unstale":"2023-05-12T09:09:05.525492+0000","last_undegraded":"2023-05-12T09:09:05.525492+0000","last_fullsized":"2023-05-12T09:09:05.525492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:45:27.296866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524659+0000","last_change":"2023-05-12T09:09:03.890886+0000","last_active":"2023-05-12T09:09:05.524659+0000","last_peered":"2023-05-12T09:09:05.524659+0000","last_clean":"2023-05-12T09:09:05.524659+0000","last_became_active":"2023-05-12T09:09:03.890638+0000","last_became_peered":"2023-05-12T09:09:03.890638+0000","last_unstale":"2023-05-12T09:09:05.524659+0000","last_undegraded":"2023-05-12T09:09:05.524659+0000","last_fullsized":"2023-05-12T09:09:05.524659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:39:43.260171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370385+0000","last_change":"2023-05-12T09:09:04.374857+0000","last_active":"2023-05-12T09:09:05.370385+0000","last_peered":"2023-05-12T09:09:05.370385+0000","last_clean":"2023-05-12T09:09:05.370385+0000","last_became_active":"2023-05-12T09:09:04.374612+0000","last_became_peered":"2023-05-12T09:09:04.374612+0000","last_unstale":"2023-05-12T09:09:05.370385+0000","last_undegraded":"2023-05-12T09:09:05.370385+0000","last_fullsized":"2023-05-12T09:09:05.370385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:46:06.115729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370153+0000","last_change":"2023-05-12T09:09:03.897820+0000","last_active":"2023-05-12T09:09:05.370153+0000","last_peered":"2023-05-12T09:09:05.370153+0000","last_clean":"2023-05-12T09:09:05.370153+0000","last_became_active":"2023-05-12T09:09:03.897558+0000","last_became_peered":"2023-05-12T09:09:03.897558+0000","last_unstale":"2023-05-12T09:09:05.370153+0000","last_undegraded":"2023-05-12T09:09:05.370153+0000","last_fullsized":"2023-05-12T09:09:05.370153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T21:03:48.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524585+0000","last_change":"2023-05-12T09:09:04.390060+0000","last_active":"2023-05-12T09:09:05.524585+0000","last_peered":"2023-05-12T09:09:05.524585+0000","last_clean":"2023-05-12T09:09:05.524585+0000","last_became_active":"2023-05-12T09:09:04.389807+0000","last_became_peered":"2023-05-12T09:09:04.389807+0000","last_unstale":"2023-05-12T09:09:05.524585+0000","last_undegraded":"2023-05-12T09:09:05.524585+0000","last_fullsized":"2023-05-12T09:09:05.524585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:56:06.370459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526368+0000","last_change":"2023-05-12T09:09:03.899139+0000","last_active":"2023-05-12T09:09:05.526368+0000","last_peered":"2023-05-12T09:09:05.526368+0000","last_clean":"2023-05-12T09:09:05.526368+0000","last_became_active":"2023-05-12T09:09:03.898851+0000","last_became_peered":"2023-05-12T09:09:03.898851+0000","last_unstale":"2023-05-12T09:09:05.526368+0000","last_undegraded":"2023-05-12T09:09:05.526368+0000","last_fullsized":"2023-05-12T09:09:05.526368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:38:16.015198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368765+0000","last_change":"2023-05-12T09:09:04.384396+0000","last_active":"2023-05-12T09:09:05.368765+0000","last_peered":"2023-05-12T09:09:05.368765+0000","last_clean":"2023-05-12T09:09:05.368765+0000","last_became_active":"2023-05-12T09:09:04.384142+0000","last_became_peered":"2023-05-12T09:09:04.384142+0000","last_unstale":"2023-05-12T09:09:05.368765+0000","last_undegraded":"2023-05-12T09:09:05.368765+0000","last_fullsized":"2023-05-12T09:09:05.368765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:21:56.693727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525174+0000","last_change":"2023-05-12T09:09:03.898664+0000","last_active":"2023-05-12T09:09:05.525174+0000","last_peered":"2023-05-12T09:09:05.525174+0000","last_clean":"2023-05-12T09:09:05.525174+0000","last_became_active":"2023-05-12T09:09:03.898255+0000","last_became_peered":"2023-05-12T09:09:03.898255+0000","last_unstale":"2023-05-12T09:09:05.525174+0000","last_undegraded":"2023-05-12T09:09:05.525174+0000","last_fullsized":"2023-05-12T09:09:05.525174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:58:20.540454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368861+0000","last_change":"2023-05-12T09:09:04.381374+0000","last_active":"2023-05-12T09:09:05.368861+0000","last_peered":"2023-05-12T09:09:05.368861+0000","last_clean":"2023-05-12T09:09:05.368861+0000","last_became_active":"2023-05-12T09:09:04.380322+0000","last_became_peered":"2023-05-12T09:09:04.380322+0000","last_unstale":"2023-05-12T09:09:05.368861+0000","last_undegraded":"2023-05-12T09:09:05.368861+0000","last_fullsized":"2023-05-12T09:09:05.368861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:15:07.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369267+0000","last_change":"2023-05-12T09:09:03.901336+0000","last_active":"2023-05-12T09:09:05.369267+0000","last_peered":"2023-05-12T09:09:05.369267+0000","last_clean":"2023-05-12T09:09:05.369267+0000","last_became_active":"2023-05-12T09:09:03.901093+0000","last_became_peered":"2023-05-12T09:09:03.901093+0000","last_unstale":"2023-05-12T09:09:05.369267+0000","last_undegraded":"2023-05-12T09:09:05.369267+0000","last_fullsized":"2023-05-12T09:09:05.369267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:30:46.428353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368740+0000","last_change":"2023-05-12T09:09:04.380397+0000","last_active":"2023-05-12T09:09:05.368740+0000","last_peered":"2023-05-12T09:09:05.368740+0000","last_clean":"2023-05-12T09:09:05.368740+0000","last_became_active":"2023-05-12T09:09:04.379830+0000","last_became_peered":"2023-05-12T09:09:04.379830+0000","last_unstale":"2023-05-12T09:09:05.368740+0000","last_undegraded":"2023-05-12T09:09:05.368740+0000","last_fullsized":"2023-05-12T09:09:05.368740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:59:53.543221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369124+0000","last_change":"2023-05-12T09:09:03.903743+0000","last_active":"2023-05-12T09:09:05.369124+0000","last_peered":"2023-05-12T09:09:05.369124+0000","last_clean":"2023-05-12T09:09:05.369124+0000","last_became_active":"2023-05-12T09:09:03.903330+0000","last_became_peered":"2023-05-12T09:09:03.903330+0000","last_unstale":"2023-05-12T09:09:05.369124+0000","last_undegraded":"2023-05-12T09:09:05.369124+0000","last_fullsized":"2023-05-12T09:09:05.369124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:25:13.658831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524340+0000","last_change":"2023-05-12T09:09:04.390802+0000","last_active":"2023-05-12T09:09:05.524340+0000","last_peered":"2023-05-12T09:09:05.524340+0000","last_clean":"2023-05-12T09:09:05.524340+0000","last_became_active":"2023-05-12T09:09:04.390550+0000","last_became_peered":"2023-05-12T09:09:04.390550+0000","last_unstale":"2023-05-12T09:09:05.524340+0000","last_undegraded":"2023-05-12T09:09:05.524340+0000","last_fullsized":"2023-05-12T09:09:05.524340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:09:30.637918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525360+0000","last_change":"2023-05-12T09:09:03.893986+0000","last_active":"2023-05-12T09:09:05.525360+0000","last_peered":"2023-05-12T09:09:05.525360+0000","last_clean":"2023-05-12T09:09:05.525360+0000","last_became_active":"2023-05-12T09:09:03.893664+0000","last_became_peered":"2023-05-12T09:09:03.893664+0000","last_unstale":"2023-05-12T09:09:05.525360+0000","last_undegraded":"2023-05-12T09:09:05.525360+0000","last_fullsized":"2023-05-12T09:09:05.525360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:12:10.319636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370400+0000","last_change":"2023-05-12T09:09:04.376696+0000","last_active":"2023-05-12T09:09:05.370400+0000","last_peered":"2023-05-12T09:09:05.370400+0000","last_clean":"2023-05-12T09:09:05.370400+0000","last_became_active":"2023-05-12T09:09:04.376435+0000","last_became_peered":"2023-05-12T09:09:04.376435+0000","last_unstale":"2023-05-12T09:09:05.370400+0000","last_undegraded":"2023-05-12T09:09:05.370400+0000","last_fullsized":"2023-05-12T09:09:05.370400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:12:12.470939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.523968+0000","last_change":"2023-05-12T09:09:03.901825+0000","last_active":"2023-05-12T09:09:05.523968+0000","last_peered":"2023-05-12T09:09:05.523968+0000","last_clean":"2023-05-12T09:09:05.523968+0000","last_became_active":"2023-05-12T09:09:03.901534+0000","last_became_peered":"2023-05-12T09:09:03.901534+0000","last_unstale":"2023-05-12T09:09:05.523968+0000","last_undegraded":"2023-05-12T09:09:05.523968+0000","last_fullsized":"2023-05-12T09:09:05.523968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:25:06.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524134+0000","last_change":"2023-05-12T09:09:04.378833+0000","last_active":"2023-05-12T09:09:05.524134+0000","last_peered":"2023-05-12T09:09:05.524134+0000","last_clean":"2023-05-12T09:09:05.524134+0000","last_became_active":"2023-05-12T09:09:04.378581+0000","last_became_peered":"2023-05-12T09:09:04.378581+0000","last_unstale":"2023-05-12T09:09:05.524134+0000","last_undegraded":"2023-05-12T09:09:05.524134+0000","last_fullsized":"2023-05-12T09:09:05.524134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:30:43.070773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525362+0000","last_change":"2023-05-12T09:09:03.901768+0000","last_active":"2023-05-12T09:09:05.525362+0000","last_peered":"2023-05-12T09:09:05.525362+0000","last_clean":"2023-05-12T09:09:05.525362+0000","last_became_active":"2023-05-12T09:09:03.901487+0000","last_became_peered":"2023-05-12T09:09:03.901487+0000","last_unstale":"2023-05-12T09:09:05.525362+0000","last_undegraded":"2023-05-12T09:09:05.525362+0000","last_fullsized":"2023-05-12T09:09:05.525362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:59:38.779581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369027+0000","last_change":"2023-05-12T09:09:04.384765+0000","last_active":"2023-05-12T09:09:05.369027+0000","last_peered":"2023-05-12T09:09:05.369027+0000","last_clean":"2023-05-12T09:09:05.369027+0000","last_became_active":"2023-05-12T09:09:04.384491+0000","last_became_peered":"2023-05-12T09:09:04.384491+0000","last_unstale":"2023-05-12T09:09:05.369027+0000","last_undegraded":"2023-05-12T09:09:05.369027+0000","last_fullsized":"2023-05-12T09:09:05.369027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:32:26.625036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526405+0000","last_change":"2023-05-12T09:09:03.906251+0000","last_active":"2023-05-12T09:09:05.526405+0000","last_peered":"2023-05-12T09:09:05.526405+0000","last_clean":"2023-05-12T09:09:05.526405+0000","last_became_active":"2023-05-12T09:09:03.905973+0000","last_became_peered":"2023-05-12T09:09:03.905973+0000","last_unstale":"2023-05-12T09:09:05.526405+0000","last_undegraded":"2023-05-12T09:09:05.526405+0000","last_fullsized":"2023-05-12T09:09:05.526405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:16:05.219780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526390+0000","last_change":"2023-05-12T09:07:04.835422+0000","last_active":"2023-05-12T09:09:05.526390+0000","last_peered":"2023-05-12T09:09:05.526390+0000","last_clean":"2023-05-12T09:09:05.526390+0000","last_became_active":"2023-05-12T09:07:04.834944+0000","last_became_peered":"2023-05-12T09:07:04.834944+0000","last_unstale":"2023-05-12T09:09:05.526390+0000","last_undegraded":"2023-05-12T09:09:05.526390+0000","last_fullsized":"2023-05-12T09:09:05.526390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:16:54.117136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368876+0000","last_change":"2023-05-12T09:09:04.380062+0000","last_active":"2023-05-12T09:09:05.368876+0000","last_peered":"2023-05-12T09:09:05.368876+0000","last_clean":"2023-05-12T09:09:05.368876+0000","last_became_active":"2023-05-12T09:09:04.379288+0000","last_became_peered":"2023-05-12T09:09:04.379288+0000","last_unstale":"2023-05-12T09:09:05.368876+0000","last_undegraded":"2023-05-12T09:09:05.368876+0000","last_fullsized":"2023-05-12T09:09:05.368876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:56.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525221+0000","last_change":"2023-05-12T09:09:03.903511+0000","last_active":"2023-05-12T09:09:05.525221+0000","last_peered":"2023-05-12T09:09:05.525221+0000","last_clean":"2023-05-12T09:09:05.525221+0000","last_became_active":"2023-05-12T09:09:03.903240+0000","last_became_peered":"2023-05-12T09:09:03.903240+0000","last_unstale":"2023-05-12T09:09:05.525221+0000","last_undegraded":"2023-05-12T09:09:05.525221+0000","last_fullsized":"2023-05-12T09:09:05.525221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:58:20.540454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369345+0000","last_change":"2023-05-12T09:07:04.828759+0000","last_active":"2023-05-12T09:09:05.369345+0000","last_peered":"2023-05-12T09:09:05.369345+0000","last_clean":"2023-05-12T09:09:05.369345+0000","last_became_active":"2023-05-12T09:07:04.828460+0000","last_became_peered":"2023-05-12T09:07:04.828460+0000","last_unstale":"2023-05-12T09:09:05.369345+0000","last_undegraded":"2023-05-12T09:09:05.369345+0000","last_fullsized":"2023-05-12T09:09:05.369345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:42:51.123407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525570+0000","last_change":"2023-05-12T09:09:04.385569+0000","last_active":"2023-05-12T09:09:05.525570+0000","last_peered":"2023-05-12T09:09:05.525570+0000","last_clean":"2023-05-12T09:09:05.525570+0000","last_became_active":"2023-05-12T09:09:04.385303+0000","last_became_peered":"2023-05-12T09:09:04.385303+0000","last_unstale":"2023-05-12T09:09:05.525570+0000","last_undegraded":"2023-05-12T09:09:05.525570+0000","last_fullsized":"2023-05-12T09:09:05.525570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:50:39.189696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524112+0000","last_change":"2023-05-12T09:09:03.893141+0000","last_active":"2023-05-12T09:09:05.524112+0000","last_peered":"2023-05-12T09:09:05.524112+0000","last_clean":"2023-05-12T09:09:05.524112+0000","last_became_active":"2023-05-12T09:09:03.892854+0000","last_became_peered":"2023-05-12T09:09:03.892854+0000","last_unstale":"2023-05-12T09:09:05.524112+0000","last_undegraded":"2023-05-12T09:09:05.524112+0000","last_fullsized":"2023-05-12T09:09:05.524112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:11:47.896590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524404+0000","last_change":"2023-05-12T09:07:04.830658+0000","last_active":"2023-05-12T09:09:05.524404+0000","last_peered":"2023-05-12T09:09:05.524404+0000","last_clean":"2023-05-12T09:09:05.524404+0000","last_became_active":"2023-05-12T09:07:04.830354+0000","last_became_peered":"2023-05-12T09:07:04.830354+0000","last_unstale":"2023-05-12T09:09:05.524404+0000","last_undegraded":"2023-05-12T09:09:05.524404+0000","last_fullsized":"2023-05-12T09:09:05.524404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:23:29.091315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":196,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525733+0000","last_change":"2023-05-12T09:07:04.830850+0000","last_active":"2023-05-12T09:09:05.525733+0000","last_peered":"2023-05-12T09:09:05.525733+0000","last_clean":"2023-05-12T09:09:05.525733+0000","last_became_active":"2023-05-12T09:07:04.829577+0000","last_became_peered":"2023-05-12T09:07:04.829577+0000","last_unstale":"2023-05-12T09:09:05.525733+0000","last_undegraded":"2023-05-12T09:09:05.525733+0000","last_fullsized":"2023-05-12T09:09:05.525733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:46:41.946248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524448+0000","last_change":"2023-05-12T09:09:04.376636+0000","last_active":"2023-05-12T09:09:05.524448+0000","last_peered":"2023-05-12T09:09:05.524448+0000","last_clean":"2023-05-12T09:09:05.524448+0000","last_became_active":"2023-05-12T09:09:04.376295+0000","last_became_peered":"2023-05-12T09:09:04.376295+0000","last_unstale":"2023-05-12T09:09:05.524448+0000","last_undegraded":"2023-05-12T09:09:05.524448+0000","last_fullsized":"2023-05-12T09:09:05.524448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:13:29.117504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525692+0000","last_change":"2023-05-12T09:09:03.905707+0000","last_active":"2023-05-12T09:09:05.525692+0000","last_peered":"2023-05-12T09:09:05.525692+0000","last_clean":"2023-05-12T09:09:05.525692+0000","last_became_active":"2023-05-12T09:09:03.905248+0000","last_became_peered":"2023-05-12T09:09:03.905248+0000","last_unstale":"2023-05-12T09:09:05.525692+0000","last_undegraded":"2023-05-12T09:09:05.525692+0000","last_fullsized":"2023-05-12T09:09:05.525692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:43:52.608003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525802+0000","last_change":"2023-05-12T09:07:05.258677+0000","last_active":"2023-05-12T09:09:05.525802+0000","last_peered":"2023-05-12T09:09:05.525802+0000","last_clean":"2023-05-12T09:09:05.525802+0000","last_became_active":"2023-05-12T09:07:05.258372+0000","last_became_peered":"2023-05-12T09:07:05.258372+0000","last_unstale":"2023-05-12T09:09:05.525802+0000","last_undegraded":"2023-05-12T09:09:05.525802+0000","last_fullsized":"2023-05-12T09:09:05.525802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:52:23.669645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524466+0000","last_change":"2023-05-12T09:09:04.382374+0000","last_active":"2023-05-12T09:09:05.524466+0000","last_peered":"2023-05-12T09:09:05.524466+0000","last_clean":"2023-05-12T09:09:05.524466+0000","last_became_active":"2023-05-12T09:09:04.381904+0000","last_became_peered":"2023-05-12T09:09:04.381904+0000","last_unstale":"2023-05-12T09:09:05.524466+0000","last_undegraded":"2023-05-12T09:09:05.524466+0000","last_fullsized":"2023-05-12T09:09:05.524466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:28:32.168752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525239+0000","last_change":"2023-05-12T09:09:03.899235+0000","last_active":"2023-05-12T09:09:05.525239+0000","last_peered":"2023-05-12T09:09:05.525239+0000","last_clean":"2023-05-12T09:09:05.525239+0000","last_became_active":"2023-05-12T09:09:03.898956+0000","last_became_peered":"2023-05-12T09:09:03.898956+0000","last_unstale":"2023-05-12T09:09:05.525239+0000","last_undegraded":"2023-05-12T09:09:05.525239+0000","last_fullsized":"2023-05-12T09:09:05.525239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:51:40.122290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525574+0000","last_change":"2023-05-12T09:07:05.258599+0000","last_active":"2023-05-12T09:09:05.525574+0000","last_peered":"2023-05-12T09:09:05.525574+0000","last_clean":"2023-05-12T09:09:05.525574+0000","last_became_active":"2023-05-12T09:07:05.258301+0000","last_became_peered":"2023-05-12T09:07:05.258301+0000","last_unstale":"2023-05-12T09:09:05.525574+0000","last_undegraded":"2023-05-12T09:09:05.525574+0000","last_fullsized":"2023-05-12T09:09:05.525574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:23:06.374371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368946+0000","last_change":"2023-05-12T09:09:04.381452+0000","last_active":"2023-05-12T09:09:05.368946+0000","last_peered":"2023-05-12T09:09:05.368946+0000","last_clean":"2023-05-12T09:09:05.368946+0000","last_became_active":"2023-05-12T09:09:04.381113+0000","last_became_peered":"2023-05-12T09:09:04.381113+0000","last_unstale":"2023-05-12T09:09:05.368946+0000","last_undegraded":"2023-05-12T09:09:05.368946+0000","last_fullsized":"2023-05-12T09:09:05.368946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:22:44.120344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369174+0000","last_change":"2023-05-12T09:09:03.899586+0000","last_active":"2023-05-12T09:09:05.369174+0000","last_peered":"2023-05-12T09:09:05.369174+0000","last_clean":"2023-05-12T09:09:05.369174+0000","last_became_active":"2023-05-12T09:09:03.898726+0000","last_became_peered":"2023-05-12T09:09:03.898726+0000","last_unstale":"2023-05-12T09:09:05.369174+0000","last_undegraded":"2023-05-12T09:09:05.369174+0000","last_fullsized":"2023-05-12T09:09:05.369174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:25:21.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524903+0000","last_change":"2023-05-12T09:07:05.258734+0000","last_active":"2023-05-12T09:09:05.524903+0000","last_peered":"2023-05-12T09:09:05.524903+0000","last_clean":"2023-05-12T09:09:05.524903+0000","last_became_active":"2023-05-12T09:07:05.258376+0000","last_became_peered":"2023-05-12T09:07:05.258376+0000","last_unstale":"2023-05-12T09:09:05.524903+0000","last_undegraded":"2023-05-12T09:09:05.524903+0000","last_fullsized":"2023-05-12T09:09:05.524903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:41:56.919026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524689+0000","last_change":"2023-05-12T09:09:04.390568+0000","last_active":"2023-05-12T09:09:05.524689+0000","last_peered":"2023-05-12T09:09:05.524689+0000","last_clean":"2023-05-12T09:09:05.524689+0000","last_became_active":"2023-05-12T09:09:04.390297+0000","last_became_peered":"2023-05-12T09:09:04.390297+0000","last_unstale":"2023-05-12T09:09:05.524689+0000","last_undegraded":"2023-05-12T09:09:05.524689+0000","last_fullsized":"2023-05-12T09:09:05.524689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:33:02.395196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524374+0000","last_change":"2023-05-12T09:09:03.900665+0000","last_active":"2023-05-12T09:09:05.524374+0000","last_peered":"2023-05-12T09:09:05.524374+0000","last_clean":"2023-05-12T09:09:05.524374+0000","last_became_active":"2023-05-12T09:09:03.900368+0000","last_became_peered":"2023-05-12T09:09:03.900368+0000","last_unstale":"2023-05-12T09:09:05.524374+0000","last_undegraded":"2023-05-12T09:09:05.524374+0000","last_fullsized":"2023-05-12T09:09:05.524374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:33:01.392985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368892+0000","last_change":"2023-05-12T09:07:05.258598+0000","last_active":"2023-05-12T09:09:05.368892+0000","last_peered":"2023-05-12T09:09:05.368892+0000","last_clean":"2023-05-12T09:09:05.368892+0000","last_became_active":"2023-05-12T09:07:05.258280+0000","last_became_peered":"2023-05-12T09:07:05.258280+0000","last_unstale":"2023-05-12T09:09:05.368892+0000","last_undegraded":"2023-05-12T09:09:05.368892+0000","last_fullsized":"2023-05-12T09:09:05.368892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:42:55.160903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526161+0000","last_change":"2023-05-12T09:09:04.388652+0000","last_active":"2023-05-12T09:09:05.526161+0000","last_peered":"2023-05-12T09:09:05.526161+0000","last_clean":"2023-05-12T09:09:05.526161+0000","last_became_active":"2023-05-12T09:09:04.388400+0000","last_became_peered":"2023-05-12T09:09:04.388400+0000","last_unstale":"2023-05-12T09:09:05.526161+0000","last_undegraded":"2023-05-12T09:09:05.526161+0000","last_fullsized":"2023-05-12T09:09:05.526161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:18:11.110214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524691+0000","last_change":"2023-05-12T09:09:03.896427+0000","last_active":"2023-05-12T09:09:05.524691+0000","last_peered":"2023-05-12T09:09:05.524691+0000","last_clean":"2023-05-12T09:09:05.524691+0000","last_became_active":"2023-05-12T09:09:03.896191+0000","last_became_peered":"2023-05-12T09:09:03.896191+0000","last_unstale":"2023-05-12T09:09:05.524691+0000","last_undegraded":"2023-05-12T09:09:05.524691+0000","last_fullsized":"2023-05-12T09:09:05.524691+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:54:12.262920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369069+0000","last_change":"2023-05-12T09:07:04.830787+0000","last_active":"2023-05-12T09:09:05.369069+0000","last_peered":"2023-05-12T09:09:05.369069+0000","last_clean":"2023-05-12T09:09:05.369069+0000","last_became_active":"2023-05-12T09:07:04.830492+0000","last_became_peered":"2023-05-12T09:07:04.830492+0000","last_unstale":"2023-05-12T09:09:05.369069+0000","last_undegraded":"2023-05-12T09:09:05.369069+0000","last_fullsized":"2023-05-12T09:09:05.369069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:42:22.913281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9736,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362104,"statfs":{"total":96636764160,"available":96626794496,"internally_reserved":0,"allocated":1048576,"data_stored":794063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.78400000000000003}]},{"osd":1,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.4560000000000004,"5min":4.4560000000000004,"15min":4.4560000000000004},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5620000000000003,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8580,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363260,"statfs":{"total":96636764160,"available":96627978240,"internally_reserved":0,"allocated":454656,"data_stored":202916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":6.9550000000000001,"5min":6.9550000000000001,"15min":6.9550000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.9370000000000003,"5min":5.9370000000000003,"15min":5.9370000000000003},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":7.024,"5min":7.024,"15min":7.024},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.96,"5min":5.96,"15min":5.96},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.41899999999999998}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.62},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9736,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362104,"statfs":{"total":96636764160,"available":96626794496,"internally_reserved":0,"allocated":1048576,"data_stored":794043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.436,"15min":0.44600000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54000000000000004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65100000000000002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.51300000000000001,"15min":0.52500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59799999999999998,"5min":1.75,"15min":1.75},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.60899999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.437}]},{"osd":3,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.58299999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.63500000000000001,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.5}]},{"osd":4,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82899999999999996,"15min":0.84299999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.62},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98599999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82199999999999995,"15min":0.83999999999999997},"min":{"1min":0.52300000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.89400000000000002,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97499999999999998,"5min":1.806,"15min":1.806},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1,"5min":1.857,"15min":1.857},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95099999999999996,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0469999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8708,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363132,"statfs":{"total":96636764160,"available":96627847168,"internally_reserved":0,"allocated":454656,"data_stored":203639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.68600000000000005,"15min":0.73599999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.311},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.84499999999999997,"15min":0.91500000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.55600000000000005,"5min":11.914,"15min":11.914},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.73799999999999999,"15min":0.78600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.56499999999999995,"15min":0.58499999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69499999999999995,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.90100000000000002,"15min":0.97899999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.56299999999999994,"5min":12.064,"15min":12.064},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.76900000000000002,"15min":0.81499999999999995},"min":{"1min":0.438,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61599999999999999,"5min":6.7229999999999999,"15min":6.7229999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85899999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":1.129,"15min":1.2050000000000001},"min":{"1min":0.46899999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84299999999999997,"5min":12.034000000000001,"15min":12.034000000000001},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.97399999999999998,"15min":1.0249999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.81499999999999995,"5min":6.7910000000000004,"15min":6.7910000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84999999999999998,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":1.3440000000000001,"15min":1.458},"min":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.80800000000000005,"5min":11.968,"15min":11.968},"last":0.625},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.99399999999999999,"15min":1.044},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.84399999999999997,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.95099999999999996,"15min":0.995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.88600000000000001,"5min":6.867,"15min":6.867},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":1.151,"15min":1.2290000000000001},"min":{"1min":0.56599999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.86299999999999999,"5min":12.004,"15min":12.004},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8524,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363316,"statfs":{"total":96636764160,"available":96628035584,"internally_reserved":0,"allocated":462848,"data_stored":203830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54700000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.433},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.307,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60899999999999999,"5min":1.01,"15min":1.01},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.441,"15min":0.442},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66300000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.57399999999999995,"5min":1.216,"15min":1.216},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.29,"15min":1.29},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1100000000000001,"5min":1.371,"15min":1.371},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.147,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.01,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.80600000000000005,"15min":0.81599999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.179,"15min":1.179},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0640000000000001,"5min":1.413,"15min":1.413},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.83099999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0489999999999999,"5min":1.262,"15min":1.262},"last":0.627}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8716,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363124,"statfs":{"total":96636764160,"available":96627838976,"internally_reserved":0,"allocated":462848,"data_stored":204243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.40500000000000003}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.62}]},{"osd":4,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8716,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363124,"statfs":{"total":96636764160,"available":96627838976,"internally_reserved":0,"allocated":462848,"data_stored":205169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":8.7530000000000001,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":8.7710000000000008,"5min":8.7710000000000008,"15min":8.7710000000000008},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.626},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.532,"5min":4.532,"15min":4.532},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.499},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53300000000000003}]},{"osd":6,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67600000000000005}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8576,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363264,"statfs":{"total":96636764160,"available":96627982336,"internally_reserved":0,"allocated":450560,"data_stored":202314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.64000000000000001,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71199999999999997,"5min":1.159,"15min":1.159},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.67300000000000004},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.748,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.47599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.879,"5min":1.597,"15min":1.597},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79400000000000004,"5min":1.431,"15min":1.431},"last":0.752},{"interface":"front","average":{"1min":0.627,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89300000000000002,"5min":1.53,"15min":1.53},"last":0.89000000000000001}]},{"osd":3,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.80200000000000005,"15min":0.82599999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.83799999999999997,"5min":1.333,"15min":1.333},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.78700000000000003,"5min":1.649,"15min":1.649},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86799999999999999,"5min":1.532,"15min":1.532},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68899999999999995,"15min":0.69599999999999995},"min":{"1min":0.441,"5min":0.436,"15min":0.436},"max":{"1min":0.872,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.90400000000000003,"5min":1.708,"15min":1.708},"last":0.90400000000000003}]},{"osd":7,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.745},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90100000000000002,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.871},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91400000000000003,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-12T09:09:09.732 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-12T09:09:09.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.944+0000 7f7e2cdff700 1 Processor -- start 2023-05-12T09:09:09.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.944+0000 7f7e2cdff700 1 -- start start 2023-05-12T09:09:09.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.945+0000 7f7e2cdff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280d2110 0x7f7e28167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.945+0000 7f7e2cdff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e28161000 con 0x7f7e280cfbf0 2023-05-12T09:09:09.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.945+0000 7f7e2cdff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e280d0020 con 0x7f7e280b87a0 2023-05-12T09:09:09.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.945+0000 7f7e2cdff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280d02d0 con 0x7f7e280d2110 2023-05-12T09:09:09.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.945+0000 7f7e1ffff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f7e280cfbf0 0x7f7e281608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59624/0 (socket says 172.21.15.116:59624) 2023-05-12T09:09:09.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.945+0000 7f7e1ffff700 1 -- 172.21.15.116:0/2515920321 learned_addr learned my addr 172.21.15.116:0/2515920321 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:09.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.945+0000 7f7e26d9d700 1 --2- 172.21.15.116:0/2515920321 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280d2110 0x7f7e28167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.946+0000 7f7e25d9b700 1 -- 172.21.15.116:0/2515920321 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828250167 0 0) 0x7f7e28161000 con 0x7f7e280cfbf0 2023-05-12T09:09:09.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.946+0000 7f7e25d9b700 1 -- 172.21.15.116:0/2515920321 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e140035b0 con 0x7f7e280cfbf0 2023-05-12T09:09:09.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.946+0000 7f7e25d9b700 1 -- 172.21.15.116:0/2515920321 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140799225 0 0) 0x7f7e280d0020 con 0x7f7e280b87a0 2023-05-12T09:09:09.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.946+0000 7f7e25d9b700 1 -- 172.21.15.116:0/2515920321 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e28161000 con 0x7f7e280b87a0 2023-05-12T09:09:09.952 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.946+0000 7f7e26d9d700 1 -- 172.21.15.116:0/2515920321 >> v1:172.21.15.182:6789/0 conn(0x7f7e280b87a0 legacy=0x7f7e281601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.952 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.946+0000 7f7e26d9d700 1 -- 172.21.15.116:0/2515920321 >> v1:172.21.15.116:6789/0 conn(0x7f7e280cfbf0 legacy=0x7f7e281608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.952 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.946+0000 7f7e26d9d700 1 -- 172.21.15.116:0/2515920321 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280cdc60 con 0x7f7e280d2110 2023-05-12T09:09:09.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.946+0000 7f7e26d9d700 1 --2- 172.21.15.116:0/2515920321 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280d2110 0x7f7e28167550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009dc0 tx=0x7f7e2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e6006212ae6b40f server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:09.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.947+0000 7f7e25d9b700 1 -- 172.21.15.116:0/2515920321 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2000e070 con 0x7f7e280d2110 2023-05-12T09:09:09.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.947+0000 7f7e25d9b700 1 -- 172.21.15.116:0/2515920321 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2000bb20 con 0x7f7e280d2110 2023-05-12T09:09:09.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.947+0000 7f7e25d9b700 1 -- 172.21.15.116:0/2515920321 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2000be90 con 0x7f7e280d2110 2023-05-12T09:09:09.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.947+0000 7f7e2cdff700 1 -- 172.21.15.116:0/2515920321 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280d2110 msgr2=0x7f7e28167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.947+0000 7f7e2cdff700 1 --2- 172.21.15.116:0/2515920321 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280d2110 0x7f7e28167550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009dc0 tx=0x7f7e2000b330 comp rx=0 tx=0).stop 2023-05-12T09:09:09.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.947+0000 7f7e2cdff700 1 -- 172.21.15.116:0/2515920321 shutdown_connections 2023-05-12T09:09:09.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.947+0000 7f7e2cdff700 1 --2- 172.21.15.116:0/2515920321 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280d2110 0x7f7e28167550 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.947+0000 7f7e2cdff700 1 -- 172.21.15.116:0/2515920321 >> 172.21.15.116:0/2515920321 conn(0x7f7e28071b10 msgr2=0x7f7e28071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:09.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.947+0000 7f7e2cdff700 1 -- 172.21.15.116:0/2515920321 shutdown_connections 2023-05-12T09:09:09.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.947+0000 7f7e2cdff700 1 -- 172.21.15.116:0/2515920321 wait complete. 2023-05-12T09:09:09.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.949+0000 7f7e2cdff700 1 Processor -- start 2023-05-12T09:09:09.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.949+0000 7f7e2cdff700 1 -- start start 2023-05-12T09:09:09.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e2cdff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280b87a0 0x7f7e280ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e2cdff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e280cfbf0 0x7f7e28152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e2cdff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7e280d2110 0x7f7e281534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e2cdff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280cc130 con 0x7f7e280cfbf0 2023-05-12T09:09:09.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e2cdff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e28157250 con 0x7f7e280d2110 2023-05-12T09:09:09.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e2cdff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280cba70 con 0x7f7e280b87a0 2023-05-12T09:09:09.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e1ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e280cfbf0 0x7f7e28152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e1ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e280cfbf0 0x7f7e28152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35776/0 (socket says 172.21.15.116:35776) 2023-05-12T09:09:09.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e1ffff700 1 -- 172.21.15.116:0/976198560 learned_addr learned my addr 172.21.15.116:0/976198560 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:09.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e2659c700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280b87a0 0x7f7e280ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.959 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.950+0000 7f7e26d9d700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7e280d2110 0x7f7e281534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e1ffff700 1 -- 172.21.15.116:0/976198560 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280b87a0 msgr2=0x7f7e280ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e1ffff700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280b87a0 0x7f7e280ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e1ffff700 1 -- 172.21.15.116:0/976198560 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7e280d2110 msgr2=0x7f7e281534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:09.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e1ffff700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7e280d2110 0x7f7e281534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:09.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e1ffff700 1 -- 172.21.15.116:0/976198560 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20009a70 con 0x7f7e280cfbf0 2023-05-12T09:09:09.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e1ffff700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e280cfbf0 0x7f7e28152f60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000c700 tx=0x7f7e1000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:09.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e1effd700 1 -- 172.21.15.116:0/976198560 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10005d70 con 0x7f7e280cfbf0 2023-05-12T09:09:09.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e1effd700 1 -- 172.21.15.116:0/976198560 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e100070d0 con 0x7f7e280cfbf0 2023-05-12T09:09:09.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e2cdff700 1 -- 172.21.15.116:0/976198560 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e280cd980 con 0x7f7e280cfbf0 2023-05-12T09:09:09.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e1effd700 1 -- 172.21.15.116:0/976198560 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10007460 con 0x7f7e280cfbf0 2023-05-12T09:09:09.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.951+0000 7f7e2cdff700 1 -- 172.21.15.116:0/976198560 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e280cd6a0 con 0x7f7e280cfbf0 2023-05-12T09:09:09.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.952+0000 7f7e2cdff700 1 -- 172.21.15.116:0/976198560 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e28167a90 con 0x7f7e280cfbf0 2023-05-12T09:09:09.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.953+0000 7f7e1effd700 1 -- 172.21.15.116:0/976198560 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e100075c0 con 0x7f7e280cfbf0 2023-05-12T09:09:09.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.954+0000 7f7e1effd700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7e0806ace0 0x7f7e0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:09.961 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.954+0000 7f7e1effd700 1 -- 172.21.15.116:0/976198560 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7e10088ac0 con 0x7f7e280cfbf0 2023-05-12T09:09:09.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.954+0000 7f7e2659c700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7e0806ace0 0x7f7e0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:09.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.955+0000 7f7e2659c700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7e0806ace0 0x7f7e0806d190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7e180011e0 tx=0x7f7e18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:09.962 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:09.958+0000 7f7e1effd700 1 -- 172.21.15.116:0/976198560 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7e10053990 con 0x7f7e280cfbf0 2023-05-12T09:09:10.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.226+0000 7f7e2cdff700 1 -- 172.21.15.116:0/976198560 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7e280cb8d0 con 0x7f7e280cfbf0 2023-05-12T09:09:10.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.226+0000 7f7e1effd700 1 -- 172.21.15.116:0/976198560 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1013 (secure 0 0 0) 0x7f7e10017410 con 0x7f7e280cfbf0 2023-05-12T09:09:10.230 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:10.230 INFO:teuthology.orchestra.run.smithi116.stdout:{"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":139,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1683882422,"num_in_osds":8,"osd_in_since":1683882414,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":73003008,"bytes_avail":773021110272,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5580}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-05-12T09:08:17.583878+0000","services":{}},"progress_events":{}} 2023-05-12T09:09:10.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.228+0000 7f7e2cdff700 1 -- 172.21.15.116:0/976198560 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7e0806ace0 msgr2=0x7f7e0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:10.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.228+0000 7f7e2cdff700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7e0806ace0 0x7f7e0806d190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7e180011e0 tx=0x7f7e18009040 comp rx=0 tx=0).stop 2023-05-12T09:09:10.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.229+0000 7f7e2cdff700 1 -- 172.21.15.116:0/976198560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e280cfbf0 msgr2=0x7f7e28152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:10.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.229+0000 7f7e2cdff700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e280cfbf0 0x7f7e28152f60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000c700 tx=0x7f7e1000ca10 comp rx=0 tx=0).stop 2023-05-12T09:09:10.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.229+0000 7f7e2cdff700 1 -- 172.21.15.116:0/976198560 shutdown_connections 2023-05-12T09:09:10.232 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.229+0000 7f7e2cdff700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7e280d2110 0x7f7e281534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.229+0000 7f7e2cdff700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f7e0806ace0 0x7f7e0806d190 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.229+0000 7f7e2cdff700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7e280b87a0 0x7f7e280ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.229+0000 7f7e2cdff700 1 --2- 172.21.15.116:0/976198560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e280cfbf0 0x7f7e28152f60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.229+0000 7f7e2cdff700 1 -- 172.21.15.116:0/976198560 >> 172.21.15.116:0/976198560 conn(0x7f7e28071b10 msgr2=0x7f7e280b7780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:10.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.229+0000 7f7e2cdff700 1 -- 172.21.15.116:0/976198560 shutdown_connections 2023-05-12T09:09:10.233 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.229+0000 7f7e2cdff700 1 -- 172.21.15.116:0/976198560 wait complete. 2023-05-12T09:09:10.249 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-12T09:09:10.250 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-12T09:09:10.341 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:09:10.345 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:09:10.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.436+0000 7f76a87ff700 1 Processor -- start 2023-05-12T09:09:10.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.436+0000 7f76a87ff700 1 -- start start 2023-05-12T09:09:10.440 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.437+0000 7f76a87ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f76a015c590 0x7f76a0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.438+0000 7f76a87ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a00cd520 con 0x7f76a00cf010 2023-05-12T09:09:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.438+0000 7f76a87ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a00d2640 con 0x7f76a00cff50 2023-05-12T09:09:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.438+0000 7f76a87ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a01610d0 con 0x7f76a015c590 2023-05-12T09:09:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.438+0000 7f76a5d9a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f76a00cf010 0x7f76a00cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59626/0 (socket says 172.21.15.116:59626) 2023-05-12T09:09:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.438+0000 7f76a5d9a700 1 -- 172.21.15.116:0/4224635467 learned_addr learned my addr 172.21.15.116:0/4224635467 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:10.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.438+0000 7f76a659b700 1 --2- 172.21.15.116:0/4224635467 >> v2:172.21.15.182:3300/0 conn(0x7f76a015c590 0x7f76a0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:10.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.438+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367120261 0 0) 0x7f76a00cd520 con 0x7f76a00cf010 2023-05-12T09:09:10.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.438+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f768c0035b0 con 0x7f76a00cf010 2023-05-12T09:09:10.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3535582545 0 0) 0x7f768c0035b0 con 0x7f76a00cf010 2023-05-12T09:09:10.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 >> v2:172.21.15.182:3300/0 conn(0x7f76a015c590 msgr2=0x7f76a0160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:10.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 --2- 172.21.15.116:0/4224635467 >> v2:172.21.15.182:3300/0 conn(0x7f76a015c590 0x7f76a0160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 >> v1:172.21.15.182:6789/0 conn(0x7f76a00cff50 legacy=0x7f76a00d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:10.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a00b23c0 con 0x7f76a00cf010 2023-05-12T09:09:10.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f7690001670 con 0x7f76a00cf010 2023-05-12T09:09:10.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 >> v1:172.21.15.116:6789/0 conn(0x7f76a00cf010 legacy=0x7f76a00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:10.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f768c003a00 0x7f768c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:10.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f768c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:10.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f768c005200 0x7f768c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:10.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a01610d0 con 0x7f768c004850 2023-05-12T09:09:10.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c00c080 con 0x7f768c005200 2023-05-12T09:09:10.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c00c240 con 0x7f768c003a00 2023-05-12T09:09:10.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5d9a700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f768c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:10.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a6d9c700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f768c005200 0x7f768c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:10.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a659b700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f768c003a00 0x7f768c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:10.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5d9a700 1 -- 172.21.15.116:0/4224635467 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f768c003a00 msgr2=0x7f768c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:10.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5d9a700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f768c003a00 0x7f768c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5d9a700 1 -- 172.21.15.116:0/4224635467 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f768c005200 msgr2=0x7f768c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:10.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5d9a700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f768c005200 0x7f768c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a5d9a700 1 -- 172.21.15.116:0/4224635467 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0035b0 con 0x7f768c004850 2023-05-12T09:09:10.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.439+0000 7f76a6d9c700 1 -- 172.21.15.116:0/4224635467 reap_dead start 2023-05-12T09:09:10.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.440+0000 7f76a5d9a700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f768c004cc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f769000c240 tx=0x7f768c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e156120b2e209174 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:10.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.440+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690007c10 con 0x7f768c004850 2023-05-12T09:09:10.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.440+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769000ce00 con 0x7f768c004850 2023-05-12T09:09:10.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.440+0000 7f76a5599700 1 -- 172.21.15.116:0/4224635467 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690005ba0 con 0x7f768c004850 2023-05-12T09:09:10.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.440+0000 7f76a87ff700 1 -- 172.21.15.116:0/4224635467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 msgr2=0x7f768c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:10.447 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.440+0000 7f76a87ff700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f768c004cc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f769000c240 tx=0x7f768c005880 comp rx=0 tx=0).stop 2023-05-12T09:09:10.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.440+0000 7f76a87ff700 1 -- 172.21.15.116:0/4224635467 shutdown_connections 2023-05-12T09:09:10.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.440+0000 7f76a87ff700 1 --2- 172.21.15.116:0/4224635467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f768c004cc0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.440+0000 7f76a87ff700 1 -- 172.21.15.116:0/4224635467 >> 172.21.15.116:0/4224635467 conn(0x7f76a0071b10 msgr2=0x7f76a0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:10.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.440+0000 7f76a87ff700 1 -- 172.21.15.116:0/4224635467 shutdown_connections 2023-05-12T09:09:10.448 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.441+0000 7f76a87ff700 1 -- 172.21.15.116:0/4224635467 wait complete. 2023-05-12T09:09:10.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.442+0000 7f76a87ff700 1 Processor -- start 2023-05-12T09:09:10.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.442+0000 7f76a87ff700 1 -- start start 2023-05-12T09:09:10.450 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.443+0000 7f76a87ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f76a00c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:10.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.443+0000 7f76a87ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76a01e6990 0x7f76a0156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:10.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.443+0000 7f76a87ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76a0157530 0x7f76a00b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:10.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.443+0000 7f76a87ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a01579b0 con 0x7f768c004850 2023-05-12T09:09:10.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.443+0000 7f76a87ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a01e6f50 con 0x7f76a01e6990 2023-05-12T09:09:10.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.443+0000 7f76a87ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a01e7230 con 0x7f76a0157530 2023-05-12T09:09:10.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.443+0000 7f76a659b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f76a00c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:10.451 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a659b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f76a00c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35792/0 (socket says 172.21.15.116:35792) 2023-05-12T09:09:10.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a659b700 1 -- 172.21.15.116:0/1953914643 learned_addr learned my addr 172.21.15.116:0/1953914643 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:10.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a6d9c700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76a0157530 0x7f76a00b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:10.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a5d9a700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76a01e6990 0x7f76a0156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:10.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a659b700 1 -- 172.21.15.116:0/1953914643 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76a0157530 msgr2=0x7f76a00b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:10.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a659b700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76a0157530 0x7f76a00b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a659b700 1 -- 172.21.15.116:0/1953914643 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76a01e6990 msgr2=0x7f76a0156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:10.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a659b700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76a01e6990 0x7f76a0156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a659b700 1 -- 172.21.15.116:0/1953914643 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a00cd770 con 0x7f768c004850 2023-05-12T09:09:10.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a5d9a700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76a01e6990 0x7f76a0156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:09:10.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a659b700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f76a00c83e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f769c011aa0 tx=0x7f769c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:10.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f7696ffd700 1 -- 172.21.15.116:0/1953914643 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00f940 con 0x7f768c004850 2023-05-12T09:09:10.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f7696ffd700 1 -- 172.21.15.116:0/1953914643 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c00faa0 con 0x7f768c004850 2023-05-12T09:09:10.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f7696ffd700 1 -- 172.21.15.116:0/1953914643 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00fe50 con 0x7f768c004850 2023-05-12T09:09:10.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.444+0000 7f76a87ff700 1 -- 172.21.15.116:0/1953914643 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a00cf560 con 0x7f768c004850 2023-05-12T09:09:10.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.445+0000 7f76a87ff700 1 -- 172.21.15.116:0/1953914643 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a015c960 con 0x7f768c004850 2023-05-12T09:09:10.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.445+0000 7f76a87ff700 1 -- 172.21.15.116:0/1953914643 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a00b51f0 con 0x7f768c004850 2023-05-12T09:09:10.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.446+0000 7f7696ffd700 1 -- 172.21.15.116:0/1953914643 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f769c014440 con 0x7f768c004850 2023-05-12T09:09:10.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.447+0000 7f7696ffd700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f768406ace0 0x7f768406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:10.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.447+0000 7f7696ffd700 1 -- 172.21.15.116:0/1953914643 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f769c089e60 con 0x7f768c004850 2023-05-12T09:09:10.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.447+0000 7f76a5d9a700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f768406ace0 0x7f768406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:10.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.448+0000 7f76a5d9a700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f768406ace0 0x7f768406d190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7690001930 tx=0x7f7690007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:10.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.451+0000 7f7696ffd700 1 -- 172.21.15.116:0/1953914643 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f769c0587c0 con 0x7f768c004850 2023-05-12T09:09:10.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.640+0000 7f76a87ff700 1 -- 172.21.15.116:0/1953914643 --> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76a015ae60 con 0x7f768406ace0 2023-05-12T09:09:10.652 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.649+0000 7f7696ffd700 1 -- 172.21.15.116:0/1953914643 <== mgr.4106 v2:172.21.15.116:6832/3989593778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311267 (secure 0 0 0) 0x7f76a015ae60 con 0x7f768406ace0 2023-05-12T09:09:10.656 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:10.657 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 -- 172.21.15.116:0/1953914643 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f768406ace0 msgr2=0x7f768406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:10.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f768406ace0 0x7f768406d190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7690001930 tx=0x7f7690007000 comp rx=0 tx=0).stop 2023-05-12T09:09:10.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 -- 172.21.15.116:0/1953914643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 msgr2=0x7f76a00c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:10.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f76a00c83e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f769c011aa0 tx=0x7f769c011db0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 -- 172.21.15.116:0/1953914643 shutdown_connections 2023-05-12T09:09:10.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f768406ace0 0x7f768406d190 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.658 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76a0157530 0x7f76a00b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f768c004850 0x7f76a00c83e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 --2- 172.21.15.116:0/1953914643 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76a01e6990 0x7f76a0156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:10.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 -- 172.21.15.116:0/1953914643 >> 172.21.15.116:0/1953914643 conn(0x7f76a0071b10 msgr2=0x7f76a01598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:10.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 -- 172.21.15.116:0/1953914643 shutdown_connections 2023-05-12T09:09:10.659 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:10.654+0000 7f76a87ff700 1 -- 172.21.15.116:0/1953914643 wait complete. 2023-05-12T09:09:10.660 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2023-05-12T09:09:10.674 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-05-12T09:09:09.594039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71292,"kb_used_data":4732,"kb_used_omap":0,"kb_used_meta":66496,"kb_avail":754903428,"statfs":{"total":773094113280,"available":773021110272,"internally_reserved":0,"allocated":4845568,"data_stored":2810217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68091904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000864"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525644+0000","last_change":"2023-05-12T09:09:04.386504+0000","last_active":"2023-05-12T09:09:05.525644+0000","last_peered":"2023-05-12T09:09:05.525644+0000","last_clean":"2023-05-12T09:09:05.525644+0000","last_became_active":"2023-05-12T09:09:04.386247+0000","last_became_peered":"2023-05-12T09:09:04.386247+0000","last_unstale":"2023-05-12T09:09:05.525644+0000","last_undegraded":"2023-05-12T09:09:05.525644+0000","last_fullsized":"2023-05-12T09:09:05.525644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:12:31.106955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524972+0000","last_change":"2023-05-12T09:09:04.382931+0000","last_active":"2023-05-12T09:09:05.524972+0000","last_peered":"2023-05-12T09:09:05.524972+0000","last_clean":"2023-05-12T09:09:05.524972+0000","last_became_active":"2023-05-12T09:09:04.382666+0000","last_became_peered":"2023-05-12T09:09:04.382666+0000","last_unstale":"2023-05-12T09:09:05.524972+0000","last_undegraded":"2023-05-12T09:09:05.524972+0000","last_fullsized":"2023-05-12T09:09:05.524972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:20:41.081497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526540+0000","last_change":"2023-05-12T09:09:04.384475+0000","last_active":"2023-05-12T09:09:05.526540+0000","last_peered":"2023-05-12T09:09:05.526540+0000","last_clean":"2023-05-12T09:09:05.526540+0000","last_became_active":"2023-05-12T09:09:04.384193+0000","last_became_peered":"2023-05-12T09:09:04.384193+0000","last_unstale":"2023-05-12T09:09:05.526540+0000","last_undegraded":"2023-05-12T09:09:05.526540+0000","last_fullsized":"2023-05-12T09:09:05.526540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:27:56.479049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524357+0000","last_change":"2023-05-12T09:09:04.392312+0000","last_active":"2023-05-12T09:09:05.524357+0000","last_peered":"2023-05-12T09:09:05.524357+0000","last_clean":"2023-05-12T09:09:05.524357+0000","last_became_active":"2023-05-12T09:09:04.392058+0000","last_became_peered":"2023-05-12T09:09:04.392058+0000","last_unstale":"2023-05-12T09:09:05.524357+0000","last_undegraded":"2023-05-12T09:09:05.524357+0000","last_fullsized":"2023-05-12T09:09:05.524357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:57:27.622878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524918+0000","last_change":"2023-05-12T09:09:04.377823+0000","last_active":"2023-05-12T09:09:05.524918+0000","last_peered":"2023-05-12T09:09:05.524918+0000","last_clean":"2023-05-12T09:09:05.524918+0000","last_became_active":"2023-05-12T09:09:04.377580+0000","last_became_peered":"2023-05-12T09:09:04.377580+0000","last_unstale":"2023-05-12T09:09:05.524918+0000","last_undegraded":"2023-05-12T09:09:05.524918+0000","last_fullsized":"2023-05-12T09:09:05.524918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:40:40.702906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368750+0000","last_change":"2023-05-12T09:09:04.380240+0000","last_active":"2023-05-12T09:09:05.368750+0000","last_peered":"2023-05-12T09:09:05.368750+0000","last_clean":"2023-05-12T09:09:05.368750+0000","last_became_active":"2023-05-12T09:09:04.379567+0000","last_became_peered":"2023-05-12T09:09:04.379567+0000","last_unstale":"2023-05-12T09:09:05.368750+0000","last_undegraded":"2023-05-12T09:09:05.368750+0000","last_fullsized":"2023-05-12T09:09:05.368750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:27:23.814861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525192+0000","last_change":"2023-05-12T09:09:04.387166+0000","last_active":"2023-05-12T09:09:05.525192+0000","last_peered":"2023-05-12T09:09:05.525192+0000","last_clean":"2023-05-12T09:09:05.525192+0000","last_became_active":"2023-05-12T09:09:04.386855+0000","last_became_peered":"2023-05-12T09:09:04.386855+0000","last_unstale":"2023-05-12T09:09:05.525192+0000","last_undegraded":"2023-05-12T09:09:05.525192+0000","last_fullsized":"2023-05-12T09:09:05.525192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:51:41.124501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524129+0000","last_change":"2023-05-12T09:09:04.381056+0000","last_active":"2023-05-12T09:09:05.524129+0000","last_peered":"2023-05-12T09:09:05.524129+0000","last_clean":"2023-05-12T09:09:05.524129+0000","last_became_active":"2023-05-12T09:09:04.380828+0000","last_became_peered":"2023-05-12T09:09:04.380828+0000","last_unstale":"2023-05-12T09:09:05.524129+0000","last_undegraded":"2023-05-12T09:09:05.524129+0000","last_fullsized":"2023-05-12T09:09:05.524129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:01:52.267927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524531+0000","last_change":"2023-05-12T09:09:04.380020+0000","last_active":"2023-05-12T09:09:05.524531+0000","last_peered":"2023-05-12T09:09:05.524531+0000","last_clean":"2023-05-12T09:09:05.524531+0000","last_became_active":"2023-05-12T09:09:04.379753+0000","last_became_peered":"2023-05-12T09:09:04.379753+0000","last_unstale":"2023-05-12T09:09:05.524531+0000","last_undegraded":"2023-05-12T09:09:05.524531+0000","last_fullsized":"2023-05-12T09:09:05.524531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:09:41.115391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524310+0000","last_change":"2023-05-12T09:09:04.382219+0000","last_active":"2023-05-12T09:09:05.524310+0000","last_peered":"2023-05-12T09:09:05.524310+0000","last_clean":"2023-05-12T09:09:05.524310+0000","last_became_active":"2023-05-12T09:09:04.381527+0000","last_became_peered":"2023-05-12T09:09:04.381527+0000","last_unstale":"2023-05-12T09:09:05.524310+0000","last_undegraded":"2023-05-12T09:09:05.524310+0000","last_fullsized":"2023-05-12T09:09:05.524310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:01:51.907572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524369+0000","last_change":"2023-05-12T09:09:04.375935+0000","last_active":"2023-05-12T09:09:05.524369+0000","last_peered":"2023-05-12T09:09:05.524369+0000","last_clean":"2023-05-12T09:09:05.524369+0000","last_became_active":"2023-05-12T09:09:04.375665+0000","last_became_peered":"2023-05-12T09:09:04.375665+0000","last_unstale":"2023-05-12T09:09:05.524369+0000","last_undegraded":"2023-05-12T09:09:05.524369+0000","last_fullsized":"2023-05-12T09:09:05.524369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:22:01.450509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525276+0000","last_change":"2023-05-12T09:09:04.378328+0000","last_active":"2023-05-12T09:09:05.525276+0000","last_peered":"2023-05-12T09:09:05.525276+0000","last_clean":"2023-05-12T09:09:05.525276+0000","last_became_active":"2023-05-12T09:09:04.377980+0000","last_became_peered":"2023-05-12T09:09:04.377980+0000","last_unstale":"2023-05-12T09:09:05.525276+0000","last_undegraded":"2023-05-12T09:09:05.525276+0000","last_fullsized":"2023-05-12T09:09:05.525276+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:56:43.536448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370026+0000","last_change":"2023-05-12T09:09:04.387230+0000","last_active":"2023-05-12T09:09:05.370026+0000","last_peered":"2023-05-12T09:09:05.370026+0000","last_clean":"2023-05-12T09:09:05.370026+0000","last_became_active":"2023-05-12T09:09:04.386807+0000","last_became_peered":"2023-05-12T09:09:04.386807+0000","last_unstale":"2023-05-12T09:09:05.370026+0000","last_undegraded":"2023-05-12T09:09:05.370026+0000","last_fullsized":"2023-05-12T09:09:05.370026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:43:23.522527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524272+0000","last_change":"2023-05-12T09:09:04.379528+0000","last_active":"2023-05-12T09:09:05.524272+0000","last_peered":"2023-05-12T09:09:05.524272+0000","last_clean":"2023-05-12T09:09:05.524272+0000","last_became_active":"2023-05-12T09:09:04.379240+0000","last_became_peered":"2023-05-12T09:09:04.379240+0000","last_unstale":"2023-05-12T09:09:05.524272+0000","last_undegraded":"2023-05-12T09:09:05.524272+0000","last_fullsized":"2023-05-12T09:09:05.524272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:25:33.795660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368644+0000","last_change":"2023-05-12T09:09:04.386139+0000","last_active":"2023-05-12T09:09:05.368644+0000","last_peered":"2023-05-12T09:09:05.368644+0000","last_clean":"2023-05-12T09:09:05.368644+0000","last_became_active":"2023-05-12T09:09:04.385890+0000","last_became_peered":"2023-05-12T09:09:04.385890+0000","last_unstale":"2023-05-12T09:09:05.368644+0000","last_undegraded":"2023-05-12T09:09:05.368644+0000","last_fullsized":"2023-05-12T09:09:05.368644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:59:12.005243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368483+0000","last_change":"2023-05-12T09:09:04.381594+0000","last_active":"2023-05-12T09:09:05.368483+0000","last_peered":"2023-05-12T09:09:05.368483+0000","last_clean":"2023-05-12T09:09:05.368483+0000","last_became_active":"2023-05-12T09:09:04.381306+0000","last_became_peered":"2023-05-12T09:09:04.381306+0000","last_unstale":"2023-05-12T09:09:05.368483+0000","last_undegraded":"2023-05-12T09:09:05.368483+0000","last_fullsized":"2023-05-12T09:09:05.368483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:47:29.018998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526249+0000","last_change":"2023-05-12T09:09:04.390854+0000","last_active":"2023-05-12T09:09:05.526249+0000","last_peered":"2023-05-12T09:09:05.526249+0000","last_clean":"2023-05-12T09:09:05.526249+0000","last_became_active":"2023-05-12T09:09:04.390598+0000","last_became_peered":"2023-05-12T09:09:04.390598+0000","last_unstale":"2023-05-12T09:09:05.526249+0000","last_undegraded":"2023-05-12T09:09:05.526249+0000","last_fullsized":"2023-05-12T09:09:05.526249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:51:32.345508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526369+0000","last_change":"2023-05-12T09:09:04.384388+0000","last_active":"2023-05-12T09:09:05.526369+0000","last_peered":"2023-05-12T09:09:05.526369+0000","last_clean":"2023-05-12T09:09:05.526369+0000","last_became_active":"2023-05-12T09:09:04.383867+0000","last_became_peered":"2023-05-12T09:09:04.383867+0000","last_unstale":"2023-05-12T09:09:05.526369+0000","last_undegraded":"2023-05-12T09:09:05.526369+0000","last_fullsized":"2023-05-12T09:09:05.526369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:28:46.039724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368751+0000","last_change":"2023-05-12T09:09:04.381162+0000","last_active":"2023-05-12T09:09:05.368751+0000","last_peered":"2023-05-12T09:09:05.368751+0000","last_clean":"2023-05-12T09:09:05.368751+0000","last_became_active":"2023-05-12T09:09:04.379970+0000","last_became_peered":"2023-05-12T09:09:04.379970+0000","last_unstale":"2023-05-12T09:09:05.368751+0000","last_undegraded":"2023-05-12T09:09:05.368751+0000","last_fullsized":"2023-05-12T09:09:05.368751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:05:49.166270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370096+0000","last_change":"2023-05-12T09:09:04.377471+0000","last_active":"2023-05-12T09:09:05.370096+0000","last_peered":"2023-05-12T09:09:05.370096+0000","last_clean":"2023-05-12T09:09:05.370096+0000","last_became_active":"2023-05-12T09:09:04.377206+0000","last_became_peered":"2023-05-12T09:09:04.377206+0000","last_unstale":"2023-05-12T09:09:05.370096+0000","last_undegraded":"2023-05-12T09:09:05.370096+0000","last_fullsized":"2023-05-12T09:09:05.370096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:19:11.089930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368896+0000","last_change":"2023-05-12T09:09:04.388538+0000","last_active":"2023-05-12T09:09:05.368896+0000","last_peered":"2023-05-12T09:09:05.368896+0000","last_clean":"2023-05-12T09:09:05.368896+0000","last_became_active":"2023-05-12T09:09:04.388265+0000","last_became_peered":"2023-05-12T09:09:04.388265+0000","last_unstale":"2023-05-12T09:09:05.368896+0000","last_undegraded":"2023-05-12T09:09:05.368896+0000","last_fullsized":"2023-05-12T09:09:05.368896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:20:12.211222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524324+0000","last_change":"2023-05-12T09:09:04.381121+0000","last_active":"2023-05-12T09:09:05.524324+0000","last_peered":"2023-05-12T09:09:05.524324+0000","last_clean":"2023-05-12T09:09:05.524324+0000","last_became_active":"2023-05-12T09:09:04.380885+0000","last_became_peered":"2023-05-12T09:09:04.380885+0000","last_unstale":"2023-05-12T09:09:05.524324+0000","last_undegraded":"2023-05-12T09:09:05.524324+0000","last_fullsized":"2023-05-12T09:09:05.524324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:47:08.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368441+0000","last_change":"2023-05-12T09:09:04.376351+0000","last_active":"2023-05-12T09:09:05.368441+0000","last_peered":"2023-05-12T09:09:05.368441+0000","last_clean":"2023-05-12T09:09:05.368441+0000","last_became_active":"2023-05-12T09:09:04.376088+0000","last_became_peered":"2023-05-12T09:09:04.376088+0000","last_unstale":"2023-05-12T09:09:05.368441+0000","last_undegraded":"2023-05-12T09:09:05.368441+0000","last_fullsized":"2023-05-12T09:09:05.368441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:30:56.733268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368461+0000","last_change":"2023-05-12T09:09:04.376338+0000","last_active":"2023-05-12T09:09:05.368461+0000","last_peered":"2023-05-12T09:09:05.368461+0000","last_clean":"2023-05-12T09:09:05.368461+0000","last_became_active":"2023-05-12T09:09:04.376069+0000","last_became_peered":"2023-05-12T09:09:04.376069+0000","last_unstale":"2023-05-12T09:09:05.368461+0000","last_undegraded":"2023-05-12T09:09:05.368461+0000","last_fullsized":"2023-05-12T09:09:05.368461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:37:18.764062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369092+0000","last_change":"2023-05-12T09:09:04.378099+0000","last_active":"2023-05-12T09:09:05.369092+0000","last_peered":"2023-05-12T09:09:05.369092+0000","last_clean":"2023-05-12T09:09:05.369092+0000","last_became_active":"2023-05-12T09:09:04.377827+0000","last_became_peered":"2023-05-12T09:09:04.377827+0000","last_unstale":"2023-05-12T09:09:05.369092+0000","last_undegraded":"2023-05-12T09:09:05.369092+0000","last_fullsized":"2023-05-12T09:09:05.369092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:27:31.699297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370362+0000","last_change":"2023-05-12T09:09:04.384513+0000","last_active":"2023-05-12T09:09:05.370362+0000","last_peered":"2023-05-12T09:09:05.370362+0000","last_clean":"2023-05-12T09:09:05.370362+0000","last_became_active":"2023-05-12T09:09:04.384269+0000","last_became_peered":"2023-05-12T09:09:04.384269+0000","last_unstale":"2023-05-12T09:09:05.370362+0000","last_undegraded":"2023-05-12T09:09:05.370362+0000","last_fullsized":"2023-05-12T09:09:05.370362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:07:17.973275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526255+0000","last_change":"2023-05-12T09:09:04.390308+0000","last_active":"2023-05-12T09:09:05.526255+0000","last_peered":"2023-05-12T09:09:05.526255+0000","last_clean":"2023-05-12T09:09:05.526255+0000","last_became_active":"2023-05-12T09:09:04.390036+0000","last_became_peered":"2023-05-12T09:09:04.390036+0000","last_unstale":"2023-05-12T09:09:05.526255+0000","last_undegraded":"2023-05-12T09:09:05.526255+0000","last_fullsized":"2023-05-12T09:09:05.526255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:25:06.887710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524874+0000","last_change":"2023-05-12T09:09:04.382137+0000","last_active":"2023-05-12T09:09:05.524874+0000","last_peered":"2023-05-12T09:09:05.524874+0000","last_clean":"2023-05-12T09:09:05.524874+0000","last_became_active":"2023-05-12T09:09:04.381653+0000","last_became_peered":"2023-05-12T09:09:04.381653+0000","last_unstale":"2023-05-12T09:09:05.524874+0000","last_undegraded":"2023-05-12T09:09:05.524874+0000","last_fullsized":"2023-05-12T09:09:05.524874+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:45:21.983499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368698+0000","last_change":"2023-05-12T09:09:04.379182+0000","last_active":"2023-05-12T09:09:05.368698+0000","last_peered":"2023-05-12T09:09:05.368698+0000","last_clean":"2023-05-12T09:09:05.368698+0000","last_became_active":"2023-05-12T09:09:04.378909+0000","last_became_peered":"2023-05-12T09:09:04.378909+0000","last_unstale":"2023-05-12T09:09:05.368698+0000","last_undegraded":"2023-05-12T09:09:05.368698+0000","last_fullsized":"2023-05-12T09:09:05.368698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:01.201284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526107+0000","last_change":"2023-05-12T09:09:04.376810+0000","last_active":"2023-05-12T09:09:05.526107+0000","last_peered":"2023-05-12T09:09:05.526107+0000","last_clean":"2023-05-12T09:09:05.526107+0000","last_became_active":"2023-05-12T09:09:04.376113+0000","last_became_peered":"2023-05-12T09:09:04.376113+0000","last_unstale":"2023-05-12T09:09:05.526107+0000","last_undegraded":"2023-05-12T09:09:05.526107+0000","last_fullsized":"2023-05-12T09:09:05.526107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:14:31.845272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368794+0000","last_change":"2023-05-12T09:09:04.390251+0000","last_active":"2023-05-12T09:09:05.368794+0000","last_peered":"2023-05-12T09:09:05.368794+0000","last_clean":"2023-05-12T09:09:05.368794+0000","last_became_active":"2023-05-12T09:09:04.389960+0000","last_became_peered":"2023-05-12T09:09:04.389960+0000","last_unstale":"2023-05-12T09:09:05.368794+0000","last_undegraded":"2023-05-12T09:09:05.368794+0000","last_fullsized":"2023-05-12T09:09:05.368794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:18:06.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369879+0000","last_change":"2023-05-12T09:09:04.378906+0000","last_active":"2023-05-12T09:09:05.369879+0000","last_peered":"2023-05-12T09:09:05.369879+0000","last_clean":"2023-05-12T09:09:05.369879+0000","last_became_active":"2023-05-12T09:09:04.378653+0000","last_became_peered":"2023-05-12T09:09:04.378653+0000","last_unstale":"2023-05-12T09:09:05.369879+0000","last_undegraded":"2023-05-12T09:09:05.369879+0000","last_fullsized":"2023-05-12T09:09:05.369879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:17:26.362380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524733+0000","last_change":"2023-05-12T09:09:04.388485+0000","last_active":"2023-05-12T09:09:05.524733+0000","last_peered":"2023-05-12T09:09:05.524733+0000","last_clean":"2023-05-12T09:09:05.524733+0000","last_became_active":"2023-05-12T09:09:04.388199+0000","last_became_peered":"2023-05-12T09:09:04.388199+0000","last_unstale":"2023-05-12T09:09:05.524733+0000","last_undegraded":"2023-05-12T09:09:05.524733+0000","last_fullsized":"2023-05-12T09:09:05.524733+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:45:21.983499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369280+0000","last_change":"2023-05-12T09:09:03.900712+0000","last_active":"2023-05-12T09:09:05.369280+0000","last_peered":"2023-05-12T09:09:05.369280+0000","last_clean":"2023-05-12T09:09:05.369280+0000","last_became_active":"2023-05-12T09:09:03.900526+0000","last_became_peered":"2023-05-12T09:09:03.900526+0000","last_unstale":"2023-05-12T09:09:05.369280+0000","last_undegraded":"2023-05-12T09:09:05.369280+0000","last_fullsized":"2023-05-12T09:09:05.369280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:29:38.904769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368950+0000","last_change":"2023-05-12T09:09:04.382106+0000","last_active":"2023-05-12T09:09:05.368950+0000","last_peered":"2023-05-12T09:09:05.368950+0000","last_clean":"2023-05-12T09:09:05.368950+0000","last_became_active":"2023-05-12T09:09:04.381786+0000","last_became_peered":"2023-05-12T09:09:04.381786+0000","last_unstale":"2023-05-12T09:09:05.368950+0000","last_undegraded":"2023-05-12T09:09:05.368950+0000","last_fullsized":"2023-05-12T09:09:05.368950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:16:42.179276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526584+0000","last_change":"2023-05-12T09:09:03.902057+0000","last_active":"2023-05-12T09:09:05.526584+0000","last_peered":"2023-05-12T09:09:05.526584+0000","last_clean":"2023-05-12T09:09:05.526584+0000","last_became_active":"2023-05-12T09:09:03.901685+0000","last_became_peered":"2023-05-12T09:09:03.901685+0000","last_unstale":"2023-05-12T09:09:05.526584+0000","last_undegraded":"2023-05-12T09:09:05.526584+0000","last_fullsized":"2023-05-12T09:09:05.526584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:45:33.502711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525096+0000","last_change":"2023-05-12T09:09:04.389493+0000","last_active":"2023-05-12T09:09:05.525096+0000","last_peered":"2023-05-12T09:09:05.525096+0000","last_clean":"2023-05-12T09:09:05.525096+0000","last_became_active":"2023-05-12T09:09:04.389173+0000","last_became_peered":"2023-05-12T09:09:04.389173+0000","last_unstale":"2023-05-12T09:09:05.525096+0000","last_undegraded":"2023-05-12T09:09:05.525096+0000","last_fullsized":"2023-05-12T09:09:05.525096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:08.417440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524696+0000","last_change":"2023-05-12T09:09:03.898834+0000","last_active":"2023-05-12T09:09:05.524696+0000","last_peered":"2023-05-12T09:09:05.524696+0000","last_clean":"2023-05-12T09:09:05.524696+0000","last_became_active":"2023-05-12T09:09:03.898530+0000","last_became_peered":"2023-05-12T09:09:03.898530+0000","last_unstale":"2023-05-12T09:09:05.524696+0000","last_undegraded":"2023-05-12T09:09:05.524696+0000","last_fullsized":"2023-05-12T09:09:05.524696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:43:55.973079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524683+0000","last_change":"2023-05-12T09:09:04.383685+0000","last_active":"2023-05-12T09:09:05.524683+0000","last_peered":"2023-05-12T09:09:05.524683+0000","last_clean":"2023-05-12T09:09:05.524683+0000","last_became_active":"2023-05-12T09:09:04.383282+0000","last_became_peered":"2023-05-12T09:09:04.383282+0000","last_unstale":"2023-05-12T09:09:05.524683+0000","last_undegraded":"2023-05-12T09:09:05.524683+0000","last_fullsized":"2023-05-12T09:09:05.524683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:40:40.702906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525420+0000","last_change":"2023-05-12T09:09:03.901767+0000","last_active":"2023-05-12T09:09:05.525420+0000","last_peered":"2023-05-12T09:09:05.525420+0000","last_clean":"2023-05-12T09:09:05.525420+0000","last_became_active":"2023-05-12T09:09:03.901442+0000","last_became_peered":"2023-05-12T09:09:03.901442+0000","last_unstale":"2023-05-12T09:09:05.525420+0000","last_undegraded":"2023-05-12T09:09:05.525420+0000","last_fullsized":"2023-05-12T09:09:05.525420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:52:40.761299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526252+0000","last_change":"2023-05-12T09:09:04.376992+0000","last_active":"2023-05-12T09:09:05.526252+0000","last_peered":"2023-05-12T09:09:05.526252+0000","last_clean":"2023-05-12T09:09:05.526252+0000","last_became_active":"2023-05-12T09:09:04.375692+0000","last_became_peered":"2023-05-12T09:09:04.375692+0000","last_unstale":"2023-05-12T09:09:05.526252+0000","last_undegraded":"2023-05-12T09:09:05.526252+0000","last_fullsized":"2023-05-12T09:09:05.526252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:32:40.239050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369408+0000","last_change":"2023-05-12T09:09:03.903591+0000","last_active":"2023-05-12T09:09:05.369408+0000","last_peered":"2023-05-12T09:09:05.369408+0000","last_clean":"2023-05-12T09:09:05.369408+0000","last_became_active":"2023-05-12T09:09:03.903005+0000","last_became_peered":"2023-05-12T09:09:03.903005+0000","last_unstale":"2023-05-12T09:09:05.369408+0000","last_undegraded":"2023-05-12T09:09:05.369408+0000","last_fullsized":"2023-05-12T09:09:05.369408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:31:23.672158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524840+0000","last_change":"2023-05-12T09:09:04.375860+0000","last_active":"2023-05-12T09:09:05.524840+0000","last_peered":"2023-05-12T09:09:05.524840+0000","last_clean":"2023-05-12T09:09:05.524840+0000","last_became_active":"2023-05-12T09:09:04.375603+0000","last_became_peered":"2023-05-12T09:09:04.375603+0000","last_unstale":"2023-05-12T09:09:05.524840+0000","last_undegraded":"2023-05-12T09:09:05.524840+0000","last_fullsized":"2023-05-12T09:09:05.524840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:28:51.124741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526353+0000","last_change":"2023-05-12T09:09:03.906356+0000","last_active":"2023-05-12T09:09:05.526353+0000","last_peered":"2023-05-12T09:09:05.526353+0000","last_clean":"2023-05-12T09:09:05.526353+0000","last_became_active":"2023-05-12T09:09:03.906036+0000","last_became_peered":"2023-05-12T09:09:03.906036+0000","last_unstale":"2023-05-12T09:09:05.526353+0000","last_undegraded":"2023-05-12T09:09:05.526353+0000","last_fullsized":"2023-05-12T09:09:05.526353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:47:26.343563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524571+0000","last_change":"2023-05-12T09:09:04.381281+0000","last_active":"2023-05-12T09:09:05.524571+0000","last_peered":"2023-05-12T09:09:05.524571+0000","last_clean":"2023-05-12T09:09:05.524571+0000","last_became_active":"2023-05-12T09:09:04.380108+0000","last_became_peered":"2023-05-12T09:09:04.380108+0000","last_unstale":"2023-05-12T09:09:05.524571+0000","last_undegraded":"2023-05-12T09:09:05.524571+0000","last_fullsized":"2023-05-12T09:09:05.524571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:50.791537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524740+0000","last_change":"2023-05-12T09:09:03.898492+0000","last_active":"2023-05-12T09:09:05.524740+0000","last_peered":"2023-05-12T09:09:05.524740+0000","last_clean":"2023-05-12T09:09:05.524740+0000","last_became_active":"2023-05-12T09:09:03.898190+0000","last_became_peered":"2023-05-12T09:09:03.898190+0000","last_unstale":"2023-05-12T09:09:05.524740+0000","last_undegraded":"2023-05-12T09:09:05.524740+0000","last_fullsized":"2023-05-12T09:09:05.524740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:28.145368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368445+0000","last_change":"2023-05-12T09:09:04.377136+0000","last_active":"2023-05-12T09:09:05.368445+0000","last_peered":"2023-05-12T09:09:05.368445+0000","last_clean":"2023-05-12T09:09:05.368445+0000","last_became_active":"2023-05-12T09:09:04.376865+0000","last_became_peered":"2023-05-12T09:09:04.376865+0000","last_unstale":"2023-05-12T09:09:05.368445+0000","last_undegraded":"2023-05-12T09:09:05.368445+0000","last_fullsized":"2023-05-12T09:09:05.368445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:48:51.992494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524585+0000","last_change":"2023-05-12T09:09:03.890845+0000","last_active":"2023-05-12T09:09:05.524585+0000","last_peered":"2023-05-12T09:09:05.524585+0000","last_clean":"2023-05-12T09:09:05.524585+0000","last_became_active":"2023-05-12T09:09:03.890331+0000","last_became_peered":"2023-05-12T09:09:03.890331+0000","last_unstale":"2023-05-12T09:09:05.524585+0000","last_undegraded":"2023-05-12T09:09:05.524585+0000","last_fullsized":"2023-05-12T09:09:05.524585+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:47.563461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526577+0000","last_change":"2023-05-12T09:09:04.384151+0000","last_active":"2023-05-12T09:09:05.526577+0000","last_peered":"2023-05-12T09:09:05.526577+0000","last_clean":"2023-05-12T09:09:05.526577+0000","last_became_active":"2023-05-12T09:09:04.383500+0000","last_became_peered":"2023-05-12T09:09:04.383500+0000","last_unstale":"2023-05-12T09:09:05.526577+0000","last_undegraded":"2023-05-12T09:09:05.526577+0000","last_fullsized":"2023-05-12T09:09:05.526577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:45:09.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526460+0000","last_change":"2023-05-12T09:09:03.903662+0000","last_active":"2023-05-12T09:09:05.526460+0000","last_peered":"2023-05-12T09:09:05.526460+0000","last_clean":"2023-05-12T09:09:05.526460+0000","last_became_active":"2023-05-12T09:09:03.903397+0000","last_became_peered":"2023-05-12T09:09:03.903397+0000","last_unstale":"2023-05-12T09:09:05.526460+0000","last_undegraded":"2023-05-12T09:09:05.526460+0000","last_fullsized":"2023-05-12T09:09:05.526460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:34:25.163055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525765+0000","last_change":"2023-05-12T09:09:04.391085+0000","last_active":"2023-05-12T09:09:05.525765+0000","last_peered":"2023-05-12T09:09:05.525765+0000","last_clean":"2023-05-12T09:09:05.525765+0000","last_became_active":"2023-05-12T09:09:04.390794+0000","last_became_peered":"2023-05-12T09:09:04.390794+0000","last_unstale":"2023-05-12T09:09:05.525765+0000","last_undegraded":"2023-05-12T09:09:05.525765+0000","last_fullsized":"2023-05-12T09:09:05.525765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:00:18.511857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524554+0000","last_change":"2023-05-12T09:09:03.894465+0000","last_active":"2023-05-12T09:09:05.524554+0000","last_peered":"2023-05-12T09:09:05.524554+0000","last_clean":"2023-05-12T09:09:05.524554+0000","last_became_active":"2023-05-12T09:09:03.894109+0000","last_became_peered":"2023-05-12T09:09:03.894109+0000","last_unstale":"2023-05-12T09:09:05.524554+0000","last_undegraded":"2023-05-12T09:09:05.524554+0000","last_fullsized":"2023-05-12T09:09:05.524554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:17:48.837620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369135+0000","last_change":"2023-05-12T09:09:04.382147+0000","last_active":"2023-05-12T09:09:05.369135+0000","last_peered":"2023-05-12T09:09:05.369135+0000","last_clean":"2023-05-12T09:09:05.369135+0000","last_became_active":"2023-05-12T09:09:04.381902+0000","last_became_peered":"2023-05-12T09:09:04.381902+0000","last_unstale":"2023-05-12T09:09:05.369135+0000","last_undegraded":"2023-05-12T09:09:05.369135+0000","last_fullsized":"2023-05-12T09:09:05.369135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:17:49.851641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525876+0000","last_change":"2023-05-12T09:09:03.905365+0000","last_active":"2023-05-12T09:09:05.525876+0000","last_peered":"2023-05-12T09:09:05.525876+0000","last_clean":"2023-05-12T09:09:05.525876+0000","last_became_active":"2023-05-12T09:09:03.905121+0000","last_became_peered":"2023-05-12T09:09:03.905121+0000","last_unstale":"2023-05-12T09:09:05.525876+0000","last_undegraded":"2023-05-12T09:09:05.525876+0000","last_fullsized":"2023-05-12T09:09:05.525876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:37:59.723440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525423+0000","last_change":"2023-05-12T09:09:04.389953+0000","last_active":"2023-05-12T09:09:05.525423+0000","last_peered":"2023-05-12T09:09:05.525423+0000","last_clean":"2023-05-12T09:09:05.525423+0000","last_became_active":"2023-05-12T09:09:04.389660+0000","last_became_peered":"2023-05-12T09:09:04.389660+0000","last_unstale":"2023-05-12T09:09:05.525423+0000","last_undegraded":"2023-05-12T09:09:05.525423+0000","last_fullsized":"2023-05-12T09:09:05.525423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:12:11.321847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370186+0000","last_change":"2023-05-12T09:09:03.903025+0000","last_active":"2023-05-12T09:09:05.370186+0000","last_peered":"2023-05-12T09:09:05.370186+0000","last_clean":"2023-05-12T09:09:05.370186+0000","last_became_active":"2023-05-12T09:09:03.902746+0000","last_became_peered":"2023-05-12T09:09:03.902746+0000","last_unstale":"2023-05-12T09:09:05.370186+0000","last_undegraded":"2023-05-12T09:09:05.370186+0000","last_fullsized":"2023-05-12T09:09:05.370186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:35:59.060606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368500+0000","last_change":"2023-05-12T09:09:04.381403+0000","last_active":"2023-05-12T09:09:05.368500+0000","last_peered":"2023-05-12T09:09:05.368500+0000","last_clean":"2023-05-12T09:09:05.368500+0000","last_became_active":"2023-05-12T09:09:04.381065+0000","last_became_peered":"2023-05-12T09:09:04.381065+0000","last_unstale":"2023-05-12T09:09:05.368500+0000","last_undegraded":"2023-05-12T09:09:05.368500+0000","last_fullsized":"2023-05-12T09:09:05.368500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:39:54.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369012+0000","last_change":"2023-05-12T09:09:03.897457+0000","last_active":"2023-05-12T09:09:05.369012+0000","last_peered":"2023-05-12T09:09:05.369012+0000","last_clean":"2023-05-12T09:09:05.369012+0000","last_became_active":"2023-05-12T09:09:03.897208+0000","last_became_peered":"2023-05-12T09:09:03.897208+0000","last_unstale":"2023-05-12T09:09:05.369012+0000","last_undegraded":"2023-05-12T09:09:05.369012+0000","last_fullsized":"2023-05-12T09:09:05.369012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:36:58.128983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524926+0000","last_change":"2023-05-12T09:09:04.382791+0000","last_active":"2023-05-12T09:09:05.524926+0000","last_peered":"2023-05-12T09:09:05.524926+0000","last_clean":"2023-05-12T09:09:05.524926+0000","last_became_active":"2023-05-12T09:09:04.382364+0000","last_became_peered":"2023-05-12T09:09:04.382364+0000","last_unstale":"2023-05-12T09:09:05.524926+0000","last_undegraded":"2023-05-12T09:09:05.524926+0000","last_fullsized":"2023-05-12T09:09:05.524926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:21:19.580512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525800+0000","last_change":"2023-05-12T09:09:03.901200+0000","last_active":"2023-05-12T09:09:05.525800+0000","last_peered":"2023-05-12T09:09:05.525800+0000","last_clean":"2023-05-12T09:09:05.525800+0000","last_became_active":"2023-05-12T09:09:03.900868+0000","last_became_peered":"2023-05-12T09:09:03.900868+0000","last_unstale":"2023-05-12T09:09:05.525800+0000","last_undegraded":"2023-05-12T09:09:05.525800+0000","last_fullsized":"2023-05-12T09:09:05.525800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:20:48.285000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368613+0000","last_change":"2023-05-12T09:09:04.382637+0000","last_active":"2023-05-12T09:09:05.368613+0000","last_peered":"2023-05-12T09:09:05.368613+0000","last_clean":"2023-05-12T09:09:05.368613+0000","last_became_active":"2023-05-12T09:09:04.381521+0000","last_became_peered":"2023-05-12T09:09:04.381521+0000","last_unstale":"2023-05-12T09:09:05.368613+0000","last_undegraded":"2023-05-12T09:09:05.368613+0000","last_fullsized":"2023-05-12T09:09:05.368613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:29.854507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368910+0000","last_change":"2023-05-12T09:09:03.895812+0000","last_active":"2023-05-12T09:09:05.368910+0000","last_peered":"2023-05-12T09:09:05.368910+0000","last_clean":"2023-05-12T09:09:05.368910+0000","last_became_active":"2023-05-12T09:09:03.895537+0000","last_became_peered":"2023-05-12T09:09:03.895537+0000","last_unstale":"2023-05-12T09:09:05.368910+0000","last_undegraded":"2023-05-12T09:09:05.368910+0000","last_fullsized":"2023-05-12T09:09:05.368910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:39:44.374210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525492+0000","last_change":"2023-05-12T09:09:04.380481+0000","last_active":"2023-05-12T09:09:05.525492+0000","last_peered":"2023-05-12T09:09:05.525492+0000","last_clean":"2023-05-12T09:09:05.525492+0000","last_became_active":"2023-05-12T09:09:04.380206+0000","last_became_peered":"2023-05-12T09:09:04.380206+0000","last_unstale":"2023-05-12T09:09:05.525492+0000","last_undegraded":"2023-05-12T09:09:05.525492+0000","last_fullsized":"2023-05-12T09:09:05.525492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:45:27.296866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524659+0000","last_change":"2023-05-12T09:09:03.890886+0000","last_active":"2023-05-12T09:09:05.524659+0000","last_peered":"2023-05-12T09:09:05.524659+0000","last_clean":"2023-05-12T09:09:05.524659+0000","last_became_active":"2023-05-12T09:09:03.890638+0000","last_became_peered":"2023-05-12T09:09:03.890638+0000","last_unstale":"2023-05-12T09:09:05.524659+0000","last_undegraded":"2023-05-12T09:09:05.524659+0000","last_fullsized":"2023-05-12T09:09:05.524659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:39:43.260171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370385+0000","last_change":"2023-05-12T09:09:04.374857+0000","last_active":"2023-05-12T09:09:05.370385+0000","last_peered":"2023-05-12T09:09:05.370385+0000","last_clean":"2023-05-12T09:09:05.370385+0000","last_became_active":"2023-05-12T09:09:04.374612+0000","last_became_peered":"2023-05-12T09:09:04.374612+0000","last_unstale":"2023-05-12T09:09:05.370385+0000","last_undegraded":"2023-05-12T09:09:05.370385+0000","last_fullsized":"2023-05-12T09:09:05.370385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:46:06.115729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370153+0000","last_change":"2023-05-12T09:09:03.897820+0000","last_active":"2023-05-12T09:09:05.370153+0000","last_peered":"2023-05-12T09:09:05.370153+0000","last_clean":"2023-05-12T09:09:05.370153+0000","last_became_active":"2023-05-12T09:09:03.897558+0000","last_became_peered":"2023-05-12T09:09:03.897558+0000","last_unstale":"2023-05-12T09:09:05.370153+0000","last_undegraded":"2023-05-12T09:09:05.370153+0000","last_fullsized":"2023-05-12T09:09:05.370153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T21:03:48.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524585+0000","last_change":"2023-05-12T09:09:04.390060+0000","last_active":"2023-05-12T09:09:05.524585+0000","last_peered":"2023-05-12T09:09:05.524585+0000","last_clean":"2023-05-12T09:09:05.524585+0000","last_became_active":"2023-05-12T09:09:04.389807+0000","last_became_peered":"2023-05-12T09:09:04.389807+0000","last_unstale":"2023-05-12T09:09:05.524585+0000","last_undegraded":"2023-05-12T09:09:05.524585+0000","last_fullsized":"2023-05-12T09:09:05.524585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:56:06.370459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526368+0000","last_change":"2023-05-12T09:09:03.899139+0000","last_active":"2023-05-12T09:09:05.526368+0000","last_peered":"2023-05-12T09:09:05.526368+0000","last_clean":"2023-05-12T09:09:05.526368+0000","last_became_active":"2023-05-12T09:09:03.898851+0000","last_became_peered":"2023-05-12T09:09:03.898851+0000","last_unstale":"2023-05-12T09:09:05.526368+0000","last_undegraded":"2023-05-12T09:09:05.526368+0000","last_fullsized":"2023-05-12T09:09:05.526368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:38:16.015198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368765+0000","last_change":"2023-05-12T09:09:04.384396+0000","last_active":"2023-05-12T09:09:05.368765+0000","last_peered":"2023-05-12T09:09:05.368765+0000","last_clean":"2023-05-12T09:09:05.368765+0000","last_became_active":"2023-05-12T09:09:04.384142+0000","last_became_peered":"2023-05-12T09:09:04.384142+0000","last_unstale":"2023-05-12T09:09:05.368765+0000","last_undegraded":"2023-05-12T09:09:05.368765+0000","last_fullsized":"2023-05-12T09:09:05.368765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:21:56.693727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525174+0000","last_change":"2023-05-12T09:09:03.898664+0000","last_active":"2023-05-12T09:09:05.525174+0000","last_peered":"2023-05-12T09:09:05.525174+0000","last_clean":"2023-05-12T09:09:05.525174+0000","last_became_active":"2023-05-12T09:09:03.898255+0000","last_became_peered":"2023-05-12T09:09:03.898255+0000","last_unstale":"2023-05-12T09:09:05.525174+0000","last_undegraded":"2023-05-12T09:09:05.525174+0000","last_fullsized":"2023-05-12T09:09:05.525174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:58:20.540454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368861+0000","last_change":"2023-05-12T09:09:04.381374+0000","last_active":"2023-05-12T09:09:05.368861+0000","last_peered":"2023-05-12T09:09:05.368861+0000","last_clean":"2023-05-12T09:09:05.368861+0000","last_became_active":"2023-05-12T09:09:04.380322+0000","last_became_peered":"2023-05-12T09:09:04.380322+0000","last_unstale":"2023-05-12T09:09:05.368861+0000","last_undegraded":"2023-05-12T09:09:05.368861+0000","last_fullsized":"2023-05-12T09:09:05.368861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:15:07.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369267+0000","last_change":"2023-05-12T09:09:03.901336+0000","last_active":"2023-05-12T09:09:05.369267+0000","last_peered":"2023-05-12T09:09:05.369267+0000","last_clean":"2023-05-12T09:09:05.369267+0000","last_became_active":"2023-05-12T09:09:03.901093+0000","last_became_peered":"2023-05-12T09:09:03.901093+0000","last_unstale":"2023-05-12T09:09:05.369267+0000","last_undegraded":"2023-05-12T09:09:05.369267+0000","last_fullsized":"2023-05-12T09:09:05.369267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:30:46.428353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368740+0000","last_change":"2023-05-12T09:09:04.380397+0000","last_active":"2023-05-12T09:09:05.368740+0000","last_peered":"2023-05-12T09:09:05.368740+0000","last_clean":"2023-05-12T09:09:05.368740+0000","last_became_active":"2023-05-12T09:09:04.379830+0000","last_became_peered":"2023-05-12T09:09:04.379830+0000","last_unstale":"2023-05-12T09:09:05.368740+0000","last_undegraded":"2023-05-12T09:09:05.368740+0000","last_fullsized":"2023-05-12T09:09:05.368740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:59:53.543221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369124+0000","last_change":"2023-05-12T09:09:03.903743+0000","last_active":"2023-05-12T09:09:05.369124+0000","last_peered":"2023-05-12T09:09:05.369124+0000","last_clean":"2023-05-12T09:09:05.369124+0000","last_became_active":"2023-05-12T09:09:03.903330+0000","last_became_peered":"2023-05-12T09:09:03.903330+0000","last_unstale":"2023-05-12T09:09:05.369124+0000","last_undegraded":"2023-05-12T09:09:05.369124+0000","last_fullsized":"2023-05-12T09:09:05.369124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:25:13.658831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524340+0000","last_change":"2023-05-12T09:09:04.390802+0000","last_active":"2023-05-12T09:09:05.524340+0000","last_peered":"2023-05-12T09:09:05.524340+0000","last_clean":"2023-05-12T09:09:05.524340+0000","last_became_active":"2023-05-12T09:09:04.390550+0000","last_became_peered":"2023-05-12T09:09:04.390550+0000","last_unstale":"2023-05-12T09:09:05.524340+0000","last_undegraded":"2023-05-12T09:09:05.524340+0000","last_fullsized":"2023-05-12T09:09:05.524340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:09:30.637918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525360+0000","last_change":"2023-05-12T09:09:03.893986+0000","last_active":"2023-05-12T09:09:05.525360+0000","last_peered":"2023-05-12T09:09:05.525360+0000","last_clean":"2023-05-12T09:09:05.525360+0000","last_became_active":"2023-05-12T09:09:03.893664+0000","last_became_peered":"2023-05-12T09:09:03.893664+0000","last_unstale":"2023-05-12T09:09:05.525360+0000","last_undegraded":"2023-05-12T09:09:05.525360+0000","last_fullsized":"2023-05-12T09:09:05.525360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:12:10.319636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370400+0000","last_change":"2023-05-12T09:09:04.376696+0000","last_active":"2023-05-12T09:09:05.370400+0000","last_peered":"2023-05-12T09:09:05.370400+0000","last_clean":"2023-05-12T09:09:05.370400+0000","last_became_active":"2023-05-12T09:09:04.376435+0000","last_became_peered":"2023-05-12T09:09:04.376435+0000","last_unstale":"2023-05-12T09:09:05.370400+0000","last_undegraded":"2023-05-12T09:09:05.370400+0000","last_fullsized":"2023-05-12T09:09:05.370400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:12:12.470939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.523968+0000","last_change":"2023-05-12T09:09:03.901825+0000","last_active":"2023-05-12T09:09:05.523968+0000","last_peered":"2023-05-12T09:09:05.523968+0000","last_clean":"2023-05-12T09:09:05.523968+0000","last_became_active":"2023-05-12T09:09:03.901534+0000","last_became_peered":"2023-05-12T09:09:03.901534+0000","last_unstale":"2023-05-12T09:09:05.523968+0000","last_undegraded":"2023-05-12T09:09:05.523968+0000","last_fullsized":"2023-05-12T09:09:05.523968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:25:06.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524134+0000","last_change":"2023-05-12T09:09:04.378833+0000","last_active":"2023-05-12T09:09:05.524134+0000","last_peered":"2023-05-12T09:09:05.524134+0000","last_clean":"2023-05-12T09:09:05.524134+0000","last_became_active":"2023-05-12T09:09:04.378581+0000","last_became_peered":"2023-05-12T09:09:04.378581+0000","last_unstale":"2023-05-12T09:09:05.524134+0000","last_undegraded":"2023-05-12T09:09:05.524134+0000","last_fullsized":"2023-05-12T09:09:05.524134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:30:43.070773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525362+0000","last_change":"2023-05-12T09:09:03.901768+0000","last_active":"2023-05-12T09:09:05.525362+0000","last_peered":"2023-05-12T09:09:05.525362+0000","last_clean":"2023-05-12T09:09:05.525362+0000","last_became_active":"2023-05-12T09:09:03.901487+0000","last_became_peered":"2023-05-12T09:09:03.901487+0000","last_unstale":"2023-05-12T09:09:05.525362+0000","last_undegraded":"2023-05-12T09:09:05.525362+0000","last_fullsized":"2023-05-12T09:09:05.525362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:59:38.779581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369027+0000","last_change":"2023-05-12T09:09:04.384765+0000","last_active":"2023-05-12T09:09:05.369027+0000","last_peered":"2023-05-12T09:09:05.369027+0000","last_clean":"2023-05-12T09:09:05.369027+0000","last_became_active":"2023-05-12T09:09:04.384491+0000","last_became_peered":"2023-05-12T09:09:04.384491+0000","last_unstale":"2023-05-12T09:09:05.369027+0000","last_undegraded":"2023-05-12T09:09:05.369027+0000","last_fullsized":"2023-05-12T09:09:05.369027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:32:26.625036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526405+0000","last_change":"2023-05-12T09:09:03.906251+0000","last_active":"2023-05-12T09:09:05.526405+0000","last_peered":"2023-05-12T09:09:05.526405+0000","last_clean":"2023-05-12T09:09:05.526405+0000","last_became_active":"2023-05-12T09:09:03.905973+0000","last_became_peered":"2023-05-12T09:09:03.905973+0000","last_unstale":"2023-05-12T09:09:05.526405+0000","last_undegraded":"2023-05-12T09:09:05.526405+0000","last_fullsized":"2023-05-12T09:09:05.526405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:16:05.219780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526390+0000","last_change":"2023-05-12T09:07:04.835422+0000","last_active":"2023-05-12T09:09:05.526390+0000","last_peered":"2023-05-12T09:09:05.526390+0000","last_clean":"2023-05-12T09:09:05.526390+0000","last_became_active":"2023-05-12T09:07:04.834944+0000","last_became_peered":"2023-05-12T09:07:04.834944+0000","last_unstale":"2023-05-12T09:09:05.526390+0000","last_undegraded":"2023-05-12T09:09:05.526390+0000","last_fullsized":"2023-05-12T09:09:05.526390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:16:54.117136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368876+0000","last_change":"2023-05-12T09:09:04.380062+0000","last_active":"2023-05-12T09:09:05.368876+0000","last_peered":"2023-05-12T09:09:05.368876+0000","last_clean":"2023-05-12T09:09:05.368876+0000","last_became_active":"2023-05-12T09:09:04.379288+0000","last_became_peered":"2023-05-12T09:09:04.379288+0000","last_unstale":"2023-05-12T09:09:05.368876+0000","last_undegraded":"2023-05-12T09:09:05.368876+0000","last_fullsized":"2023-05-12T09:09:05.368876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:56.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525221+0000","last_change":"2023-05-12T09:09:03.903511+0000","last_active":"2023-05-12T09:09:05.525221+0000","last_peered":"2023-05-12T09:09:05.525221+0000","last_clean":"2023-05-12T09:09:05.525221+0000","last_became_active":"2023-05-12T09:09:03.903240+0000","last_became_peered":"2023-05-12T09:09:03.903240+0000","last_unstale":"2023-05-12T09:09:05.525221+0000","last_undegraded":"2023-05-12T09:09:05.525221+0000","last_fullsized":"2023-05-12T09:09:05.525221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:58:20.540454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369345+0000","last_change":"2023-05-12T09:07:04.828759+0000","last_active":"2023-05-12T09:09:05.369345+0000","last_peered":"2023-05-12T09:09:05.369345+0000","last_clean":"2023-05-12T09:09:05.369345+0000","last_became_active":"2023-05-12T09:07:04.828460+0000","last_became_peered":"2023-05-12T09:07:04.828460+0000","last_unstale":"2023-05-12T09:09:05.369345+0000","last_undegraded":"2023-05-12T09:09:05.369345+0000","last_fullsized":"2023-05-12T09:09:05.369345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:42:51.123407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525570+0000","last_change":"2023-05-12T09:09:04.385569+0000","last_active":"2023-05-12T09:09:05.525570+0000","last_peered":"2023-05-12T09:09:05.525570+0000","last_clean":"2023-05-12T09:09:05.525570+0000","last_became_active":"2023-05-12T09:09:04.385303+0000","last_became_peered":"2023-05-12T09:09:04.385303+0000","last_unstale":"2023-05-12T09:09:05.525570+0000","last_undegraded":"2023-05-12T09:09:05.525570+0000","last_fullsized":"2023-05-12T09:09:05.525570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:50:39.189696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524112+0000","last_change":"2023-05-12T09:09:03.893141+0000","last_active":"2023-05-12T09:09:05.524112+0000","last_peered":"2023-05-12T09:09:05.524112+0000","last_clean":"2023-05-12T09:09:05.524112+0000","last_became_active":"2023-05-12T09:09:03.892854+0000","last_became_peered":"2023-05-12T09:09:03.892854+0000","last_unstale":"2023-05-12T09:09:05.524112+0000","last_undegraded":"2023-05-12T09:09:05.524112+0000","last_fullsized":"2023-05-12T09:09:05.524112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:11:47.896590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524404+0000","last_change":"2023-05-12T09:07:04.830658+0000","last_active":"2023-05-12T09:09:05.524404+0000","last_peered":"2023-05-12T09:09:05.524404+0000","last_clean":"2023-05-12T09:09:05.524404+0000","last_became_active":"2023-05-12T09:07:04.830354+0000","last_became_peered":"2023-05-12T09:07:04.830354+0000","last_unstale":"2023-05-12T09:09:05.524404+0000","last_undegraded":"2023-05-12T09:09:05.524404+0000","last_fullsized":"2023-05-12T09:09:05.524404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:23:29.091315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":196,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525733+0000","last_change":"2023-05-12T09:07:04.830850+0000","last_active":"2023-05-12T09:09:05.525733+0000","last_peered":"2023-05-12T09:09:05.525733+0000","last_clean":"2023-05-12T09:09:05.525733+0000","last_became_active":"2023-05-12T09:07:04.829577+0000","last_became_peered":"2023-05-12T09:07:04.829577+0000","last_unstale":"2023-05-12T09:09:05.525733+0000","last_undegraded":"2023-05-12T09:09:05.525733+0000","last_fullsized":"2023-05-12T09:09:05.525733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:46:41.946248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524448+0000","last_change":"2023-05-12T09:09:04.376636+0000","last_active":"2023-05-12T09:09:05.524448+0000","last_peered":"2023-05-12T09:09:05.524448+0000","last_clean":"2023-05-12T09:09:05.524448+0000","last_became_active":"2023-05-12T09:09:04.376295+0000","last_became_peered":"2023-05-12T09:09:04.376295+0000","last_unstale":"2023-05-12T09:09:05.524448+0000","last_undegraded":"2023-05-12T09:09:05.524448+0000","last_fullsized":"2023-05-12T09:09:05.524448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:13:29.117504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525692+0000","last_change":"2023-05-12T09:09:03.905707+0000","last_active":"2023-05-12T09:09:05.525692+0000","last_peered":"2023-05-12T09:09:05.525692+0000","last_clean":"2023-05-12T09:09:05.525692+0000","last_became_active":"2023-05-12T09:09:03.905248+0000","last_became_peered":"2023-05-12T09:09:03.905248+0000","last_unstale":"2023-05-12T09:09:05.525692+0000","last_undegraded":"2023-05-12T09:09:05.525692+0000","last_fullsized":"2023-05-12T09:09:05.525692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:43:52.608003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525802+0000","last_change":"2023-05-12T09:07:05.258677+0000","last_active":"2023-05-12T09:09:05.525802+0000","last_peered":"2023-05-12T09:09:05.525802+0000","last_clean":"2023-05-12T09:09:05.525802+0000","last_became_active":"2023-05-12T09:07:05.258372+0000","last_became_peered":"2023-05-12T09:07:05.258372+0000","last_unstale":"2023-05-12T09:09:05.525802+0000","last_undegraded":"2023-05-12T09:09:05.525802+0000","last_fullsized":"2023-05-12T09:09:05.525802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:52:23.669645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524466+0000","last_change":"2023-05-12T09:09:04.382374+0000","last_active":"2023-05-12T09:09:05.524466+0000","last_peered":"2023-05-12T09:09:05.524466+0000","last_clean":"2023-05-12T09:09:05.524466+0000","last_became_active":"2023-05-12T09:09:04.381904+0000","last_became_peered":"2023-05-12T09:09:04.381904+0000","last_unstale":"2023-05-12T09:09:05.524466+0000","last_undegraded":"2023-05-12T09:09:05.524466+0000","last_fullsized":"2023-05-12T09:09:05.524466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:28:32.168752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525239+0000","last_change":"2023-05-12T09:09:03.899235+0000","last_active":"2023-05-12T09:09:05.525239+0000","last_peered":"2023-05-12T09:09:05.525239+0000","last_clean":"2023-05-12T09:09:05.525239+0000","last_became_active":"2023-05-12T09:09:03.898956+0000","last_became_peered":"2023-05-12T09:09:03.898956+0000","last_unstale":"2023-05-12T09:09:05.525239+0000","last_undegraded":"2023-05-12T09:09:05.525239+0000","last_fullsized":"2023-05-12T09:09:05.525239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:51:40.122290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525574+0000","last_change":"2023-05-12T09:07:05.258599+0000","last_active":"2023-05-12T09:09:05.525574+0000","last_peered":"2023-05-12T09:09:05.525574+0000","last_clean":"2023-05-12T09:09:05.525574+0000","last_became_active":"2023-05-12T09:07:05.258301+0000","last_became_peered":"2023-05-12T09:07:05.258301+0000","last_unstale":"2023-05-12T09:09:05.525574+0000","last_undegraded":"2023-05-12T09:09:05.525574+0000","last_fullsized":"2023-05-12T09:09:05.525574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:23:06.374371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368946+0000","last_change":"2023-05-12T09:09:04.381452+0000","last_active":"2023-05-12T09:09:05.368946+0000","last_peered":"2023-05-12T09:09:05.368946+0000","last_clean":"2023-05-12T09:09:05.368946+0000","last_became_active":"2023-05-12T09:09:04.381113+0000","last_became_peered":"2023-05-12T09:09:04.381113+0000","last_unstale":"2023-05-12T09:09:05.368946+0000","last_undegraded":"2023-05-12T09:09:05.368946+0000","last_fullsized":"2023-05-12T09:09:05.368946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:22:44.120344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369174+0000","last_change":"2023-05-12T09:09:03.899586+0000","last_active":"2023-05-12T09:09:05.369174+0000","last_peered":"2023-05-12T09:09:05.369174+0000","last_clean":"2023-05-12T09:09:05.369174+0000","last_became_active":"2023-05-12T09:09:03.898726+0000","last_became_peered":"2023-05-12T09:09:03.898726+0000","last_unstale":"2023-05-12T09:09:05.369174+0000","last_undegraded":"2023-05-12T09:09:05.369174+0000","last_fullsized":"2023-05-12T09:09:05.369174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:25:21.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524903+0000","last_change":"2023-05-12T09:07:05.258734+0000","last_active":"2023-05-12T09:09:05.524903+0000","last_peered":"2023-05-12T09:09:05.524903+0000","last_clean":"2023-05-12T09:09:05.524903+0000","last_became_active":"2023-05-12T09:07:05.258376+0000","last_became_peered":"2023-05-12T09:07:05.258376+0000","last_unstale":"2023-05-12T09:09:05.524903+0000","last_undegraded":"2023-05-12T09:09:05.524903+0000","last_fullsized":"2023-05-12T09:09:05.524903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:41:56.919026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524689+0000","last_change":"2023-05-12T09:09:04.390568+0000","last_active":"2023-05-12T09:09:05.524689+0000","last_peered":"2023-05-12T09:09:05.524689+0000","last_clean":"2023-05-12T09:09:05.524689+0000","last_became_active":"2023-05-12T09:09:04.390297+0000","last_became_peered":"2023-05-12T09:09:04.390297+0000","last_unstale":"2023-05-12T09:09:05.524689+0000","last_undegraded":"2023-05-12T09:09:05.524689+0000","last_fullsized":"2023-05-12T09:09:05.524689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:33:02.395196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524374+0000","last_change":"2023-05-12T09:09:03.900665+0000","last_active":"2023-05-12T09:09:05.524374+0000","last_peered":"2023-05-12T09:09:05.524374+0000","last_clean":"2023-05-12T09:09:05.524374+0000","last_became_active":"2023-05-12T09:09:03.900368+0000","last_became_peered":"2023-05-12T09:09:03.900368+0000","last_unstale":"2023-05-12T09:09:05.524374+0000","last_undegraded":"2023-05-12T09:09:05.524374+0000","last_fullsized":"2023-05-12T09:09:05.524374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:33:01.392985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368892+0000","last_change":"2023-05-12T09:07:05.258598+0000","last_active":"2023-05-12T09:09:05.368892+0000","last_peered":"2023-05-12T09:09:05.368892+0000","last_clean":"2023-05-12T09:09:05.368892+0000","last_became_active":"2023-05-12T09:07:05.258280+0000","last_became_peered":"2023-05-12T09:07:05.258280+0000","last_unstale":"2023-05-12T09:09:05.368892+0000","last_undegraded":"2023-05-12T09:09:05.368892+0000","last_fullsized":"2023-05-12T09:09:05.368892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:42:55.160903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526161+0000","last_change":"2023-05-12T09:09:04.388652+0000","last_active":"2023-05-12T09:09:05.526161+0000","last_peered":"2023-05-12T09:09:05.526161+0000","last_clean":"2023-05-12T09:09:05.526161+0000","last_became_active":"2023-05-12T09:09:04.388400+0000","last_became_peered":"2023-05-12T09:09:04.388400+0000","last_unstale":"2023-05-12T09:09:05.526161+0000","last_undegraded":"2023-05-12T09:09:05.526161+0000","last_fullsized":"2023-05-12T09:09:05.526161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:18:11.110214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524691+0000","last_change":"2023-05-12T09:09:03.896427+0000","last_active":"2023-05-12T09:09:05.524691+0000","last_peered":"2023-05-12T09:09:05.524691+0000","last_clean":"2023-05-12T09:09:05.524691+0000","last_became_active":"2023-05-12T09:09:03.896191+0000","last_became_peered":"2023-05-12T09:09:03.896191+0000","last_unstale":"2023-05-12T09:09:05.524691+0000","last_undegraded":"2023-05-12T09:09:05.524691+0000","last_fullsized":"2023-05-12T09:09:05.524691+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:54:12.262920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369069+0000","last_change":"2023-05-12T09:07:04.830787+0000","last_active":"2023-05-12T09:09:05.369069+0000","last_peered":"2023-05-12T09:09:05.369069+0000","last_clean":"2023-05-12T09:09:05.369069+0000","last_became_active":"2023-05-12T09:07:04.830492+0000","last_became_peered":"2023-05-12T09:07:04.830492+0000","last_unstale":"2023-05-12T09:09:05.369069+0000","last_undegraded":"2023-05-12T09:09:05.369069+0000","last_fullsized":"2023-05-12T09:09:05.369069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:42:22.913281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9736,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362104,"statfs":{"total":96636764160,"available":96626794496,"internally_reserved":0,"allocated":1048576,"data_stored":794063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.78400000000000003}]},{"osd":1,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.4560000000000004,"5min":4.4560000000000004,"15min":4.4560000000000004},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5620000000000003,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8580,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363260,"statfs":{"total":96636764160,"available":96627978240,"internally_reserved":0,"allocated":454656,"data_stored":202916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":6.9550000000000001,"5min":6.9550000000000001,"15min":6.9550000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.9370000000000003,"5min":5.9370000000000003,"15min":5.9370000000000003},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":7.024,"5min":7.024,"15min":7.024},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.96,"5min":5.96,"15min":5.96},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.41899999999999998}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.62},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9736,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362104,"statfs":{"total":96636764160,"available":96626794496,"internally_reserved":0,"allocated":1048576,"data_stored":794043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.436,"15min":0.44600000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54000000000000004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65100000000000002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.51300000000000001,"15min":0.52500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59799999999999998,"5min":1.75,"15min":1.75},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.60899999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.437}]},{"osd":3,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.58299999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.63500000000000001,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.5}]},{"osd":4,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82899999999999996,"15min":0.84299999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.62},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98599999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82199999999999995,"15min":0.83999999999999997},"min":{"1min":0.52300000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.89400000000000002,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97499999999999998,"5min":1.806,"15min":1.806},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1,"5min":1.857,"15min":1.857},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95099999999999996,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0469999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8708,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363132,"statfs":{"total":96636764160,"available":96627847168,"internally_reserved":0,"allocated":454656,"data_stored":203639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.68600000000000005,"15min":0.73599999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.311},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.84499999999999997,"15min":0.91500000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.55600000000000005,"5min":11.914,"15min":11.914},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.73799999999999999,"15min":0.78600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.56499999999999995,"15min":0.58499999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69499999999999995,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.90100000000000002,"15min":0.97899999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.56299999999999994,"5min":12.064,"15min":12.064},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.76900000000000002,"15min":0.81499999999999995},"min":{"1min":0.438,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61599999999999999,"5min":6.7229999999999999,"15min":6.7229999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85899999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":1.129,"15min":1.2050000000000001},"min":{"1min":0.46899999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84299999999999997,"5min":12.034000000000001,"15min":12.034000000000001},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.97399999999999998,"15min":1.0249999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.81499999999999995,"5min":6.7910000000000004,"15min":6.7910000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84999999999999998,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":1.3440000000000001,"15min":1.458},"min":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.80800000000000005,"5min":11.968,"15min":11.968},"last":0.625},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.99399999999999999,"15min":1.044},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.84399999999999997,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.95099999999999996,"15min":0.995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.88600000000000001,"5min":6.867,"15min":6.867},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":1.151,"15min":1.2290000000000001},"min":{"1min":0.56599999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.86299999999999999,"5min":12.004,"15min":12.004},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8524,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363316,"statfs":{"total":96636764160,"available":96628035584,"internally_reserved":0,"allocated":462848,"data_stored":203830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54700000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.433},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.307,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60899999999999999,"5min":1.01,"15min":1.01},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.441,"15min":0.442},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66300000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.57399999999999995,"5min":1.216,"15min":1.216},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.29,"15min":1.29},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1100000000000001,"5min":1.371,"15min":1.371},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.147,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.01,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.80600000000000005,"15min":0.81599999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.179,"15min":1.179},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0640000000000001,"5min":1.413,"15min":1.413},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.83099999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0489999999999999,"5min":1.262,"15min":1.262},"last":0.627}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8716,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363124,"statfs":{"total":96636764160,"available":96627838976,"internally_reserved":0,"allocated":462848,"data_stored":204243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.40500000000000003}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.62}]},{"osd":4,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8716,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363124,"statfs":{"total":96636764160,"available":96627838976,"internally_reserved":0,"allocated":462848,"data_stored":205169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":8.7530000000000001,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":8.7710000000000008,"5min":8.7710000000000008,"15min":8.7710000000000008},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.626},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.532,"5min":4.532,"15min":4.532},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.499},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53300000000000003}]},{"osd":6,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67600000000000005}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8576,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363264,"statfs":{"total":96636764160,"available":96627982336,"internally_reserved":0,"allocated":450560,"data_stored":202314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.64000000000000001,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71199999999999997,"5min":1.159,"15min":1.159},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.67300000000000004},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.748,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.47599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.879,"5min":1.597,"15min":1.597},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79400000000000004,"5min":1.431,"15min":1.431},"last":0.752},{"interface":"front","average":{"1min":0.627,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89300000000000002,"5min":1.53,"15min":1.53},"last":0.89000000000000001}]},{"osd":3,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.80200000000000005,"15min":0.82599999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.83799999999999997,"5min":1.333,"15min":1.333},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.78700000000000003,"5min":1.649,"15min":1.649},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86799999999999999,"5min":1.532,"15min":1.532},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68899999999999995,"15min":0.69599999999999995},"min":{"1min":0.441,"5min":0.436,"15min":0.436},"max":{"1min":0.872,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.90400000000000003,"5min":1.708,"15min":1.708},"last":0.90400000000000003}]},{"osd":7,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.745},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90100000000000002,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.871},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91400000000000003,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-12T09:09:13.683 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-12T09:09:13.877 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.874+0000 7fdb17fff700 1 Processor -- start 2023-05-12T09:09:13.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.874+0000 7fdb17fff700 1 -- start start 2023-05-12T09:09:13.878 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.875+0000 7fdb17fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdb100cd790 0x7fdb100ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:13.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.875+0000 7fdb17fff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1006a5f0 con 0x7fdb100cdb60 2023-05-12T09:09:13.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.875+0000 7fdb17fff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1006a840 con 0x7fdb100b1d50 2023-05-12T09:09:13.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.875+0000 7fdb17fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1006ab20 con 0x7fdb100cd790 2023-05-12T09:09:13.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.876+0000 7fdb1559a700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdb100cdb60 0x7fdb100b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:57386/0 (socket says 172.21.15.116:57386) 2023-05-12T09:09:13.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.876+0000 7fdb15d9b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdb100cd790 0x7fdb100ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:13.879 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.876+0000 7fdb1559a700 1 -- 172.21.15.116:0/3032104911 learned_addr learned my addr 172.21.15.116:0/3032104911 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:13.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.876+0000 7fdb14d99700 1 -- 172.21.15.116:0/3032104911 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191848027 0 0) 0x7fdb1006a5f0 con 0x7fdb100cdb60 2023-05-12T09:09:13.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.876+0000 7fdb14d99700 1 -- 172.21.15.116:0/3032104911 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdafc0035b0 con 0x7fdb100cdb60 2023-05-12T09:09:13.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.876+0000 7fdb15d9b700 1 -- 172.21.15.116:0/3032104911 >> v1:172.21.15.182:6789/0 conn(0x7fdb100b1d50 legacy=0x7fdb1006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:13.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.876+0000 7fdb15d9b700 1 -- 172.21.15.116:0/3032104911 >> v1:172.21.15.116:6789/0 conn(0x7fdb100cdb60 legacy=0x7fdb100b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:13.881 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.876+0000 7fdb15d9b700 1 -- 172.21.15.116:0/3032104911 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1006ae00 con 0x7fdb100cd790 2023-05-12T09:09:13.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.876+0000 7fdb15d9b700 1 --2- 172.21.15.116:0/3032104911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100cd790 0x7fdb100ca210 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009870 tx=0x7fdb0c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9003d2dd16046a26 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:13.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.877+0000 7fdb14d99700 1 -- 172.21.15.116:0/3032104911 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c004230 con 0x7fdb100cd790 2023-05-12T09:09:13.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.877+0000 7fdb14d99700 1 -- 172.21.15.116:0/3032104911 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c004390 con 0x7fdb100cd790 2023-05-12T09:09:13.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.877+0000 7fdb14d99700 1 -- 172.21.15.116:0/3032104911 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0036a0 con 0x7fdb100cd790 2023-05-12T09:09:13.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.877+0000 7fdb17fff700 1 -- 172.21.15.116:0/3032104911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100cd790 msgr2=0x7fdb100ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:13.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.877+0000 7fdb17fff700 1 --2- 172.21.15.116:0/3032104911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100cd790 0x7fdb100ca210 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009870 tx=0x7fdb0c009b80 comp rx=0 tx=0).stop 2023-05-12T09:09:13.882 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.877+0000 7fdb17fff700 1 -- 172.21.15.116:0/3032104911 shutdown_connections 2023-05-12T09:09:13.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.877+0000 7fdb17fff700 1 --2- 172.21.15.116:0/3032104911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100cd790 0x7fdb100ca210 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:13.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.877+0000 7fdb17fff700 1 -- 172.21.15.116:0/3032104911 >> 172.21.15.116:0/3032104911 conn(0x7fdb1006e980 msgr2=0x7fdb100cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:13.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.877+0000 7fdb17fff700 1 -- 172.21.15.116:0/3032104911 shutdown_connections 2023-05-12T09:09:13.883 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.877+0000 7fdb17fff700 1 -- 172.21.15.116:0/3032104911 wait complete. 2023-05-12T09:09:13.884 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.879+0000 7fdb17fff700 1 Processor -- start 2023-05-12T09:09:13.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.879+0000 7fdb17fff700 1 -- start start 2023-05-12T09:09:13.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.880+0000 7fdb17fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100b1d50 0x7fdb100cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:13.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.880+0000 7fdb17fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdb100cd790 0x7fdb100c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:13.885 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.880+0000 7fdb17fff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdb100cdb60 0x7fdb100c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:13.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.880+0000 7fdb17fff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100b5720 con 0x7fdb100b1d50 2023-05-12T09:09:13.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.880+0000 7fdb17fff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100b4aa0 con 0x7fdb100cdb60 2023-05-12T09:09:13.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.880+0000 7fdb17fff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100b4d80 con 0x7fdb100cd790 2023-05-12T09:09:13.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.880+0000 7fdb15d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100b1d50 0x7fdb100cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:13.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.880+0000 7fdb15d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100b1d50 0x7fdb100cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49744/0 (socket says 172.21.15.116:49744) 2023-05-12T09:09:13.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.880+0000 7fdb15d9b700 1 -- 172.21.15.116:0/1919075153 learned_addr learned my addr 172.21.15.116:0/1919075153 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:13.886 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb15d9b700 1 -- 172.21.15.116:0/1919075153 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdb100cd790 msgr2=0x7fdb100c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:13.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb15d9b700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdb100cd790 0x7fdb100c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:13.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb15d9b700 1 -- 172.21.15.116:0/1919075153 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdb100cdb60 msgr2=0x7fdb100c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:13.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb15d9b700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdb100cdb60 0x7fdb100c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:13.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb15d9b700 1 -- 172.21.15.116:0/1919075153 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c0094a0 con 0x7fdb100b1d50 2023-05-12T09:09:13.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb15d9b700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100b1d50 0x7fdb100cadd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0090b0 tx=0x7fdb0c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:13.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb067fc700 1 -- 172.21.15.116:0/1919075153 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c011630 con 0x7fdb100b1d50 2023-05-12T09:09:13.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb067fc700 1 -- 172.21.15.116:0/1919075153 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c011790 con 0x7fdb100b1d50 2023-05-12T09:09:13.887 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb067fc700 1 -- 172.21.15.116:0/1919075153 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c011b40 con 0x7fdb100b1d50 2023-05-12T09:09:13.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb17fff700 1 -- 172.21.15.116:0/1919075153 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb100ce000 con 0x7fdb100b1d50 2023-05-12T09:09:13.888 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.881+0000 7fdb17fff700 1 -- 172.21.15.116:0/1919075153 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1006b0e0 con 0x7fdb100b1d50 2023-05-12T09:09:13.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.882+0000 7fdb17fff700 1 -- 172.21.15.116:0/1919075153 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1015ca20 con 0x7fdb100b1d50 2023-05-12T09:09:13.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.883+0000 7fdb067fc700 1 -- 172.21.15.116:0/1919075153 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb0c011ca0 con 0x7fdb100b1d50 2023-05-12T09:09:13.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.884+0000 7fdb067fc700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdaf406ace0 0x7fdaf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:13.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.884+0000 7fdb067fc700 1 -- 172.21.15.116:0/1919075153 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdb0c08ade0 con 0x7fdb100b1d50 2023-05-12T09:09:13.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.884+0000 7fdb1559a700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdaf406ace0 0x7fdaf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:13.889 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.885+0000 7fdb1559a700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdaf406ace0 0x7fdaf406d190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdb000011e0 tx=0x7fdb000079a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:13.891 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:13.888+0000 7fdb067fc700 1 -- 172.21.15.116:0/1919075153 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdb0c055cc0 con 0x7fdb100b1d50 2023-05-12T09:09:14.078 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.075+0000 7fdb17fff700 1 -- 172.21.15.116:0/1919075153 --> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb100ce4c0 con 0x7fdaf406ace0 2023-05-12T09:09:14.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.084+0000 7fdb067fc700 1 -- 172.21.15.116:0/1919075153 <== mgr.4106 v2:172.21.15.116:6832/3989593778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311267 (secure 0 0 0) 0x7fdb100ce4c0 con 0x7fdaf406ace0 2023-05-12T09:09:14.090 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:14.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.088+0000 7fdb17fff700 1 -- 172.21.15.116:0/1919075153 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdaf406ace0 msgr2=0x7fdaf406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.088+0000 7fdb17fff700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdaf406ace0 0x7fdaf406d190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdb000011e0 tx=0x7fdb000079a0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.088+0000 7fdb17fff700 1 -- 172.21.15.116:0/1919075153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100b1d50 msgr2=0x7fdb100cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.088+0000 7fdb17fff700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100b1d50 0x7fdb100cadd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0090b0 tx=0x7fdb0c0047c0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.092 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.088+0000 7fdb17fff700 1 -- 172.21.15.116:0/1919075153 shutdown_connections 2023-05-12T09:09:14.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.088+0000 7fdb17fff700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fdb100cdb60 0x7fdb100c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.088+0000 7fdb17fff700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb100b1d50 0x7fdb100cadd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.088+0000 7fdb17fff700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fdaf406ace0 0x7fdaf406d190 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.088+0000 7fdb17fff700 1 --2- 172.21.15.116:0/1919075153 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fdb100cd790 0x7fdb100c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.088+0000 7fdb17fff700 1 -- 172.21.15.116:0/1919075153 >> 172.21.15.116:0/1919075153 conn(0x7fdb1006e980 msgr2=0x7fdb10157e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:14.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.089+0000 7fdb17fff700 1 -- 172.21.15.116:0/1919075153 shutdown_connections 2023-05-12T09:09:14.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.089+0000 7fdb17fff700 1 -- 172.21.15.116:0/1919075153 wait complete. 2023-05-12T09:09:14.094 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2023-05-12T09:09:14.108 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-05-12T09:09:13.594946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71292,"kb_used_data":4732,"kb_used_omap":0,"kb_used_meta":66496,"kb_avail":754903428,"statfs":{"total":773094113280,"available":773021110272,"internally_reserved":0,"allocated":4845568,"data_stored":2810217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68091904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.235603"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525644+0000","last_change":"2023-05-12T09:09:04.386504+0000","last_active":"2023-05-12T09:09:05.525644+0000","last_peered":"2023-05-12T09:09:05.525644+0000","last_clean":"2023-05-12T09:09:05.525644+0000","last_became_active":"2023-05-12T09:09:04.386247+0000","last_became_peered":"2023-05-12T09:09:04.386247+0000","last_unstale":"2023-05-12T09:09:05.525644+0000","last_undegraded":"2023-05-12T09:09:05.525644+0000","last_fullsized":"2023-05-12T09:09:05.525644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:12:31.106955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524972+0000","last_change":"2023-05-12T09:09:04.382931+0000","last_active":"2023-05-12T09:09:05.524972+0000","last_peered":"2023-05-12T09:09:05.524972+0000","last_clean":"2023-05-12T09:09:05.524972+0000","last_became_active":"2023-05-12T09:09:04.382666+0000","last_became_peered":"2023-05-12T09:09:04.382666+0000","last_unstale":"2023-05-12T09:09:05.524972+0000","last_undegraded":"2023-05-12T09:09:05.524972+0000","last_fullsized":"2023-05-12T09:09:05.524972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:20:41.081497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526540+0000","last_change":"2023-05-12T09:09:04.384475+0000","last_active":"2023-05-12T09:09:05.526540+0000","last_peered":"2023-05-12T09:09:05.526540+0000","last_clean":"2023-05-12T09:09:05.526540+0000","last_became_active":"2023-05-12T09:09:04.384193+0000","last_became_peered":"2023-05-12T09:09:04.384193+0000","last_unstale":"2023-05-12T09:09:05.526540+0000","last_undegraded":"2023-05-12T09:09:05.526540+0000","last_fullsized":"2023-05-12T09:09:05.526540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:27:56.479049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524357+0000","last_change":"2023-05-12T09:09:04.392312+0000","last_active":"2023-05-12T09:09:05.524357+0000","last_peered":"2023-05-12T09:09:05.524357+0000","last_clean":"2023-05-12T09:09:05.524357+0000","last_became_active":"2023-05-12T09:09:04.392058+0000","last_became_peered":"2023-05-12T09:09:04.392058+0000","last_unstale":"2023-05-12T09:09:05.524357+0000","last_undegraded":"2023-05-12T09:09:05.524357+0000","last_fullsized":"2023-05-12T09:09:05.524357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:57:27.622878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524918+0000","last_change":"2023-05-12T09:09:04.377823+0000","last_active":"2023-05-12T09:09:05.524918+0000","last_peered":"2023-05-12T09:09:05.524918+0000","last_clean":"2023-05-12T09:09:05.524918+0000","last_became_active":"2023-05-12T09:09:04.377580+0000","last_became_peered":"2023-05-12T09:09:04.377580+0000","last_unstale":"2023-05-12T09:09:05.524918+0000","last_undegraded":"2023-05-12T09:09:05.524918+0000","last_fullsized":"2023-05-12T09:09:05.524918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:40:40.702906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368750+0000","last_change":"2023-05-12T09:09:04.380240+0000","last_active":"2023-05-12T09:09:05.368750+0000","last_peered":"2023-05-12T09:09:05.368750+0000","last_clean":"2023-05-12T09:09:05.368750+0000","last_became_active":"2023-05-12T09:09:04.379567+0000","last_became_peered":"2023-05-12T09:09:04.379567+0000","last_unstale":"2023-05-12T09:09:05.368750+0000","last_undegraded":"2023-05-12T09:09:05.368750+0000","last_fullsized":"2023-05-12T09:09:05.368750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:27:23.814861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525192+0000","last_change":"2023-05-12T09:09:04.387166+0000","last_active":"2023-05-12T09:09:05.525192+0000","last_peered":"2023-05-12T09:09:05.525192+0000","last_clean":"2023-05-12T09:09:05.525192+0000","last_became_active":"2023-05-12T09:09:04.386855+0000","last_became_peered":"2023-05-12T09:09:04.386855+0000","last_unstale":"2023-05-12T09:09:05.525192+0000","last_undegraded":"2023-05-12T09:09:05.525192+0000","last_fullsized":"2023-05-12T09:09:05.525192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:51:41.124501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524129+0000","last_change":"2023-05-12T09:09:04.381056+0000","last_active":"2023-05-12T09:09:05.524129+0000","last_peered":"2023-05-12T09:09:05.524129+0000","last_clean":"2023-05-12T09:09:05.524129+0000","last_became_active":"2023-05-12T09:09:04.380828+0000","last_became_peered":"2023-05-12T09:09:04.380828+0000","last_unstale":"2023-05-12T09:09:05.524129+0000","last_undegraded":"2023-05-12T09:09:05.524129+0000","last_fullsized":"2023-05-12T09:09:05.524129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:01:52.267927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524531+0000","last_change":"2023-05-12T09:09:04.380020+0000","last_active":"2023-05-12T09:09:05.524531+0000","last_peered":"2023-05-12T09:09:05.524531+0000","last_clean":"2023-05-12T09:09:05.524531+0000","last_became_active":"2023-05-12T09:09:04.379753+0000","last_became_peered":"2023-05-12T09:09:04.379753+0000","last_unstale":"2023-05-12T09:09:05.524531+0000","last_undegraded":"2023-05-12T09:09:05.524531+0000","last_fullsized":"2023-05-12T09:09:05.524531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:09:41.115391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524310+0000","last_change":"2023-05-12T09:09:04.382219+0000","last_active":"2023-05-12T09:09:05.524310+0000","last_peered":"2023-05-12T09:09:05.524310+0000","last_clean":"2023-05-12T09:09:05.524310+0000","last_became_active":"2023-05-12T09:09:04.381527+0000","last_became_peered":"2023-05-12T09:09:04.381527+0000","last_unstale":"2023-05-12T09:09:05.524310+0000","last_undegraded":"2023-05-12T09:09:05.524310+0000","last_fullsized":"2023-05-12T09:09:05.524310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:01:51.907572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524369+0000","last_change":"2023-05-12T09:09:04.375935+0000","last_active":"2023-05-12T09:09:05.524369+0000","last_peered":"2023-05-12T09:09:05.524369+0000","last_clean":"2023-05-12T09:09:05.524369+0000","last_became_active":"2023-05-12T09:09:04.375665+0000","last_became_peered":"2023-05-12T09:09:04.375665+0000","last_unstale":"2023-05-12T09:09:05.524369+0000","last_undegraded":"2023-05-12T09:09:05.524369+0000","last_fullsized":"2023-05-12T09:09:05.524369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:22:01.450509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525276+0000","last_change":"2023-05-12T09:09:04.378328+0000","last_active":"2023-05-12T09:09:05.525276+0000","last_peered":"2023-05-12T09:09:05.525276+0000","last_clean":"2023-05-12T09:09:05.525276+0000","last_became_active":"2023-05-12T09:09:04.377980+0000","last_became_peered":"2023-05-12T09:09:04.377980+0000","last_unstale":"2023-05-12T09:09:05.525276+0000","last_undegraded":"2023-05-12T09:09:05.525276+0000","last_fullsized":"2023-05-12T09:09:05.525276+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:56:43.536448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370026+0000","last_change":"2023-05-12T09:09:04.387230+0000","last_active":"2023-05-12T09:09:05.370026+0000","last_peered":"2023-05-12T09:09:05.370026+0000","last_clean":"2023-05-12T09:09:05.370026+0000","last_became_active":"2023-05-12T09:09:04.386807+0000","last_became_peered":"2023-05-12T09:09:04.386807+0000","last_unstale":"2023-05-12T09:09:05.370026+0000","last_undegraded":"2023-05-12T09:09:05.370026+0000","last_fullsized":"2023-05-12T09:09:05.370026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:43:23.522527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524272+0000","last_change":"2023-05-12T09:09:04.379528+0000","last_active":"2023-05-12T09:09:05.524272+0000","last_peered":"2023-05-12T09:09:05.524272+0000","last_clean":"2023-05-12T09:09:05.524272+0000","last_became_active":"2023-05-12T09:09:04.379240+0000","last_became_peered":"2023-05-12T09:09:04.379240+0000","last_unstale":"2023-05-12T09:09:05.524272+0000","last_undegraded":"2023-05-12T09:09:05.524272+0000","last_fullsized":"2023-05-12T09:09:05.524272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:25:33.795660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368644+0000","last_change":"2023-05-12T09:09:04.386139+0000","last_active":"2023-05-12T09:09:05.368644+0000","last_peered":"2023-05-12T09:09:05.368644+0000","last_clean":"2023-05-12T09:09:05.368644+0000","last_became_active":"2023-05-12T09:09:04.385890+0000","last_became_peered":"2023-05-12T09:09:04.385890+0000","last_unstale":"2023-05-12T09:09:05.368644+0000","last_undegraded":"2023-05-12T09:09:05.368644+0000","last_fullsized":"2023-05-12T09:09:05.368644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:59:12.005243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368483+0000","last_change":"2023-05-12T09:09:04.381594+0000","last_active":"2023-05-12T09:09:05.368483+0000","last_peered":"2023-05-12T09:09:05.368483+0000","last_clean":"2023-05-12T09:09:05.368483+0000","last_became_active":"2023-05-12T09:09:04.381306+0000","last_became_peered":"2023-05-12T09:09:04.381306+0000","last_unstale":"2023-05-12T09:09:05.368483+0000","last_undegraded":"2023-05-12T09:09:05.368483+0000","last_fullsized":"2023-05-12T09:09:05.368483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:47:29.018998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526249+0000","last_change":"2023-05-12T09:09:04.390854+0000","last_active":"2023-05-12T09:09:05.526249+0000","last_peered":"2023-05-12T09:09:05.526249+0000","last_clean":"2023-05-12T09:09:05.526249+0000","last_became_active":"2023-05-12T09:09:04.390598+0000","last_became_peered":"2023-05-12T09:09:04.390598+0000","last_unstale":"2023-05-12T09:09:05.526249+0000","last_undegraded":"2023-05-12T09:09:05.526249+0000","last_fullsized":"2023-05-12T09:09:05.526249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:51:32.345508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526369+0000","last_change":"2023-05-12T09:09:04.384388+0000","last_active":"2023-05-12T09:09:05.526369+0000","last_peered":"2023-05-12T09:09:05.526369+0000","last_clean":"2023-05-12T09:09:05.526369+0000","last_became_active":"2023-05-12T09:09:04.383867+0000","last_became_peered":"2023-05-12T09:09:04.383867+0000","last_unstale":"2023-05-12T09:09:05.526369+0000","last_undegraded":"2023-05-12T09:09:05.526369+0000","last_fullsized":"2023-05-12T09:09:05.526369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:28:46.039724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368751+0000","last_change":"2023-05-12T09:09:04.381162+0000","last_active":"2023-05-12T09:09:05.368751+0000","last_peered":"2023-05-12T09:09:05.368751+0000","last_clean":"2023-05-12T09:09:05.368751+0000","last_became_active":"2023-05-12T09:09:04.379970+0000","last_became_peered":"2023-05-12T09:09:04.379970+0000","last_unstale":"2023-05-12T09:09:05.368751+0000","last_undegraded":"2023-05-12T09:09:05.368751+0000","last_fullsized":"2023-05-12T09:09:05.368751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:05:49.166270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370096+0000","last_change":"2023-05-12T09:09:04.377471+0000","last_active":"2023-05-12T09:09:05.370096+0000","last_peered":"2023-05-12T09:09:05.370096+0000","last_clean":"2023-05-12T09:09:05.370096+0000","last_became_active":"2023-05-12T09:09:04.377206+0000","last_became_peered":"2023-05-12T09:09:04.377206+0000","last_unstale":"2023-05-12T09:09:05.370096+0000","last_undegraded":"2023-05-12T09:09:05.370096+0000","last_fullsized":"2023-05-12T09:09:05.370096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:19:11.089930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368896+0000","last_change":"2023-05-12T09:09:04.388538+0000","last_active":"2023-05-12T09:09:05.368896+0000","last_peered":"2023-05-12T09:09:05.368896+0000","last_clean":"2023-05-12T09:09:05.368896+0000","last_became_active":"2023-05-12T09:09:04.388265+0000","last_became_peered":"2023-05-12T09:09:04.388265+0000","last_unstale":"2023-05-12T09:09:05.368896+0000","last_undegraded":"2023-05-12T09:09:05.368896+0000","last_fullsized":"2023-05-12T09:09:05.368896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:20:12.211222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524324+0000","last_change":"2023-05-12T09:09:04.381121+0000","last_active":"2023-05-12T09:09:05.524324+0000","last_peered":"2023-05-12T09:09:05.524324+0000","last_clean":"2023-05-12T09:09:05.524324+0000","last_became_active":"2023-05-12T09:09:04.380885+0000","last_became_peered":"2023-05-12T09:09:04.380885+0000","last_unstale":"2023-05-12T09:09:05.524324+0000","last_undegraded":"2023-05-12T09:09:05.524324+0000","last_fullsized":"2023-05-12T09:09:05.524324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:47:08.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368441+0000","last_change":"2023-05-12T09:09:04.376351+0000","last_active":"2023-05-12T09:09:05.368441+0000","last_peered":"2023-05-12T09:09:05.368441+0000","last_clean":"2023-05-12T09:09:05.368441+0000","last_became_active":"2023-05-12T09:09:04.376088+0000","last_became_peered":"2023-05-12T09:09:04.376088+0000","last_unstale":"2023-05-12T09:09:05.368441+0000","last_undegraded":"2023-05-12T09:09:05.368441+0000","last_fullsized":"2023-05-12T09:09:05.368441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:30:56.733268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368461+0000","last_change":"2023-05-12T09:09:04.376338+0000","last_active":"2023-05-12T09:09:05.368461+0000","last_peered":"2023-05-12T09:09:05.368461+0000","last_clean":"2023-05-12T09:09:05.368461+0000","last_became_active":"2023-05-12T09:09:04.376069+0000","last_became_peered":"2023-05-12T09:09:04.376069+0000","last_unstale":"2023-05-12T09:09:05.368461+0000","last_undegraded":"2023-05-12T09:09:05.368461+0000","last_fullsized":"2023-05-12T09:09:05.368461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:37:18.764062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369092+0000","last_change":"2023-05-12T09:09:04.378099+0000","last_active":"2023-05-12T09:09:05.369092+0000","last_peered":"2023-05-12T09:09:05.369092+0000","last_clean":"2023-05-12T09:09:05.369092+0000","last_became_active":"2023-05-12T09:09:04.377827+0000","last_became_peered":"2023-05-12T09:09:04.377827+0000","last_unstale":"2023-05-12T09:09:05.369092+0000","last_undegraded":"2023-05-12T09:09:05.369092+0000","last_fullsized":"2023-05-12T09:09:05.369092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:27:31.699297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370362+0000","last_change":"2023-05-12T09:09:04.384513+0000","last_active":"2023-05-12T09:09:05.370362+0000","last_peered":"2023-05-12T09:09:05.370362+0000","last_clean":"2023-05-12T09:09:05.370362+0000","last_became_active":"2023-05-12T09:09:04.384269+0000","last_became_peered":"2023-05-12T09:09:04.384269+0000","last_unstale":"2023-05-12T09:09:05.370362+0000","last_undegraded":"2023-05-12T09:09:05.370362+0000","last_fullsized":"2023-05-12T09:09:05.370362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:07:17.973275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526255+0000","last_change":"2023-05-12T09:09:04.390308+0000","last_active":"2023-05-12T09:09:05.526255+0000","last_peered":"2023-05-12T09:09:05.526255+0000","last_clean":"2023-05-12T09:09:05.526255+0000","last_became_active":"2023-05-12T09:09:04.390036+0000","last_became_peered":"2023-05-12T09:09:04.390036+0000","last_unstale":"2023-05-12T09:09:05.526255+0000","last_undegraded":"2023-05-12T09:09:05.526255+0000","last_fullsized":"2023-05-12T09:09:05.526255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:25:06.887710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524874+0000","last_change":"2023-05-12T09:09:04.382137+0000","last_active":"2023-05-12T09:09:05.524874+0000","last_peered":"2023-05-12T09:09:05.524874+0000","last_clean":"2023-05-12T09:09:05.524874+0000","last_became_active":"2023-05-12T09:09:04.381653+0000","last_became_peered":"2023-05-12T09:09:04.381653+0000","last_unstale":"2023-05-12T09:09:05.524874+0000","last_undegraded":"2023-05-12T09:09:05.524874+0000","last_fullsized":"2023-05-12T09:09:05.524874+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:45:21.983499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368698+0000","last_change":"2023-05-12T09:09:04.379182+0000","last_active":"2023-05-12T09:09:05.368698+0000","last_peered":"2023-05-12T09:09:05.368698+0000","last_clean":"2023-05-12T09:09:05.368698+0000","last_became_active":"2023-05-12T09:09:04.378909+0000","last_became_peered":"2023-05-12T09:09:04.378909+0000","last_unstale":"2023-05-12T09:09:05.368698+0000","last_undegraded":"2023-05-12T09:09:05.368698+0000","last_fullsized":"2023-05-12T09:09:05.368698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:21:01.201284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526107+0000","last_change":"2023-05-12T09:09:04.376810+0000","last_active":"2023-05-12T09:09:05.526107+0000","last_peered":"2023-05-12T09:09:05.526107+0000","last_clean":"2023-05-12T09:09:05.526107+0000","last_became_active":"2023-05-12T09:09:04.376113+0000","last_became_peered":"2023-05-12T09:09:04.376113+0000","last_unstale":"2023-05-12T09:09:05.526107+0000","last_undegraded":"2023-05-12T09:09:05.526107+0000","last_fullsized":"2023-05-12T09:09:05.526107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:14:31.845272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368794+0000","last_change":"2023-05-12T09:09:04.390251+0000","last_active":"2023-05-12T09:09:05.368794+0000","last_peered":"2023-05-12T09:09:05.368794+0000","last_clean":"2023-05-12T09:09:05.368794+0000","last_became_active":"2023-05-12T09:09:04.389960+0000","last_became_peered":"2023-05-12T09:09:04.389960+0000","last_unstale":"2023-05-12T09:09:05.368794+0000","last_undegraded":"2023-05-12T09:09:05.368794+0000","last_fullsized":"2023-05-12T09:09:05.368794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:18:06.177215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369879+0000","last_change":"2023-05-12T09:09:04.378906+0000","last_active":"2023-05-12T09:09:05.369879+0000","last_peered":"2023-05-12T09:09:05.369879+0000","last_clean":"2023-05-12T09:09:05.369879+0000","last_became_active":"2023-05-12T09:09:04.378653+0000","last_became_peered":"2023-05-12T09:09:04.378653+0000","last_unstale":"2023-05-12T09:09:05.369879+0000","last_undegraded":"2023-05-12T09:09:05.369879+0000","last_fullsized":"2023-05-12T09:09:05.369879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:17:26.362380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524733+0000","last_change":"2023-05-12T09:09:04.388485+0000","last_active":"2023-05-12T09:09:05.524733+0000","last_peered":"2023-05-12T09:09:05.524733+0000","last_clean":"2023-05-12T09:09:05.524733+0000","last_became_active":"2023-05-12T09:09:04.388199+0000","last_became_peered":"2023-05-12T09:09:04.388199+0000","last_unstale":"2023-05-12T09:09:05.524733+0000","last_undegraded":"2023-05-12T09:09:05.524733+0000","last_fullsized":"2023-05-12T09:09:05.524733+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:45:21.983499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369280+0000","last_change":"2023-05-12T09:09:03.900712+0000","last_active":"2023-05-12T09:09:05.369280+0000","last_peered":"2023-05-12T09:09:05.369280+0000","last_clean":"2023-05-12T09:09:05.369280+0000","last_became_active":"2023-05-12T09:09:03.900526+0000","last_became_peered":"2023-05-12T09:09:03.900526+0000","last_unstale":"2023-05-12T09:09:05.369280+0000","last_undegraded":"2023-05-12T09:09:05.369280+0000","last_fullsized":"2023-05-12T09:09:05.369280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:29:38.904769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368950+0000","last_change":"2023-05-12T09:09:04.382106+0000","last_active":"2023-05-12T09:09:05.368950+0000","last_peered":"2023-05-12T09:09:05.368950+0000","last_clean":"2023-05-12T09:09:05.368950+0000","last_became_active":"2023-05-12T09:09:04.381786+0000","last_became_peered":"2023-05-12T09:09:04.381786+0000","last_unstale":"2023-05-12T09:09:05.368950+0000","last_undegraded":"2023-05-12T09:09:05.368950+0000","last_fullsized":"2023-05-12T09:09:05.368950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:16:42.179276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526584+0000","last_change":"2023-05-12T09:09:03.902057+0000","last_active":"2023-05-12T09:09:05.526584+0000","last_peered":"2023-05-12T09:09:05.526584+0000","last_clean":"2023-05-12T09:09:05.526584+0000","last_became_active":"2023-05-12T09:09:03.901685+0000","last_became_peered":"2023-05-12T09:09:03.901685+0000","last_unstale":"2023-05-12T09:09:05.526584+0000","last_undegraded":"2023-05-12T09:09:05.526584+0000","last_fullsized":"2023-05-12T09:09:05.526584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:45:33.502711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525096+0000","last_change":"2023-05-12T09:09:04.389493+0000","last_active":"2023-05-12T09:09:05.525096+0000","last_peered":"2023-05-12T09:09:05.525096+0000","last_clean":"2023-05-12T09:09:05.525096+0000","last_became_active":"2023-05-12T09:09:04.389173+0000","last_became_peered":"2023-05-12T09:09:04.389173+0000","last_unstale":"2023-05-12T09:09:05.525096+0000","last_undegraded":"2023-05-12T09:09:05.525096+0000","last_fullsized":"2023-05-12T09:09:05.525096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:40:08.417440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524696+0000","last_change":"2023-05-12T09:09:03.898834+0000","last_active":"2023-05-12T09:09:05.524696+0000","last_peered":"2023-05-12T09:09:05.524696+0000","last_clean":"2023-05-12T09:09:05.524696+0000","last_became_active":"2023-05-12T09:09:03.898530+0000","last_became_peered":"2023-05-12T09:09:03.898530+0000","last_unstale":"2023-05-12T09:09:05.524696+0000","last_undegraded":"2023-05-12T09:09:05.524696+0000","last_fullsized":"2023-05-12T09:09:05.524696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:43:55.973079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524683+0000","last_change":"2023-05-12T09:09:04.383685+0000","last_active":"2023-05-12T09:09:05.524683+0000","last_peered":"2023-05-12T09:09:05.524683+0000","last_clean":"2023-05-12T09:09:05.524683+0000","last_became_active":"2023-05-12T09:09:04.383282+0000","last_became_peered":"2023-05-12T09:09:04.383282+0000","last_unstale":"2023-05-12T09:09:05.524683+0000","last_undegraded":"2023-05-12T09:09:05.524683+0000","last_fullsized":"2023-05-12T09:09:05.524683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:40:40.702906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525420+0000","last_change":"2023-05-12T09:09:03.901767+0000","last_active":"2023-05-12T09:09:05.525420+0000","last_peered":"2023-05-12T09:09:05.525420+0000","last_clean":"2023-05-12T09:09:05.525420+0000","last_became_active":"2023-05-12T09:09:03.901442+0000","last_became_peered":"2023-05-12T09:09:03.901442+0000","last_unstale":"2023-05-12T09:09:05.525420+0000","last_undegraded":"2023-05-12T09:09:05.525420+0000","last_fullsized":"2023-05-12T09:09:05.525420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:52:40.761299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526252+0000","last_change":"2023-05-12T09:09:04.376992+0000","last_active":"2023-05-12T09:09:05.526252+0000","last_peered":"2023-05-12T09:09:05.526252+0000","last_clean":"2023-05-12T09:09:05.526252+0000","last_became_active":"2023-05-12T09:09:04.375692+0000","last_became_peered":"2023-05-12T09:09:04.375692+0000","last_unstale":"2023-05-12T09:09:05.526252+0000","last_undegraded":"2023-05-12T09:09:05.526252+0000","last_fullsized":"2023-05-12T09:09:05.526252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:32:40.239050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369408+0000","last_change":"2023-05-12T09:09:03.903591+0000","last_active":"2023-05-12T09:09:05.369408+0000","last_peered":"2023-05-12T09:09:05.369408+0000","last_clean":"2023-05-12T09:09:05.369408+0000","last_became_active":"2023-05-12T09:09:03.903005+0000","last_became_peered":"2023-05-12T09:09:03.903005+0000","last_unstale":"2023-05-12T09:09:05.369408+0000","last_undegraded":"2023-05-12T09:09:05.369408+0000","last_fullsized":"2023-05-12T09:09:05.369408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:31:23.672158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524840+0000","last_change":"2023-05-12T09:09:04.375860+0000","last_active":"2023-05-12T09:09:05.524840+0000","last_peered":"2023-05-12T09:09:05.524840+0000","last_clean":"2023-05-12T09:09:05.524840+0000","last_became_active":"2023-05-12T09:09:04.375603+0000","last_became_peered":"2023-05-12T09:09:04.375603+0000","last_unstale":"2023-05-12T09:09:05.524840+0000","last_undegraded":"2023-05-12T09:09:05.524840+0000","last_fullsized":"2023-05-12T09:09:05.524840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:28:51.124741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526353+0000","last_change":"2023-05-12T09:09:03.906356+0000","last_active":"2023-05-12T09:09:05.526353+0000","last_peered":"2023-05-12T09:09:05.526353+0000","last_clean":"2023-05-12T09:09:05.526353+0000","last_became_active":"2023-05-12T09:09:03.906036+0000","last_became_peered":"2023-05-12T09:09:03.906036+0000","last_unstale":"2023-05-12T09:09:05.526353+0000","last_undegraded":"2023-05-12T09:09:05.526353+0000","last_fullsized":"2023-05-12T09:09:05.526353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:47:26.343563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524571+0000","last_change":"2023-05-12T09:09:04.381281+0000","last_active":"2023-05-12T09:09:05.524571+0000","last_peered":"2023-05-12T09:09:05.524571+0000","last_clean":"2023-05-12T09:09:05.524571+0000","last_became_active":"2023-05-12T09:09:04.380108+0000","last_became_peered":"2023-05-12T09:09:04.380108+0000","last_unstale":"2023-05-12T09:09:05.524571+0000","last_undegraded":"2023-05-12T09:09:05.524571+0000","last_fullsized":"2023-05-12T09:09:05.524571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:50.791537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524740+0000","last_change":"2023-05-12T09:09:03.898492+0000","last_active":"2023-05-12T09:09:05.524740+0000","last_peered":"2023-05-12T09:09:05.524740+0000","last_clean":"2023-05-12T09:09:05.524740+0000","last_became_active":"2023-05-12T09:09:03.898190+0000","last_became_peered":"2023-05-12T09:09:03.898190+0000","last_unstale":"2023-05-12T09:09:05.524740+0000","last_undegraded":"2023-05-12T09:09:05.524740+0000","last_fullsized":"2023-05-12T09:09:05.524740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:25:28.145368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368445+0000","last_change":"2023-05-12T09:09:04.377136+0000","last_active":"2023-05-12T09:09:05.368445+0000","last_peered":"2023-05-12T09:09:05.368445+0000","last_clean":"2023-05-12T09:09:05.368445+0000","last_became_active":"2023-05-12T09:09:04.376865+0000","last_became_peered":"2023-05-12T09:09:04.376865+0000","last_unstale":"2023-05-12T09:09:05.368445+0000","last_undegraded":"2023-05-12T09:09:05.368445+0000","last_fullsized":"2023-05-12T09:09:05.368445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:48:51.992494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524585+0000","last_change":"2023-05-12T09:09:03.890845+0000","last_active":"2023-05-12T09:09:05.524585+0000","last_peered":"2023-05-12T09:09:05.524585+0000","last_clean":"2023-05-12T09:09:05.524585+0000","last_became_active":"2023-05-12T09:09:03.890331+0000","last_became_peered":"2023-05-12T09:09:03.890331+0000","last_unstale":"2023-05-12T09:09:05.524585+0000","last_undegraded":"2023-05-12T09:09:05.524585+0000","last_fullsized":"2023-05-12T09:09:05.524585+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:12:47.563461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526577+0000","last_change":"2023-05-12T09:09:04.384151+0000","last_active":"2023-05-12T09:09:05.526577+0000","last_peered":"2023-05-12T09:09:05.526577+0000","last_clean":"2023-05-12T09:09:05.526577+0000","last_became_active":"2023-05-12T09:09:04.383500+0000","last_became_peered":"2023-05-12T09:09:04.383500+0000","last_unstale":"2023-05-12T09:09:05.526577+0000","last_undegraded":"2023-05-12T09:09:05.526577+0000","last_fullsized":"2023-05-12T09:09:05.526577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:45:09.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526460+0000","last_change":"2023-05-12T09:09:03.903662+0000","last_active":"2023-05-12T09:09:05.526460+0000","last_peered":"2023-05-12T09:09:05.526460+0000","last_clean":"2023-05-12T09:09:05.526460+0000","last_became_active":"2023-05-12T09:09:03.903397+0000","last_became_peered":"2023-05-12T09:09:03.903397+0000","last_unstale":"2023-05-12T09:09:05.526460+0000","last_undegraded":"2023-05-12T09:09:05.526460+0000","last_fullsized":"2023-05-12T09:09:05.526460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:34:25.163055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525765+0000","last_change":"2023-05-12T09:09:04.391085+0000","last_active":"2023-05-12T09:09:05.525765+0000","last_peered":"2023-05-12T09:09:05.525765+0000","last_clean":"2023-05-12T09:09:05.525765+0000","last_became_active":"2023-05-12T09:09:04.390794+0000","last_became_peered":"2023-05-12T09:09:04.390794+0000","last_unstale":"2023-05-12T09:09:05.525765+0000","last_undegraded":"2023-05-12T09:09:05.525765+0000","last_fullsized":"2023-05-12T09:09:05.525765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:00:18.511857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524554+0000","last_change":"2023-05-12T09:09:03.894465+0000","last_active":"2023-05-12T09:09:05.524554+0000","last_peered":"2023-05-12T09:09:05.524554+0000","last_clean":"2023-05-12T09:09:05.524554+0000","last_became_active":"2023-05-12T09:09:03.894109+0000","last_became_peered":"2023-05-12T09:09:03.894109+0000","last_unstale":"2023-05-12T09:09:05.524554+0000","last_undegraded":"2023-05-12T09:09:05.524554+0000","last_fullsized":"2023-05-12T09:09:05.524554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:17:48.837620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369135+0000","last_change":"2023-05-12T09:09:04.382147+0000","last_active":"2023-05-12T09:09:05.369135+0000","last_peered":"2023-05-12T09:09:05.369135+0000","last_clean":"2023-05-12T09:09:05.369135+0000","last_became_active":"2023-05-12T09:09:04.381902+0000","last_became_peered":"2023-05-12T09:09:04.381902+0000","last_unstale":"2023-05-12T09:09:05.369135+0000","last_undegraded":"2023-05-12T09:09:05.369135+0000","last_fullsized":"2023-05-12T09:09:05.369135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:17:49.851641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525876+0000","last_change":"2023-05-12T09:09:03.905365+0000","last_active":"2023-05-12T09:09:05.525876+0000","last_peered":"2023-05-12T09:09:05.525876+0000","last_clean":"2023-05-12T09:09:05.525876+0000","last_became_active":"2023-05-12T09:09:03.905121+0000","last_became_peered":"2023-05-12T09:09:03.905121+0000","last_unstale":"2023-05-12T09:09:05.525876+0000","last_undegraded":"2023-05-12T09:09:05.525876+0000","last_fullsized":"2023-05-12T09:09:05.525876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:37:59.723440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525423+0000","last_change":"2023-05-12T09:09:04.389953+0000","last_active":"2023-05-12T09:09:05.525423+0000","last_peered":"2023-05-12T09:09:05.525423+0000","last_clean":"2023-05-12T09:09:05.525423+0000","last_became_active":"2023-05-12T09:09:04.389660+0000","last_became_peered":"2023-05-12T09:09:04.389660+0000","last_unstale":"2023-05-12T09:09:05.525423+0000","last_undegraded":"2023-05-12T09:09:05.525423+0000","last_fullsized":"2023-05-12T09:09:05.525423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:12:11.321847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370186+0000","last_change":"2023-05-12T09:09:03.903025+0000","last_active":"2023-05-12T09:09:05.370186+0000","last_peered":"2023-05-12T09:09:05.370186+0000","last_clean":"2023-05-12T09:09:05.370186+0000","last_became_active":"2023-05-12T09:09:03.902746+0000","last_became_peered":"2023-05-12T09:09:03.902746+0000","last_unstale":"2023-05-12T09:09:05.370186+0000","last_undegraded":"2023-05-12T09:09:05.370186+0000","last_fullsized":"2023-05-12T09:09:05.370186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:35:59.060606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368500+0000","last_change":"2023-05-12T09:09:04.381403+0000","last_active":"2023-05-12T09:09:05.368500+0000","last_peered":"2023-05-12T09:09:05.368500+0000","last_clean":"2023-05-12T09:09:05.368500+0000","last_became_active":"2023-05-12T09:09:04.381065+0000","last_became_peered":"2023-05-12T09:09:04.381065+0000","last_unstale":"2023-05-12T09:09:05.368500+0000","last_undegraded":"2023-05-12T09:09:05.368500+0000","last_fullsized":"2023-05-12T09:09:05.368500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:39:54.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369012+0000","last_change":"2023-05-12T09:09:03.897457+0000","last_active":"2023-05-12T09:09:05.369012+0000","last_peered":"2023-05-12T09:09:05.369012+0000","last_clean":"2023-05-12T09:09:05.369012+0000","last_became_active":"2023-05-12T09:09:03.897208+0000","last_became_peered":"2023-05-12T09:09:03.897208+0000","last_unstale":"2023-05-12T09:09:05.369012+0000","last_undegraded":"2023-05-12T09:09:05.369012+0000","last_fullsized":"2023-05-12T09:09:05.369012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:36:58.128983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524926+0000","last_change":"2023-05-12T09:09:04.382791+0000","last_active":"2023-05-12T09:09:05.524926+0000","last_peered":"2023-05-12T09:09:05.524926+0000","last_clean":"2023-05-12T09:09:05.524926+0000","last_became_active":"2023-05-12T09:09:04.382364+0000","last_became_peered":"2023-05-12T09:09:04.382364+0000","last_unstale":"2023-05-12T09:09:05.524926+0000","last_undegraded":"2023-05-12T09:09:05.524926+0000","last_fullsized":"2023-05-12T09:09:05.524926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:21:19.580512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525800+0000","last_change":"2023-05-12T09:09:03.901200+0000","last_active":"2023-05-12T09:09:05.525800+0000","last_peered":"2023-05-12T09:09:05.525800+0000","last_clean":"2023-05-12T09:09:05.525800+0000","last_became_active":"2023-05-12T09:09:03.900868+0000","last_became_peered":"2023-05-12T09:09:03.900868+0000","last_unstale":"2023-05-12T09:09:05.525800+0000","last_undegraded":"2023-05-12T09:09:05.525800+0000","last_fullsized":"2023-05-12T09:09:05.525800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:20:48.285000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368613+0000","last_change":"2023-05-12T09:09:04.382637+0000","last_active":"2023-05-12T09:09:05.368613+0000","last_peered":"2023-05-12T09:09:05.368613+0000","last_clean":"2023-05-12T09:09:05.368613+0000","last_became_active":"2023-05-12T09:09:04.381521+0000","last_became_peered":"2023-05-12T09:09:04.381521+0000","last_unstale":"2023-05-12T09:09:05.368613+0000","last_undegraded":"2023-05-12T09:09:05.368613+0000","last_fullsized":"2023-05-12T09:09:05.368613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:52:29.854507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368910+0000","last_change":"2023-05-12T09:09:03.895812+0000","last_active":"2023-05-12T09:09:05.368910+0000","last_peered":"2023-05-12T09:09:05.368910+0000","last_clean":"2023-05-12T09:09:05.368910+0000","last_became_active":"2023-05-12T09:09:03.895537+0000","last_became_peered":"2023-05-12T09:09:03.895537+0000","last_unstale":"2023-05-12T09:09:05.368910+0000","last_undegraded":"2023-05-12T09:09:05.368910+0000","last_fullsized":"2023-05-12T09:09:05.368910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:39:44.374210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525492+0000","last_change":"2023-05-12T09:09:04.380481+0000","last_active":"2023-05-12T09:09:05.525492+0000","last_peered":"2023-05-12T09:09:05.525492+0000","last_clean":"2023-05-12T09:09:05.525492+0000","last_became_active":"2023-05-12T09:09:04.380206+0000","last_became_peered":"2023-05-12T09:09:04.380206+0000","last_unstale":"2023-05-12T09:09:05.525492+0000","last_undegraded":"2023-05-12T09:09:05.525492+0000","last_fullsized":"2023-05-12T09:09:05.525492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:45:27.296866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524659+0000","last_change":"2023-05-12T09:09:03.890886+0000","last_active":"2023-05-12T09:09:05.524659+0000","last_peered":"2023-05-12T09:09:05.524659+0000","last_clean":"2023-05-12T09:09:05.524659+0000","last_became_active":"2023-05-12T09:09:03.890638+0000","last_became_peered":"2023-05-12T09:09:03.890638+0000","last_unstale":"2023-05-12T09:09:05.524659+0000","last_undegraded":"2023-05-12T09:09:05.524659+0000","last_fullsized":"2023-05-12T09:09:05.524659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:39:43.260171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370385+0000","last_change":"2023-05-12T09:09:04.374857+0000","last_active":"2023-05-12T09:09:05.370385+0000","last_peered":"2023-05-12T09:09:05.370385+0000","last_clean":"2023-05-12T09:09:05.370385+0000","last_became_active":"2023-05-12T09:09:04.374612+0000","last_became_peered":"2023-05-12T09:09:04.374612+0000","last_unstale":"2023-05-12T09:09:05.370385+0000","last_undegraded":"2023-05-12T09:09:05.370385+0000","last_fullsized":"2023-05-12T09:09:05.370385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:46:06.115729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370153+0000","last_change":"2023-05-12T09:09:03.897820+0000","last_active":"2023-05-12T09:09:05.370153+0000","last_peered":"2023-05-12T09:09:05.370153+0000","last_clean":"2023-05-12T09:09:05.370153+0000","last_became_active":"2023-05-12T09:09:03.897558+0000","last_became_peered":"2023-05-12T09:09:03.897558+0000","last_unstale":"2023-05-12T09:09:05.370153+0000","last_undegraded":"2023-05-12T09:09:05.370153+0000","last_fullsized":"2023-05-12T09:09:05.370153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T21:03:48.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524585+0000","last_change":"2023-05-12T09:09:04.390060+0000","last_active":"2023-05-12T09:09:05.524585+0000","last_peered":"2023-05-12T09:09:05.524585+0000","last_clean":"2023-05-12T09:09:05.524585+0000","last_became_active":"2023-05-12T09:09:04.389807+0000","last_became_peered":"2023-05-12T09:09:04.389807+0000","last_unstale":"2023-05-12T09:09:05.524585+0000","last_undegraded":"2023-05-12T09:09:05.524585+0000","last_fullsized":"2023-05-12T09:09:05.524585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:56:06.370459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526368+0000","last_change":"2023-05-12T09:09:03.899139+0000","last_active":"2023-05-12T09:09:05.526368+0000","last_peered":"2023-05-12T09:09:05.526368+0000","last_clean":"2023-05-12T09:09:05.526368+0000","last_became_active":"2023-05-12T09:09:03.898851+0000","last_became_peered":"2023-05-12T09:09:03.898851+0000","last_unstale":"2023-05-12T09:09:05.526368+0000","last_undegraded":"2023-05-12T09:09:05.526368+0000","last_fullsized":"2023-05-12T09:09:05.526368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:38:16.015198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368765+0000","last_change":"2023-05-12T09:09:04.384396+0000","last_active":"2023-05-12T09:09:05.368765+0000","last_peered":"2023-05-12T09:09:05.368765+0000","last_clean":"2023-05-12T09:09:05.368765+0000","last_became_active":"2023-05-12T09:09:04.384142+0000","last_became_peered":"2023-05-12T09:09:04.384142+0000","last_unstale":"2023-05-12T09:09:05.368765+0000","last_undegraded":"2023-05-12T09:09:05.368765+0000","last_fullsized":"2023-05-12T09:09:05.368765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:21:56.693727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525174+0000","last_change":"2023-05-12T09:09:03.898664+0000","last_active":"2023-05-12T09:09:05.525174+0000","last_peered":"2023-05-12T09:09:05.525174+0000","last_clean":"2023-05-12T09:09:05.525174+0000","last_became_active":"2023-05-12T09:09:03.898255+0000","last_became_peered":"2023-05-12T09:09:03.898255+0000","last_unstale":"2023-05-12T09:09:05.525174+0000","last_undegraded":"2023-05-12T09:09:05.525174+0000","last_fullsized":"2023-05-12T09:09:05.525174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:58:20.540454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368861+0000","last_change":"2023-05-12T09:09:04.381374+0000","last_active":"2023-05-12T09:09:05.368861+0000","last_peered":"2023-05-12T09:09:05.368861+0000","last_clean":"2023-05-12T09:09:05.368861+0000","last_became_active":"2023-05-12T09:09:04.380322+0000","last_became_peered":"2023-05-12T09:09:04.380322+0000","last_unstale":"2023-05-12T09:09:05.368861+0000","last_undegraded":"2023-05-12T09:09:05.368861+0000","last_fullsized":"2023-05-12T09:09:05.368861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:15:07.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369267+0000","last_change":"2023-05-12T09:09:03.901336+0000","last_active":"2023-05-12T09:09:05.369267+0000","last_peered":"2023-05-12T09:09:05.369267+0000","last_clean":"2023-05-12T09:09:05.369267+0000","last_became_active":"2023-05-12T09:09:03.901093+0000","last_became_peered":"2023-05-12T09:09:03.901093+0000","last_unstale":"2023-05-12T09:09:05.369267+0000","last_undegraded":"2023-05-12T09:09:05.369267+0000","last_fullsized":"2023-05-12T09:09:05.369267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:30:46.428353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368740+0000","last_change":"2023-05-12T09:09:04.380397+0000","last_active":"2023-05-12T09:09:05.368740+0000","last_peered":"2023-05-12T09:09:05.368740+0000","last_clean":"2023-05-12T09:09:05.368740+0000","last_became_active":"2023-05-12T09:09:04.379830+0000","last_became_peered":"2023-05-12T09:09:04.379830+0000","last_unstale":"2023-05-12T09:09:05.368740+0000","last_undegraded":"2023-05-12T09:09:05.368740+0000","last_fullsized":"2023-05-12T09:09:05.368740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:59:53.543221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369124+0000","last_change":"2023-05-12T09:09:03.903743+0000","last_active":"2023-05-12T09:09:05.369124+0000","last_peered":"2023-05-12T09:09:05.369124+0000","last_clean":"2023-05-12T09:09:05.369124+0000","last_became_active":"2023-05-12T09:09:03.903330+0000","last_became_peered":"2023-05-12T09:09:03.903330+0000","last_unstale":"2023-05-12T09:09:05.369124+0000","last_undegraded":"2023-05-12T09:09:05.369124+0000","last_fullsized":"2023-05-12T09:09:05.369124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:25:13.658831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524340+0000","last_change":"2023-05-12T09:09:04.390802+0000","last_active":"2023-05-12T09:09:05.524340+0000","last_peered":"2023-05-12T09:09:05.524340+0000","last_clean":"2023-05-12T09:09:05.524340+0000","last_became_active":"2023-05-12T09:09:04.390550+0000","last_became_peered":"2023-05-12T09:09:04.390550+0000","last_unstale":"2023-05-12T09:09:05.524340+0000","last_undegraded":"2023-05-12T09:09:05.524340+0000","last_fullsized":"2023-05-12T09:09:05.524340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:09:30.637918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525360+0000","last_change":"2023-05-12T09:09:03.893986+0000","last_active":"2023-05-12T09:09:05.525360+0000","last_peered":"2023-05-12T09:09:05.525360+0000","last_clean":"2023-05-12T09:09:05.525360+0000","last_became_active":"2023-05-12T09:09:03.893664+0000","last_became_peered":"2023-05-12T09:09:03.893664+0000","last_unstale":"2023-05-12T09:09:05.525360+0000","last_undegraded":"2023-05-12T09:09:05.525360+0000","last_fullsized":"2023-05-12T09:09:05.525360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:12:10.319636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.370400+0000","last_change":"2023-05-12T09:09:04.376696+0000","last_active":"2023-05-12T09:09:05.370400+0000","last_peered":"2023-05-12T09:09:05.370400+0000","last_clean":"2023-05-12T09:09:05.370400+0000","last_became_active":"2023-05-12T09:09:04.376435+0000","last_became_peered":"2023-05-12T09:09:04.376435+0000","last_unstale":"2023-05-12T09:09:05.370400+0000","last_undegraded":"2023-05-12T09:09:05.370400+0000","last_fullsized":"2023-05-12T09:09:05.370400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:12:12.470939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.523968+0000","last_change":"2023-05-12T09:09:03.901825+0000","last_active":"2023-05-12T09:09:05.523968+0000","last_peered":"2023-05-12T09:09:05.523968+0000","last_clean":"2023-05-12T09:09:05.523968+0000","last_became_active":"2023-05-12T09:09:03.901534+0000","last_became_peered":"2023-05-12T09:09:03.901534+0000","last_unstale":"2023-05-12T09:09:05.523968+0000","last_undegraded":"2023-05-12T09:09:05.523968+0000","last_fullsized":"2023-05-12T09:09:05.523968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:25:06.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524134+0000","last_change":"2023-05-12T09:09:04.378833+0000","last_active":"2023-05-12T09:09:05.524134+0000","last_peered":"2023-05-12T09:09:05.524134+0000","last_clean":"2023-05-12T09:09:05.524134+0000","last_became_active":"2023-05-12T09:09:04.378581+0000","last_became_peered":"2023-05-12T09:09:04.378581+0000","last_unstale":"2023-05-12T09:09:05.524134+0000","last_undegraded":"2023-05-12T09:09:05.524134+0000","last_fullsized":"2023-05-12T09:09:05.524134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:30:43.070773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525362+0000","last_change":"2023-05-12T09:09:03.901768+0000","last_active":"2023-05-12T09:09:05.525362+0000","last_peered":"2023-05-12T09:09:05.525362+0000","last_clean":"2023-05-12T09:09:05.525362+0000","last_became_active":"2023-05-12T09:09:03.901487+0000","last_became_peered":"2023-05-12T09:09:03.901487+0000","last_unstale":"2023-05-12T09:09:05.525362+0000","last_undegraded":"2023-05-12T09:09:05.525362+0000","last_fullsized":"2023-05-12T09:09:05.525362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:59:38.779581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369027+0000","last_change":"2023-05-12T09:09:04.384765+0000","last_active":"2023-05-12T09:09:05.369027+0000","last_peered":"2023-05-12T09:09:05.369027+0000","last_clean":"2023-05-12T09:09:05.369027+0000","last_became_active":"2023-05-12T09:09:04.384491+0000","last_became_peered":"2023-05-12T09:09:04.384491+0000","last_unstale":"2023-05-12T09:09:05.369027+0000","last_undegraded":"2023-05-12T09:09:05.369027+0000","last_fullsized":"2023-05-12T09:09:05.369027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T19:32:26.625036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526405+0000","last_change":"2023-05-12T09:09:03.906251+0000","last_active":"2023-05-12T09:09:05.526405+0000","last_peered":"2023-05-12T09:09:05.526405+0000","last_clean":"2023-05-12T09:09:05.526405+0000","last_became_active":"2023-05-12T09:09:03.905973+0000","last_became_peered":"2023-05-12T09:09:03.905973+0000","last_unstale":"2023-05-12T09:09:05.526405+0000","last_undegraded":"2023-05-12T09:09:05.526405+0000","last_fullsized":"2023-05-12T09:09:05.526405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:16:05.219780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526390+0000","last_change":"2023-05-12T09:07:04.835422+0000","last_active":"2023-05-12T09:09:05.526390+0000","last_peered":"2023-05-12T09:09:05.526390+0000","last_clean":"2023-05-12T09:09:05.526390+0000","last_became_active":"2023-05-12T09:07:04.834944+0000","last_became_peered":"2023-05-12T09:07:04.834944+0000","last_unstale":"2023-05-12T09:09:05.526390+0000","last_undegraded":"2023-05-12T09:09:05.526390+0000","last_fullsized":"2023-05-12T09:09:05.526390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:16:54.117136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368876+0000","last_change":"2023-05-12T09:09:04.380062+0000","last_active":"2023-05-12T09:09:05.368876+0000","last_peered":"2023-05-12T09:09:05.368876+0000","last_clean":"2023-05-12T09:09:05.368876+0000","last_became_active":"2023-05-12T09:09:04.379288+0000","last_became_peered":"2023-05-12T09:09:04.379288+0000","last_unstale":"2023-05-12T09:09:05.368876+0000","last_undegraded":"2023-05-12T09:09:05.368876+0000","last_fullsized":"2023-05-12T09:09:05.368876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:15:56.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525221+0000","last_change":"2023-05-12T09:09:03.903511+0000","last_active":"2023-05-12T09:09:05.525221+0000","last_peered":"2023-05-12T09:09:05.525221+0000","last_clean":"2023-05-12T09:09:05.525221+0000","last_became_active":"2023-05-12T09:09:03.903240+0000","last_became_peered":"2023-05-12T09:09:03.903240+0000","last_unstale":"2023-05-12T09:09:05.525221+0000","last_undegraded":"2023-05-12T09:09:05.525221+0000","last_fullsized":"2023-05-12T09:09:05.525221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:58:20.540454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369345+0000","last_change":"2023-05-12T09:07:04.828759+0000","last_active":"2023-05-12T09:09:05.369345+0000","last_peered":"2023-05-12T09:09:05.369345+0000","last_clean":"2023-05-12T09:09:05.369345+0000","last_became_active":"2023-05-12T09:07:04.828460+0000","last_became_peered":"2023-05-12T09:07:04.828460+0000","last_unstale":"2023-05-12T09:09:05.369345+0000","last_undegraded":"2023-05-12T09:09:05.369345+0000","last_fullsized":"2023-05-12T09:09:05.369345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:42:51.123407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525570+0000","last_change":"2023-05-12T09:09:04.385569+0000","last_active":"2023-05-12T09:09:05.525570+0000","last_peered":"2023-05-12T09:09:05.525570+0000","last_clean":"2023-05-12T09:09:05.525570+0000","last_became_active":"2023-05-12T09:09:04.385303+0000","last_became_peered":"2023-05-12T09:09:04.385303+0000","last_unstale":"2023-05-12T09:09:05.525570+0000","last_undegraded":"2023-05-12T09:09:05.525570+0000","last_fullsized":"2023-05-12T09:09:05.525570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T09:50:39.189696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524112+0000","last_change":"2023-05-12T09:09:03.893141+0000","last_active":"2023-05-12T09:09:05.524112+0000","last_peered":"2023-05-12T09:09:05.524112+0000","last_clean":"2023-05-12T09:09:05.524112+0000","last_became_active":"2023-05-12T09:09:03.892854+0000","last_became_peered":"2023-05-12T09:09:03.892854+0000","last_unstale":"2023-05-12T09:09:05.524112+0000","last_undegraded":"2023-05-12T09:09:05.524112+0000","last_fullsized":"2023-05-12T09:09:05.524112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T17:11:47.896590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524404+0000","last_change":"2023-05-12T09:07:04.830658+0000","last_active":"2023-05-12T09:09:05.524404+0000","last_peered":"2023-05-12T09:09:05.524404+0000","last_clean":"2023-05-12T09:09:05.524404+0000","last_became_active":"2023-05-12T09:07:04.830354+0000","last_became_peered":"2023-05-12T09:07:04.830354+0000","last_unstale":"2023-05-12T09:09:05.524404+0000","last_undegraded":"2023-05-12T09:09:05.524404+0000","last_fullsized":"2023-05-12T09:09:05.524404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T12:23:29.091315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":196,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525733+0000","last_change":"2023-05-12T09:07:04.830850+0000","last_active":"2023-05-12T09:09:05.525733+0000","last_peered":"2023-05-12T09:09:05.525733+0000","last_clean":"2023-05-12T09:09:05.525733+0000","last_became_active":"2023-05-12T09:07:04.829577+0000","last_became_peered":"2023-05-12T09:07:04.829577+0000","last_unstale":"2023-05-12T09:09:05.525733+0000","last_undegraded":"2023-05-12T09:09:05.525733+0000","last_fullsized":"2023-05-12T09:09:05.525733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:46:41.946248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524448+0000","last_change":"2023-05-12T09:09:04.376636+0000","last_active":"2023-05-12T09:09:05.524448+0000","last_peered":"2023-05-12T09:09:05.524448+0000","last_clean":"2023-05-12T09:09:05.524448+0000","last_became_active":"2023-05-12T09:09:04.376295+0000","last_became_peered":"2023-05-12T09:09:04.376295+0000","last_unstale":"2023-05-12T09:09:05.524448+0000","last_undegraded":"2023-05-12T09:09:05.524448+0000","last_fullsized":"2023-05-12T09:09:05.524448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:13:29.117504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525692+0000","last_change":"2023-05-12T09:09:03.905707+0000","last_active":"2023-05-12T09:09:05.525692+0000","last_peered":"2023-05-12T09:09:05.525692+0000","last_clean":"2023-05-12T09:09:05.525692+0000","last_became_active":"2023-05-12T09:09:03.905248+0000","last_became_peered":"2023-05-12T09:09:03.905248+0000","last_unstale":"2023-05-12T09:09:05.525692+0000","last_undegraded":"2023-05-12T09:09:05.525692+0000","last_fullsized":"2023-05-12T09:09:05.525692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:43:52.608003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525802+0000","last_change":"2023-05-12T09:07:05.258677+0000","last_active":"2023-05-12T09:09:05.525802+0000","last_peered":"2023-05-12T09:09:05.525802+0000","last_clean":"2023-05-12T09:09:05.525802+0000","last_became_active":"2023-05-12T09:07:05.258372+0000","last_became_peered":"2023-05-12T09:07:05.258372+0000","last_unstale":"2023-05-12T09:09:05.525802+0000","last_undegraded":"2023-05-12T09:09:05.525802+0000","last_fullsized":"2023-05-12T09:09:05.525802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T13:52:23.669645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524466+0000","last_change":"2023-05-12T09:09:04.382374+0000","last_active":"2023-05-12T09:09:05.524466+0000","last_peered":"2023-05-12T09:09:05.524466+0000","last_clean":"2023-05-12T09:09:05.524466+0000","last_became_active":"2023-05-12T09:09:04.381904+0000","last_became_peered":"2023-05-12T09:09:04.381904+0000","last_unstale":"2023-05-12T09:09:05.524466+0000","last_undegraded":"2023-05-12T09:09:05.524466+0000","last_fullsized":"2023-05-12T09:09:05.524466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T14:28:32.168752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525239+0000","last_change":"2023-05-12T09:09:03.899235+0000","last_active":"2023-05-12T09:09:05.525239+0000","last_peered":"2023-05-12T09:09:05.525239+0000","last_clean":"2023-05-12T09:09:05.525239+0000","last_became_active":"2023-05-12T09:09:03.898956+0000","last_became_peered":"2023-05-12T09:09:03.898956+0000","last_unstale":"2023-05-12T09:09:05.525239+0000","last_undegraded":"2023-05-12T09:09:05.525239+0000","last_fullsized":"2023-05-12T09:09:05.525239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:51:40.122290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.525574+0000","last_change":"2023-05-12T09:07:05.258599+0000","last_active":"2023-05-12T09:09:05.525574+0000","last_peered":"2023-05-12T09:09:05.525574+0000","last_clean":"2023-05-12T09:09:05.525574+0000","last_became_active":"2023-05-12T09:07:05.258301+0000","last_became_peered":"2023-05-12T09:07:05.258301+0000","last_unstale":"2023-05-12T09:09:05.525574+0000","last_undegraded":"2023-05-12T09:09:05.525574+0000","last_fullsized":"2023-05-12T09:09:05.525574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:23:06.374371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368946+0000","last_change":"2023-05-12T09:09:04.381452+0000","last_active":"2023-05-12T09:09:05.368946+0000","last_peered":"2023-05-12T09:09:05.368946+0000","last_clean":"2023-05-12T09:09:05.368946+0000","last_became_active":"2023-05-12T09:09:04.381113+0000","last_became_peered":"2023-05-12T09:09:04.381113+0000","last_unstale":"2023-05-12T09:09:05.368946+0000","last_undegraded":"2023-05-12T09:09:05.368946+0000","last_fullsized":"2023-05-12T09:09:05.368946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T16:22:44.120344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369174+0000","last_change":"2023-05-12T09:09:03.899586+0000","last_active":"2023-05-12T09:09:05.369174+0000","last_peered":"2023-05-12T09:09:05.369174+0000","last_clean":"2023-05-12T09:09:05.369174+0000","last_became_active":"2023-05-12T09:09:03.898726+0000","last_became_peered":"2023-05-12T09:09:03.898726+0000","last_unstale":"2023-05-12T09:09:05.369174+0000","last_undegraded":"2023-05-12T09:09:05.369174+0000","last_fullsized":"2023-05-12T09:09:05.369174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:25:21.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524903+0000","last_change":"2023-05-12T09:07:05.258734+0000","last_active":"2023-05-12T09:09:05.524903+0000","last_peered":"2023-05-12T09:09:05.524903+0000","last_clean":"2023-05-12T09:09:05.524903+0000","last_became_active":"2023-05-12T09:07:05.258376+0000","last_became_peered":"2023-05-12T09:07:05.258376+0000","last_unstale":"2023-05-12T09:09:05.524903+0000","last_undegraded":"2023-05-12T09:09:05.524903+0000","last_fullsized":"2023-05-12T09:09:05.524903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T10:41:56.919026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524689+0000","last_change":"2023-05-12T09:09:04.390568+0000","last_active":"2023-05-12T09:09:05.524689+0000","last_peered":"2023-05-12T09:09:05.524689+0000","last_clean":"2023-05-12T09:09:05.524689+0000","last_became_active":"2023-05-12T09:09:04.390297+0000","last_became_peered":"2023-05-12T09:09:04.390297+0000","last_unstale":"2023-05-12T09:09:05.524689+0000","last_undegraded":"2023-05-12T09:09:05.524689+0000","last_fullsized":"2023-05-12T09:09:05.524689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:33:02.395196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524374+0000","last_change":"2023-05-12T09:09:03.900665+0000","last_active":"2023-05-12T09:09:05.524374+0000","last_peered":"2023-05-12T09:09:05.524374+0000","last_clean":"2023-05-12T09:09:05.524374+0000","last_became_active":"2023-05-12T09:09:03.900368+0000","last_became_peered":"2023-05-12T09:09:03.900368+0000","last_unstale":"2023-05-12T09:09:05.524374+0000","last_undegraded":"2023-05-12T09:09:05.524374+0000","last_fullsized":"2023-05-12T09:09:05.524374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T15:33:01.392985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.368892+0000","last_change":"2023-05-12T09:07:05.258598+0000","last_active":"2023-05-12T09:09:05.368892+0000","last_peered":"2023-05-12T09:09:05.368892+0000","last_clean":"2023-05-12T09:09:05.368892+0000","last_became_active":"2023-05-12T09:07:05.258280+0000","last_became_peered":"2023-05-12T09:07:05.258280+0000","last_unstale":"2023-05-12T09:09:05.368892+0000","last_undegraded":"2023-05-12T09:09:05.368892+0000","last_fullsized":"2023-05-12T09:09:05.368892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:42:55.160903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.526161+0000","last_change":"2023-05-12T09:09:04.388652+0000","last_active":"2023-05-12T09:09:05.526161+0000","last_peered":"2023-05-12T09:09:05.526161+0000","last_clean":"2023-05-12T09:09:05.526161+0000","last_became_active":"2023-05-12T09:09:04.388400+0000","last_became_peered":"2023-05-12T09:09:04.388400+0000","last_unstale":"2023-05-12T09:09:05.526161+0000","last_undegraded":"2023-05-12T09:09:05.526161+0000","last_fullsized":"2023-05-12T09:09:05.526161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:03.871566+0000","last_clean_scrub_stamp":"2023-05-12T09:09:03.871566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T18:18:11.110214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.524691+0000","last_change":"2023-05-12T09:09:03.896427+0000","last_active":"2023-05-12T09:09:05.524691+0000","last_peered":"2023-05-12T09:09:05.524691+0000","last_clean":"2023-05-12T09:09:05.524691+0000","last_became_active":"2023-05-12T09:09:03.896191+0000","last_became_peered":"2023-05-12T09:09:03.896191+0000","last_unstale":"2023-05-12T09:09:05.524691+0000","last_undegraded":"2023-05-12T09:09:05.524691+0000","last_fullsized":"2023-05-12T09:09:05.524691+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:09:02.869355+0000","last_clean_scrub_stamp":"2023-05-12T09:09:02.869355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T20:54:12.262920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-12T09:09:05.369069+0000","last_change":"2023-05-12T09:07:04.830787+0000","last_active":"2023-05-12T09:09:05.369069+0000","last_peered":"2023-05-12T09:09:05.369069+0000","last_clean":"2023-05-12T09:09:05.369069+0000","last_became_active":"2023-05-12T09:07:04.830492+0000","last_became_peered":"2023-05-12T09:07:04.830492+0000","last_unstale":"2023-05-12T09:09:05.369069+0000","last_undegraded":"2023-05-12T09:09:05.369069+0000","last_fullsized":"2023-05-12T09:09:05.369069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-12T09:07:03.815302+0000","last_clean_scrub_stamp":"2023-05-12T09:07:03.815302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-13T11:42:22.913281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9736,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362104,"statfs":{"total":96636764160,"available":96626794496,"internally_reserved":0,"allocated":1048576,"data_stored":794063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.78400000000000003}]},{"osd":1,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.4560000000000004,"5min":4.4560000000000004,"15min":4.4560000000000004},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5620000000000003,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri May 12 09:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8580,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363260,"statfs":{"total":96636764160,"available":96627978240,"internally_reserved":0,"allocated":454656,"data_stored":202916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":6.9550000000000001,"5min":6.9550000000000001,"15min":6.9550000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.9370000000000003,"5min":5.9370000000000003,"15min":5.9370000000000003},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":7.024,"5min":7.024,"15min":7.024},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.96,"5min":5.96,"15min":5.96},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.41899999999999998}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.62},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9736,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362104,"statfs":{"total":96636764160,"available":96626794496,"internally_reserved":0,"allocated":1048576,"data_stored":794043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.436,"15min":0.44600000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54000000000000004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65100000000000002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.51300000000000001,"15min":0.52500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59799999999999998,"5min":1.75,"15min":1.75},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.60899999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.437}]},{"osd":3,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.58299999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.63500000000000001,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.5}]},{"osd":4,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82899999999999996,"15min":0.84299999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.62},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98599999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.82199999999999995,"15min":0.83999999999999997},"min":{"1min":0.52300000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.89400000000000002,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97499999999999998,"5min":1.806,"15min":1.806},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1,"5min":1.857,"15min":1.857},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95099999999999996,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0469999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8708,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363132,"statfs":{"total":96636764160,"available":96627847168,"internally_reserved":0,"allocated":454656,"data_stored":203639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.68600000000000005,"15min":0.73599999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.311},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.84499999999999997,"15min":0.91500000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.55600000000000005,"5min":11.914,"15min":11.914},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.73799999999999999,"15min":0.78600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.56499999999999995,"15min":0.58499999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69499999999999995,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.90100000000000002,"15min":0.97899999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.56299999999999994,"5min":12.064,"15min":12.064},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.76900000000000002,"15min":0.81499999999999995},"min":{"1min":0.438,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61599999999999999,"5min":6.7229999999999999,"15min":6.7229999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85899999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":1.129,"15min":1.2050000000000001},"min":{"1min":0.46899999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84299999999999997,"5min":12.034000000000001,"15min":12.034000000000001},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.97399999999999998,"15min":1.0249999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.81499999999999995,"5min":6.7910000000000004,"15min":6.7910000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84999999999999998,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":1.3440000000000001,"15min":1.458},"min":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.80800000000000005,"5min":11.968,"15min":11.968},"last":0.625},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.99399999999999999,"15min":1.044},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.84399999999999997,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri May 12 09:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.95099999999999996,"15min":0.995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.88600000000000001,"5min":6.867,"15min":6.867},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":1.151,"15min":1.2290000000000001},"min":{"1min":0.56599999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.86299999999999999,"5min":12.004,"15min":12.004},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8524,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363316,"statfs":{"total":96636764160,"available":96628035584,"internally_reserved":0,"allocated":462848,"data_stored":203830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54700000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.433},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.307,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60899999999999999,"5min":1.01,"15min":1.01},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.441,"15min":0.442},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66300000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.57399999999999995,"5min":1.216,"15min":1.216},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.29,"15min":1.29},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1100000000000001,"5min":1.371,"15min":1.371},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.147,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.01,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.80600000000000005,"15min":0.81599999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.179,"15min":1.179},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri May 12 09:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0640000000000001,"5min":1.413,"15min":1.413},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.82199999999999995,"15min":0.83099999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0489999999999999,"5min":1.262,"15min":1.262},"last":0.627}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8716,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363124,"statfs":{"total":96636764160,"available":96627838976,"internally_reserved":0,"allocated":462848,"data_stored":204243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.40500000000000003}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.62}]},{"osd":4,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8716,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363124,"statfs":{"total":96636764160,"available":96627838976,"internally_reserved":0,"allocated":462848,"data_stored":205169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":8.7530000000000001,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":8.7710000000000008,"5min":8.7710000000000008,"15min":8.7710000000000008},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.5090000000000003,"5min":4.5090000000000003,"15min":4.5090000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.626},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.532,"5min":4.532,"15min":4.532},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.499},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53300000000000003}]},{"osd":6,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67600000000000005}]},{"osd":7,"last update":"Fri May 12 09:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8576,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363264,"statfs":{"total":96636764160,"available":96627982336,"internally_reserved":0,"allocated":450560,"data_stored":202314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.64000000000000001,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71199999999999997,"5min":1.159,"15min":1.159},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.67300000000000004},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.748,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.47599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.879,"5min":1.597,"15min":1.597},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79400000000000004,"5min":1.431,"15min":1.431},"last":0.752},{"interface":"front","average":{"1min":0.627,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89300000000000002,"5min":1.53,"15min":1.53},"last":0.89000000000000001}]},{"osd":3,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.80200000000000005,"15min":0.82599999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.83799999999999997,"5min":1.333,"15min":1.333},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.78700000000000003,"5min":1.649,"15min":1.649},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86799999999999999,"5min":1.532,"15min":1.532},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68899999999999995,"15min":0.69599999999999995},"min":{"1min":0.441,"5min":0.436,"15min":0.436},"max":{"1min":0.872,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.90400000000000003,"5min":1.708,"15min":1.708},"last":0.90400000000000003}]},{"osd":7,"last update":"Fri May 12 09:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.745},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90100000000000002,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.871},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91400000000000003,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-12T09:09:14.115 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-12T09:09:14.116 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-12T09:09:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.337+0000 7fef7e3ff700 1 Processor -- start 2023-05-12T09:09:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.337+0000 7fef7e3ff700 1 -- start start 2023-05-12T09:09:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.338+0000 7fef7e3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 0x7fef78070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.338+0000 7fef7e3ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fef78071030 0x7fef7806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.338+0000 7fef7e3ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef780cb280 con 0x7fef7815a5a0 2023-05-12T09:09:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.338+0000 7fef7e3ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7815a970 con 0x7fef78071030 2023-05-12T09:09:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.338+0000 7fef7e3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef780714b0 con 0x7fef7806aaf0 2023-05-12T09:09:14.342 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.339+0000 7fef777fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 0x7fef78070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.339+0000 7fef7c99c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fef78071030 0x7fef7806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.339+0000 7fef777fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 0x7fef78070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.116:52400/0 (socket says 172.21.15.116:52400) 2023-05-12T09:09:14.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.339+0000 7fef777fe700 1 -- 172.21.15.116:0/2852684741 learned_addr learned my addr 172.21.15.116:0/2852684741 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:14.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.339+0000 7fef777fe700 1 -- 172.21.15.116:0/2852684741 >> v2:172.21.15.182:3300/0 conn(0x7fef78071030 msgr2=0x7fef7806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:14.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.339+0000 7fef777fe700 1 --2- 172.21.15.116:0/2852684741 >> v2:172.21.15.182:3300/0 conn(0x7fef78071030 0x7fef7806d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.343 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.339+0000 7fef777fe700 1 -- 172.21.15.116:0/2852684741 >> v1:172.21.15.182:6789/0 conn(0x7fef7815a5a0 legacy=0x7fef7806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.339+0000 7fef777fe700 1 -- 172.21.15.116:0/2852684741 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78071700 con 0x7fef7806aaf0 2023-05-12T09:09:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.339+0000 7fef7c99c700 1 --2- 172.21.15.116:0/2852684741 >> v2:172.21.15.182:3300/0 conn(0x7fef78071030 0x7fef7806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:09:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.339+0000 7fef777fe700 1 --2- 172.21.15.116:0/2852684741 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 0x7fef78070af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef6c006fd0 tx=0x7fef6c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a770cff8210abea1 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef76ffd700 1 -- 172.21.15.116:0/2852684741 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c005e30 con 0x7fef7806aaf0 2023-05-12T09:09:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef76ffd700 1 -- 172.21.15.116:0/2852684741 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c004030 con 0x7fef7806aaf0 2023-05-12T09:09:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef76ffd700 1 -- 172.21.15.116:0/2852684741 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0043e0 con 0x7fef7806aaf0 2023-05-12T09:09:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef7e3ff700 1 -- 172.21.15.116:0/2852684741 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 msgr2=0x7fef78070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef7e3ff700 1 --2- 172.21.15.116:0/2852684741 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 0x7fef78070af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef6c006fd0 tx=0x7fef6c009bd0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef7e3ff700 1 -- 172.21.15.116:0/2852684741 shutdown_connections 2023-05-12T09:09:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef7e3ff700 1 --2- 172.21.15.116:0/2852684741 >> v2:172.21.15.182:3300/0 conn(0x7fef78071030 0x7fef7806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef7e3ff700 1 --2- 172.21.15.116:0/2852684741 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 0x7fef78070af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef7e3ff700 1 -- 172.21.15.116:0/2852684741 >> 172.21.15.116:0/2852684741 conn(0x7fef780cf720 msgr2=0x7fef780cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef7e3ff700 1 -- 172.21.15.116:0/2852684741 shutdown_connections 2023-05-12T09:09:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.340+0000 7fef7e3ff700 1 -- 172.21.15.116:0/2852684741 wait complete. 2023-05-12T09:09:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.342+0000 7fef7e3ff700 1 Processor -- start 2023-05-12T09:09:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.342+0000 7fef7e3ff700 1 -- start start 2023-05-12T09:09:14.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.343+0000 7fef7e3ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 0x7fef780b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.343+0000 7fef7e3ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef78071030 0x7fef7815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.343+0000 7fef7e3ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef7815a5a0 0x7fef780b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.348 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.343+0000 7fef7e3ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7815d500 con 0x7fef78071030 2023-05-12T09:09:14.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.343+0000 7fef7e3ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef780b1fa0 con 0x7fef7815a5a0 2023-05-12T09:09:14.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.343+0000 7fef7e3ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef780b2280 con 0x7fef7806aaf0 2023-05-12T09:09:14.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.343+0000 7fef777fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef78071030 0x7fef7815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.343+0000 7fef777fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef78071030 0x7fef7815cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49746/0 (socket says 172.21.15.116:49746) 2023-05-12T09:09:14.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.343+0000 7fef777fe700 1 -- 172.21.15.116:0/3815855214 learned_addr learned my addr 172.21.15.116:0/3815855214 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:14.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef77fff700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 0x7fef780b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef7c99c700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef7815a5a0 0x7fef780b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.349 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef777fe700 1 -- 172.21.15.116:0/3815855214 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 msgr2=0x7fef780b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef777fe700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 0x7fef780b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef777fe700 1 -- 172.21.15.116:0/3815855214 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef7815a5a0 msgr2=0x7fef780b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef777fe700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef7815a5a0 0x7fef780b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef777fe700 1 -- 172.21.15.116:0/3815855214 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70009a70 con 0x7fef78071030 2023-05-12T09:09:14.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef777fe700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef78071030 0x7fef7815cfc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009c10 tx=0x7fef6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:14.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef74ff9700 1 -- 172.21.15.116:0/3815855214 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c003dd0 con 0x7fef78071030 2023-05-12T09:09:14.350 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef74ff9700 1 -- 172.21.15.116:0/3815855214 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c01c420 con 0x7fef78071030 2023-05-12T09:09:14.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef7e3ff700 1 -- 172.21.15.116:0/3815855214 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c009500 con 0x7fef78071030 2023-05-12T09:09:14.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef74ff9700 1 -- 172.21.15.116:0/3815855214 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c01c7b0 con 0x7fef78071030 2023-05-12T09:09:14.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.344+0000 7fef7e3ff700 1 -- 172.21.15.116:0/3815855214 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7806c6c0 con 0x7fef78071030 2023-05-12T09:09:14.351 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.345+0000 7fef7e3ff700 1 -- 172.21.15.116:0/3815855214 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef780719e0 con 0x7fef78071030 2023-05-12T09:09:14.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.346+0000 7fef74ff9700 1 -- 172.21.15.116:0/3815855214 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef6c01c910 con 0x7fef78071030 2023-05-12T09:09:14.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.347+0000 7fef74ff9700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef6406ace0 0x7fef6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.347+0000 7fef74ff9700 1 -- 172.21.15.116:0/3815855214 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fef6c08a6e0 con 0x7fef78071030 2023-05-12T09:09:14.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.347+0000 7fef77fff700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef6406ace0 0x7fef6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.352 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.348+0000 7fef77fff700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef6406ace0 0x7fef6406d190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fef68000f60 tx=0x7fef68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:14.354 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.351+0000 7fef74ff9700 1 -- 172.21.15.116:0/3815855214 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fef6c055640 con 0x7fef78071030 2023-05-12T09:09:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.620+0000 7fef7e3ff700 1 -- 172.21.15.116:0/3815855214 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fef7806c9a0 con 0x7fef78071030 2023-05-12T09:09:14.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.625+0000 7fef74ff9700 1 -- 172.21.15.116:0/3815855214 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fef6c058c60 con 0x7fef78071030 2023-05-12T09:09:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 -- 172.21.15.116:0/3815855214 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef6406ace0 msgr2=0x7fef6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef6406ace0 0x7fef6406d190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fef68000f60 tx=0x7fef68009040 comp rx=0 tx=0).stop 2023-05-12T09:09:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 -- 172.21.15.116:0/3815855214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef78071030 msgr2=0x7fef7815cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef78071030 0x7fef7815cfc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009c10 tx=0x7fef6c004750 comp rx=0 tx=0).stop 2023-05-12T09:09:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 -- 172.21.15.116:0/3815855214 shutdown_connections 2023-05-12T09:09:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fef7815a5a0 0x7fef780b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fef6406ace0 0x7fef6406d190 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fef7806aaf0 0x7fef780b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 --2- 172.21.15.116:0/3815855214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef78071030 0x7fef7815cfc0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 -- 172.21.15.116:0/3815855214 >> 172.21.15.116:0/3815855214 conn(0x7fef780cf720 msgr2=0x7fef7806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 -- 172.21.15.116:0/3815855214 shutdown_connections 2023-05-12T09:09:14.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.627+0000 7fef7e3ff700 1 -- 172.21.15.116:0/3815855214 wait complete. 2023-05-12T09:09:14.632 INFO:teuthology.orchestra.run.smithi116.stderr:updated caps for client.0 2023-05-12T09:09:14.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-12T09:09:14.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.830+0000 7ff7825ff700 1 Processor -- start 2023-05-12T09:09:14.833 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.830+0000 7ff7825ff700 1 -- start start 2023-05-12T09:09:14.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.831+0000 7ff7825ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c0b87a0 0x7ff77c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.831+0000 7ff7825ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff77c1601e0 0x7ff77c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.831+0000 7ff7825ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c160ff0 con 0x7ff77c160b70 2023-05-12T09:09:14.834 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.831+0000 7ff7825ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c0d02d0 con 0x7ff77c1601e0 2023-05-12T09:09:14.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.831+0000 7ff7825ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0d0cb0 con 0x7ff77c0b87a0 2023-05-12T09:09:14.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.831+0000 7ff780b9c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff77c160b70 0x7ff77c0d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:57398/0 (socket says 172.21.15.116:57398) 2023-05-12T09:09:14.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.831+0000 7ff780b9c700 1 -- 172.21.15.116:0/3200388067 learned_addr learned my addr 172.21.15.116:0/3200388067 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:14.835 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.831+0000 7ff773fff700 1 --2- 172.21.15.116:0/3200388067 >> v2:172.21.15.116:3300/0 conn(0x7ff77c1601e0 0x7ff77c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.836 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff77bfff700 1 --2- 172.21.15.116:0/3200388067 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c0b87a0 0x7ff77c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff77b7fe700 1 -- 172.21.15.116:0/3200388067 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714590242 0 0) 0x7ff77c160ff0 con 0x7ff77c160b70 2023-05-12T09:09:14.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff77b7fe700 1 -- 172.21.15.116:0/3200388067 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7680035b0 con 0x7ff77c160b70 2023-05-12T09:09:14.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff773fff700 1 -- 172.21.15.116:0/3200388067 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c0b87a0 msgr2=0x7ff77c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:14.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff773fff700 1 --2- 172.21.15.116:0/3200388067 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c0b87a0 0x7ff77c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff773fff700 1 -- 172.21.15.116:0/3200388067 >> v1:172.21.15.116:6789/0 conn(0x7ff77c160b70 legacy=0x7ff77c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff773fff700 1 -- 172.21.15.116:0/3200388067 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c0cdc60 con 0x7ff77c1601e0 2023-05-12T09:09:14.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff77bfff700 1 --2- 172.21.15.116:0/3200388067 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c0b87a0 0x7ff77c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-12T09:09:14.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff773fff700 1 --2- 172.21.15.116:0/3200388067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c1601e0 0x7ff77c160630 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff764009840 tx=0x7ff764009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b98ae9d1b89bf2 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:14.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff77b7fe700 1 -- 172.21.15.116:0/3200388067 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764011830 con 0x7ff77c1601e0 2023-05-12T09:09:14.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff77b7fe700 1 -- 172.21.15.116:0/3200388067 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff764011990 con 0x7ff77c1601e0 2023-05-12T09:09:14.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.832+0000 7ff77b7fe700 1 -- 172.21.15.116:0/3200388067 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764011d20 con 0x7ff77c1601e0 2023-05-12T09:09:14.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.833+0000 7ff7825ff700 1 -- 172.21.15.116:0/3200388067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c1601e0 msgr2=0x7ff77c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.833+0000 7ff7825ff700 1 --2- 172.21.15.116:0/3200388067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c1601e0 0x7ff77c160630 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff764009840 tx=0x7ff764009b50 comp rx=0 tx=0).stop 2023-05-12T09:09:14.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.833+0000 7ff7825ff700 1 -- 172.21.15.116:0/3200388067 shutdown_connections 2023-05-12T09:09:14.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.833+0000 7ff7825ff700 1 --2- 172.21.15.116:0/3200388067 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c0b87a0 0x7ff77c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.833+0000 7ff7825ff700 1 --2- 172.21.15.116:0/3200388067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c1601e0 0x7ff77c160630 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.833+0000 7ff7825ff700 1 -- 172.21.15.116:0/3200388067 >> 172.21.15.116:0/3200388067 conn(0x7ff77c071b10 msgr2=0x7ff77c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:14.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.833+0000 7ff7825ff700 1 -- 172.21.15.116:0/3200388067 shutdown_connections 2023-05-12T09:09:14.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.833+0000 7ff7825ff700 1 -- 172.21.15.116:0/3200388067 wait complete. 2023-05-12T09:09:14.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.835+0000 7ff7825ff700 1 Processor -- start 2023-05-12T09:09:14.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.835+0000 7ff7825ff700 1 -- start start 2023-05-12T09:09:14.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff7825ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff77c0b87a0 0x7ff77c0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff7825ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c1601e0 0x7ff77c0b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff7825ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c160b70 0x7ff77c1f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff7825ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c15f950 con 0x7ff77c160b70 2023-05-12T09:09:14.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff7825ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c15ecd0 con 0x7ff77c0b87a0 2023-05-12T09:09:14.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff7825ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c15efb0 con 0x7ff77c1601e0 2023-05-12T09:09:14.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff780b9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c160b70 0x7ff77c1f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff780b9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c160b70 0x7ff77c1f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49762/0 (socket says 172.21.15.116:49762) 2023-05-12T09:09:14.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff780b9c700 1 -- 172.21.15.116:0/519739841 learned_addr learned my addr 172.21.15.116:0/519739841 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:14.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff773fff700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c1601e0 0x7ff77c0b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff77bfff700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff77c0b87a0 0x7ff77c0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff780b9c700 1 -- 172.21.15.116:0/519739841 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c1601e0 msgr2=0x7ff77c0b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff780b9c700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c1601e0 0x7ff77c0b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff780b9c700 1 -- 172.21.15.116:0/519739841 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff77c0b87a0 msgr2=0x7ff77c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:14.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff780b9c700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff77c0b87a0 0x7ff77c0b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:14.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.837+0000 7ff780b9c700 1 -- 172.21.15.116:0/519739841 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640094a0 con 0x7ff77c160b70 2023-05-12T09:09:14.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.838+0000 7ff780b9c700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c160b70 0x7ff77c1f2bd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff77400caa0 tx=0x7ff77400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:14.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.838+0000 7ff7797fa700 1 -- 172.21.15.116:0/519739841 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400a9e0 con 0x7ff77c160b70 2023-05-12T09:09:14.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.838+0000 7ff7797fa700 1 -- 172.21.15.116:0/519739841 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77400ab40 con 0x7ff77c160b70 2023-05-12T09:09:14.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.838+0000 7ff7797fa700 1 -- 172.21.15.116:0/519739841 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774012400 con 0x7ff77c160b70 2023-05-12T09:09:14.844 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.838+0000 7ff7825ff700 1 -- 172.21.15.116:0/519739841 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c0cd980 con 0x7ff77c160b70 2023-05-12T09:09:14.845 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.838+0000 7ff7825ff700 1 -- 172.21.15.116:0/519739841 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c0cd6a0 con 0x7ff77c160b70 2023-05-12T09:09:14.845 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.839+0000 7ff7825ff700 1 -- 172.21.15.116:0/519739841 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c0d2110 con 0x7ff77c160b70 2023-05-12T09:09:14.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.840+0000 7ff7797fa700 1 -- 172.21.15.116:0/519739841 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff77401b3b0 con 0x7ff77c160b70 2023-05-12T09:09:14.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.841+0000 7ff7797fa700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff75c06ace0 0x7ff75c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:14.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.841+0000 7ff7797fa700 1 -- 172.21.15.116:0/519739841 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff774089270 con 0x7ff77c160b70 2023-05-12T09:09:14.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.841+0000 7ff77bfff700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff75c06ace0 0x7ff75c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:14.846 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.842+0000 7ff77bfff700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff75c06ace0 0x7ff75c06d190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0099d0 tx=0x7ff76c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:14.848 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:14.845+0000 7ff7797fa700 1 -- 172.21.15.116:0/519739841 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff774054210 con 0x7ff77c160b70 2023-05-12T09:09:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.080+0000 7ff7825ff700 1 -- 172.21.15.116:0/519739841 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff77c15fa90 con 0x7ff77c160b70 2023-05-12T09:09:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.081+0000 7ff7797fa700 1 -- 172.21.15.116:0/519739841 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7ff77c15fa90 con 0x7ff77c160b70 2023-05-12T09:09:15.084 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:15.085 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6834/593435655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":593435655},{"type":"v1","addr":"172.21.15.182:6834","nonce":593435655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/842957183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6833","nonce":842957183},{"type":"v1","addr":"172.21.15.182:6835","nonce":842957183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2126365264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2126365264},{"type":"v1","addr":"172.21.15.116:6836","nonce":2126365264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-12T09:09:04.356393+0000","modified":"2023-05-12T09:09:07.489713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6837/1678737826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":1678737826},{"type":"v1","addr":"172.21.15.116:6837","nonce":1678737826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-12T09:09:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 -- 172.21.15.116:0/519739841 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff75c06ace0 msgr2=0x7ff75c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff75c06ace0 0x7ff75c06d190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0099d0 tx=0x7ff76c008040 comp rx=0 tx=0).stop 2023-05-12T09:09:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 -- 172.21.15.116:0/519739841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c160b70 msgr2=0x7ff77c1f2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c160b70 0x7ff77c1f2bd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff77400caa0 tx=0x7ff77400cdb0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 -- 172.21.15.116:0/519739841 shutdown_connections 2023-05-12T09:09:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c160b70 0x7ff77c1f2bd0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff77c0b87a0 0x7ff77c0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7ff75c06ace0 0x7ff75c06d190 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 --2- 172.21.15.116:0/519739841 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff77c1601e0 0x7ff77c0b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 -- 172.21.15.116:0/519739841 >> 172.21.15.116:0/519739841 conn(0x7ff77c071b10 msgr2=0x7ff77c0b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.083+0000 7ff7825ff700 1 -- 172.21.15.116:0/519739841 shutdown_connections 2023-05-12T09:09:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.084+0000 7ff7825ff700 1 -- 172.21.15.116:0/519739841 wait complete. 2023-05-12T09:09:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:dumped fsmap epoch 17 2023-05-12T09:09:15.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-12T09:09:04.356393+0000', 'modified': '2023-05-12T09:09:07.489713+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5580}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5580': {'gid': 5580, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.116:6837/1678737826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6835', 'nonce': 1678737826}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 1678737826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-12T09:09:15.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-12T09:09:15.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-12T09:09:15.694 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.690+0000 7f18d83ff700 1 Processor -- start 2023-05-12T09:09:15.694 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.691+0000 7f18d83ff700 1 -- start start 2023-05-12T09:09:15.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.692+0000 7f18d83ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00d0130 0x7f18d00cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.692+0000 7f18d83ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d00b26f0 con 0x7f18d00cbf90 2023-05-12T09:09:15.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.692+0000 7f18d83ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d00cf890 con 0x7f18d006b4f0 2023-05-12T09:09:15.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.692+0000 7f18d83ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00cfb60 con 0x7f18d00d0130 2023-05-12T09:09:15.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.692+0000 7f18d699c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f18d00cbf90 0x7f18d00cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:57410/0 (socket says 172.21.15.116:57410) 2023-05-12T09:09:15.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.692+0000 7f18d699c700 1 -- 172.21.15.116:0/3465726417 learned_addr learned my addr 172.21.15.116:0/3465726417 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:15.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.692+0000 7f18d599a700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00d0130 0x7f18d00cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.692+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925658618 0 0) 0x7f18d00b26f0 con 0x7f18d00cbf90 2023-05-12T09:09:15.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.692+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18bc0035b0 con 0x7f18d00cbf90 2023-05-12T09:09:15.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420429374 0 0) 0x7f18d00cf890 con 0x7f18d006b4f0 2023-05-12T09:09:15.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d00b26f0 con 0x7f18d006b4f0 2023-05-12T09:09:15.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2373035735 0 0) 0x7f18bc0035b0 con 0x7f18d00cbf90 2023-05-12T09:09:15.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00d0130 msgr2=0x7f18d00cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00d0130 0x7f18d00cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 >> v1:172.21.15.182:6789/0 conn(0x7f18d006b4f0 legacy=0x7f18d006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d00cfe40 con 0x7f18d00cbf90 2023-05-12T09:09:15.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2105704933 0 0) 0x7f18c80019f0 con 0x7f18d00cbf90 2023-05-12T09:09:15.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 >> v1:172.21.15.116:6789/0 conn(0x7f18d00cbf90 legacy=0x7f18d00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00d0130 0x7f18bc003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f18bc004120 0x7f18bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 0x7f18bc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00cfb60 con 0x7f18bc004d90 2023-05-12T09:09:15.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc00bba0 con 0x7f18bc004120 2023-05-12T09:09:15.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc00bd30 con 0x7f18d00d0130 2023-05-12T09:09:15.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d699c700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 0x7f18bc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d599a700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f18bc004120 0x7f18bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.693+0000 7f18d619b700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00d0130 0x7f18bc003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d699c700 1 -- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00d0130 msgr2=0x7f18bc003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d699c700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00d0130 0x7f18bc003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d699c700 1 -- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f18bc004120 msgr2=0x7f18bc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d699c700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f18bc004120 0x7f18bc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d699c700 1 -- 172.21.15.116:0/3465726417 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0035b0 con 0x7f18bc004d90 2023-05-12T09:09:15.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d699c700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 0x7f18bc005200 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f18c800a7c0 tx=0x7f18bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d566723d1c15a804 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:15.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80072d0 con 0x7f18bc004d90 2023-05-12T09:09:15.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c8007430 con 0x7f18bc004d90 2023-05-12T09:09:15.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d5199700 1 -- 172.21.15.116:0/3465726417 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80077c0 con 0x7f18bc004d90 2023-05-12T09:09:15.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d83ff700 1 -- 172.21.15.116:0/3465726417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 msgr2=0x7f18bc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.702 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.694+0000 7f18d83ff700 1 --2- 172.21.15.116:0/3465726417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 0x7f18bc005200 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f18c800a7c0 tx=0x7f18bc005880 comp rx=0 tx=0).stop 2023-05-12T09:09:15.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.695+0000 7f18d699c700 1 -- 172.21.15.116:0/3465726417 reap_dead start 2023-05-12T09:09:15.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.695+0000 7f18d83ff700 1 -- 172.21.15.116:0/3465726417 shutdown_connections 2023-05-12T09:09:15.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.695+0000 7f18d83ff700 1 -- 172.21.15.116:0/3465726417 >> 172.21.15.116:0/3465726417 conn(0x7f18d009a090 msgr2=0x7f18d00d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:15.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.695+0000 7f18d83ff700 1 -- 172.21.15.116:0/3465726417 shutdown_connections 2023-05-12T09:09:15.703 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.695+0000 7f18d83ff700 1 -- 172.21.15.116:0/3465726417 wait complete. 2023-05-12T09:09:15.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.696+0000 7f18d83ff700 1 Processor -- start 2023-05-12T09:09:15.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.697+0000 7f18d83ff700 1 -- start start 2023-05-12T09:09:15.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.697+0000 7f18d83ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 0x7f18d015a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.697+0000 7f18d83ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f18d00c9770 0x7f18d00c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.705 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d83ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00b5c00 0x7f18d00b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d83ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d015acf0 con 0x7f18bc004d90 2023-05-12T09:09:15.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d83ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00b65e0 con 0x7f18d00c9770 2023-05-12T09:09:15.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d83ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00c5c70 con 0x7f18d00b5c00 2023-05-12T09:09:15.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d619b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 0x7f18d015a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d619b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 0x7f18d015a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49790/0 (socket says 172.21.15.116:49790) 2023-05-12T09:09:15.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d619b700 1 -- 172.21.15.116:0/1337975195 learned_addr learned my addr 172.21.15.116:0/1337975195 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:15.706 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d619b700 1 -- 172.21.15.116:0/1337975195 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00b5c00 msgr2=0x7f18d00b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d619b700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00b5c00 0x7f18d00b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d619b700 1 -- 172.21.15.116:0/1337975195 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f18d00c9770 msgr2=0x7f18d00c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d599a700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f18d00c9770 0x7f18d00c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d619b700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f18d00c9770 0x7f18d00c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d619b700 1 -- 172.21.15.116:0/1337975195 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d00cb790 con 0x7f18bc004d90 2023-05-12T09:09:15.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.698+0000 7f18d619b700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 0x7f18d015a7b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00f7e0 tx=0x7f18cc00fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:15.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.699+0000 7f18c6ffd700 1 -- 172.21.15.116:0/1337975195 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc001520 con 0x7f18bc004d90 2023-05-12T09:09:15.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.699+0000 7f18c6ffd700 1 -- 172.21.15.116:0/1337975195 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc0052e0 con 0x7f18bc004d90 2023-05-12T09:09:15.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.699+0000 7f18d83ff700 1 -- 172.21.15.116:0/1337975195 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d00cb4b0 con 0x7f18bc004d90 2023-05-12T09:09:15.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.699+0000 7f18c6ffd700 1 -- 172.21.15.116:0/1337975195 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc003680 con 0x7f18bc004d90 2023-05-12T09:09:15.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.699+0000 7f18d83ff700 1 -- 172.21.15.116:0/1337975195 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d00cba70 con 0x7f18bc004d90 2023-05-12T09:09:15.708 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.702+0000 7f18c6ffd700 1 -- 172.21.15.116:0/1337975195 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18cc003800 con 0x7f18bc004d90 2023-05-12T09:09:15.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.703+0000 7f18c6ffd700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f18b406ace0 0x7f18b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.703+0000 7f18c6ffd700 1 -- 172.21.15.116:0/1337975195 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f18cc0894d0 con 0x7f18bc004d90 2023-05-12T09:09:15.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.703+0000 7f18d599a700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f18b406ace0 0x7f18b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.703+0000 7f18d599a700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f18b406ace0 0x7f18b406d190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f18d00c9b40 tx=0x7f18c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:15.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.704+0000 7f18ebce6b80 1 Processor -- start 2023-05-12T09:09:15.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.705+0000 7f18ebce6b80 1 -- start start 2023-05-12T09:09:15.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9dbf230 0x563ae9dbf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dc02d0 0x563ae9da4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 0x563ae9da46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae9c63600 con 0x563ae9dc02d0 2023-05-12T09:09:15.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae9cd2790 con 0x563ae9d77740 2023-05-12T09:09:15.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ae9ccba60 con 0x563ae9dbf230 2023-05-12T09:09:15.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18d599a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dc02d0 0x563ae9da4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18d599a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dc02d0 0x563ae9da4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49798/0 (socket says 172.21.15.116:49798) 2023-05-12T09:09:15.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18d599a700 1 -- 172.21.15.116:0/1851647934 learned_addr learned my addr 172.21.15.116:0/1851647934 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:15.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18d699c700 1 --2- 172.21.15.116:0/1851647934 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 0x563ae9da46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.706+0000 7f18d619b700 1 --2- 172.21.15.116:0/1851647934 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9dbf230 0x563ae9dbf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.707+0000 7f18d599a700 1 -- 172.21.15.116:0/1851647934 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9dbf230 msgr2=0x563ae9dbf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.707+0000 7f18d599a700 1 --2- 172.21.15.116:0/1851647934 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9dbf230 0x563ae9dbf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.707+0000 7f18d599a700 1 -- 172.21.15.116:0/1851647934 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 msgr2=0x563ae9da46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.707+0000 7f18d599a700 1 --2- 172.21.15.116:0/1851647934 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 0x563ae9da46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.707+0000 7f18d599a700 1 -- 172.21.15.116:0/1851647934 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ae9abf790 con 0x563ae9dc02d0 2023-05-12T09:09:15.713 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.707+0000 7f18d599a700 1 --2- 172.21.15.116:0/1851647934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dc02d0 0x563ae9da4180 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f18c0013bd0 tx=0x7f18c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5c66ddd15acae5 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:15.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.707+0000 7f18b3fff700 1 -- 172.21.15.116:0/1851647934 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0013ee0 con 0x563ae9dc02d0 2023-05-12T09:09:15.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.707+0000 7f18b3fff700 1 -- 172.21.15.116:0/1851647934 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c0004030 con 0x563ae9dc02d0 2023-05-12T09:09:15.714 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.707+0000 7f18b3fff700 1 -- 172.21.15.116:0/1851647934 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c00043e0 con 0x563ae9dc02d0 2023-05-12T09:09:15.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.708+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1851647934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dc02d0 msgr2=0x563ae9da4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.708+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/1851647934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dc02d0 0x563ae9da4180 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f18c0013bd0 tx=0x7f18c0016000 comp rx=0 tx=0).stop 2023-05-12T09:09:15.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.708+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1851647934 shutdown_connections 2023-05-12T09:09:15.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.708+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/1851647934 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 0x563ae9da46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.717 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.708+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/1851647934 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9dbf230 0x563ae9dbf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.708+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/1851647934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dc02d0 0x563ae9da4180 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.708+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1851647934 >> 172.21.15.116:0/1851647934 conn(0x563ae9d6eb60 msgr2=0x563ae9d740c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:15.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.708+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1851647934 shutdown_connections 2023-05-12T09:09:15.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.708+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1851647934 wait complete. 2023-05-12T09:09:15.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.709+0000 7f18ebce6b80 1 -- start start 2023-05-12T09:09:15.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.709+0000 7f18ebce6b80 1 Processor -- start 2023-05-12T09:09:15.718 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9d77740 0x563ae9dd0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9dd0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 0x563ae9da09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae9c67ad0 con 0x563ae9dbf230 2023-05-12T09:09:15.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae9c67770 con 0x563ae9dc02d0 2023-05-12T09:09:15.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ae9ac0390 con 0x563ae9d77740 2023-05-12T09:09:15.719 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18ebce6b80 10 client.0 _ll_register_callbacks cb 0x563ae9c69400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-12T09:09:15.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d599a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9dd0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d599a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9dd0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49804/0 (socket says 172.21.15.116:49804) 2023-05-12T09:09:15.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d599a700 1 -- 172.21.15.116:0/1063050915 learned_addr learned my addr 172.21.15.116:0/1063050915 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:15.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d619b700 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9d77740 0x563ae9dd0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d699c700 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 0x563ae9da09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d599a700 1 -- 172.21.15.116:0/1063050915 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9d77740 msgr2=0x563ae9dd0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.720 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d599a700 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9d77740 0x563ae9dd0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d599a700 1 -- 172.21.15.116:0/1063050915 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 msgr2=0x563ae9da09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d599a700 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 0x563ae9da09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d599a700 1 -- 172.21.15.116:0/1063050915 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c0013880 con 0x563ae9dbf230 2023-05-12T09:09:15.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.711+0000 7f18d699c700 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 0x563ae9da09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:15.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.712+0000 7f18d599a700 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9dd0fc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f18c0026040 tx=0x7f18c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948e230c2d07a964 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:15.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.712+0000 7f18b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-05-12T09:09:15.721 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.712+0000 7f18b17fa700 1 -- 172.21.15.116:0/1063050915 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0013ee0 con 0x563ae9dbf230 2023-05-12T09:09:15.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.712+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1063050915 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ae9d6c170 con 0x563ae9dbf230 2023-05-12T09:09:15.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.712+0000 7f18b17fa700 1 -- 172.21.15.116:0/1063050915 <== mon.0 v2:172.21.15.116:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f18c0016b00 con 0x563ae9dbf230 2023-05-12T09:09:15.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.712+0000 7f18b17fa700 1 -- 172.21.15.116:0/1063050915 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18c0016cc0 con 0x563ae9dbf230 2023-05-12T09:09:15.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.712+0000 7f18ebce6b80 10 client.5790 fetch_fsmap learned FSMap version 17 2023-05-12T09:09:15.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.712+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1063050915 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563ae9c922e0 con 0x563ae9dbf230 2023-05-12T09:09:15.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.712+0000 7f18b17fa700 1 -- 172.21.15.116:0/1063050915 <== mon.0 v2:172.21.15.116:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563ae9d6c170 con 0x563ae9dbf230 2023-05-12T09:09:15.722 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.713+0000 7f18b17fa700 1 -- 172.21.15.116:0/1063050915 <== mon.0 v2:172.21.15.116:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f18c00036a0 con 0x563ae9dbf230 2023-05-12T09:09:15.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.713+0000 7f18ebce6b80 10 client.5790 fetch_fsmap finished waiting for FSMap version 17 2023-05-12T09:09:15.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.713+0000 7f18ebce6b80 10 client.5790 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-12T09:09:15.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.713+0000 7f18ebce6b80 20 client.5790 populate_metadata read hostname 'smithi116' 2023-05-12T09:09:15.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.713+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.116:6835/1678737826,v1:172.21.15.116:6837/1678737826] conn(0x563ae9da1410 0x563ae9da5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.713+0000 7f18ebce6b80 4 client.5790 mds_command: new command op to 5580 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-12T09:09:15.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.713+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1063050915 --> [v2:172.21.15.116:6835/1678737826,v1:172.21.15.116:6837/1678737826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ae9d492f0 con 0x563ae9da1410 2023-05-12T09:09:15.723 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.713+0000 7f18d619b700 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.116:6835/1678737826,v1:172.21.15.116:6837/1678737826] conn(0x563ae9da1410 0x563ae9da5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.713+0000 7f18b17fa700 10 client.5790 ms_handle_connect on v2:172.21.15.116:6835/1678737826 2023-05-12T09:09:15.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.713+0000 7f18d619b700 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.116:6835/1678737826,v1:172.21.15.116:6837/1678737826] conn(0x563ae9da1410 0x563ae9da5830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3742cd06a83a9502 server_cookie=aaa2775d760e15bf in_seq=0 out_seq=0 2023-05-12T09:09:15.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18b17fa700 1 -- 172.21.15.116:0/1063050915 <== mds.0 v2:172.21.15.116:6835/1678737826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18412 (crc 0 0 0) 0x563ae9d492f0 con 0x563ae9da1410 2023-05-12T09:09:15.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18b17fa700 10 client.5790 handle_command_reply: tid=0 2023-05-12T09:09:15.724 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18ebce6b80 1 client.5790 shutdown 2023-05-12T09:09:15.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1063050915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 msgr2=0x563ae9dd0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9dd0fc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f18c0026040 tx=0x7f18c00047c0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.725 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1063050915 shutdown_connections 2023-05-12T09:09:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.116:6835/1678737826,v1:172.21.15.116:6837/1678737826] conn(0x563ae9da1410 0x563ae9da5830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 0x563ae9da09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9d77740 0x563ae9dd0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/1063050915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9dd0fc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18b17fa700 0 client.5790 ms_handle_reset on v2:172.21.15.116:6835/1678737826 2023-05-12T09:09:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.714+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1063050915 >> 172.21.15.116:0/1063050915 conn(0x563ae9d6eb60 msgr2=0x563ae9dbe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.715+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1063050915 shutdown_connections 2023-05-12T09:09:15.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.715+0000 7f18ebce6b80 1 -- 172.21.15.116:0/1063050915 wait complete. 2023-05-12T09:09:15.727 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.715+0000 7f18ebce6b80 20 client.5790 trim_cache size 0 max 16384 2023-05-12T09:09:15.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.733+0000 7f18ebce6b80 1 Processor -- start 2023-05-12T09:09:15.736 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.733+0000 7f18ebce6b80 1 -- start start 2023-05-12T09:09:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.734+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9d77740 0x563ae9d79ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.734+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9d72df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.734+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 0x563ae9dbc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.734+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae9d6bdc0 con 0x563ae9dbf230 2023-05-12T09:09:15.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.734+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae9dbe950 con 0x563ae9dc02d0 2023-05-12T09:09:15.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.734+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ae9da2580 con 0x563ae9d77740 2023-05-12T09:09:15.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.734+0000 7f18d599a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9d72df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.734+0000 7f18d599a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9d72df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49820/0 (socket says 172.21.15.116:49820) 2023-05-12T09:09:15.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.734+0000 7f18d599a700 1 -- 172.21.15.116:0/725531615 learned_addr learned my addr 172.21.15.116:0/725531615 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:15.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18d599a700 1 -- 172.21.15.116:0/725531615 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9d77740 msgr2=0x563ae9d79ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18d599a700 1 --2- 172.21.15.116:0/725531615 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9d77740 0x563ae9d79ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18d699c700 1 --2- 172.21.15.116:0/725531615 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 0x563ae9dbc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18d599a700 1 -- 172.21.15.116:0/725531615 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 msgr2=0x563ae9dbc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.740 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18d599a700 1 --2- 172.21.15.116:0/725531615 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 0x563ae9dbc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18d599a700 1 -- 172.21.15.116:0/725531615 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ae9c92030 con 0x563ae9dbf230 2023-05-12T09:09:15.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18d699c700 1 --2- 172.21.15.116:0/725531615 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 0x563ae9dbc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:15.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18d599a700 1 --2- 172.21.15.116:0/725531615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9d72df0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f18c0006c50 tx=0x7f18c002d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcaa3538e2b08bf server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:15.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18c4bff700 1 -- 172.21.15.116:0/725531615 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0013ee0 con 0x563ae9dbf230 2023-05-12T09:09:15.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18c4bff700 1 -- 172.21.15.116:0/725531615 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c00044e0 con 0x563ae9dbf230 2023-05-12T09:09:15.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.735+0000 7f18c4bff700 1 -- 172.21.15.116:0/725531615 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0009280 con 0x563ae9dbf230 2023-05-12T09:09:15.741 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.736+0000 7f18ebce6b80 1 -- 172.21.15.116:0/725531615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 msgr2=0x563ae9d72df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.736+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/725531615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9d72df0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f18c0006c50 tx=0x7f18c002d000 comp rx=0 tx=0).stop 2023-05-12T09:09:15.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.736+0000 7f18ebce6b80 1 -- 172.21.15.116:0/725531615 shutdown_connections 2023-05-12T09:09:15.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.736+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/725531615 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9dc02d0 0x563ae9dbc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.736+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/725531615 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9d77740 0x563ae9d79ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.736+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/725531615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9d72df0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.742 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.736+0000 7f18ebce6b80 1 -- 172.21.15.116:0/725531615 >> 172.21.15.116:0/725531615 conn(0x563ae9d6eb60 msgr2=0x563ae9dbf600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:15.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.736+0000 7f18ebce6b80 1 -- 172.21.15.116:0/725531615 shutdown_connections 2023-05-12T09:09:15.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.736+0000 7f18ebce6b80 1 -- 172.21.15.116:0/725531615 wait complete. 2023-05-12T09:09:15.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.737+0000 7f18ebce6b80 1 -- start start 2023-05-12T09:09:15.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.737+0000 7f18ebce6b80 1 Processor -- start 2023-05-12T09:09:15.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 0x563ae9e25e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9da5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18ebce6b80 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9dc02d0 0x563ae9da6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae9d98310 con 0x563ae9dbf230 2023-05-12T09:09:15.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae9d98550 con 0x563ae9d77740 2023-05-12T09:09:15.746 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18ebce6b80 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ae9d77c70 con 0x563ae9dc02d0 2023-05-12T09:09:15.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18ebce6b80 10 client.0 _ll_register_callbacks cb 0x563ae9c69400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-12T09:09:15.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18d599a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9da5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18d599a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9da5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49830/0 (socket says 172.21.15.116:49830) 2023-05-12T09:09:15.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18d599a700 1 -- 172.21.15.116:0/865649070 learned_addr learned my addr 172.21.15.116:0/865649070 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:15.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18d619b700 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 0x563ae9e25e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18d599a700 1 -- 172.21.15.116:0/865649070 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9dc02d0 msgr2=0x563ae9da6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18d599a700 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9dc02d0 0x563ae9da6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18d599a700 1 -- 172.21.15.116:0/865649070 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 msgr2=0x563ae9e25e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:15.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18d599a700 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 0x563ae9e25e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18d599a700 1 -- 172.21.15.116:0/865649070 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ae9c922e0 con 0x563ae9dbf230 2023-05-12T09:09:15.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.738+0000 7f18d619b700 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 0x563ae9e25e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:15.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18d599a700 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9da5bd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f18c0006a50 tx=0x7f18c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b14bfee1237fae1 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:15.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-05-12T09:09:15.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18b17fa700 1 -- 172.21.15.116:0/865649070 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0053070 con 0x563ae9dbf230 2023-05-12T09:09:15.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18b17fa700 1 -- 172.21.15.116:0/865649070 <== mon.0 v2:172.21.15.116:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f18c000f040 con 0x563ae9dbf230 2023-05-12T09:09:15.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18ebce6b80 1 -- 172.21.15.116:0/865649070 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ae9cc4ba0 con 0x563ae9dbf230 2023-05-12T09:09:15.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18b17fa700 1 -- 172.21.15.116:0/865649070 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18c00036a0 con 0x563ae9dbf230 2023-05-12T09:09:15.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18ebce6b80 10 client.5796 fetch_fsmap learned FSMap version 17 2023-05-12T09:09:15.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18ebce6b80 1 -- 172.21.15.116:0/865649070 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563ae9c78b10 con 0x563ae9dbf230 2023-05-12T09:09:15.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18b17fa700 1 -- 172.21.15.116:0/865649070 <== mon.0 v2:172.21.15.116:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563ae9cc4ba0 con 0x563ae9dbf230 2023-05-12T09:09:15.749 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18b17fa700 1 -- 172.21.15.116:0/865649070 <== mon.0 v2:172.21.15.116:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f18c0016b00 con 0x563ae9dbf230 2023-05-12T09:09:15.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18ebce6b80 10 client.5796 fetch_fsmap finished waiting for FSMap version 17 2023-05-12T09:09:15.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18ebce6b80 10 client.5796 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-12T09:09:15.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18ebce6b80 20 client.5796 populate_metadata read hostname 'smithi116' 2023-05-12T09:09:15.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.116:6835/1678737826,v1:172.21.15.116:6837/1678737826] conn(0x563ae9de1bf0 0x563ae9dcf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18ebce6b80 4 client.5796 mds_command: new command op to 5580 tid=0[{"prefix": "status"}] 2023-05-12T09:09:15.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.739+0000 7f18ebce6b80 1 -- 172.21.15.116:0/865649070 --> [v2:172.21.15.116:6835/1678737826,v1:172.21.15.116:6837/1678737826] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563ae9b1aef0 con 0x563ae9de1bf0 2023-05-12T09:09:15.750 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18d619b700 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.116:6835/1678737826,v1:172.21.15.116:6837/1678737826] conn(0x563ae9de1bf0 0x563ae9dcf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18b17fa700 10 client.5796 ms_handle_connect on v2:172.21.15.116:6835/1678737826 2023-05-12T09:09:15.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18d619b700 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.116:6835/1678737826,v1:172.21.15.116:6837/1678737826] conn(0x563ae9de1bf0 0x563ae9dcf850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73da91ab55ba9d28 server_cookie=f38de7da84ada09f in_seq=0 out_seq=0 2023-05-12T09:09:15.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18b17fa700 1 -- 172.21.15.116:0/865649070 <== mds.0 v2:172.21.15.116:6835/1678737826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563ae9b1aef0 con 0x563ae9de1bf0 2023-05-12T09:09:15.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18b17fa700 10 client.5796 handle_command_reply: tid=0 2023-05-12T09:09:15.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18ebce6b80 1 client.5796 shutdown 2023-05-12T09:09:15.751 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18ebce6b80 1 -- 172.21.15.116:0/865649070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 msgr2=0x563ae9da5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9da5bd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f18c0006a50 tx=0x7f18c0019000 comp rx=0 tx=0).stop 2023-05-12T09:09:15.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18ebce6b80 1 -- 172.21.15.116:0/865649070 shutdown_connections 2023-05-12T09:09:15.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.116:6835/1678737826,v1:172.21.15.116:6837/1678737826] conn(0x563ae9de1bf0 0x563ae9dcf850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x563ae9dc02d0 0x563ae9da6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x563ae9d77740 0x563ae9e25e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18b17fa700 0 client.5796 ms_handle_reset on v2:172.21.15.116:6835/1678737826 2023-05-12T09:09:15.752 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18ebce6b80 1 --2- 172.21.15.116:0/865649070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ae9dbf230 0x563ae9da5bd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.740+0000 7f18ebce6b80 1 -- 172.21.15.116:0/865649070 >> 172.21.15.116:0/865649070 conn(0x563ae9d6eb60 msgr2=0x563ae9da68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:15.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18ebce6b80 1 -- 172.21.15.116:0/865649070 shutdown_connections 2023-05-12T09:09:15.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18ebce6b80 1 -- 172.21.15.116:0/865649070 wait complete. 2023-05-12T09:09:15.753 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18ebce6b80 20 client.5796 trim_cache size 0 max 16384 2023-05-12T09:09:15.753 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-05-12T09:09:15.754 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_fsid": "09fd430d-d641-4faf-8b07-e4040d2273e8", 2023-05-12T09:09:15.754 INFO:teuthology.orchestra.run.smithi116.stdout: "whoami": 0, 2023-05-12T09:09:15.754 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 5580, 2023-05-12T09:09:15.754 INFO:teuthology.orchestra.run.smithi116.stdout: "want_state": "up:active", 2023-05-12T09:09:15.754 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "up:active", 2023-05-12T09:09:15.754 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs", 2023-05-12T09:09:15.754 INFO:teuthology.orchestra.run.smithi116.stdout: "rank_uptime": 11.38233001, 2023-05-12T09:09:15.755 INFO:teuthology.orchestra.run.smithi116.stdout: "mdsmap_epoch": 17, 2023-05-12T09:09:15.755 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_epoch": 39, 2023-05-12T09:09:15.755 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_epoch_barrier": 39, 2023-05-12T09:09:15.755 INFO:teuthology.orchestra.run.smithi116.stdout: "uptime": 19.658467731999998 2023-05-12T09:09:15.755 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-05-12T09:09:15.756 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18d83ff700 1 -- 172.21.15.116:0/1337975195 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f18b406ace0 msgr2=0x7f18b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.756 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18d83ff700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f18b406ace0 0x7f18b406d190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f18d00c9b40 tx=0x7f18c0008040 comp rx=0 tx=0).stop 2023-05-12T09:09:15.756 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18d83ff700 1 -- 172.21.15.116:0/1337975195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 msgr2=0x7f18d015a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18d83ff700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 0x7f18d015a7b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00f7e0 tx=0x7f18cc00fba0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18d83ff700 1 -- 172.21.15.116:0/1337975195 shutdown_connections 2023-05-12T09:09:15.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18d83ff700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f18b406ace0 0x7f18b406d190 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18d83ff700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f18d00b5c00 0x7f18d00b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18d83ff700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18bc004d90 0x7f18d015a7b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18d83ff700 1 --2- 172.21.15.116:0/1337975195 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f18d00c9770 0x7f18d00c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.757 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.741+0000 7f18d83ff700 1 -- 172.21.15.116:0/1337975195 >> 172.21.15.116:0/1337975195 conn(0x7f18d009a090 msgr2=0x7f18d015c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:15.758 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.742+0000 7f18d83ff700 1 -- 172.21.15.116:0/1337975195 shutdown_connections 2023-05-12T09:09:15.758 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.742+0000 7f18d83ff700 1 -- 172.21.15.116:0/1337975195 wait complete. 2023-05-12T09:09:15.761 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-12T09:09:15.945 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.942+0000 7fe89a7ff700 1 Processor -- start 2023-05-12T09:09:15.945 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.942+0000 7fe89a7ff700 1 -- start start 2023-05-12T09:09:15.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.943+0000 7fe89a7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940d0130 0x7fe8940cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.943+0000 7fe89a7ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940b26f0 con 0x7fe89406b4f0 2023-05-12T09:09:15.946 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.943+0000 7fe89a7ff700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940cf890 con 0x7fe8940cbf90 2023-05-12T09:09:15.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.943+0000 7fe89a7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940cfb60 con 0x7fe8940d0130 2023-05-12T09:09:15.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.943+0000 7fe893fff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe89406b4f0 0x7fe89406b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:57426/0 (socket says 172.21.15.116:57426) 2023-05-12T09:09:15.947 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.943+0000 7fe893fff700 1 -- 172.21.15.116:0/1108198236 learned_addr learned my addr 172.21.15.116:0/1108198236 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:15.948 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.944+0000 7fe8937fe700 1 --2- 172.21.15.116:0/1108198236 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940d0130 0x7fe8940cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.944+0000 7fe892ffd700 1 -- 172.21.15.116:0/1108198236 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483071355 0 0) 0x7fe8940b26f0 con 0x7fe89406b4f0 2023-05-12T09:09:15.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.944+0000 7fe892ffd700 1 -- 172.21.15.116:0/1108198236 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe87c0035b0 con 0x7fe89406b4f0 2023-05-12T09:09:15.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.944+0000 7fe892ffd700 1 -- 172.21.15.116:0/1108198236 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536318123 0 0) 0x7fe8940cf890 con 0x7fe8940cbf90 2023-05-12T09:09:15.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.944+0000 7fe892ffd700 1 -- 172.21.15.116:0/1108198236 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8940b26f0 con 0x7fe8940cbf90 2023-05-12T09:09:15.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.944+0000 7fe892ffd700 1 -- 172.21.15.116:0/1108198236 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3664184082 0 0) 0x7fe87c0035b0 con 0x7fe89406b4f0 2023-05-12T09:09:15.949 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.944+0000 7fe8937fe700 1 -- 172.21.15.116:0/1108198236 >> v1:172.21.15.182:6789/0 conn(0x7fe8940cbf90 legacy=0x7fe8940cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.944+0000 7fe8937fe700 1 -- 172.21.15.116:0/1108198236 >> v1:172.21.15.116:6789/0 conn(0x7fe89406b4f0 legacy=0x7fe89406b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.944+0000 7fe8937fe700 1 -- 172.21.15.116:0/1108198236 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940cfe40 con 0x7fe8940d0130 2023-05-12T09:09:15.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe8937fe700 1 --2- 172.21.15.116:0/1108198236 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940d0130 0x7fe8940cf350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe888009870 tx=0x7fe888009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13c2603fad70a6c6 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:15.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe892ffd700 1 -- 172.21.15.116:0/1108198236 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884001670 con 0x7fe8940d0130 2023-05-12T09:09:15.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe892ffd700 1 -- 172.21.15.116:0/1108198236 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888004030 con 0x7fe8940d0130 2023-05-12T09:09:15.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe892ffd700 1 -- 172.21.15.116:0/1108198236 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8880043c0 con 0x7fe8940d0130 2023-05-12T09:09:15.950 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe89a7ff700 1 -- 172.21.15.116:0/1108198236 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940d0130 msgr2=0x7fe8940cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe89a7ff700 1 --2- 172.21.15.116:0/1108198236 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940d0130 0x7fe8940cf350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe888009870 tx=0x7fe888009b80 comp rx=0 tx=0).stop 2023-05-12T09:09:15.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe89a7ff700 1 -- 172.21.15.116:0/1108198236 shutdown_connections 2023-05-12T09:09:15.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe89a7ff700 1 --2- 172.21.15.116:0/1108198236 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940d0130 0x7fe8940cf350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe89a7ff700 1 -- 172.21.15.116:0/1108198236 >> 172.21.15.116:0/1108198236 conn(0x7fe89409a090 msgr2=0x7fe8940d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:15.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe89a7ff700 1 -- 172.21.15.116:0/1108198236 shutdown_connections 2023-05-12T09:09:15.951 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.945+0000 7fe89a7ff700 1 -- 172.21.15.116:0/1108198236 wait complete. 2023-05-12T09:09:15.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.947+0000 7fe89a7ff700 1 Processor -- start 2023-05-12T09:09:15.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.947+0000 7fe89a7ff700 1 -- start start 2023-05-12T09:09:15.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.948+0000 7fe89a7ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe89406b4f0 0x7fe89414adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.953 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.948+0000 7fe89a7ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940cbf90 0x7fe89415d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.948+0000 7fe89a7ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8940d0130 0x7fe8940b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.948+0000 7fe89a7ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89415fda0 con 0x7fe8940d0130 2023-05-12T09:09:15.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.948+0000 7fe89a7ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89415f190 con 0x7fe89406b4f0 2023-05-12T09:09:15.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.948+0000 7fe89a7ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89415f470 con 0x7fe8940cbf90 2023-05-12T09:09:15.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.948+0000 7fe898d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8940d0130 0x7fe8940b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.948+0000 7fe898d9c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8940d0130 0x7fe8940b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49844/0 (socket says 172.21.15.116:49844) 2023-05-12T09:09:15.954 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.948+0000 7fe898d9c700 1 -- 172.21.15.116:0/839066670 learned_addr learned my addr 172.21.15.116:0/839066670 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:15.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe8937fe700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940cbf90 0x7fe89415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe893fff700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe89406b4f0 0x7fe89414adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe898d9c700 1 -- 172.21.15.116:0/839066670 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940cbf90 msgr2=0x7fe89415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe898d9c700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940cbf90 0x7fe89415d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe898d9c700 1 -- 172.21.15.116:0/839066670 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe89406b4f0 msgr2=0x7fe89414adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:15.955 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe898d9c700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe89406b4f0 0x7fe89414adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:15.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe898d9c700 1 -- 172.21.15.116:0/839066670 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8880094a0 con 0x7fe8940d0130 2023-05-12T09:09:15.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe898d9c700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8940d0130 0x7fe8940b2b90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00cc20 tx=0x7fe88c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:15.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe890ff9700 1 -- 172.21.15.116:0/839066670 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00ac20 con 0x7fe8940d0130 2023-05-12T09:09:15.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe890ff9700 1 -- 172.21.15.116:0/839066670 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c00ad80 con 0x7fe8940d0130 2023-05-12T09:09:15.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe890ff9700 1 -- 172.21.15.116:0/839066670 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c003c20 con 0x7fe8940d0130 2023-05-12T09:09:15.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe89a7ff700 1 -- 172.21.15.116:0/839066670 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8940cb790 con 0x7fe8940d0130 2023-05-12T09:09:15.956 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.949+0000 7fe89a7ff700 1 -- 172.21.15.116:0/839066670 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8940cb4b0 con 0x7fe8940d0130 2023-05-12T09:09:15.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.950+0000 7fe89a7ff700 1 -- 172.21.15.116:0/839066670 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8940cba70 con 0x7fe8940d0130 2023-05-12T09:09:15.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.951+0000 7fe890ff9700 1 -- 172.21.15.116:0/839066670 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe88c0050d0 con 0x7fe8940d0130 2023-05-12T09:09:15.957 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.952+0000 7fe890ff9700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe88006ace0 0x7fe88006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:15.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.953+0000 7fe890ff9700 1 -- 172.21.15.116:0/839066670 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe88c089810 con 0x7fe8940d0130 2023-05-12T09:09:15.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.953+0000 7fe893fff700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe88006ace0 0x7fe88006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:15.958 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.953+0000 7fe893fff700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe88006ace0 0x7fe88006d190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe884001380 tx=0x7fe8840015f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:15.960 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:15.957+0000 7fe890ff9700 1 -- 172.21.15.116:0/839066670 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe88c0546e0 con 0x7fe8940d0130 2023-05-12T09:09:16.197 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.194+0000 7fe89a7ff700 1 -- 172.21.15.116:0/839066670 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe8940c7c50 con 0x7fe8940d0130 2023-05-12T09:09:16.197 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.194+0000 7fe890ff9700 1 -- 172.21.15.116:0/839066670 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe88c057d00 con 0x7fe8940d0130 2023-05-12T09:09:16.198 INFO:teuthology.orchestra.run.smithi116.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-12T09:09:16.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 -- 172.21.15.116:0/839066670 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe88006ace0 msgr2=0x7fe88006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:16.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe88006ace0 0x7fe88006d190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe884001380 tx=0x7fe8840015f0 comp rx=0 tx=0).stop 2023-05-12T09:09:16.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 -- 172.21.15.116:0/839066670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8940d0130 msgr2=0x7fe8940b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:16.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8940d0130 0x7fe8940b2b90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00cc20 tx=0x7fe88c00a060 comp rx=0 tx=0).stop 2023-05-12T09:09:16.200 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 -- 172.21.15.116:0/839066670 shutdown_connections 2023-05-12T09:09:16.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8940d0130 0x7fe8940b2b90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:16.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fe89406b4f0 0x7fe89414adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:16.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7fe88006ace0 0x7fe88006d190 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:16.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 --2- 172.21.15.116:0/839066670 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fe8940cbf90 0x7fe89415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:16.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 -- 172.21.15.116:0/839066670 >> 172.21.15.116:0/839066670 conn(0x7fe89409a090 msgr2=0x7fe89406b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:16.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 -- 172.21.15.116:0/839066670 shutdown_connections 2023-05-12T09:09:16.201 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:16.197+0000 7fe89a7ff700 1 -- 172.21.15.116:0/839066670 wait complete. 2023-05-12T09:09:16.216 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-12T09:09:16.217 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-12T09:09:16.217 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2023-05-12T09:09:16.218 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-12T09:09:16.218 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-12T09:09:16.218 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-12T09:09:16.218 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-12T09:09:16.219 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-12T09:09:16.219 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-12T09:09:16.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:16.220 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2023-05-12T09:09:16.261 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-12T09:09:16.262 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-12T09:09:16.262 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2023-05-12T09:09:16.262 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:09:16.262 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2023-05-12T09:09:16.262 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:09:16.262 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:09:16.262 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:09:16.263 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2023-05-12T09:09:16.263 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:09:16.263 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:09:16.263 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2023-05-12T09:09:16.263 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-12T09:09:16.263 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:09:16.263 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-12T09:09:16.264 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2023-05-12T09:09:16.264 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-12T09:09:16.264 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 41974sec preferred_lft 41974sec 2023-05-12T09:09:16.264 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2023-05-12T09:09:16.264 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:09:16.264 INFO:teuthology.orchestra.run.smithi116.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-12T09:09:16.264 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 46:82:4a:82:a6:fc brd ff:ff:ff:ff:ff:ff 2023-05-12T09:09:16.265 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-12T09:09:16.265 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:09:16.265 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::c814:ddff:fe94:e5ba/64 scope link 2023-05-12T09:09:16.265 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:09:16.265 INFO:teuthology.orchestra.run.smithi116.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-12T09:09:16.265 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 46:82:4a:82:a6:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-12T09:09:16.265 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::4482:4aff:fe82:a6fc/64 scope link 2023-05-12T09:09:16.265 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:09:16.266 INFO:teuthology.orchestra.run.smithi116.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-12T09:09:16.266 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether b6:8e:2b:66:0f:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-12T09:09:16.266 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::b48e:2bff:fe66:f0e/64 scope link 2023-05-12T09:09:16.266 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-05-12T09:09:16.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:16.267 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-12T09:09:16.367 INFO:teuthology.orchestra.run.smithi116.stdout:1 2023-05-12T09:09:16.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:16.369 DEBUG:teuthology.orchestra.run.smithi116:> route 2023-05-12T09:09:16.413 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2023-05-12T09:09:16.414 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-12T09:09:16.414 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-12T09:09:16.414 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-12T09:09:16.414 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-12T09:09:16.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:16.415 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-05-12T09:09:16.415 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-05-12T09:09:16.415 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-12T09:09:16.416 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-12T09:09:16.416 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-12T09:09:16.416 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-05-12T09:09:16.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:16.605 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2023-05-12T09:09:16.647 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-12T09:09:16.647 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-12T09:09:16.648 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-12T09:09:16.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:16.649 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2023-05-12T09:09:16.751 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-12T09:09:16.752 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:09:16.752 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-12T09:09:16.793 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-12T09:09:16.794 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-12T09:09:16.794 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-12T09:09:16.874 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-05-12T09:09:16.977 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:09:16.977 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:09:17.037 INFO:teuthology.orchestra.run.smithi116.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:09:17.039 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:09:17.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:17.040 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-05-12T09:09:17.082 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-12T09:09:17.082 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-12T09:09:17.126 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-05-12T09:09:17.190 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-12T09:09:17.190 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-12T09:09:17.253 INFO:teuthology.orchestra.run.smithi116.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-12T09:09:17.256 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-12T09:09:17.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:17.257 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-05-12T09:09:17.282 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:2023-05-12T09:09:17.279+0000 7f2e1832c5c0 -1 init, newargv = 0x55d972615360 newargc=15 2023-05-12T09:09:17.282 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:ceph-fuse[124845]: starting ceph client 2023-05-12T09:09:17.290 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:ceph-fuse[124845]: starting fuse 2023-05-12T09:09:17.302 INFO:teuthology.orchestra.run.smithi116.stdout:42 2023-05-12T09:09:17.303 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-12T09:09:17.303 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-12T09:09:17.303 DEBUG:teuthology.orchestra.run.smithi116:> import glob 2023-05-12T09:09:17.304 DEBUG:teuthology.orchestra.run.smithi116:> import re 2023-05-12T09:09:17.304 DEBUG:teuthology.orchestra.run.smithi116:> import os 2023-05-12T09:09:17.304 DEBUG:teuthology.orchestra.run.smithi116:> import subprocess 2023-05-12T09:09:17.305 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:09:17.305 DEBUG:teuthology.orchestra.run.smithi116:> def _find_admin_socket(client_name): 2023-05-12T09:09:17.305 DEBUG:teuthology.orchestra.run.smithi116:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-12T09:09:17.306 DEBUG:teuthology.orchestra.run.smithi116:> files = glob.glob(asok_path) 2023-05-12T09:09:17.306 DEBUG:teuthology.orchestra.run.smithi116:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-12T09:09:17.306 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:09:17.307 DEBUG:teuthology.orchestra.run.smithi116:> # Given a non-glob path, it better be there 2023-05-12T09:09:17.307 DEBUG:teuthology.orchestra.run.smithi116:> if "*" not in asok_path: 2023-05-12T09:09:17.307 DEBUG:teuthology.orchestra.run.smithi116:> assert(len(files) == 1) 2023-05-12T09:09:17.308 DEBUG:teuthology.orchestra.run.smithi116:> return files[0] 2023-05-12T09:09:17.308 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:09:17.308 DEBUG:teuthology.orchestra.run.smithi116:> for f in files: 2023-05-12T09:09:17.308 DEBUG:teuthology.orchestra.run.smithi116:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-12T09:09:17.309 DEBUG:teuthology.orchestra.run.smithi116:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-12T09:09:17.309 DEBUG:teuthology.orchestra.run.smithi116:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-12T09:09:17.309 DEBUG:teuthology.orchestra.run.smithi116:> contents = proc_f.read() 2023-05-12T09:09:17.310 DEBUG:teuthology.orchestra.run.smithi116:> if mountpoint in contents: 2023-05-12T09:09:17.310 DEBUG:teuthology.orchestra.run.smithi116:> return f 2023-05-12T09:09:17.310 DEBUG:teuthology.orchestra.run.smithi116:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-12T09:09:17.311 DEBUG:teuthology.orchestra.run.smithi116:> 2023-05-12T09:09:17.311 DEBUG:teuthology.orchestra.run.smithi116:> print(_find_admin_socket("client.0")) 2023-05-12T09:09:17.311 DEBUG:teuthology.orchestra.run.smithi116:> ' 2023-05-12T09:09:17.477 INFO:teuthology.orchestra.run.smithi116.stdout:/var/run/ceph/ceph-client.0.124845.asok 2023-05-12T09:09:17.655 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.124845.asok 2023-05-12T09:09:17.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:17.656 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.124845.asok status 2023-05-12T09:09:17.868 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-05-12T09:09:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "metadata": { 2023-05-12T09:09:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_sha1": "5a6b166b7c43e2b5890833e75dd257ab21264ded", 2023-05-12T09:09:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev)", 2023-05-12T09:09:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "entity_id": "0", 2023-05-12T09:09:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "hostname": "smithi116", 2023-05-12T09:09:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-12T09:09:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "pid": "124845", 2023-05-12T09:09:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "root": "/" 2023-05-12T09:09:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:09:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_count": 0, 2023-05-12T09:09:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_pinned_count": 0, 2023-05-12T09:09:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 5808, 2023-05-12T09:09:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "inst": { 2023-05-12T09:09:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "name": { 2023-05-12T09:09:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "client", 2023-05-12T09:09:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "num": 5808 2023-05-12T09:09:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:09:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-05-12T09:09:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-05-12T09:09:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "192.168.0.1:0", 2023-05-12T09:09:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1841112867 2023-05-12T09:09:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-05-12T09:09:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:09:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-05-12T09:09:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-05-12T09:09:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "192.168.0.1:0", 2023-05-12T09:09:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1841112867 2023-05-12T09:09:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-05-12T09:09:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "inst_str": "client.5808 192.168.0.1:0/1841112867", 2023-05-12T09:09:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "addr_str": "192.168.0.1:0/1841112867", 2023-05-12T09:09:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "inode_count": 1, 2023-05-12T09:09:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_epoch": 17, 2023-05-12T09:09:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch": 39, 2023-05-12T09:09:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch_barrier": 0, 2023-05-12T09:09:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklisted": false, 2023-05-12T09:09:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs" 2023-05-12T09:09:17.874 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-05-12T09:09:17.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:17.882 DEBUG:teuthology.orchestra.run.smithi116:> stat --file-system '--printf=%T 2023-05-12T09:09:17.882 DEBUG:teuthology.orchestra.run.smithi116:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-12T09:09:17.925 INFO:teuthology.orchestra.run.smithi116.stdout:fuseblk 2023-05-12T09:09:17.925 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-12T09:09:17.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:17.926 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-12T09:09:18.028 DEBUG:teuthology.orchestra.run.smithi116:> mktemp -d --suffix=xfstests-dev 2023-05-12T09:09:18.070 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.b9w2OCk4k0xfstests-dev 2023-05-12T09:09:18.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:18.071 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.b9w2OCk4k0xfstests-dev) 2023-05-12T09:09:18.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:18.174 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.b9w2OCk4k0xfstests-dev) 2023-05-12T09:09:18.221 INFO:teuthology.orchestra.run.smithi116.stderr:Cloning into '/tmp/tmp.b9w2OCk4k0xfstests-dev'... 2023-05-12T09:09:19.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:19.057 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-05-12T09:09:19.107 DEBUG:teuthology.orchestra.run.smithi116:> mktemp -d --suffix=test 2023-05-12T09:09:19.148 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.A6WkqqsMBotest 2023-05-12T09:09:19.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:09:19.148 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-05-12T09:09:19.233 DEBUG:teuthology.orchestra.run.smithi116:> mktemp -d --suffix=scratch 2023-05-12T09:09:19.314 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.DMgB7X1Attscratch 2023-05-12T09:09:19.314 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-05-12T09:09:19.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-05-12T09:09:20.275 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:11:29 ago on Fri 12 May 2023 08:57:51 AM UTC. 2023-05-12T09:09:21.277 INFO:teuthology.orchestra.run.smithi116.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-05-12T09:09:21.278 INFO:teuthology.orchestra.run.smithi116.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-05-12T09:09:21.279 INFO:teuthology.orchestra.run.smithi116.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-05-12T09:09:21.280 INFO:teuthology.orchestra.run.smithi116.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-05-12T09:09:21.281 INFO:teuthology.orchestra.run.smithi116.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-05-12T09:09:21.282 INFO:teuthology.orchestra.run.smithi116.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-05-12T09:09:21.284 INFO:teuthology.orchestra.run.smithi116.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-05-12T09:09:21.285 INFO:teuthology.orchestra.run.smithi116.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-05-12T09:09:21.287 INFO:teuthology.orchestra.run.smithi116.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-05-12T09:09:21.288 INFO:teuthology.orchestra.run.smithi116.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-05-12T09:09:21.289 INFO:teuthology.orchestra.run.smithi116.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-05-12T09:09:21.290 INFO:teuthology.orchestra.run.smithi116.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-05-12T09:09:21.291 INFO:teuthology.orchestra.run.smithi116.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-05-12T09:09:21.292 INFO:teuthology.orchestra.run.smithi116.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-05-12T09:09:21.293 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-12T09:09:21.294 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-12T09:09:21.295 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-12T09:09:21.296 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-12T09:09:21.297 INFO:teuthology.orchestra.run.smithi116.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-05-12T09:09:21.298 INFO:teuthology.orchestra.run.smithi116.stdout:Package libuuid-devel-2.32.1-41.el8.x86_64 is already installed. 2023-05-12T09:09:21.299 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-05-12T09:09:21.300 INFO:teuthology.orchestra.run.smithi116.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-05-12T09:09:21.304 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-12T09:09:21.452 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-05-12T09:09:21.454 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2023-05-12T09:09:21.454 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2023-05-12T09:09:21.455 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2023-05-12T09:09:21.455 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-05-12T09:09:21.455 INFO:teuthology.orchestra.run.smithi116.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-05-12T09:09:21.455 INFO:teuthology.orchestra.run.smithi116.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-05-12T09:09:21.455 INFO:teuthology.orchestra.run.smithi116.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-05-12T09:09:21.455 INFO:teuthology.orchestra.run.smithi116.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-05-12T09:09:21.455 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-05-12T09:09:21.456 INFO:teuthology.orchestra.run.smithi116.stdout: daxctl-libs x86_64 71.1-4.el8 baseos 42 k 2023-05-12T09:09:21.456 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-05-12T09:09:21.456 INFO:teuthology.orchestra.run.smithi116.stdout: ndctl-libs x86_64 71.1-4.el8 baseos 80 k 2023-05-12T09:09:21.456 INFO:teuthology.orchestra.run.smithi116.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-05-12T09:09:21.456 INFO:teuthology.orchestra.run.smithi116.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-05-12T09:09:21.456 INFO:teuthology.orchestra.run.smithi116.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-05-12T09:09:21.456 INFO:teuthology.orchestra.run.smithi116.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-05-12T09:09:21.457 INFO:teuthology.orchestra.run.smithi116.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-05-12T09:09:21.457 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2023-05-12T09:09:21.457 INFO:teuthology.orchestra.run.smithi116.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-05-12T09:09:21.457 INFO:teuthology.orchestra.run.smithi116.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-05-12T09:09:21.457 INFO:teuthology.orchestra.run.smithi116.stdout:Enabling module streams: 2023-05-12T09:09:21.457 INFO:teuthology.orchestra.run.smithi116.stdout: python27 2.7 2023-05-12T09:09:21.457 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:21.457 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-05-12T09:09:21.458 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2023-05-12T09:09:21.458 INFO:teuthology.orchestra.run.smithi116.stdout:Install 14 Packages 2023-05-12T09:09:21.458 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:21.458 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 11 M 2023-05-12T09:09:21.459 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 40 M 2023-05-12T09:09:21.459 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-05-12T09:09:21.885 INFO:teuthology.orchestra.run.smithi116.stdout:(1/14): python2-2.7.18-12.module_el8+299+aa6e9a 615 kB/s | 110 kB 00:00 2023-05-12T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout:(2/14): libpmemblk-1.6.1-1.el8.x86_64.rpm 449 kB/s | 92 kB 00:00 2023-05-12T09:09:22.018 INFO:teuthology.orchestra.run.smithi116.stdout:(3/14): fio-3.19-4.el8.x86_64.rpm 1.7 MB/s | 538 kB 00:00 2023-05-12T09:09:22.218 INFO:teuthology.orchestra.run.smithi116.stdout:(4/14): python2-pip-9.0.3-19.module_el8+299+aa6 5.9 MB/s | 1.8 MB 00:00 2023-05-12T09:09:22.278 INFO:teuthology.orchestra.run.smithi116.stdout:(5/14): python2-pip-wheel-9.0.3-19.module_el8+2 3.4 MB/s | 892 kB 00:00 2023-05-12T09:09:22.403 INFO:teuthology.orchestra.run.smithi116.stdout:(6/14): python2-setuptools-39.0.1-13.module_el8 3.7 MB/s | 702 kB 00:00 2023-05-12T09:09:22.428 INFO:teuthology.orchestra.run.smithi116.stdout:(7/14): python2-setuptools-wheel-39.0.1-13.modu 1.9 MB/s | 287 kB 00:00 2023-05-12T09:09:22.470 INFO:teuthology.orchestra.run.smithi116.stdout:(8/14): python2-wheel-wheel-0.31.1-3.module_el8 666 kB/s | 44 kB 00:00 2023-05-12T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout:(9/14): daxctl-libs-71.1-4.el8.x86_64.rpm 456 kB/s | 42 kB 00:00 2023-05-12T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout:(10/14): ndctl-libs-71.1-4.el8.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2023-05-12T09:09:22.587 INFO:teuthology.orchestra.run.smithi116.stdout:(11/14): dump-0.4-0.36.b46.el8.x86_64.rpm 1.4 MB/s | 164 kB 00:00 2023-05-12T09:09:22.612 INFO:teuthology.orchestra.run.smithi116.stdout:(12/14): rmt-1.5.3-13.el8.x86_64.rpm 1.2 MB/s | 51 kB 00:00 2023-05-12T09:09:22.771 INFO:teuthology.orchestra.run.smithi116.stdout:(13/14): python2-libs-2.7.18-12.module_el8+299+ 7.3 MB/s | 6.5 MB 00:00 2023-05-12T09:09:22.879 INFO:teuthology.orchestra.run.smithi116.stdout:(14/14): indent-2.2.13-2.el8.x86_64.rpm 639 kB/s | 187 kB 00:00 2023-05-12T09:09:22.880 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-05-12T09:09:22.880 INFO:teuthology.orchestra.run.smithi116.stdout:Total 8.0 MB/s | 11 MB 00:01 2023-05-12T09:09:23.172 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-05-12T09:09:23.200 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-05-12T09:09:23.201 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-05-12T09:09:23.440 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-05-12T09:09:23.445 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-05-12T09:09:24.046 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-05-12T09:09:24.230 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : daxctl-libs-71.1-4.el8.x86_64 1/14 2023-05-12T09:09:24.301 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: daxctl-libs-71.1-4.el8.x86_64 1/14 2023-05-12T09:09:24.497 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ndctl-libs-71.1-4.el8.x86_64 2/14 2023-05-12T09:09:24.596 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ndctl-libs-71.1-4.el8.x86_64 2/14 2023-05-12T09:09:24.739 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/14 2023-05-12T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/14 2023-05-12T09:09:25.044 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 4/14 2023-05-12T09:09:25.195 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 5/14 2023-05-12T09:09:26.687 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/14 2023-05-12T09:09:27.481 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 7/14 2023-05-12T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 8/14 2023-05-12T09:09:28.129 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 9/14 2023-05-12T09:09:28.356 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 10/14 2023-05-12T09:09:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 10/14 2023-05-12T09:09:28.724 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 11/14 2023-05-12T09:09:28.985 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fio-3.19-4.el8.x86_64 12/14 2023-05-12T09:09:29.193 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : indent-2.2.13-2.el8.x86_64 13/14 2023-05-12T09:09:29.372 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 14/14 2023-05-12T09:09:29.796 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 14/14 2023-05-12T09:09:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fio-3.19-4.el8.x86_64 1/14 2023-05-12T09:09:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/14 2023-05-12T09:09:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/14 2023-05-12T09:09:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/14 2023-05-12T09:09:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/14 2023-05-12T09:09:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/14 2023-05-12T09:09:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/14 2023-05-12T09:09:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/14 2023-05-12T09:09:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/14 2023-05-12T09:09:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : daxctl-libs-71.1-4.el8.x86_64 10/14 2023-05-12T09:09:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/14 2023-05-12T09:09:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ndctl-libs-71.1-4.el8.x86_64 12/14 2023-05-12T09:09:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 13/14 2023-05-12T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : indent-2.2.13-2.el8.x86_64 14/14 2023-05-12T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-05-12T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: daxctl-libs-71.1-4.el8.x86_64 2023-05-12T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-05-12T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: fio-3.19-4.el8.x86_64 2023-05-12T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: indent-2.2.13-2.el8.x86_64 2023-05-12T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-05-12T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: ndctl-libs-71.1-4.el8.x86_64 2023-05-12T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-05-12T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-05-12T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-05-12T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-05-12T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-05-12T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-05-12T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-05-12T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-05-12T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-05-12T09:09:30.769 DEBUG:teuthology.orchestra.run.smithi116:> sudo useradd -m fsgqa 2023-05-12T09:09:30.832 INFO:teuthology.orchestra.run.smithi116.stderr:useradd: user 'fsgqa' already exists 2023-05-12T09:09:30.834 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-12T09:09:30.835 DEBUG:teuthology.orchestra.run.smithi116:> sudo groupadd fsgqa 2023-05-12T09:09:30.895 INFO:teuthology.orchestra.run.smithi116.stderr:groupadd: group 'fsgqa' already exists 2023-05-12T09:09:30.897 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-12T09:09:30.897 DEBUG:teuthology.orchestra.run.smithi116:> sudo useradd fsgqa2 2023-05-12T09:09:31.917 DEBUG:teuthology.orchestra.run.smithi116:> sudo useradd 123456-fsgqa 2023-05-12T09:09:32.500 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-05-12T09:09:32.686 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.683+0000 7f3241bff700 1 Processor -- start 2023-05-12T09:09:32.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.683+0000 7f3241bff700 1 -- start start 2023-05-12T09:09:32.687 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.684+0000 7f3241bff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f323c158d30 0x7f323c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:32.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.685+0000 7f3241bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c0cda50 0x7f323c0ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:32.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.685+0000 7f3241bff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c0cc9b0 con 0x7f323c070d60 2023-05-12T09:09:32.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.685+0000 7f3241bff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c071dd0 con 0x7f323c158d30 2023-05-12T09:09:32.688 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.685+0000 7f3241bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0ccc90 con 0x7f323c0cda50 2023-05-12T09:09:32.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.685+0000 7f323bfff700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f323c070d60 0x7f323c15c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:35268/0 (socket says 172.21.15.116:35268) 2023-05-12T09:09:32.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.685+0000 7f323bfff700 1 -- 172.21.15.116:0/3086252121 learned_addr learned my addr 172.21.15.116:0/3086252121 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-05-12T09:09:32.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.685+0000 7f323affd700 1 --2- 172.21.15.116:0/3086252121 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c0cda50 0x7f323c0ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:32.690 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.685+0000 7f323b7fe700 1 --2- 172.21.15.116:0/3086252121 >> v2:172.21.15.182:3300/0 conn(0x7f323c158d30 0x7f323c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:32.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.685+0000 7f323a7fc700 1 -- 172.21.15.116:0/3086252121 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402082485 0 0) 0x7f323c0cc9b0 con 0x7f323c070d60 2023-05-12T09:09:32.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.685+0000 7f323a7fc700 1 -- 172.21.15.116:0/3086252121 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32240035b0 con 0x7f323c070d60 2023-05-12T09:09:32.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.686+0000 7f323b7fe700 1 -- 172.21.15.116:0/3086252121 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c0cda50 msgr2=0x7f323c0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:32.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.686+0000 7f323b7fe700 1 --2- 172.21.15.116:0/3086252121 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c0cda50 0x7f323c0ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:32.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.686+0000 7f323b7fe700 1 -- 172.21.15.116:0/3086252121 >> v1:172.21.15.116:6789/0 conn(0x7f323c070d60 legacy=0x7f323c15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:32.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.686+0000 7f323b7fe700 1 -- 172.21.15.116:0/3086252121 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c0ccf70 con 0x7f323c158d30 2023-05-12T09:09:32.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.686+0000 7f323affd700 1 --2- 172.21.15.116:0/3086252121 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c0cda50 0x7f323c0ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-12T09:09:32.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.686+0000 7f323b7fe700 1 --2- 172.21.15.116:0/3086252121 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f323c158d30 0x7f323c0ca330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f322c009840 tx=0x7f322c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0bac52a08e42e33 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:32.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.686+0000 7f323a7fc700 1 -- 172.21.15.116:0/3086252121 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011830 con 0x7f323c158d30 2023-05-12T09:09:32.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.686+0000 7f323a7fc700 1 -- 172.21.15.116:0/3086252121 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c011990 con 0x7f323c158d30 2023-05-12T09:09:32.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.686+0000 7f323a7fc700 1 -- 172.21.15.116:0/3086252121 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011d20 con 0x7f323c158d30 2023-05-12T09:09:32.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.687+0000 7f3241bff700 1 -- 172.21.15.116:0/3086252121 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f323c158d30 msgr2=0x7f323c0ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:32.692 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.687+0000 7f3241bff700 1 --2- 172.21.15.116:0/3086252121 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f323c158d30 0x7f323c0ca330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f322c009840 tx=0x7f322c009b50 comp rx=0 tx=0).stop 2023-05-12T09:09:32.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.687+0000 7f3241bff700 1 -- 172.21.15.116:0/3086252121 shutdown_connections 2023-05-12T09:09:32.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.687+0000 7f3241bff700 1 --2- 172.21.15.116:0/3086252121 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f323c158d30 0x7f323c0ca330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:32.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.687+0000 7f3241bff700 1 --2- 172.21.15.116:0/3086252121 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c0cda50 0x7f323c0ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:32.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.687+0000 7f3241bff700 1 -- 172.21.15.116:0/3086252121 >> 172.21.15.116:0/3086252121 conn(0x7f323c0cb6c0 msgr2=0x7f323c0cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:32.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.687+0000 7f3241bff700 1 -- 172.21.15.116:0/3086252121 shutdown_connections 2023-05-12T09:09:32.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.687+0000 7f3241bff700 1 -- 172.21.15.116:0/3086252121 wait complete. 2023-05-12T09:09:32.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.688+0000 7f3241bff700 1 Processor -- start 2023-05-12T09:09:32.695 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.689+0000 7f3241bff700 1 -- start start 2023-05-12T09:09:32.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.689+0000 7f3241bff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c070d60 0x7f323c1e58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:32.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.689+0000 7f3241bff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f323c0cda50 0x7f323c1e3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:32.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f3241bff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c158d30 0x7f323c1e7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:32.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f3241bff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1e37a0 con 0x7f323c070d60 2023-05-12T09:09:32.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f3241bff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1e5fa0 con 0x7f323c0cda50 2023-05-12T09:09:32.696 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f3241bff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1e6280 con 0x7f323c158d30 2023-05-12T09:09:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323b7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c070d60 0x7f323c1e58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323b7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c070d60 0x7f323c1e58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49262/0 (socket says 172.21.15.116:49262) 2023-05-12T09:09:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323b7fe700 1 -- 172.21.15.116:0/1615120367 learned_addr learned my addr 172.21.15.116:0/1615120367 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323affd700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f323c0cda50 0x7f323c1e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323bfff700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c158d30 0x7f323c1e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323b7fe700 1 -- 172.21.15.116:0/1615120367 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c158d30 msgr2=0x7f323c1e7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323b7fe700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c158d30 0x7f323c1e7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323b7fe700 1 -- 172.21.15.116:0/1615120367 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f323c0cda50 msgr2=0x7f323c1e3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323b7fe700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f323c0cda50 0x7f323c1e3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323b7fe700 1 -- 172.21.15.116:0/1615120367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32300094a0 con 0x7f323c070d60 2023-05-12T09:09:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323bfff700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c158d30 0x7f323c1e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.690+0000 7f323b7fe700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c070d60 0x7f323c1e58a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f322c009fd0 tx=0x7f322c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.691+0000 7f3223fff700 1 -- 172.21.15.116:0/1615120367 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0036a0 con 0x7f323c070d60 2023-05-12T09:09:32.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.691+0000 7f3223fff700 1 -- 172.21.15.116:0/1615120367 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c01e070 con 0x7f323c070d60 2023-05-12T09:09:32.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.691+0000 7f3223fff700 1 -- 172.21.15.116:0/1615120367 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c003a60 con 0x7f323c070d60 2023-05-12T09:09:32.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.691+0000 7f3241bff700 1 -- 172.21.15.116:0/1615120367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322c0094a0 con 0x7f323c070d60 2023-05-12T09:09:32.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.691+0000 7f3241bff700 1 -- 172.21.15.116:0/1615120367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c0cd530 con 0x7f323c070d60 2023-05-12T09:09:32.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.692+0000 7f3241bff700 1 -- 172.21.15.116:0/1615120367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c0cd250 con 0x7f323c070d60 2023-05-12T09:09:32.699 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.693+0000 7f3223fff700 1 -- 172.21.15.116:0/1615120367 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f322c003bc0 con 0x7f323c070d60 2023-05-12T09:09:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.693+0000 7f3223fff700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f322806ace0 0x7f322806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.693+0000 7f3223fff700 1 -- 172.21.15.116:0/1615120367 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f322c08a520 con 0x7f323c070d60 2023-05-12T09:09:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.694+0000 7f323affd700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f322806ace0 0x7f322806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.694+0000 7f323affd700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f322806ace0 0x7f322806d190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f323c0c4fc0 tx=0x7f3230008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.698+0000 7f3223fff700 1 -- 172.21.15.116:0/1615120367 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f322c055530 con 0x7f323c070d60 2023-05-12T09:09:32.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.971+0000 7f3241bff700 1 -- 172.21.15.116:0/1615120367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f323c0711e0 con 0x7f323c070d60 2023-05-12T09:09:32.974 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.971+0000 7f3223fff700 1 -- 172.21.15.116:0/1615120367 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f322c020510 con 0x7f323c070d60 2023-05-12T09:09:32.975 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:09:32.975 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"09fd430d-d641-4faf-8b07-e4040d2273e8","modified":"2023-05-12T09:06:12.333526Z","created":"2023-05-12T09:06:12.333526Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:3300","nonce":0},{"type":"v1","addr":"172.21.15.182:6789","nonce":0}]},"addr":"172.21.15.182:6789/0","public_addr":"172.21.15.182:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:3301","nonce":0},{"type":"v1","addr":"172.21.15.182:6790","nonce":0}]},"addr":"172.21.15.182:6790/0","public_addr":"172.21.15.182:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-12T09:09:32.976 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.973+0000 7f3241bff700 1 -- 172.21.15.116:0/1615120367 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f322806ace0 msgr2=0x7f322806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:32.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.973+0000 7f3241bff700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f322806ace0 0x7f322806d190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f323c0c4fc0 tx=0x7f3230008040 comp rx=0 tx=0).stop 2023-05-12T09:09:32.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.973+0000 7f3241bff700 1 -- 172.21.15.116:0/1615120367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c070d60 msgr2=0x7f323c1e58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:32.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.973+0000 7f3241bff700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c070d60 0x7f323c1e58a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f322c009fd0 tx=0x7f322c004750 comp rx=0 tx=0).stop 2023-05-12T09:09:32.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.973+0000 7f3241bff700 1 -- 172.21.15.116:0/1615120367 shutdown_connections 2023-05-12T09:09:32.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.973+0000 7f3241bff700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7f322806ace0 0x7f322806d190 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:32.977 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.973+0000 7f3241bff700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f323c158d30 0x7f323c1e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:32.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.973+0000 7f3241bff700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c070d60 0x7f323c1e58a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:32.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.973+0000 7f3241bff700 1 --2- 172.21.15.116:0/1615120367 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f323c0cda50 0x7f323c1e3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:32.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.973+0000 7f3241bff700 1 -- 172.21.15.116:0/1615120367 >> 172.21.15.116:0/1615120367 conn(0x7f323c0cb6c0 msgr2=0x7f323c0b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:32.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.974+0000 7f3241bff700 1 -- 172.21.15.116:0/1615120367 shutdown_connections 2023-05-12T09:09:32.978 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:32.974+0000 7f3241bff700 1 -- 172.21.15.116:0/1615120367 wait complete. 2023-05-12T09:09:32.979 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2023-05-12T09:09:32.994 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-05-12T09:09:33.179 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.176+0000 7faaa73ff700 1 Processor -- start 2023-05-12T09:09:33.180 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.176+0000 7faaa73ff700 1 -- start start 2023-05-12T09:09:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa73ff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7faaa00b87a0 0x7faaa00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa73ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faaa01601e0 0x7faaa0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa73ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faaa0160b70 0x7faaa00d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa73ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa00d02d0 con 0x7faaa0160b70 2023-05-12T09:09:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa73ff700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa00d0cb0 con 0x7faaa00b87a0 2023-05-12T09:09:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa73ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00b2730 con 0x7faaa01601e0 2023-05-12T09:09:33.182 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa599c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faaa0160b70 0x7faaa00d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:33.182 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa599c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faaa0160b70 0x7faaa00d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49266/0 (socket says 172.21.15.116:49266) 2023-05-12T09:09:33.182 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa599c700 1 -- 172.21.15.116:0/147393869 learned_addr learned my addr 172.21.15.116:0/147393869 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa499a700 1 --2- 172.21.15.116:0/147393869 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faaa01601e0 0x7faaa0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa519b700 1 --2- 172.21.15.116:0/147393869 >> v2:172.21.15.182:3300/0 conn(0x7faaa00b87a0 0x7faaa00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa599c700 1 -- 172.21.15.116:0/147393869 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faaa01601e0 msgr2=0x7faaa0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:33.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa599c700 1 --2- 172.21.15.116:0/147393869 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faaa01601e0 0x7faaa0160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa599c700 1 -- 172.21.15.116:0/147393869 >> v2:172.21.15.182:3300/0 conn(0x7faaa00b87a0 msgr2=0x7faaa00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-12T09:09:33.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa599c700 1 --2- 172.21.15.116:0/147393869 >> v2:172.21.15.182:3300/0 conn(0x7faaa00b87a0 0x7faaa00cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa599c700 1 -- 172.21.15.116:0/147393869 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0160ff0 con 0x7faaa0160b70 2023-05-12T09:09:33.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.178+0000 7faaa519b700 1 --2- 172.21.15.116:0/147393869 >> v2:172.21.15.182:3300/0 conn(0x7faaa00b87a0 0x7faaa00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-12T09:09:33.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faaa599c700 1 --2- 172.21.15.116:0/147393869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa0160b70 0x7faaa00d2de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faaa00b4ac0 tx=0x7faa9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6611777ef13438a7 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:33.184 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faa97fff700 1 -- 172.21.15.116:0/147393869 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9800e070 con 0x7faaa0160b70 2023-05-12T09:09:33.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faa97fff700 1 -- 172.21.15.116:0/147393869 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9800b9c0 con 0x7faaa0160b70 2023-05-12T09:09:33.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faa97fff700 1 -- 172.21.15.116:0/147393869 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9800bd70 con 0x7faaa0160b70 2023-05-12T09:09:33.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faaa73ff700 1 -- 172.21.15.116:0/147393869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa0160b70 msgr2=0x7faaa00d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:33.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faaa73ff700 1 --2- 172.21.15.116:0/147393869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa0160b70 0x7faaa00d2de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faaa00b4ac0 tx=0x7faa9800b330 comp rx=0 tx=0).stop 2023-05-12T09:09:33.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faaa73ff700 1 -- 172.21.15.116:0/147393869 shutdown_connections 2023-05-12T09:09:33.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faaa73ff700 1 --2- 172.21.15.116:0/147393869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa0160b70 0x7faaa00d2de0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.185 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faaa73ff700 1 --2- 172.21.15.116:0/147393869 >> v2:172.21.15.182:3300/0 conn(0x7faaa00b87a0 0x7faaa00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.186 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faaa73ff700 1 --2- 172.21.15.116:0/147393869 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faaa01601e0 0x7faaa0160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.186 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faaa73ff700 1 -- 172.21.15.116:0/147393869 >> 172.21.15.116:0/147393869 conn(0x7faaa0071b10 msgr2=0x7faaa0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:33.186 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faaa73ff700 1 -- 172.21.15.116:0/147393869 shutdown_connections 2023-05-12T09:09:33.186 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.179+0000 7faaa73ff700 1 -- 172.21.15.116:0/147393869 wait complete. 2023-05-12T09:09:33.188 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.181+0000 7faaa73ff700 1 Processor -- start 2023-05-12T09:09:33.188 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.181+0000 7faaa73ff700 1 -- start start 2023-05-12T09:09:33.188 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.182+0000 7faaa73ff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa00b87a0 0x7faaa00c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:33.188 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.182+0000 7faaa73ff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faaa01601e0 0x7faaa01514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:33.188 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.182+0000 7faaa73ff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faaa0160b70 0x7faaa00b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:33.188 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.182+0000 7faaa73ff700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00c6f00 con 0x7faaa00b87a0 2023-05-12T09:09:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.182+0000 7faaa73ff700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00c7180 con 0x7faaa0160b70 2023-05-12T09:09:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.182+0000 7faaa73ff700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00c7460 con 0x7faaa01601e0 2023-05-12T09:09:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.182+0000 7faaa519b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa00b87a0 0x7faaa00c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.182+0000 7faaa519b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa00b87a0 0x7faaa00c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49274/0 (socket says 172.21.15.116:49274) 2023-05-12T09:09:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.182+0000 7faaa519b700 1 -- 172.21.15.116:0/433829804 learned_addr learned my addr 172.21.15.116:0/433829804 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-05-12T09:09:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faaa599c700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faaa0160b70 0x7faaa00b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faaa499a700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faaa01601e0 0x7faaa01514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faaa519b700 1 -- 172.21.15.116:0/433829804 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faaa01601e0 msgr2=0x7faaa01514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faaa519b700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faaa01601e0 0x7faaa01514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faaa519b700 1 -- 172.21.15.116:0/433829804 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faaa0160b70 msgr2=0x7faaa00b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faaa519b700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faaa0160b70 0x7faaa00b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faaa519b700 1 -- 172.21.15.116:0/433829804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98009b30 con 0x7faaa00b87a0 2023-05-12T09:09:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faaa519b700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa00b87a0 0x7faaa00c69c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c7f0 tx=0x7faa9c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faa95ffb700 1 -- 172.21.15.116:0/433829804 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c011800 con 0x7faaa00b87a0 2023-05-12T09:09:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faa95ffb700 1 -- 172.21.15.116:0/433829804 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c011960 con 0x7faaa00b87a0 2023-05-12T09:09:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faa95ffb700 1 -- 172.21.15.116:0/433829804 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c011d10 con 0x7faaa00b87a0 2023-05-12T09:09:33.191 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faaa73ff700 1 -- 172.21.15.116:0/433829804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa00cd6a0 con 0x7faaa00b87a0 2023-05-12T09:09:33.191 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.183+0000 7faaa73ff700 1 -- 172.21.15.116:0/433829804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa00cdc60 con 0x7faaa00b87a0 2023-05-12T09:09:33.191 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.184+0000 7faaa73ff700 1 -- 172.21.15.116:0/433829804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa00cd980 con 0x7faaa00b87a0 2023-05-12T09:09:33.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.185+0000 7faa95ffb700 1 -- 172.21.15.116:0/433829804 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa9c018360 con 0x7faaa00b87a0 2023-05-12T09:09:33.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.186+0000 7faa95ffb700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faa8406ad10 0x7faa8406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-12T09:09:33.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.186+0000 7faa95ffb700 1 -- 172.21.15.116:0/433829804 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faa9c089610 con 0x7faaa00b87a0 2023-05-12T09:09:33.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.186+0000 7faaa499a700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faa8406ad10 0x7faa8406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-12T09:09:33.192 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.187+0000 7faaa499a700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faa8406ad10 0x7faa8406d1c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faaa015f9a0 tx=0x7faa90008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-12T09:09:33.193 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.191+0000 7faa95ffb700 1 -- 172.21.15.116:0/433829804 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faa9c0544e0 con 0x7faaa00b87a0 2023-05-12T09:09:33.462 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.459+0000 7faaa73ff700 1 -- 172.21.15.116:0/433829804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7faaa00c7950 con 0x7faaa00b87a0 2023-05-12T09:09:33.463 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.460+0000 7faa95ffb700 1 -- 172.21.15.116:0/433829804 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7faa9c057b00 con 0x7faaa00b87a0 2023-05-12T09:09:33.463 INFO:teuthology.orchestra.run.smithi116.stdout:[client.admin] 2023-05-12T09:09:33.463 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCEAV5kjeSqJxAAYIOfjwO95S7777UCRKuLAg== 2023-05-12T09:09:33.464 INFO:teuthology.orchestra.run.smithi116.stdout: caps mds = "allow *" 2023-05-12T09:09:33.464 INFO:teuthology.orchestra.run.smithi116.stdout: caps mgr = "allow *" 2023-05-12T09:09:33.464 INFO:teuthology.orchestra.run.smithi116.stdout: caps mon = "allow *" 2023-05-12T09:09:33.464 INFO:teuthology.orchestra.run.smithi116.stdout: caps osd = "allow *" 2023-05-12T09:09:33.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 -- 172.21.15.116:0/433829804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faa8406ad10 msgr2=0x7faa8406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:33.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faa8406ad10 0x7faa8406d1c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faaa015f9a0 tx=0x7faa90008040 comp rx=0 tx=0).stop 2023-05-12T09:09:33.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 -- 172.21.15.116:0/433829804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa00b87a0 msgr2=0x7faaa00c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-12T09:09:33.465 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa00b87a0 0x7faaa00c69c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c7f0 tx=0x7faa9c00cbb0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 -- 172.21.15.116:0/433829804 shutdown_connections 2023-05-12T09:09:33.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faaa0160b70 0x7faaa00b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaa00b87a0 0x7faaa00c69c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.116:6832/3989593778,v1:172.21.15.116:6833/3989593778] conn(0x7faa8406ad10 0x7faa8406d1c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 --2- 172.21.15.116:0/433829804 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faaa01601e0 0x7faaa01514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-12T09:09:33.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 -- 172.21.15.116:0/433829804 >> 172.21.15.116:0/433829804 conn(0x7faaa0071b10 msgr2=0x7faaa00b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-12T09:09:33.466 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 -- 172.21.15.116:0/433829804 shutdown_connections 2023-05-12T09:09:33.467 INFO:teuthology.orchestra.run.smithi116.stderr:2023-05-12T09:09:33.462+0000 7faaa73ff700 1 -- 172.21.15.116:0/433829804 wait complete. 2023-05-12T09:09:33.482 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2023-05-12T09:09:33.525 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.UwSMbZH9qJ 2023-05-12T09:09:33.526 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:09:33.526 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/tmp/tmp.UwSMbZH9qJ 2023-05-12T09:09:33.606 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:09:33.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/tmp/tmp.b9w2OCk4k0xfstests-dev/local.config 2023-05-12T09:09:33.709 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.A6WkqqsMBotest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.DMgB7X1Attscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.116:6789 -k /tmp/tmp.UwSMbZH9qJ --client_mountpoint /test" 2023-05-12T09:09:33.710 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T09:09:33.710 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/tmp/tmp.b9w2OCk4k0xfstests-dev/ceph.exclude 2023-05-12T09:09:33.811 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo make) 2023-05-12T09:09:33.937 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize -cfi 2023-05-12T09:09:34.396 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: putting auxiliary files in '.'. 2023-05-12T09:09:34.397 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: copying file './config.guess' 2023-05-12T09:09:34.405 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: copying file './config.sub' 2023-05-12T09:09:34.414 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: copying file './install-sh' 2023-05-12T09:09:34.424 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: copying file './ltmain.sh' 2023-05-12T09:09:34.478 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-05-12T09:09:34.479 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-05-12T09:09:34.490 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-05-12T09:09:34.501 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-05-12T09:09:34.512 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-05-12T09:09:34.524 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-05-12T09:09:34.538 INFO:teuthology.orchestra.run.smithi116.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-05-12T09:09:34.541 INFO:teuthology.orchestra.run.smithi116.stdout:cp include/install-sh . 2023-05-12T09:09:34.543 INFO:teuthology.orchestra.run.smithi116.stdout:aclocal -I m4 2023-05-12T09:09:35.767 INFO:teuthology.orchestra.run.smithi116.stdout:autoheader 2023-05-12T09:09:36.134 INFO:teuthology.orchestra.run.smithi116.stdout:autoconf 2023-05-12T09:09:36.334 INFO:teuthology.orchestra.run.smithi116.stdout:./configure \ 2023-05-12T09:09:36.335 INFO:teuthology.orchestra.run.smithi116.stdout: --libexecdir=/usr/lib \ 2023-05-12T09:09:36.335 INFO:teuthology.orchestra.run.smithi116.stdout: --exec_prefix=/var/lib 2023-05-12T09:09:36.915 INFO:teuthology.orchestra.run.smithi116.stdout:checking build system type... x86_64-pc-linux-gnu 2023-05-12T09:09:36.915 INFO:teuthology.orchestra.run.smithi116.stdout:checking host system type... x86_64-pc-linux-gnu 2023-05-12T09:09:36.918 INFO:teuthology.orchestra.run.smithi116.stdout:checking how to print strings... printf 2023-05-12T09:09:36.919 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gcc... gcc 2023-05-12T09:09:37.075 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether the C compiler works... yes 2023-05-12T09:09:37.075 INFO:teuthology.orchestra.run.smithi116.stdout:checking for C compiler default output file name... a.out 2023-05-12T09:09:37.123 INFO:teuthology.orchestra.run.smithi116.stdout:checking for suffix of executables... 2023-05-12T09:09:37.191 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether we are cross compiling... no 2023-05-12T09:09:37.226 INFO:teuthology.orchestra.run.smithi116.stdout:checking for suffix of object files... o 2023-05-12T09:09:37.257 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether we are using the GNU C compiler... yes 2023-05-12T09:09:37.290 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether gcc accepts -g... yes 2023-05-12T09:09:37.335 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gcc option to accept ISO C89... none needed 2023-05-12T09:09:37.342 INFO:teuthology.orchestra.run.smithi116.stdout:checking for a sed that does not truncate output... /bin/sed 2023-05-12T09:09:37.346 INFO:teuthology.orchestra.run.smithi116.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-05-12T09:09:37.349 INFO:teuthology.orchestra.run.smithi116.stdout:checking for egrep... /bin/grep -E 2023-05-12T09:09:37.352 INFO:teuthology.orchestra.run.smithi116.stdout:checking for fgrep... /bin/grep -F 2023-05-12T09:09:37.359 INFO:teuthology.orchestra.run.smithi116.stdout:checking for ld used by gcc... /bin/ld 2023-05-12T09:09:37.363 INFO:teuthology.orchestra.run.smithi116.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-05-12T09:09:37.372 INFO:teuthology.orchestra.run.smithi116.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-05-12T09:09:37.409 INFO:teuthology.orchestra.run.smithi116.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-05-12T09:09:37.409 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether ln -s works... yes 2023-05-12T09:09:37.423 INFO:teuthology.orchestra.run.smithi116.stdout:checking the maximum length of command line arguments... 1572864 2023-05-12T09:09:37.428 INFO:teuthology.orchestra.run.smithi116.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-05-12T09:09:37.429 INFO:teuthology.orchestra.run.smithi116.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-05-12T09:09:37.429 INFO:teuthology.orchestra.run.smithi116.stdout:checking for /bin/ld option to reload object files... -r 2023-05-12T09:09:37.429 INFO:teuthology.orchestra.run.smithi116.stdout:checking for objdump... objdump 2023-05-12T09:09:37.430 INFO:teuthology.orchestra.run.smithi116.stdout:checking how to recognize dependent libraries... pass_all 2023-05-12T09:09:37.430 INFO:teuthology.orchestra.run.smithi116.stdout:checking for dlltool... no 2023-05-12T09:09:37.431 INFO:teuthology.orchestra.run.smithi116.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-05-12T09:09:37.431 INFO:teuthology.orchestra.run.smithi116.stdout:checking for ar... ar 2023-05-12T09:09:37.480 INFO:teuthology.orchestra.run.smithi116.stdout:checking for archiver @FILE support... @ 2023-05-12T09:09:37.481 INFO:teuthology.orchestra.run.smithi116.stdout:checking for strip... strip 2023-05-12T09:09:37.481 INFO:teuthology.orchestra.run.smithi116.stdout:checking for ranlib... ranlib 2023-05-12T09:09:37.481 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gawk... gawk 2023-05-12T09:09:37.585 INFO:teuthology.orchestra.run.smithi116.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-05-12T09:09:37.587 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sysroot... no 2023-05-12T09:09:37.594 INFO:teuthology.orchestra.run.smithi116.stdout:checking for a working dd... /bin/dd 2023-05-12T09:09:37.600 INFO:teuthology.orchestra.run.smithi116.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-05-12T09:09:37.627 INFO:teuthology.orchestra.run.smithi116.stdout:checking for mt... no 2023-05-12T09:09:37.632 INFO:teuthology.orchestra.run.smithi116.stdout:checking if : is a manifest tool... no 2023-05-12T09:09:37.690 INFO:teuthology.orchestra.run.smithi116.stdout:checking how to run the C preprocessor... gcc -E 2023-05-12T09:09:37.935 INFO:teuthology.orchestra.run.smithi116.stdout:checking for ANSI C header files... yes 2023-05-12T09:09:37.976 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/types.h... yes 2023-05-12T09:09:38.028 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/stat.h... yes 2023-05-12T09:09:38.076 INFO:teuthology.orchestra.run.smithi116.stdout:checking for stdlib.h... yes 2023-05-12T09:09:38.126 INFO:teuthology.orchestra.run.smithi116.stdout:checking for string.h... yes 2023-05-12T09:09:38.176 INFO:teuthology.orchestra.run.smithi116.stdout:checking for memory.h... yes 2023-05-12T09:09:38.225 INFO:teuthology.orchestra.run.smithi116.stdout:checking for strings.h... yes 2023-05-12T09:09:38.288 INFO:teuthology.orchestra.run.smithi116.stdout:checking for inttypes.h... yes 2023-05-12T09:09:38.338 INFO:teuthology.orchestra.run.smithi116.stdout:checking for stdint.h... yes 2023-05-12T09:09:38.403 INFO:teuthology.orchestra.run.smithi116.stdout:checking for unistd.h... yes 2023-05-12T09:09:38.459 INFO:teuthology.orchestra.run.smithi116.stdout:checking for dlfcn.h... yes 2023-05-12T09:09:38.466 INFO:teuthology.orchestra.run.smithi116.stdout:checking for objdir... .libs 2023-05-12T09:09:38.592 INFO:teuthology.orchestra.run.smithi116.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-05-12T09:09:38.593 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-05-12T09:09:38.628 INFO:teuthology.orchestra.run.smithi116.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-05-12T09:09:38.665 INFO:teuthology.orchestra.run.smithi116.stdout:checking if gcc static flag -static works... no 2023-05-12T09:09:38.714 INFO:teuthology.orchestra.run.smithi116.stdout:checking if gcc supports -c -o file.o... yes 2023-05-12T09:09:38.714 INFO:teuthology.orchestra.run.smithi116.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-05-12T09:09:38.727 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-05-12T09:09:38.774 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether -lc should be explicitly linked in... no 2023-05-12T09:09:38.864 INFO:teuthology.orchestra.run.smithi116.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-05-12T09:09:38.864 INFO:teuthology.orchestra.run.smithi116.stdout:checking how to hardcode library paths into programs... immediate 2023-05-12T09:09:38.871 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether stripping libraries is possible... yes 2023-05-12T09:09:38.871 INFO:teuthology.orchestra.run.smithi116.stdout:checking if libtool supports shared libraries... yes 2023-05-12T09:09:38.871 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether to build shared libraries... yes 2023-05-12T09:09:38.871 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether to build static libraries... yes 2023-05-12T09:09:38.882 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gcc... (cached) gcc 2023-05-12T09:09:38.917 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-05-12T09:09:38.918 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-12T09:09:38.918 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-05-12T09:09:38.918 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gmake... /usr/bin/gmake 2023-05-12T09:09:38.919 INFO:teuthology.orchestra.run.smithi116.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-05-12T09:09:38.919 INFO:teuthology.orchestra.run.smithi116.stdout:checking for tar... /bin/tar 2023-05-12T09:09:38.919 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gzip... /bin/gzip 2023-05-12T09:09:38.934 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether gcc -MM is supported... yes 2023-05-12T09:09:38.934 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sort... /bin/sort 2023-05-12T09:09:38.935 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether ln -s works... yes 2023-05-12T09:09:38.935 INFO:teuthology.orchestra.run.smithi116.stdout:checking for rpm... /bin/rpm 2023-05-12T09:09:38.942 INFO:teuthology.orchestra.run.smithi116.stdout:checking for rpmbuild... no 2023-05-12T09:09:39.004 INFO:teuthology.orchestra.run.smithi116.stdout:checking assert.h usability... yes 2023-05-12T09:09:39.019 INFO:teuthology.orchestra.run.smithi116.stdout:checking assert.h presence... yes 2023-05-12T09:09:39.020 INFO:teuthology.orchestra.run.smithi116.stdout:checking for assert.h... yes 2023-05-12T09:09:39.072 INFO:teuthology.orchestra.run.smithi116.stdout:checking bstring.h usability... no 2023-05-12T09:09:39.094 INFO:teuthology.orchestra.run.smithi116.stdout:checking bstring.h presence... no 2023-05-12T09:09:39.094 INFO:teuthology.orchestra.run.smithi116.stdout:checking for bstring.h... no 2023-05-12T09:09:39.141 INFO:teuthology.orchestra.run.smithi116.stdout:checking libgen.h usability... yes 2023-05-12T09:09:39.156 INFO:teuthology.orchestra.run.smithi116.stdout:checking libgen.h presence... yes 2023-05-12T09:09:39.156 INFO:teuthology.orchestra.run.smithi116.stdout:checking for libgen.h... yes 2023-05-12T09:09:39.210 INFO:teuthology.orchestra.run.smithi116.stdout:checking dirent.h usability... yes 2023-05-12T09:09:39.226 INFO:teuthology.orchestra.run.smithi116.stdout:checking dirent.h presence... yes 2023-05-12T09:09:39.226 INFO:teuthology.orchestra.run.smithi116.stdout:checking for dirent.h... yes 2023-05-12T09:09:39.310 INFO:teuthology.orchestra.run.smithi116.stdout:checking errno.h usability... yes 2023-05-12T09:09:39.325 INFO:teuthology.orchestra.run.smithi116.stdout:checking errno.h presence... yes 2023-05-12T09:09:39.326 INFO:teuthology.orchestra.run.smithi116.stdout:checking for errno.h... yes 2023-05-12T09:09:39.388 INFO:teuthology.orchestra.run.smithi116.stdout:checking malloc.h usability... yes 2023-05-12T09:09:39.405 INFO:teuthology.orchestra.run.smithi116.stdout:checking malloc.h presence... yes 2023-05-12T09:09:39.405 INFO:teuthology.orchestra.run.smithi116.stdout:checking for malloc.h... yes 2023-05-12T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout:checking uuid.h usability... no 2023-05-12T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout:checking uuid.h presence... no 2023-05-12T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout:checking for uuid.h... no 2023-05-12T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout:checking uuid/uuid.h usability... yes 2023-05-12T09:09:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:checking uuid/uuid.h presence... yes 2023-05-12T09:09:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:checking for uuid/uuid.h... yes 2023-05-12T09:09:39.606 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/uuid.h usability... no 2023-05-12T09:09:39.629 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/uuid.h presence... no 2023-05-12T09:09:39.630 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/uuid.h... no 2023-05-12T09:09:39.679 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/file.h usability... yes 2023-05-12T09:09:39.695 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/file.h presence... yes 2023-05-12T09:09:39.695 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/file.h... yes 2023-05-12T09:09:39.758 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/fcntl.h usability... yes 2023-05-12T09:09:39.773 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/fcntl.h presence... yes 2023-05-12T09:09:39.773 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/fcntl.h... yes 2023-05-12T09:09:39.825 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/syssgi.h usability... no 2023-05-12T09:09:39.847 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/syssgi.h presence... no 2023-05-12T09:09:39.847 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/syssgi.h... no 2023-05-12T09:09:39.919 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/param.h usability... yes 2023-05-12T09:09:39.940 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/param.h presence... yes 2023-05-12T09:09:39.940 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/param.h... yes 2023-05-12T09:09:39.952 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/stat.h... (cached) yes 2023-05-12T09:09:40.006 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/statvfs.h usability... yes 2023-05-12T09:09:40.021 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/statvfs.h presence... yes 2023-05-12T09:09:40.022 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/statvfs.h... yes 2023-05-12T09:09:40.075 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/time.h usability... yes 2023-05-12T09:09:40.091 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/time.h presence... yes 2023-05-12T09:09:40.091 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/time.h... yes 2023-05-12T09:09:40.152 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/ioctl.h usability... yes 2023-05-12T09:09:40.167 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/ioctl.h presence... yes 2023-05-12T09:09:40.167 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/ioctl.h... yes 2023-05-12T09:09:40.224 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/wait.h usability... yes 2023-05-12T09:09:40.242 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/wait.h presence... yes 2023-05-12T09:09:40.243 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/wait.h... yes 2023-05-12T09:09:40.255 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/types.h... (cached) yes 2023-05-12T09:09:40.267 INFO:teuthology.orchestra.run.smithi116.stdout:checking for strings.h... (cached) yes 2023-05-12T09:09:40.321 INFO:teuthology.orchestra.run.smithi116.stdout:checking err.h usability... yes 2023-05-12T09:09:40.336 INFO:teuthology.orchestra.run.smithi116.stdout:checking err.h presence... yes 2023-05-12T09:09:40.336 INFO:teuthology.orchestra.run.smithi116.stdout:checking for err.h... yes 2023-05-12T09:09:40.390 INFO:teuthology.orchestra.run.smithi116.stdout:checking linux/falloc.h usability... yes 2023-05-12T09:09:40.404 INFO:teuthology.orchestra.run.smithi116.stdout:checking linux/falloc.h presence... yes 2023-05-12T09:09:40.404 INFO:teuthology.orchestra.run.smithi116.stdout:checking for linux/falloc.h... yes 2023-05-12T09:09:40.456 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-05-12T09:09:40.478 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-05-12T09:09:40.478 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/fs/xfs_fsops.h... no 2023-05-12T09:09:40.505 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:09:40.509 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:09:40.524 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/fs/xfs_itable.h usability... no 2023-05-12T09:09:40.547 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/fs/xfs_itable.h presence... no 2023-05-12T09:09:40.547 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/fs/xfs_itable.h... no 2023-05-12T09:09:40.609 INFO:teuthology.orchestra.run.smithi116.stdout:checking xfs/platform_defs.h usability... no 2023-05-12T09:09:40.632 INFO:teuthology.orchestra.run.smithi116.stdout:checking xfs/platform_defs.h presence... no 2023-05-12T09:09:40.632 INFO:teuthology.orchestra.run.smithi116.stdout:checking for xfs/platform_defs.h... no 2023-05-12T09:09:40.678 INFO:teuthology.orchestra.run.smithi116.stdout:checking btrfs/ioctl.h usability... no 2023-05-12T09:09:40.700 INFO:teuthology.orchestra.run.smithi116.stdout:checking btrfs/ioctl.h presence... no 2023-05-12T09:09:40.700 INFO:teuthology.orchestra.run.smithi116.stdout:checking for btrfs/ioctl.h... no 2023-05-12T09:09:40.745 INFO:teuthology.orchestra.run.smithi116.stdout:checking cifs/ioctl.h usability... no 2023-05-12T09:09:40.767 INFO:teuthology.orchestra.run.smithi116.stdout:checking cifs/ioctl.h presence... no 2023-05-12T09:09:40.768 INFO:teuthology.orchestra.run.smithi116.stdout:checking for cifs/ioctl.h... no 2023-05-12T09:09:40.819 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/mman.h usability... yes 2023-05-12T09:09:40.835 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/mman.h presence... yes 2023-05-12T09:09:40.835 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/mman.h... yes 2023-05-12T09:09:40.869 INFO:teuthology.orchestra.run.smithi116.stdout:checking for xfs/xfs_log_format.h... no 2023-05-12T09:09:40.932 INFO:teuthology.orchestra.run.smithi116.stdout:checking for uuid_compare... no 2023-05-12T09:09:41.098 INFO:teuthology.orchestra.run.smithi116.stdout:checking for uuid_compare in -luuid... yes 2023-05-12T09:09:41.187 INFO:teuthology.orchestra.run.smithi116.stdout:checking for xfs/xfs.h... yes 2023-05-12T09:09:41.216 INFO:teuthology.orchestra.run.smithi116.stdout:checking for xfs/libxfs.h... no 2023-05-12T09:09:41.251 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether xlog_assign_lsn is declared... no 2023-05-12T09:09:41.301 INFO:teuthology.orchestra.run.smithi116.stdout:checking for xfs/xqm.h... yes 2023-05-12T09:09:41.378 INFO:teuthology.orchestra.run.smithi116.stdout:checking xfsctl from xfs/xfs.h... ok 2023-05-12T09:09:41.420 INFO:teuthology.orchestra.run.smithi116.stdout:checking xfs/handle.h usability... yes 2023-05-12T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout:checking xfs/handle.h presence... yes 2023-05-12T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout:checking for xfs/handle.h... yes 2023-05-12T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-05-12T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/acl.h usability... yes 2023-05-12T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/acl.h presence... yes 2023-05-12T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/acl.h... yes 2023-05-12T09:09:41.621 INFO:teuthology.orchestra.run.smithi116.stdout:checking acl/libacl.h usability... yes 2023-05-12T09:09:41.639 INFO:teuthology.orchestra.run.smithi116.stdout:checking acl/libacl.h presence... yes 2023-05-12T09:09:41.639 INFO:teuthology.orchestra.run.smithi116.stdout:checking for acl/libacl.h... yes 2023-05-12T09:09:41.698 INFO:teuthology.orchestra.run.smithi116.stdout:checking for acl_init in -lacl... yes 2023-05-12T09:09:41.740 INFO:teuthology.orchestra.run.smithi116.stdout:checking gdbm-ndbm.h usability... no 2023-05-12T09:09:41.762 INFO:teuthology.orchestra.run.smithi116.stdout:checking gdbm-ndbm.h presence... no 2023-05-12T09:09:41.762 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gdbm-ndbm.h... no 2023-05-12T09:09:41.802 INFO:teuthology.orchestra.run.smithi116.stdout:checking gdbm/ndbm.h usability... no 2023-05-12T09:09:41.824 INFO:teuthology.orchestra.run.smithi116.stdout:checking gdbm/ndbm.h presence... no 2023-05-12T09:09:41.825 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gdbm/ndbm.h... no 2023-05-12T09:09:41.865 INFO:teuthology.orchestra.run.smithi116.stdout:checking ndbm.h usability... no 2023-05-12T09:09:41.887 INFO:teuthology.orchestra.run.smithi116.stdout:checking ndbm.h presence... no 2023-05-12T09:09:41.887 INFO:teuthology.orchestra.run.smithi116.stdout:checking for ndbm.h... no 2023-05-12T09:09:41.932 INFO:teuthology.orchestra.run.smithi116.stdout:checking libaio.h usability... yes 2023-05-12T09:09:41.952 INFO:teuthology.orchestra.run.smithi116.stdout:checking libaio.h presence... yes 2023-05-12T09:09:41.952 INFO:teuthology.orchestra.run.smithi116.stdout:checking for libaio.h... yes 2023-05-12T09:09:41.995 INFO:teuthology.orchestra.run.smithi116.stdout:checking liburing.h usability... no 2023-05-12T09:09:42.017 INFO:teuthology.orchestra.run.smithi116.stdout:checking liburing.h presence... no 2023-05-12T09:09:42.017 INFO:teuthology.orchestra.run.smithi116.stdout:checking for liburing.h... no 2023-05-12T09:09:42.057 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/capability.h usability... no 2023-05-12T09:09:42.080 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/capability.h presence... no 2023-05-12T09:09:42.080 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/capability.h... no 2023-05-12T09:09:42.122 INFO:teuthology.orchestra.run.smithi116.stdout:checking linux/fiemap.h usability... yes 2023-05-12T09:09:42.137 INFO:teuthology.orchestra.run.smithi116.stdout:checking linux/fiemap.h presence... yes 2023-05-12T09:09:42.137 INFO:teuthology.orchestra.run.smithi116.stdout:checking for linux/fiemap.h... yes 2023-05-12T09:09:42.194 INFO:teuthology.orchestra.run.smithi116.stdout:checking for fallocate... yes 2023-05-12T09:09:42.252 INFO:teuthology.orchestra.run.smithi116.stdout:checking for open_by_handle_at... yes 2023-05-12T09:09:42.296 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/prctl.h usability... yes 2023-05-12T09:09:42.314 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/prctl.h presence... yes 2023-05-12T09:09:42.315 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/prctl.h... yes 2023-05-12T09:09:42.357 INFO:teuthology.orchestra.run.smithi116.stdout:checking linux/fs.h usability... yes 2023-05-12T09:09:42.373 INFO:teuthology.orchestra.run.smithi116.stdout:checking linux/fs.h presence... yes 2023-05-12T09:09:42.374 INFO:teuthology.orchestra.run.smithi116.stdout:checking for linux/fs.h... yes 2023-05-12T09:09:42.413 INFO:teuthology.orchestra.run.smithi116.stdout:checking btrfsutil.h usability... no 2023-05-12T09:09:42.435 INFO:teuthology.orchestra.run.smithi116.stdout:checking btrfsutil.h presence... no 2023-05-12T09:09:42.435 INFO:teuthology.orchestra.run.smithi116.stdout:checking for btrfsutil.h... no 2023-05-12T09:09:42.495 INFO:teuthology.orchestra.run.smithi116.stdout:checking for copy_file_range... yes 2023-05-12T09:09:42.555 INFO:teuthology.orchestra.run.smithi116.stdout:checking for SEEK_DATA... yes 2023-05-12T09:09:42.632 INFO:teuthology.orchestra.run.smithi116.stdout:checking for BMV_OF_SHARED... yes 2023-05-12T09:09:42.695 INFO:teuthology.orchestra.run.smithi116.stdout:checking for nftw... yes 2023-05-12T09:09:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:checking for RLIMIT_NOFILE... yes 2023-05-12T09:09:42.790 INFO:teuthology.orchestra.run.smithi116.stdout:checking for FIEXCHANGE_RANGE... no 2023-05-12T09:09:42.848 INFO:teuthology.orchestra.run.smithi116.stdout:checking for renameat2... yes 2023-05-12T09:09:42.907 INFO:teuthology.orchestra.run.smithi116.stdout:checking for reallocarray... yes 2023-05-12T09:09:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:checking for struct mount_attr... no 2023-05-12T09:09:43.013 INFO:teuthology.orchestra.run.smithi116.stdout:checking for struct btrfs_qgroup_limit... yes 2023-05-12T09:09:43.081 INFO:teuthology.orchestra.run.smithi116.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-05-12T09:09:43.150 INFO:teuthology.orchestra.run.smithi116.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-05-12T09:09:43.218 INFO:teuthology.orchestra.run.smithi116.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-05-12T09:09:43.286 INFO:teuthology.orchestra.run.smithi116.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-05-12T09:09:43.355 INFO:teuthology.orchestra.run.smithi116.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-05-12T09:09:43.423 INFO:teuthology.orchestra.run.smithi116.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-05-12T09:09:43.473 INFO:teuthology.orchestra.run.smithi116.stdout:checking linux/btrfs.h usability... yes 2023-05-12T09:09:43.489 INFO:teuthology.orchestra.run.smithi116.stdout:checking linux/btrfs.h presence... yes 2023-05-12T09:09:43.489 INFO:teuthology.orchestra.run.smithi116.stdout:checking for linux/btrfs.h... yes 2023-05-12T09:09:43.546 INFO:teuthology.orchestra.run.smithi116.stdout:checking linux/btrfs_tree.h usability... yes 2023-05-12T09:09:43.562 INFO:teuthology.orchestra.run.smithi116.stdout:checking linux/btrfs_tree.h presence... yes 2023-05-12T09:09:43.562 INFO:teuthology.orchestra.run.smithi116.stdout:checking for linux/btrfs_tree.h... yes 2023-05-12T09:09:43.630 INFO:teuthology.orchestra.run.smithi116.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-05-12T09:09:43.658 INFO:teuthology.orchestra.run.smithi116.stdout:configure: creating ./config.status 2023-05-12T09:09:44.468 INFO:teuthology.orchestra.run.smithi116.stdout:config.status: creating include/builddefs 2023-05-12T09:09:44.495 INFO:teuthology.orchestra.run.smithi116.stdout:config.status: creating include/config.h 2023-05-12T09:09:44.515 INFO:teuthology.orchestra.run.smithi116.stdout:config.status: executing libtool commands 2023-05-12T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout:Building include 2023-05-12T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout:Building lib 2023-05-12T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: [LTDEP] 2023-05-12T09:09:44.798 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] dataascii.lo 2023-05-12T09:09:44.988 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] databin.lo 2023-05-12T09:09:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] datapid.lo 2023-05-12T09:09:45.386 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] file_lock.lo 2023-05-12T09:09:45.612 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] forker.lo 2023-05-12T09:09:45.818 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] pattern.lo 2023-05-12T09:09:46.007 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] open_flags.lo 2023-05-12T09:09:46.223 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] random_range.lo 2023-05-12T09:09:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] string_to_tokens.lo 2023-05-12T09:09:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] str_to_bytes.lo 2023-05-12T09:09:46.894 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] tlibio.lo 2023-05-12T09:09:47.200 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] write_log.lo 2023-05-12T09:09:47.512 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] random.lo 2023-05-12T09:09:47.697 INFO:teuthology.orchestra.run.smithi116.stdout: [LD] 2023-05-12T09:09:47.833 INFO:teuthology.orchestra.run.smithi116.stdout:Building ltp 2023-05-12T09:09:47.839 INFO:teuthology.orchestra.run.smithi116.stdout: [DEP] 2023-05-12T09:09:48.053 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] doio 2023-05-12T09:09:48.775 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fsstress 2023-05-12T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fsx 2023-05-12T09:09:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] growfiles 2023-05-12T09:09:51.625 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] iogen 2023-05-12T09:09:52.069 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-stress 2023-05-12T09:09:52.568 INFO:teuthology.orchestra.run.smithi116.stdout:Building src 2023-05-12T09:09:52.576 INFO:teuthology.orchestra.run.smithi116.stdout: [DEP] 2023-05-12T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: [DEP] 2023-05-12T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: [DEP] 2023-05-12T09:09:55.063 INFO:teuthology.orchestra.run.smithi116.stdout: [DEP] 2023-05-12T09:09:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: [DEP] 2023-05-12T09:09:55.436 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] dirstress 2023-05-12T09:09:55.761 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fill 2023-05-12T09:09:55.997 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fill2 2023-05-12T09:09:56.310 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] getpagesize 2023-05-12T09:09:56.530 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] holes 2023-05-12T09:09:56.809 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] lstat64 2023-05-12T09:09:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] nametest 2023-05-12T09:09:57.417 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] permname 2023-05-12T09:09:57.707 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] randholes 2023-05-12T09:09:58.039 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] runas 2023-05-12T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] truncfile 2023-05-12T09:09:58.567 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] usemem 2023-05-12T09:09:58.805 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] mmapcat 2023-05-12T09:09:59.039 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] append_reader 2023-05-12T09:09:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] append_writer 2023-05-12T09:09:59.510 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] dirperf 2023-05-12T09:09:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] metaperf 2023-05-12T09:10:00.153 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] devzero 2023-05-12T09:10:00.417 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] feature 2023-05-12T09:10:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] alloc 2023-05-12T09:10:01.015 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fault 2023-05-12T09:10:01.265 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fstest 2023-05-12T09:10:01.587 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_access_root 2023-05-12T09:10:01.826 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] godown 2023-05-12T09:10:02.083 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] resvtest 2023-05-12T09:10:02.354 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] writemod 2023-05-12T09:10:02.583 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] writev_on_pagefault 2023-05-12T09:10:02.827 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] makeextents 2023-05-12T09:10:03.092 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] itrash 2023-05-12T09:10:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] rename 2023-05-12T09:10:03.553 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] multi_open_unlink 2023-05-12T09:10:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] unwritten_sync 2023-05-12T09:10:04.071 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] genhashnames 2023-05-12T09:10:04.340 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_holes 2023-05-12T09:10:04.572 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_mmap_writev 2023-05-12T09:10:04.804 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_truncate_cmtime 2023-05-12T09:10:05.047 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] dirhash_collide 2023-05-12T09:10:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_rename_overwrite 2023-05-12T09:10:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] holetest 2023-05-12T09:10:05.838 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_truncate_self 2023-05-12T09:10:06.062 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] af_unix 2023-05-12T09:10:06.299 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_mmap_stale_pmd 2023-05-12T09:10:06.537 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_mmap_cow_race 2023-05-12T09:10:06.786 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_mmap_fallocate 2023-05-12T09:10:07.020 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fsync-err 2023-05-12T09:10:07.289 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_mmap_write_ro 2023-05-12T09:10:07.524 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_ext4_dax_journal_corruption 2023-05-12T09:10:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_ext4_dax_inline_corruption 2023-05-12T09:10:08.010 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_ofd_locks 2023-05-12T09:10:08.295 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_mmap_collision 2023-05-12T09:10:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] mmap-write-concurrent 2023-05-12T09:10:08.833 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_get_file_time 2023-05-12T09:10:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_create_short_dirs 2023-05-12T09:10:09.314 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_create_long_dirs 2023-05-12T09:10:09.564 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_enospc 2023-05-12T09:10:09.835 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_mmap_writev_overlap 2023-05-12T09:10:10.088 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] checkpoint_journal 2023-05-12T09:10:10.327 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] mmap-rw-fault 2023-05-12T09:10:10.591 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] allocstale 2023-05-12T09:10:10.612 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:10:10.616 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:10:10.853 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_mmap_cow_memory_failure 2023-05-12T09:10:11.108 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fake-dump-rootino 2023-05-12T09:10:11.343 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] dio-buf-fault 2023-05-12T09:10:11.582 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] xfsctl 2023-05-12T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] bstat 2023-05-12T09:10:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_mtab 2023-05-12T09:10:12.414 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] getdevicesize 2023-05-12T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] preallo_rw_pattern_reader 2023-05-12T09:10:12.884 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] preallo_rw_pattern_writer 2023-05-12T09:10:13.130 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] ftrunc 2023-05-12T09:10:13.364 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] trunc 2023-05-12T09:10:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fs_perms 2023-05-12T09:10:13.859 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] testx 2023-05-12T09:10:14.075 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] looptest 2023-05-12T09:10:14.349 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] locktest 2023-05-12T09:10:14.736 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] unwritten_mmap 2023-05-12T09:10:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] bulkstat_unlink_test 2023-05-12T09:10:15.271 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] deduperace 2023-05-12T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] bulkstat_unlink_test_modified 2023-05-12T09:10:15.836 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_dir_offset 2023-05-12T09:10:16.071 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_futimens 2023-05-12T09:10:16.296 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_immutable 2023-05-12T09:10:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] stale_handle 2023-05-12T09:10:17.229 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] pwrite_mmap_blocked 2023-05-12T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_dir_offset2 2023-05-12T09:10:17.744 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] seek_sanity_test 2023-05-12T09:10:18.235 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] seek_copy_test 2023-05-12T09:10:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_readdir_1 2023-05-12T09:10:18.729 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_readdir_2 2023-05-12T09:10:18.965 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fsync-tester 2023-05-12T09:10:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] nsexec 2023-05-12T09:10:19.554 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] cloner 2023-05-12T09:10:19.817 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] renameat2 2023-05-12T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_getcwd 2023-05-12T09:10:20.314 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] e4compact 2023-05-12T09:10:20.601 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] test-nextquota 2023-05-12T09:10:20.860 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] punch-alternating 2023-05-12T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] attr-list-by-handle-cursor-test 2023-05-12T09:10:21.373 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] listxattr 2023-05-12T09:10:21.605 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] dio-interleaved 2023-05-12T09:10:21.851 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_dir_type 2023-05-12T09:10:22.091 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] dio-invalidate-cache 2023-05-12T09:10:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] stat_test 2023-05-12T09:10:22.756 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_encrypted_d_revalidate 2023-05-12T09:10:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] attr_replace_test 2023-05-12T09:10:23.255 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] swapon 2023-05-12T09:10:23.505 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] mkswap 2023-05-12T09:10:23.742 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_attr_corruption 2023-05-12T09:10:23.981 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_open_tmpfiles 2023-05-12T09:10:24.247 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fscrypt-crypt-util 2023-05-12T09:10:24.955 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] bulkstat_null_ocount 2023-05-12T09:10:25.233 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] splice-test 2023-05-12T09:10:25.498 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] chprojid_fail 2023-05-12T09:10:25.751 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] detached_mounts_propagation 2023-05-12T09:10:26.022 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] ext4_resize 2023-05-12T09:10:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_readdir_3 2023-05-12T09:10:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] splice2pipe 2023-05-12T09:10:26.785 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] uuid_ioctl 2023-05-12T09:10:27.027 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fiemap-tester 2023-05-12T09:10:27.382 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_stripealign 2023-05-12T09:10:27.620 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] open_by_handle 2023-05-12T09:10:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] t_mmap_dio 2023-05-12T09:10:28.206 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] xfsfind 2023-05-12T09:10:28.487 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] fssum 2023-05-12T09:10:28.998 INFO:teuthology.orchestra.run.smithi116.stdout:Building log-writes 2023-05-12T09:10:29.007 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] replay-log 2023-05-12T09:10:29.403 INFO:teuthology.orchestra.run.smithi116.stdout:Building perf 2023-05-12T09:10:29.410 INFO:teuthology.orchestra.run.smithi116.stdout:Building aio-dio-regress 2023-05-12T09:10:29.420 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-append-write-fallocate-race 2023-05-12T09:10:29.683 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-fcntl-race 2023-05-12T09:10:29.936 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-subblock-eof-read 2023-05-12T09:10:30.169 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-append-write-read-race 2023-05-12T09:10:30.433 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-invalidate-readahead 2023-05-12T09:10:30.686 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-hole-filling-race 2023-05-12T09:10:30.926 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-05-12T09:10:31.150 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-last-ref-held-by-io 2023-05-12T09:10:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-cycle-write 2023-05-12T09:10:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-extend-stat 2023-05-12T09:10:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-05-12T09:10:32.160 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-invalidate-failure 2023-05-12T09:10:32.410 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aiodio_sparse2 2023-05-12T09:10:32.714 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aiocp 2023-05-12T09:10:33.025 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-cow-race 2023-05-12T09:10:33.268 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-write-verify 2023-05-12T09:10:33.547 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] aio-dio-eof-race 2023-05-12T09:10:33.820 INFO:teuthology.orchestra.run.smithi116.stdout:Building vfs 2023-05-12T09:10:33.830 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] vfstest 2023-05-12T09:10:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: [CC] mount-idmapped 2023-05-12T09:10:36.266 INFO:teuthology.orchestra.run.smithi116.stdout:Building m4 2023-05-12T09:10:36.272 INFO:teuthology.orchestra.run.smithi116.stdout:Building common 2023-05-12T09:10:36.279 INFO:teuthology.orchestra.run.smithi116.stdout:Building tests 2023-05-12T09:10:36.288 INFO:teuthology.orchestra.run.smithi116.stdout:Building perf 2023-05-12T09:10:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/perf/group.list 2023-05-12T09:10:36.324 INFO:teuthology.orchestra.run.smithi116.stdout:Building ext4 2023-05-12T09:10:36.333 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/ext4/group.list 2023-05-12T09:10:36.419 INFO:teuthology.orchestra.run.smithi116.stdout:Building ocfs2 2023-05-12T09:10:36.428 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/ocfs2/group.list 2023-05-12T09:10:36.459 INFO:teuthology.orchestra.run.smithi116.stdout:Building overlay 2023-05-12T09:10:36.468 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/overlay/group.list 2023-05-12T09:10:36.556 INFO:teuthology.orchestra.run.smithi116.stdout:Building cifs 2023-05-12T09:10:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/cifs/group.list 2023-05-12T09:10:36.593 INFO:teuthology.orchestra.run.smithi116.stdout:Building generic 2023-05-12T09:10:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/generic/group.list 2023-05-12T09:10:36.828 INFO:teuthology.orchestra.run.smithi116.stdout:Building shared 2023-05-12T09:10:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/shared/group.list 2023-05-12T09:10:36.877 INFO:teuthology.orchestra.run.smithi116.stdout:Building nfs 2023-05-12T09:10:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/nfs/group.list 2023-05-12T09:10:36.919 INFO:teuthology.orchestra.run.smithi116.stdout:Building f2fs 2023-05-12T09:10:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/f2fs/group.list 2023-05-12T09:10:36.967 INFO:teuthology.orchestra.run.smithi116.stdout:Building udf 2023-05-12T09:10:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/udf/group.list 2023-05-12T09:10:37.003 INFO:teuthology.orchestra.run.smithi116.stdout:Building ceph 2023-05-12T09:10:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/ceph/group.list 2023-05-12T09:10:37.045 INFO:teuthology.orchestra.run.smithi116.stdout:Building xfs 2023-05-12T09:10:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/xfs/group.list 2023-05-12T09:10:37.283 INFO:teuthology.orchestra.run.smithi116.stdout:Building btrfs 2023-05-12T09:10:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/btrfs/group.list 2023-05-12T09:10:37.425 INFO:teuthology.orchestra.run.smithi116.stdout:Building tmpfs 2023-05-12T09:10:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/tmpfs/group.list 2023-05-12T09:10:37.465 INFO:teuthology.orchestra.run.smithi116.stdout:Building selftest 2023-05-12T09:10:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/selftest/group.list 2023-05-12T09:10:37.505 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo make install) 2023-05-12T09:10:37.589 INFO:teuthology.orchestra.run.smithi116.stdout:Building include 2023-05-12T09:10:37.596 INFO:teuthology.orchestra.run.smithi116.stdout:Building lib 2023-05-12T09:10:37.603 INFO:teuthology.orchestra.run.smithi116.stdout:Building ltp 2023-05-12T09:10:37.610 INFO:teuthology.orchestra.run.smithi116.stdout:Building src 2023-05-12T09:10:37.669 INFO:teuthology.orchestra.run.smithi116.stdout:Building log-writes 2023-05-12T09:10:37.676 INFO:teuthology.orchestra.run.smithi116.stdout:Building perf 2023-05-12T09:10:37.683 INFO:teuthology.orchestra.run.smithi116.stdout:Building aio-dio-regress 2023-05-12T09:10:37.690 INFO:teuthology.orchestra.run.smithi116.stdout:Building vfs 2023-05-12T09:10:37.697 INFO:teuthology.orchestra.run.smithi116.stdout:Building m4 2023-05-12T09:10:37.704 INFO:teuthology.orchestra.run.smithi116.stdout:Building common 2023-05-12T09:10:37.711 INFO:teuthology.orchestra.run.smithi116.stdout:Building tests 2023-05-12T09:10:37.720 INFO:teuthology.orchestra.run.smithi116.stdout:Building perf 2023-05-12T09:10:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/perf/group.list 2023-05-12T09:10:37.756 INFO:teuthology.orchestra.run.smithi116.stdout:Building ext4 2023-05-12T09:10:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/ext4/group.list 2023-05-12T09:10:37.851 INFO:teuthology.orchestra.run.smithi116.stdout:Building ocfs2 2023-05-12T09:10:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/ocfs2/group.list 2023-05-12T09:10:37.890 INFO:teuthology.orchestra.run.smithi116.stdout:Building overlay 2023-05-12T09:10:37.900 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/overlay/group.list 2023-05-12T09:10:37.986 INFO:teuthology.orchestra.run.smithi116.stdout:Building cifs 2023-05-12T09:10:37.995 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/cifs/group.list 2023-05-12T09:10:38.024 INFO:teuthology.orchestra.run.smithi116.stdout:Building generic 2023-05-12T09:10:38.035 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/generic/group.list 2023-05-12T09:10:38.252 INFO:teuthology.orchestra.run.smithi116.stdout:Building shared 2023-05-12T09:10:38.261 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/shared/group.list 2023-05-12T09:10:38.301 INFO:teuthology.orchestra.run.smithi116.stdout:Building nfs 2023-05-12T09:10:38.310 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/nfs/group.list 2023-05-12T09:10:38.343 INFO:teuthology.orchestra.run.smithi116.stdout:Building f2fs 2023-05-12T09:10:38.352 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/f2fs/group.list 2023-05-12T09:10:38.392 INFO:teuthology.orchestra.run.smithi116.stdout:Building udf 2023-05-12T09:10:38.400 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/udf/group.list 2023-05-12T09:10:38.427 INFO:teuthology.orchestra.run.smithi116.stdout:Building ceph 2023-05-12T09:10:38.436 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/ceph/group.list 2023-05-12T09:10:38.469 INFO:teuthology.orchestra.run.smithi116.stdout:Building xfs 2023-05-12T09:10:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/xfs/group.list 2023-05-12T09:10:38.701 INFO:teuthology.orchestra.run.smithi116.stdout:Building btrfs 2023-05-12T09:10:38.712 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/btrfs/group.list 2023-05-12T09:10:38.840 INFO:teuthology.orchestra.run.smithi116.stdout:Building tmpfs 2023-05-12T09:10:38.850 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/tmpfs/group.list 2023-05-12T09:10:38.880 INFO:teuthology.orchestra.run.smithi116.stdout:Building selftest 2023-05-12T09:10:38.889 INFO:teuthology.orchestra.run.smithi116.stdout: [GROUP] /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/selftest/group.list 2023-05-12T09:10:38.917 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-05-12T09:10:38.920 INFO:teuthology.orchestra.run.smithi116.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-12T09:10:38.920 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-05-12T09:10:38.923 INFO:teuthology.orchestra.run.smithi116.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-12T09:10:38.923 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-05-12T09:10:38.926 INFO:teuthology.orchestra.run.smithi116.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-05-12T09:10:38.947 INFO:teuthology.orchestra.run.smithi116.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-05-12T09:10:39.108 INFO:teuthology.orchestra.run.smithi116.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-05-12T09:10:39.129 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-05-12T09:10:39.157 INFO:teuthology.orchestra.run.smithi116.stdout:Building log-writes 2023-05-12T09:10:39.164 INFO:teuthology.orchestra.run.smithi116.stdout:Building perf 2023-05-12T09:10:39.171 INFO:teuthology.orchestra.run.smithi116.stdout:Building aio-dio-regress 2023-05-12T09:10:39.178 INFO:teuthology.orchestra.run.smithi116.stdout:Building vfs 2023-05-12T09:10:39.184 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake -C log-writes install 2023-05-12T09:10:39.186 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-05-12T09:10:39.207 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-05-12T09:10:39.228 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake -C perf install 2023-05-12T09:10:39.230 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-05-12T09:10:39.251 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-05-12T09:10:39.305 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-05-12T09:10:39.308 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-05-12T09:10:39.329 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-05-12T09:10:39.457 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake -C vfs install 2023-05-12T09:10:39.459 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-05-12T09:10:39.480 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-05-12T09:10:39.509 INFO:teuthology.orchestra.run.smithi116.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-05-12T09:10:39.530 INFO:teuthology.orchestra.run.smithi116.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-05-12T09:10:40.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:10:40.721 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:10:42.259 INFO:teuthology.orchestra.run.smithi116.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-05-12T09:10:42.459 INFO:teuthology.orchestra.run.smithi116.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-05-12T09:10:42.512 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-05-12T09:10:42.514 INFO:teuthology.orchestra.run.smithi116.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-12T09:10:42.515 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-05-12T09:10:42.517 INFO:teuthology.orchestra.run.smithi116.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-05-12T09:10:42.538 INFO:teuthology.orchestra.run.smithi116.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-05-12T09:10:42.856 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-05-12T09:10:42.858 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/btrfs/ install 2023-05-12T09:10:42.862 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-05-12T09:10:42.883 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-05-12T09:10:44.787 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-05-12T09:10:44.808 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 014.out 016.out 175.out 193.out 240.out 069.out 282.out 015.out 280.out 140.out 258.out 008.out 004.out 199.out 233.out 194.out 055.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 225.out 096.out 125.out 078.out 152.out 103.out 264.out 243.out 192.out 148.out 075.out 178.out 284.out 052.out 256.out 207.out 228.out 276.out 183.out 094.out 046.out 273.out 265.out 251.out 209.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 128.out 232.out 165.out 026.out 021.out 035.out 221.out 087.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 242.out 187.out 220.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 084.out 129.out 029.out 229.out 254.out 111.out 011.out 155.out 275.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 114.out 138.out 095.out 038.out 145.out 160.out 137.out 091.out 081.out 071.out 061.out 085.out 067.out 200.out 100.out 025.out 286.out 269.out 039.out 196.out 098.out 090.out 080.out 070.out 060.out 208.out 009.out 167.out 217.out 120.out 191.out 133.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 281.out 241.out 235.out 253.out 257.out 124.out 172.out 278.out 063.out 058.out 262.out 169.out 042.out 153.out 097.out 283.out 236.out 186.out 053.out 164.out 154.out 239.out 189.out 139.out 267.out 141.out 214.out 005.out 223.out 028.out 150.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 180.out 036.out 198.out 108.out 190.out 173.out 050.out 105.out 106.out 291.out 185.out 037.out 088.out 285.out 123.out 056.out 201.out 019.out 001.out 086.out 142.out 237.out 151.out 231.out 024.out 163.out 044.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 073.out 099.out 082.out 030.out 203.out 003.out 076.out 245.out 074.out 222.out 159.out 249.out 122.out 234.out 022.out 174.out 006.out 045.out 290.out 299.out 224.out 181.out 271.out 149.out 064.out 077.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 049.out 226.out 126.out /var/lib/xfstests/tests/btrfs 2023-05-12T09:10:46.717 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/ceph/ install 2023-05-12T09:10:46.719 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-05-12T09:10:46.740 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-05-12T09:10:46.787 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-05-12T09:10:46.808 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-05-12T09:10:46.856 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/cifs/ install 2023-05-12T09:10:46.858 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-05-12T09:10:46.879 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-05-12T09:10:46.900 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-05-12T09:10:46.921 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-05-12T09:10:46.942 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/ext4/ install 2023-05-12T09:10:46.945 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-05-12T09:10:46.965 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-05-12T09:10:47.420 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-05-12T09:10:47.440 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-05-12T09:10:47.920 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/f2fs/ install 2023-05-12T09:10:47.923 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-05-12T09:10:47.944 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-05-12T09:10:47.971 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-05-12T09:10:47.992 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-05-12T09:10:48.020 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/generic/ install 2023-05-12T09:10:48.026 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-05-12T09:10:48.047 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-05-12T09:10:52.815 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-05-12T09:10:52.835 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 531.out 243.out 592.out 282.out 272.out 472.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 622.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 566.out 295.out 390.out 497.out 160.out 291.out 274.out 061.out 239.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 030.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 667.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 280.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 433.out 704.out 108.out 504.out 404.out 104.out 655.out 021.out 452.out 457.out 297.out 393.out 333.out 599.out 476.out 535.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 436.out 485.out 120.out 175.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 167.out 724.out 206.out 352.out 663.out 394.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 715.out 279.out 544.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 075.out 684.out 674.out 550.out 052.out 062.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 688.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 244.out 385.out 005.out 336.out 150.out 579.out 236.out 505.out 405.out 342.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 691.out 305.out 105.out 263.out 144.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 634.out 560.out 581.out 166.out 707.out 461.out 381.out 445.out 307.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 613.out 326.out 082.out 480.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 487.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 378.out 004.out 458.out 534.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 173.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 376.out 431.out 635.out 288.out 722.out 331.out 128.out 377.out 713.out 513.out 554.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 310.out 427.out 259.out 210.out 449.out 327.out 330.out 110.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 643.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 245.out 522.out 422.out 624.out 322.out 222.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 565.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 141.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 012.out 195.out 388.out 682.out 483.out 397.out 070.out 596.out 720.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 142.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 301.out 010.out 001.out 096.out 495.out 048.out 665.out 589.out 095.out 697.out 145.out 641.out 464.out 491.out 081.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 169.out 090.out 080.out 708.out 608.out 508.out 409.out 309.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 304.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 548.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out /var/lib/xfstests/tests/generic 2023-05-12T09:10:57.655 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/nfs/ install 2023-05-12T09:10:57.658 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-05-12T09:10:57.679 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-05-12T09:10:57.701 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-05-12T09:10:57.721 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-05-12T09:10:57.742 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/ocfs2/ install 2023-05-12T09:10:57.745 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-05-12T09:10:57.766 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-05-12T09:10:57.787 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-05-12T09:10:57.807 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-05-12T09:10:57.829 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/overlay/ install 2023-05-12T09:10:57.832 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-05-12T09:10:57.853 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-05-12T09:10:58.489 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-05-12T09:10:58.510 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-05-12T09:10:59.153 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/perf/ install 2023-05-12T09:10:59.156 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-05-12T09:10:59.177 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-05-12T09:10:59.197 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-05-12T09:10:59.218 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-05-12T09:10:59.240 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/selftest/ install 2023-05-12T09:10:59.242 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-05-12T09:10:59.263 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-05-12T09:10:59.317 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-05-12T09:10:59.338 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-05-12T09:10:59.392 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/shared/ install 2023-05-12T09:10:59.394 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-05-12T09:10:59.415 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-05-12T09:10:59.449 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-05-12T09:10:59.470 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-05-12T09:10:59.504 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/tmpfs/ install 2023-05-12T09:10:59.507 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-05-12T09:10:59.527 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-05-12T09:10:59.548 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-05-12T09:10:59.569 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-05-12T09:10:59.591 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/udf/ install 2023-05-12T09:10:59.593 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-05-12T09:10:59.614 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-05-12T09:10:59.635 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-05-12T09:10:59.657 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-05-12T09:10:59.678 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.b9w2OCk4k0xfstests-dev/tests/xfs/ install 2023-05-12T09:10:59.683 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-05-12T09:10:59.704 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-05-12T09:11:04.220 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-05-12T09:11:04.241 INFO:teuthology.orchestra.run.smithi116.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 262.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 388.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 363.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 219.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 725.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out 383.out /var/lib/xfstests/tests/xfs 2023-05-12T09:11:08.813 INFO:teuthology.orchestra.run.smithi116.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-05-12T09:11:08.834 INFO:teuthology.orchestra.run.smithi116.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-05-12T09:11:08.854 INFO:teuthology.orchestra.run.smithi116.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-05-12T09:11:08.875 INFO:teuthology.orchestra.run.smithi116.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-05-12T09:11:08.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T09:11:08.900 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec ls tests/generic) 2023-05-12T09:11:08.943 INFO:teuthology.orchestra.run.smithi116.stdout:001 2023-05-12T09:11:08.943 INFO:teuthology.orchestra.run.smithi116.stdout:001.out 2023-05-12T09:11:08.944 INFO:teuthology.orchestra.run.smithi116.stdout:002 2023-05-12T09:11:08.944 INFO:teuthology.orchestra.run.smithi116.stdout:002.out 2023-05-12T09:11:08.944 INFO:teuthology.orchestra.run.smithi116.stdout:003 2023-05-12T09:11:08.944 INFO:teuthology.orchestra.run.smithi116.stdout:003.out 2023-05-12T09:11:08.944 INFO:teuthology.orchestra.run.smithi116.stdout:004 2023-05-12T09:11:08.944 INFO:teuthology.orchestra.run.smithi116.stdout:004.out 2023-05-12T09:11:08.944 INFO:teuthology.orchestra.run.smithi116.stdout:005 2023-05-12T09:11:08.945 INFO:teuthology.orchestra.run.smithi116.stdout:005.out 2023-05-12T09:11:08.945 INFO:teuthology.orchestra.run.smithi116.stdout:006 2023-05-12T09:11:08.945 INFO:teuthology.orchestra.run.smithi116.stdout:006.out 2023-05-12T09:11:08.945 INFO:teuthology.orchestra.run.smithi116.stdout:007 2023-05-12T09:11:08.945 INFO:teuthology.orchestra.run.smithi116.stdout:007.out 2023-05-12T09:11:08.945 INFO:teuthology.orchestra.run.smithi116.stdout:008 2023-05-12T09:11:08.945 INFO:teuthology.orchestra.run.smithi116.stdout:008.out 2023-05-12T09:11:08.945 INFO:teuthology.orchestra.run.smithi116.stdout:009 2023-05-12T09:11:08.946 INFO:teuthology.orchestra.run.smithi116.stdout:009.out 2023-05-12T09:11:08.946 INFO:teuthology.orchestra.run.smithi116.stdout:010 2023-05-12T09:11:08.946 INFO:teuthology.orchestra.run.smithi116.stdout:010.out 2023-05-12T09:11:08.946 INFO:teuthology.orchestra.run.smithi116.stdout:011 2023-05-12T09:11:08.946 INFO:teuthology.orchestra.run.smithi116.stdout:011.out 2023-05-12T09:11:08.946 INFO:teuthology.orchestra.run.smithi116.stdout:012 2023-05-12T09:11:08.946 INFO:teuthology.orchestra.run.smithi116.stdout:012.out 2023-05-12T09:11:08.947 INFO:teuthology.orchestra.run.smithi116.stdout:013 2023-05-12T09:11:08.947 INFO:teuthology.orchestra.run.smithi116.stdout:013.out 2023-05-12T09:11:08.947 INFO:teuthology.orchestra.run.smithi116.stdout:014 2023-05-12T09:11:08.947 INFO:teuthology.orchestra.run.smithi116.stdout:014.out 2023-05-12T09:11:08.947 INFO:teuthology.orchestra.run.smithi116.stdout:015 2023-05-12T09:11:08.947 INFO:teuthology.orchestra.run.smithi116.stdout:015.out 2023-05-12T09:11:08.947 INFO:teuthology.orchestra.run.smithi116.stdout:016 2023-05-12T09:11:08.947 INFO:teuthology.orchestra.run.smithi116.stdout:016.out 2023-05-12T09:11:08.948 INFO:teuthology.orchestra.run.smithi116.stdout:017 2023-05-12T09:11:08.948 INFO:teuthology.orchestra.run.smithi116.stdout:017.out 2023-05-12T09:11:08.948 INFO:teuthology.orchestra.run.smithi116.stdout:018 2023-05-12T09:11:08.948 INFO:teuthology.orchestra.run.smithi116.stdout:018.out 2023-05-12T09:11:08.948 INFO:teuthology.orchestra.run.smithi116.stdout:019 2023-05-12T09:11:08.948 INFO:teuthology.orchestra.run.smithi116.stdout:019.out 2023-05-12T09:11:08.948 INFO:teuthology.orchestra.run.smithi116.stdout:020 2023-05-12T09:11:08.949 INFO:teuthology.orchestra.run.smithi116.stdout:020.out 2023-05-12T09:11:08.949 INFO:teuthology.orchestra.run.smithi116.stdout:021 2023-05-12T09:11:08.949 INFO:teuthology.orchestra.run.smithi116.stdout:021.out 2023-05-12T09:11:08.949 INFO:teuthology.orchestra.run.smithi116.stdout:022 2023-05-12T09:11:08.949 INFO:teuthology.orchestra.run.smithi116.stdout:022.out 2023-05-12T09:11:08.949 INFO:teuthology.orchestra.run.smithi116.stdout:023 2023-05-12T09:11:08.949 INFO:teuthology.orchestra.run.smithi116.stdout:023.out 2023-05-12T09:11:08.949 INFO:teuthology.orchestra.run.smithi116.stdout:024 2023-05-12T09:11:08.950 INFO:teuthology.orchestra.run.smithi116.stdout:024.out 2023-05-12T09:11:08.950 INFO:teuthology.orchestra.run.smithi116.stdout:025 2023-05-12T09:11:08.950 INFO:teuthology.orchestra.run.smithi116.stdout:025.out 2023-05-12T09:11:08.950 INFO:teuthology.orchestra.run.smithi116.stdout:026 2023-05-12T09:11:08.950 INFO:teuthology.orchestra.run.smithi116.stdout:026.out 2023-05-12T09:11:08.950 INFO:teuthology.orchestra.run.smithi116.stdout:027 2023-05-12T09:11:08.950 INFO:teuthology.orchestra.run.smithi116.stdout:027.out 2023-05-12T09:11:08.950 INFO:teuthology.orchestra.run.smithi116.stdout:028 2023-05-12T09:11:08.951 INFO:teuthology.orchestra.run.smithi116.stdout:028.out 2023-05-12T09:11:08.951 INFO:teuthology.orchestra.run.smithi116.stdout:029 2023-05-12T09:11:08.951 INFO:teuthology.orchestra.run.smithi116.stdout:029.out 2023-05-12T09:11:08.951 INFO:teuthology.orchestra.run.smithi116.stdout:030 2023-05-12T09:11:08.951 INFO:teuthology.orchestra.run.smithi116.stdout:030.out 2023-05-12T09:11:08.951 INFO:teuthology.orchestra.run.smithi116.stdout:031 2023-05-12T09:11:08.951 INFO:teuthology.orchestra.run.smithi116.stdout:031.out 2023-05-12T09:11:08.951 INFO:teuthology.orchestra.run.smithi116.stdout:032 2023-05-12T09:11:08.952 INFO:teuthology.orchestra.run.smithi116.stdout:032.out 2023-05-12T09:11:08.952 INFO:teuthology.orchestra.run.smithi116.stdout:033 2023-05-12T09:11:08.952 INFO:teuthology.orchestra.run.smithi116.stdout:033.out 2023-05-12T09:11:08.952 INFO:teuthology.orchestra.run.smithi116.stdout:034 2023-05-12T09:11:08.952 INFO:teuthology.orchestra.run.smithi116.stdout:034.out 2023-05-12T09:11:08.952 INFO:teuthology.orchestra.run.smithi116.stdout:035 2023-05-12T09:11:08.952 INFO:teuthology.orchestra.run.smithi116.stdout:035.cfg 2023-05-12T09:11:08.953 INFO:teuthology.orchestra.run.smithi116.stdout:035.out.default 2023-05-12T09:11:08.953 INFO:teuthology.orchestra.run.smithi116.stdout:035.out.nfs 2023-05-12T09:11:08.953 INFO:teuthology.orchestra.run.smithi116.stdout:036 2023-05-12T09:11:08.953 INFO:teuthology.orchestra.run.smithi116.stdout:036.out 2023-05-12T09:11:08.953 INFO:teuthology.orchestra.run.smithi116.stdout:037 2023-05-12T09:11:08.953 INFO:teuthology.orchestra.run.smithi116.stdout:037.out 2023-05-12T09:11:08.953 INFO:teuthology.orchestra.run.smithi116.stdout:038 2023-05-12T09:11:08.953 INFO:teuthology.orchestra.run.smithi116.stdout:038.out 2023-05-12T09:11:08.954 INFO:teuthology.orchestra.run.smithi116.stdout:039 2023-05-12T09:11:08.954 INFO:teuthology.orchestra.run.smithi116.stdout:039.out 2023-05-12T09:11:08.954 INFO:teuthology.orchestra.run.smithi116.stdout:040 2023-05-12T09:11:08.954 INFO:teuthology.orchestra.run.smithi116.stdout:040.out 2023-05-12T09:11:08.954 INFO:teuthology.orchestra.run.smithi116.stdout:041 2023-05-12T09:11:08.954 INFO:teuthology.orchestra.run.smithi116.stdout:041.out 2023-05-12T09:11:08.954 INFO:teuthology.orchestra.run.smithi116.stdout:042 2023-05-12T09:11:08.954 INFO:teuthology.orchestra.run.smithi116.stdout:042.out 2023-05-12T09:11:08.955 INFO:teuthology.orchestra.run.smithi116.stdout:043 2023-05-12T09:11:08.955 INFO:teuthology.orchestra.run.smithi116.stdout:043.out 2023-05-12T09:11:08.955 INFO:teuthology.orchestra.run.smithi116.stdout:044 2023-05-12T09:11:08.955 INFO:teuthology.orchestra.run.smithi116.stdout:044.out 2023-05-12T09:11:08.955 INFO:teuthology.orchestra.run.smithi116.stdout:045 2023-05-12T09:11:08.955 INFO:teuthology.orchestra.run.smithi116.stdout:045.out 2023-05-12T09:11:08.955 INFO:teuthology.orchestra.run.smithi116.stdout:046 2023-05-12T09:11:08.955 INFO:teuthology.orchestra.run.smithi116.stdout:046.out 2023-05-12T09:11:08.956 INFO:teuthology.orchestra.run.smithi116.stdout:047 2023-05-12T09:11:08.956 INFO:teuthology.orchestra.run.smithi116.stdout:047.out 2023-05-12T09:11:08.956 INFO:teuthology.orchestra.run.smithi116.stdout:048 2023-05-12T09:11:08.956 INFO:teuthology.orchestra.run.smithi116.stdout:048.out 2023-05-12T09:11:08.956 INFO:teuthology.orchestra.run.smithi116.stdout:049 2023-05-12T09:11:08.956 INFO:teuthology.orchestra.run.smithi116.stdout:049.out 2023-05-12T09:11:08.956 INFO:teuthology.orchestra.run.smithi116.stdout:050 2023-05-12T09:11:08.957 INFO:teuthology.orchestra.run.smithi116.stdout:050.cfg 2023-05-12T09:11:08.957 INFO:teuthology.orchestra.run.smithi116.stdout:050.out.default 2023-05-12T09:11:08.957 INFO:teuthology.orchestra.run.smithi116.stdout:050.out.nojournal 2023-05-12T09:11:08.957 INFO:teuthology.orchestra.run.smithi116.stdout:050.out.xfsquota 2023-05-12T09:11:08.957 INFO:teuthology.orchestra.run.smithi116.stdout:051 2023-05-12T09:11:08.957 INFO:teuthology.orchestra.run.smithi116.stdout:051.out 2023-05-12T09:11:08.957 INFO:teuthology.orchestra.run.smithi116.stdout:052 2023-05-12T09:11:08.957 INFO:teuthology.orchestra.run.smithi116.stdout:052.out 2023-05-12T09:11:08.958 INFO:teuthology.orchestra.run.smithi116.stdout:053 2023-05-12T09:11:08.958 INFO:teuthology.orchestra.run.smithi116.stdout:053.out 2023-05-12T09:11:08.958 INFO:teuthology.orchestra.run.smithi116.stdout:054 2023-05-12T09:11:08.958 INFO:teuthology.orchestra.run.smithi116.stdout:054.out 2023-05-12T09:11:08.958 INFO:teuthology.orchestra.run.smithi116.stdout:055 2023-05-12T09:11:08.958 INFO:teuthology.orchestra.run.smithi116.stdout:055.out 2023-05-12T09:11:08.958 INFO:teuthology.orchestra.run.smithi116.stdout:056 2023-05-12T09:11:08.958 INFO:teuthology.orchestra.run.smithi116.stdout:056.out 2023-05-12T09:11:08.959 INFO:teuthology.orchestra.run.smithi116.stdout:057 2023-05-12T09:11:08.959 INFO:teuthology.orchestra.run.smithi116.stdout:057.out 2023-05-12T09:11:08.959 INFO:teuthology.orchestra.run.smithi116.stdout:058 2023-05-12T09:11:08.959 INFO:teuthology.orchestra.run.smithi116.stdout:058.out 2023-05-12T09:11:08.959 INFO:teuthology.orchestra.run.smithi116.stdout:059 2023-05-12T09:11:08.959 INFO:teuthology.orchestra.run.smithi116.stdout:059.out 2023-05-12T09:11:08.959 INFO:teuthology.orchestra.run.smithi116.stdout:060 2023-05-12T09:11:08.959 INFO:teuthology.orchestra.run.smithi116.stdout:060.out 2023-05-12T09:11:08.960 INFO:teuthology.orchestra.run.smithi116.stdout:061 2023-05-12T09:11:08.960 INFO:teuthology.orchestra.run.smithi116.stdout:061.out 2023-05-12T09:11:08.960 INFO:teuthology.orchestra.run.smithi116.stdout:062 2023-05-12T09:11:08.960 INFO:teuthology.orchestra.run.smithi116.stdout:062.out 2023-05-12T09:11:08.960 INFO:teuthology.orchestra.run.smithi116.stdout:063 2023-05-12T09:11:08.960 INFO:teuthology.orchestra.run.smithi116.stdout:063.out 2023-05-12T09:11:08.960 INFO:teuthology.orchestra.run.smithi116.stdout:064 2023-05-12T09:11:08.960 INFO:teuthology.orchestra.run.smithi116.stdout:064.out 2023-05-12T09:11:08.961 INFO:teuthology.orchestra.run.smithi116.stdout:065 2023-05-12T09:11:08.961 INFO:teuthology.orchestra.run.smithi116.stdout:065.out 2023-05-12T09:11:08.961 INFO:teuthology.orchestra.run.smithi116.stdout:066 2023-05-12T09:11:08.961 INFO:teuthology.orchestra.run.smithi116.stdout:066.out 2023-05-12T09:11:08.961 INFO:teuthology.orchestra.run.smithi116.stdout:067 2023-05-12T09:11:08.961 INFO:teuthology.orchestra.run.smithi116.stdout:067.out 2023-05-12T09:11:08.961 INFO:teuthology.orchestra.run.smithi116.stdout:068 2023-05-12T09:11:08.962 INFO:teuthology.orchestra.run.smithi116.stdout:068.out 2023-05-12T09:11:08.962 INFO:teuthology.orchestra.run.smithi116.stdout:069 2023-05-12T09:11:08.962 INFO:teuthology.orchestra.run.smithi116.stdout:069.out 2023-05-12T09:11:08.962 INFO:teuthology.orchestra.run.smithi116.stdout:070 2023-05-12T09:11:08.962 INFO:teuthology.orchestra.run.smithi116.stdout:070.out 2023-05-12T09:11:08.962 INFO:teuthology.orchestra.run.smithi116.stdout:071 2023-05-12T09:11:08.962 INFO:teuthology.orchestra.run.smithi116.stdout:071.out 2023-05-12T09:11:08.962 INFO:teuthology.orchestra.run.smithi116.stdout:072 2023-05-12T09:11:08.963 INFO:teuthology.orchestra.run.smithi116.stdout:072.out 2023-05-12T09:11:08.963 INFO:teuthology.orchestra.run.smithi116.stdout:073 2023-05-12T09:11:08.963 INFO:teuthology.orchestra.run.smithi116.stdout:073.out 2023-05-12T09:11:08.963 INFO:teuthology.orchestra.run.smithi116.stdout:074 2023-05-12T09:11:08.963 INFO:teuthology.orchestra.run.smithi116.stdout:074.out 2023-05-12T09:11:08.963 INFO:teuthology.orchestra.run.smithi116.stdout:075 2023-05-12T09:11:08.963 INFO:teuthology.orchestra.run.smithi116.stdout:075.out 2023-05-12T09:11:08.963 INFO:teuthology.orchestra.run.smithi116.stdout:076 2023-05-12T09:11:08.964 INFO:teuthology.orchestra.run.smithi116.stdout:076.out 2023-05-12T09:11:08.964 INFO:teuthology.orchestra.run.smithi116.stdout:077 2023-05-12T09:11:08.964 INFO:teuthology.orchestra.run.smithi116.stdout:077.out 2023-05-12T09:11:08.964 INFO:teuthology.orchestra.run.smithi116.stdout:078 2023-05-12T09:11:08.964 INFO:teuthology.orchestra.run.smithi116.stdout:078.out 2023-05-12T09:11:08.964 INFO:teuthology.orchestra.run.smithi116.stdout:079 2023-05-12T09:11:08.964 INFO:teuthology.orchestra.run.smithi116.stdout:079.out 2023-05-12T09:11:08.964 INFO:teuthology.orchestra.run.smithi116.stdout:080 2023-05-12T09:11:08.965 INFO:teuthology.orchestra.run.smithi116.stdout:080.out 2023-05-12T09:11:08.965 INFO:teuthology.orchestra.run.smithi116.stdout:081 2023-05-12T09:11:08.965 INFO:teuthology.orchestra.run.smithi116.stdout:081.out 2023-05-12T09:11:08.965 INFO:teuthology.orchestra.run.smithi116.stdout:082 2023-05-12T09:11:08.965 INFO:teuthology.orchestra.run.smithi116.stdout:082.out 2023-05-12T09:11:08.965 INFO:teuthology.orchestra.run.smithi116.stdout:083 2023-05-12T09:11:08.965 INFO:teuthology.orchestra.run.smithi116.stdout:083.out 2023-05-12T09:11:08.965 INFO:teuthology.orchestra.run.smithi116.stdout:084 2023-05-12T09:11:08.966 INFO:teuthology.orchestra.run.smithi116.stdout:084.out 2023-05-12T09:11:08.966 INFO:teuthology.orchestra.run.smithi116.stdout:085 2023-05-12T09:11:08.966 INFO:teuthology.orchestra.run.smithi116.stdout:085.out 2023-05-12T09:11:08.966 INFO:teuthology.orchestra.run.smithi116.stdout:086 2023-05-12T09:11:08.966 INFO:teuthology.orchestra.run.smithi116.stdout:086.out 2023-05-12T09:11:08.966 INFO:teuthology.orchestra.run.smithi116.stdout:087 2023-05-12T09:11:08.966 INFO:teuthology.orchestra.run.smithi116.stdout:087.out 2023-05-12T09:11:08.967 INFO:teuthology.orchestra.run.smithi116.stdout:088 2023-05-12T09:11:08.967 INFO:teuthology.orchestra.run.smithi116.stdout:088.out 2023-05-12T09:11:08.967 INFO:teuthology.orchestra.run.smithi116.stdout:089 2023-05-12T09:11:08.967 INFO:teuthology.orchestra.run.smithi116.stdout:089.out 2023-05-12T09:11:08.967 INFO:teuthology.orchestra.run.smithi116.stdout:090 2023-05-12T09:11:08.967 INFO:teuthology.orchestra.run.smithi116.stdout:090.out 2023-05-12T09:11:08.967 INFO:teuthology.orchestra.run.smithi116.stdout:091 2023-05-12T09:11:08.967 INFO:teuthology.orchestra.run.smithi116.stdout:091.out 2023-05-12T09:11:08.968 INFO:teuthology.orchestra.run.smithi116.stdout:092 2023-05-12T09:11:08.968 INFO:teuthology.orchestra.run.smithi116.stdout:092.out 2023-05-12T09:11:08.968 INFO:teuthology.orchestra.run.smithi116.stdout:093 2023-05-12T09:11:08.968 INFO:teuthology.orchestra.run.smithi116.stdout:093.out 2023-05-12T09:11:08.968 INFO:teuthology.orchestra.run.smithi116.stdout:094 2023-05-12T09:11:08.968 INFO:teuthology.orchestra.run.smithi116.stdout:094.out 2023-05-12T09:11:08.968 INFO:teuthology.orchestra.run.smithi116.stdout:095 2023-05-12T09:11:08.968 INFO:teuthology.orchestra.run.smithi116.stdout:095.out 2023-05-12T09:11:08.969 INFO:teuthology.orchestra.run.smithi116.stdout:096 2023-05-12T09:11:08.969 INFO:teuthology.orchestra.run.smithi116.stdout:096.out 2023-05-12T09:11:08.969 INFO:teuthology.orchestra.run.smithi116.stdout:097 2023-05-12T09:11:08.969 INFO:teuthology.orchestra.run.smithi116.stdout:097.out 2023-05-12T09:11:08.969 INFO:teuthology.orchestra.run.smithi116.stdout:098 2023-05-12T09:11:08.969 INFO:teuthology.orchestra.run.smithi116.stdout:098.out 2023-05-12T09:11:08.969 INFO:teuthology.orchestra.run.smithi116.stdout:099 2023-05-12T09:11:08.969 INFO:teuthology.orchestra.run.smithi116.stdout:099.out 2023-05-12T09:11:08.970 INFO:teuthology.orchestra.run.smithi116.stdout:100 2023-05-12T09:11:08.970 INFO:teuthology.orchestra.run.smithi116.stdout:100.out 2023-05-12T09:11:08.970 INFO:teuthology.orchestra.run.smithi116.stdout:101 2023-05-12T09:11:08.970 INFO:teuthology.orchestra.run.smithi116.stdout:101.out 2023-05-12T09:11:08.970 INFO:teuthology.orchestra.run.smithi116.stdout:102 2023-05-12T09:11:08.970 INFO:teuthology.orchestra.run.smithi116.stdout:102.out 2023-05-12T09:11:08.970 INFO:teuthology.orchestra.run.smithi116.stdout:103 2023-05-12T09:11:08.970 INFO:teuthology.orchestra.run.smithi116.stdout:103.out 2023-05-12T09:11:08.971 INFO:teuthology.orchestra.run.smithi116.stdout:104 2023-05-12T09:11:08.971 INFO:teuthology.orchestra.run.smithi116.stdout:104.out 2023-05-12T09:11:08.971 INFO:teuthology.orchestra.run.smithi116.stdout:105 2023-05-12T09:11:08.971 INFO:teuthology.orchestra.run.smithi116.stdout:105.out 2023-05-12T09:11:08.971 INFO:teuthology.orchestra.run.smithi116.stdout:106 2023-05-12T09:11:08.971 INFO:teuthology.orchestra.run.smithi116.stdout:106.out 2023-05-12T09:11:08.971 INFO:teuthology.orchestra.run.smithi116.stdout:107 2023-05-12T09:11:08.971 INFO:teuthology.orchestra.run.smithi116.stdout:107.out 2023-05-12T09:11:08.972 INFO:teuthology.orchestra.run.smithi116.stdout:108 2023-05-12T09:11:08.972 INFO:teuthology.orchestra.run.smithi116.stdout:108.out 2023-05-12T09:11:08.972 INFO:teuthology.orchestra.run.smithi116.stdout:109 2023-05-12T09:11:08.972 INFO:teuthology.orchestra.run.smithi116.stdout:109.out 2023-05-12T09:11:08.972 INFO:teuthology.orchestra.run.smithi116.stdout:110 2023-05-12T09:11:08.972 INFO:teuthology.orchestra.run.smithi116.stdout:110.out 2023-05-12T09:11:08.972 INFO:teuthology.orchestra.run.smithi116.stdout:111 2023-05-12T09:11:08.973 INFO:teuthology.orchestra.run.smithi116.stdout:111.out 2023-05-12T09:11:08.973 INFO:teuthology.orchestra.run.smithi116.stdout:112 2023-05-12T09:11:08.973 INFO:teuthology.orchestra.run.smithi116.stdout:112.out 2023-05-12T09:11:08.973 INFO:teuthology.orchestra.run.smithi116.stdout:113 2023-05-12T09:11:08.973 INFO:teuthology.orchestra.run.smithi116.stdout:113.out 2023-05-12T09:11:08.973 INFO:teuthology.orchestra.run.smithi116.stdout:114 2023-05-12T09:11:08.973 INFO:teuthology.orchestra.run.smithi116.stdout:114.out 2023-05-12T09:11:08.973 INFO:teuthology.orchestra.run.smithi116.stdout:115 2023-05-12T09:11:08.974 INFO:teuthology.orchestra.run.smithi116.stdout:115.out 2023-05-12T09:11:08.974 INFO:teuthology.orchestra.run.smithi116.stdout:116 2023-05-12T09:11:08.974 INFO:teuthology.orchestra.run.smithi116.stdout:116.out 2023-05-12T09:11:08.974 INFO:teuthology.orchestra.run.smithi116.stdout:117 2023-05-12T09:11:08.974 INFO:teuthology.orchestra.run.smithi116.stdout:117.out 2023-05-12T09:11:08.974 INFO:teuthology.orchestra.run.smithi116.stdout:118 2023-05-12T09:11:08.974 INFO:teuthology.orchestra.run.smithi116.stdout:118.out 2023-05-12T09:11:08.974 INFO:teuthology.orchestra.run.smithi116.stdout:119 2023-05-12T09:11:08.975 INFO:teuthology.orchestra.run.smithi116.stdout:119.out 2023-05-12T09:11:08.975 INFO:teuthology.orchestra.run.smithi116.stdout:120 2023-05-12T09:11:08.975 INFO:teuthology.orchestra.run.smithi116.stdout:120.out 2023-05-12T09:11:08.975 INFO:teuthology.orchestra.run.smithi116.stdout:121 2023-05-12T09:11:08.975 INFO:teuthology.orchestra.run.smithi116.stdout:121.out 2023-05-12T09:11:08.975 INFO:teuthology.orchestra.run.smithi116.stdout:122 2023-05-12T09:11:08.975 INFO:teuthology.orchestra.run.smithi116.stdout:122.out 2023-05-12T09:11:08.975 INFO:teuthology.orchestra.run.smithi116.stdout:123 2023-05-12T09:11:08.976 INFO:teuthology.orchestra.run.smithi116.stdout:123.out 2023-05-12T09:11:08.976 INFO:teuthology.orchestra.run.smithi116.stdout:124 2023-05-12T09:11:08.976 INFO:teuthology.orchestra.run.smithi116.stdout:124.out 2023-05-12T09:11:08.976 INFO:teuthology.orchestra.run.smithi116.stdout:125 2023-05-12T09:11:08.976 INFO:teuthology.orchestra.run.smithi116.stdout:125.out 2023-05-12T09:11:08.976 INFO:teuthology.orchestra.run.smithi116.stdout:126 2023-05-12T09:11:08.976 INFO:teuthology.orchestra.run.smithi116.stdout:126.out 2023-05-12T09:11:08.977 INFO:teuthology.orchestra.run.smithi116.stdout:127 2023-05-12T09:11:08.977 INFO:teuthology.orchestra.run.smithi116.stdout:127.out 2023-05-12T09:11:08.977 INFO:teuthology.orchestra.run.smithi116.stdout:128 2023-05-12T09:11:08.977 INFO:teuthology.orchestra.run.smithi116.stdout:128.out 2023-05-12T09:11:08.977 INFO:teuthology.orchestra.run.smithi116.stdout:129 2023-05-12T09:11:08.977 INFO:teuthology.orchestra.run.smithi116.stdout:129.out 2023-05-12T09:11:08.977 INFO:teuthology.orchestra.run.smithi116.stdout:130 2023-05-12T09:11:08.977 INFO:teuthology.orchestra.run.smithi116.stdout:130.out 2023-05-12T09:11:08.978 INFO:teuthology.orchestra.run.smithi116.stdout:131 2023-05-12T09:11:08.978 INFO:teuthology.orchestra.run.smithi116.stdout:131.out 2023-05-12T09:11:08.978 INFO:teuthology.orchestra.run.smithi116.stdout:132 2023-05-12T09:11:08.978 INFO:teuthology.orchestra.run.smithi116.stdout:132.out 2023-05-12T09:11:08.978 INFO:teuthology.orchestra.run.smithi116.stdout:133 2023-05-12T09:11:08.978 INFO:teuthology.orchestra.run.smithi116.stdout:133.out 2023-05-12T09:11:08.978 INFO:teuthology.orchestra.run.smithi116.stdout:134 2023-05-12T09:11:08.978 INFO:teuthology.orchestra.run.smithi116.stdout:134.out 2023-05-12T09:11:08.979 INFO:teuthology.orchestra.run.smithi116.stdout:135 2023-05-12T09:11:08.979 INFO:teuthology.orchestra.run.smithi116.stdout:135.out 2023-05-12T09:11:08.979 INFO:teuthology.orchestra.run.smithi116.stdout:136 2023-05-12T09:11:08.979 INFO:teuthology.orchestra.run.smithi116.stdout:136.out 2023-05-12T09:11:08.979 INFO:teuthology.orchestra.run.smithi116.stdout:137 2023-05-12T09:11:08.979 INFO:teuthology.orchestra.run.smithi116.stdout:137.out 2023-05-12T09:11:08.979 INFO:teuthology.orchestra.run.smithi116.stdout:138 2023-05-12T09:11:08.979 INFO:teuthology.orchestra.run.smithi116.stdout:138.out 2023-05-12T09:11:08.980 INFO:teuthology.orchestra.run.smithi116.stdout:139 2023-05-12T09:11:08.980 INFO:teuthology.orchestra.run.smithi116.stdout:139.out 2023-05-12T09:11:08.980 INFO:teuthology.orchestra.run.smithi116.stdout:140 2023-05-12T09:11:08.980 INFO:teuthology.orchestra.run.smithi116.stdout:140.out 2023-05-12T09:11:08.980 INFO:teuthology.orchestra.run.smithi116.stdout:141 2023-05-12T09:11:08.980 INFO:teuthology.orchestra.run.smithi116.stdout:141.out 2023-05-12T09:11:08.980 INFO:teuthology.orchestra.run.smithi116.stdout:142 2023-05-12T09:11:08.980 INFO:teuthology.orchestra.run.smithi116.stdout:142.out 2023-05-12T09:11:08.981 INFO:teuthology.orchestra.run.smithi116.stdout:143 2023-05-12T09:11:08.981 INFO:teuthology.orchestra.run.smithi116.stdout:143.out 2023-05-12T09:11:08.981 INFO:teuthology.orchestra.run.smithi116.stdout:144 2023-05-12T09:11:08.981 INFO:teuthology.orchestra.run.smithi116.stdout:144.out 2023-05-12T09:11:08.981 INFO:teuthology.orchestra.run.smithi116.stdout:145 2023-05-12T09:11:08.981 INFO:teuthology.orchestra.run.smithi116.stdout:145.out 2023-05-12T09:11:08.981 INFO:teuthology.orchestra.run.smithi116.stdout:146 2023-05-12T09:11:08.981 INFO:teuthology.orchestra.run.smithi116.stdout:146.out 2023-05-12T09:11:08.982 INFO:teuthology.orchestra.run.smithi116.stdout:147 2023-05-12T09:11:08.982 INFO:teuthology.orchestra.run.smithi116.stdout:147.out 2023-05-12T09:11:08.982 INFO:teuthology.orchestra.run.smithi116.stdout:148 2023-05-12T09:11:08.982 INFO:teuthology.orchestra.run.smithi116.stdout:148.out 2023-05-12T09:11:08.982 INFO:teuthology.orchestra.run.smithi116.stdout:149 2023-05-12T09:11:08.982 INFO:teuthology.orchestra.run.smithi116.stdout:149.out 2023-05-12T09:11:08.982 INFO:teuthology.orchestra.run.smithi116.stdout:150 2023-05-12T09:11:08.982 INFO:teuthology.orchestra.run.smithi116.stdout:150.out 2023-05-12T09:11:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:151 2023-05-12T09:11:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:151.out 2023-05-12T09:11:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:152 2023-05-12T09:11:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:152.out 2023-05-12T09:11:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:153 2023-05-12T09:11:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:153.out 2023-05-12T09:11:08.983 INFO:teuthology.orchestra.run.smithi116.stdout:154 2023-05-12T09:11:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:154.out 2023-05-12T09:11:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:155 2023-05-12T09:11:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:155.out 2023-05-12T09:11:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:156 2023-05-12T09:11:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:156.out 2023-05-12T09:11:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:157 2023-05-12T09:11:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:157.out 2023-05-12T09:11:08.984 INFO:teuthology.orchestra.run.smithi116.stdout:158 2023-05-12T09:11:08.985 INFO:teuthology.orchestra.run.smithi116.stdout:158.out 2023-05-12T09:11:08.985 INFO:teuthology.orchestra.run.smithi116.stdout:159 2023-05-12T09:11:08.985 INFO:teuthology.orchestra.run.smithi116.stdout:159.out 2023-05-12T09:11:08.985 INFO:teuthology.orchestra.run.smithi116.stdout:160 2023-05-12T09:11:08.985 INFO:teuthology.orchestra.run.smithi116.stdout:160.out 2023-05-12T09:11:08.985 INFO:teuthology.orchestra.run.smithi116.stdout:161 2023-05-12T09:11:08.985 INFO:teuthology.orchestra.run.smithi116.stdout:161.out 2023-05-12T09:11:08.985 INFO:teuthology.orchestra.run.smithi116.stdout:162 2023-05-12T09:11:08.986 INFO:teuthology.orchestra.run.smithi116.stdout:162.out 2023-05-12T09:11:08.986 INFO:teuthology.orchestra.run.smithi116.stdout:163 2023-05-12T09:11:08.986 INFO:teuthology.orchestra.run.smithi116.stdout:163.out 2023-05-12T09:11:08.986 INFO:teuthology.orchestra.run.smithi116.stdout:164 2023-05-12T09:11:08.986 INFO:teuthology.orchestra.run.smithi116.stdout:164.out 2023-05-12T09:11:08.986 INFO:teuthology.orchestra.run.smithi116.stdout:165 2023-05-12T09:11:08.986 INFO:teuthology.orchestra.run.smithi116.stdout:165.out 2023-05-12T09:11:08.986 INFO:teuthology.orchestra.run.smithi116.stdout:166 2023-05-12T09:11:08.987 INFO:teuthology.orchestra.run.smithi116.stdout:166.out 2023-05-12T09:11:08.987 INFO:teuthology.orchestra.run.smithi116.stdout:167 2023-05-12T09:11:08.987 INFO:teuthology.orchestra.run.smithi116.stdout:167.out 2023-05-12T09:11:08.987 INFO:teuthology.orchestra.run.smithi116.stdout:168 2023-05-12T09:11:08.987 INFO:teuthology.orchestra.run.smithi116.stdout:168.out 2023-05-12T09:11:08.987 INFO:teuthology.orchestra.run.smithi116.stdout:169 2023-05-12T09:11:08.987 INFO:teuthology.orchestra.run.smithi116.stdout:169.out 2023-05-12T09:11:08.987 INFO:teuthology.orchestra.run.smithi116.stdout:170 2023-05-12T09:11:08.988 INFO:teuthology.orchestra.run.smithi116.stdout:170.out 2023-05-12T09:11:08.988 INFO:teuthology.orchestra.run.smithi116.stdout:171 2023-05-12T09:11:08.988 INFO:teuthology.orchestra.run.smithi116.stdout:171.out 2023-05-12T09:11:08.988 INFO:teuthology.orchestra.run.smithi116.stdout:172 2023-05-12T09:11:08.988 INFO:teuthology.orchestra.run.smithi116.stdout:172.out 2023-05-12T09:11:08.988 INFO:teuthology.orchestra.run.smithi116.stdout:173 2023-05-12T09:11:08.988 INFO:teuthology.orchestra.run.smithi116.stdout:173.out 2023-05-12T09:11:08.988 INFO:teuthology.orchestra.run.smithi116.stdout:174 2023-05-12T09:11:08.989 INFO:teuthology.orchestra.run.smithi116.stdout:174.out 2023-05-12T09:11:08.989 INFO:teuthology.orchestra.run.smithi116.stdout:175 2023-05-12T09:11:08.989 INFO:teuthology.orchestra.run.smithi116.stdout:175.out 2023-05-12T09:11:08.989 INFO:teuthology.orchestra.run.smithi116.stdout:176 2023-05-12T09:11:08.989 INFO:teuthology.orchestra.run.smithi116.stdout:176.out 2023-05-12T09:11:08.989 INFO:teuthology.orchestra.run.smithi116.stdout:177 2023-05-12T09:11:08.989 INFO:teuthology.orchestra.run.smithi116.stdout:177.out 2023-05-12T09:11:08.990 INFO:teuthology.orchestra.run.smithi116.stdout:178 2023-05-12T09:11:08.990 INFO:teuthology.orchestra.run.smithi116.stdout:178.out 2023-05-12T09:11:08.990 INFO:teuthology.orchestra.run.smithi116.stdout:179 2023-05-12T09:11:08.990 INFO:teuthology.orchestra.run.smithi116.stdout:179.out 2023-05-12T09:11:08.990 INFO:teuthology.orchestra.run.smithi116.stdout:180 2023-05-12T09:11:08.990 INFO:teuthology.orchestra.run.smithi116.stdout:180.out 2023-05-12T09:11:08.990 INFO:teuthology.orchestra.run.smithi116.stdout:181 2023-05-12T09:11:08.990 INFO:teuthology.orchestra.run.smithi116.stdout:181.out 2023-05-12T09:11:08.991 INFO:teuthology.orchestra.run.smithi116.stdout:182 2023-05-12T09:11:08.991 INFO:teuthology.orchestra.run.smithi116.stdout:182.out 2023-05-12T09:11:08.991 INFO:teuthology.orchestra.run.smithi116.stdout:183 2023-05-12T09:11:08.991 INFO:teuthology.orchestra.run.smithi116.stdout:183.out 2023-05-12T09:11:08.991 INFO:teuthology.orchestra.run.smithi116.stdout:184 2023-05-12T09:11:08.991 INFO:teuthology.orchestra.run.smithi116.stdout:184.out 2023-05-12T09:11:08.991 INFO:teuthology.orchestra.run.smithi116.stdout:185 2023-05-12T09:11:08.991 INFO:teuthology.orchestra.run.smithi116.stdout:185.out 2023-05-12T09:11:08.992 INFO:teuthology.orchestra.run.smithi116.stdout:186 2023-05-12T09:11:08.992 INFO:teuthology.orchestra.run.smithi116.stdout:186.out 2023-05-12T09:11:08.992 INFO:teuthology.orchestra.run.smithi116.stdout:187 2023-05-12T09:11:08.992 INFO:teuthology.orchestra.run.smithi116.stdout:187.out 2023-05-12T09:11:08.992 INFO:teuthology.orchestra.run.smithi116.stdout:188 2023-05-12T09:11:08.992 INFO:teuthology.orchestra.run.smithi116.stdout:188.out 2023-05-12T09:11:08.992 INFO:teuthology.orchestra.run.smithi116.stdout:189 2023-05-12T09:11:08.992 INFO:teuthology.orchestra.run.smithi116.stdout:189.out 2023-05-12T09:11:08.993 INFO:teuthology.orchestra.run.smithi116.stdout:190 2023-05-12T09:11:08.993 INFO:teuthology.orchestra.run.smithi116.stdout:190.out 2023-05-12T09:11:08.993 INFO:teuthology.orchestra.run.smithi116.stdout:191 2023-05-12T09:11:08.993 INFO:teuthology.orchestra.run.smithi116.stdout:191.out 2023-05-12T09:11:08.993 INFO:teuthology.orchestra.run.smithi116.stdout:192 2023-05-12T09:11:08.993 INFO:teuthology.orchestra.run.smithi116.stdout:192.out 2023-05-12T09:11:08.993 INFO:teuthology.orchestra.run.smithi116.stdout:193 2023-05-12T09:11:08.993 INFO:teuthology.orchestra.run.smithi116.stdout:193.out 2023-05-12T09:11:08.994 INFO:teuthology.orchestra.run.smithi116.stdout:194 2023-05-12T09:11:08.994 INFO:teuthology.orchestra.run.smithi116.stdout:194.out 2023-05-12T09:11:08.994 INFO:teuthology.orchestra.run.smithi116.stdout:195 2023-05-12T09:11:08.994 INFO:teuthology.orchestra.run.smithi116.stdout:195.out 2023-05-12T09:11:08.994 INFO:teuthology.orchestra.run.smithi116.stdout:196 2023-05-12T09:11:08.994 INFO:teuthology.orchestra.run.smithi116.stdout:196.out 2023-05-12T09:11:08.994 INFO:teuthology.orchestra.run.smithi116.stdout:197 2023-05-12T09:11:08.994 INFO:teuthology.orchestra.run.smithi116.stdout:197.out 2023-05-12T09:11:08.995 INFO:teuthology.orchestra.run.smithi116.stdout:198 2023-05-12T09:11:08.995 INFO:teuthology.orchestra.run.smithi116.stdout:198.out 2023-05-12T09:11:08.995 INFO:teuthology.orchestra.run.smithi116.stdout:199 2023-05-12T09:11:08.995 INFO:teuthology.orchestra.run.smithi116.stdout:199.out 2023-05-12T09:11:08.995 INFO:teuthology.orchestra.run.smithi116.stdout:200 2023-05-12T09:11:08.995 INFO:teuthology.orchestra.run.smithi116.stdout:200.out 2023-05-12T09:11:08.995 INFO:teuthology.orchestra.run.smithi116.stdout:201 2023-05-12T09:11:08.996 INFO:teuthology.orchestra.run.smithi116.stdout:201.out 2023-05-12T09:11:08.996 INFO:teuthology.orchestra.run.smithi116.stdout:202 2023-05-12T09:11:08.996 INFO:teuthology.orchestra.run.smithi116.stdout:202.out 2023-05-12T09:11:08.996 INFO:teuthology.orchestra.run.smithi116.stdout:203 2023-05-12T09:11:08.996 INFO:teuthology.orchestra.run.smithi116.stdout:203.out 2023-05-12T09:11:08.996 INFO:teuthology.orchestra.run.smithi116.stdout:204 2023-05-12T09:11:08.996 INFO:teuthology.orchestra.run.smithi116.stdout:204.out 2023-05-12T09:11:08.996 INFO:teuthology.orchestra.run.smithi116.stdout:205 2023-05-12T09:11:08.997 INFO:teuthology.orchestra.run.smithi116.stdout:205.out 2023-05-12T09:11:08.997 INFO:teuthology.orchestra.run.smithi116.stdout:206 2023-05-12T09:11:08.997 INFO:teuthology.orchestra.run.smithi116.stdout:206.out 2023-05-12T09:11:08.997 INFO:teuthology.orchestra.run.smithi116.stdout:207 2023-05-12T09:11:08.997 INFO:teuthology.orchestra.run.smithi116.stdout:207.out 2023-05-12T09:11:08.997 INFO:teuthology.orchestra.run.smithi116.stdout:208 2023-05-12T09:11:08.997 INFO:teuthology.orchestra.run.smithi116.stdout:208.out 2023-05-12T09:11:08.997 INFO:teuthology.orchestra.run.smithi116.stdout:209 2023-05-12T09:11:08.998 INFO:teuthology.orchestra.run.smithi116.stdout:209.out 2023-05-12T09:11:08.998 INFO:teuthology.orchestra.run.smithi116.stdout:210 2023-05-12T09:11:08.998 INFO:teuthology.orchestra.run.smithi116.stdout:210.out 2023-05-12T09:11:08.998 INFO:teuthology.orchestra.run.smithi116.stdout:211 2023-05-12T09:11:08.998 INFO:teuthology.orchestra.run.smithi116.stdout:211.out 2023-05-12T09:11:08.998 INFO:teuthology.orchestra.run.smithi116.stdout:212 2023-05-12T09:11:08.998 INFO:teuthology.orchestra.run.smithi116.stdout:212.out 2023-05-12T09:11:08.998 INFO:teuthology.orchestra.run.smithi116.stdout:213 2023-05-12T09:11:08.999 INFO:teuthology.orchestra.run.smithi116.stdout:213.out 2023-05-12T09:11:08.999 INFO:teuthology.orchestra.run.smithi116.stdout:214 2023-05-12T09:11:08.999 INFO:teuthology.orchestra.run.smithi116.stdout:214.out 2023-05-12T09:11:08.999 INFO:teuthology.orchestra.run.smithi116.stdout:215 2023-05-12T09:11:08.999 INFO:teuthology.orchestra.run.smithi116.stdout:215.out 2023-05-12T09:11:08.999 INFO:teuthology.orchestra.run.smithi116.stdout:216 2023-05-12T09:11:08.999 INFO:teuthology.orchestra.run.smithi116.stdout:216.out 2023-05-12T09:11:09.000 INFO:teuthology.orchestra.run.smithi116.stdout:217 2023-05-12T09:11:09.000 INFO:teuthology.orchestra.run.smithi116.stdout:217.out 2023-05-12T09:11:09.000 INFO:teuthology.orchestra.run.smithi116.stdout:218 2023-05-12T09:11:09.000 INFO:teuthology.orchestra.run.smithi116.stdout:218.out 2023-05-12T09:11:09.000 INFO:teuthology.orchestra.run.smithi116.stdout:219 2023-05-12T09:11:09.000 INFO:teuthology.orchestra.run.smithi116.stdout:219.out 2023-05-12T09:11:09.000 INFO:teuthology.orchestra.run.smithi116.stdout:220 2023-05-12T09:11:09.000 INFO:teuthology.orchestra.run.smithi116.stdout:220.out 2023-05-12T09:11:09.001 INFO:teuthology.orchestra.run.smithi116.stdout:221 2023-05-12T09:11:09.001 INFO:teuthology.orchestra.run.smithi116.stdout:221.out 2023-05-12T09:11:09.001 INFO:teuthology.orchestra.run.smithi116.stdout:222 2023-05-12T09:11:09.001 INFO:teuthology.orchestra.run.smithi116.stdout:222.out 2023-05-12T09:11:09.001 INFO:teuthology.orchestra.run.smithi116.stdout:223 2023-05-12T09:11:09.001 INFO:teuthology.orchestra.run.smithi116.stdout:223.out 2023-05-12T09:11:09.001 INFO:teuthology.orchestra.run.smithi116.stdout:224 2023-05-12T09:11:09.001 INFO:teuthology.orchestra.run.smithi116.stdout:224.out 2023-05-12T09:11:09.002 INFO:teuthology.orchestra.run.smithi116.stdout:225 2023-05-12T09:11:09.002 INFO:teuthology.orchestra.run.smithi116.stdout:225.out 2023-05-12T09:11:09.002 INFO:teuthology.orchestra.run.smithi116.stdout:226 2023-05-12T09:11:09.002 INFO:teuthology.orchestra.run.smithi116.stdout:226.out 2023-05-12T09:11:09.002 INFO:teuthology.orchestra.run.smithi116.stdout:227 2023-05-12T09:11:09.002 INFO:teuthology.orchestra.run.smithi116.stdout:227.out 2023-05-12T09:11:09.002 INFO:teuthology.orchestra.run.smithi116.stdout:228 2023-05-12T09:11:09.002 INFO:teuthology.orchestra.run.smithi116.stdout:228.out 2023-05-12T09:11:09.003 INFO:teuthology.orchestra.run.smithi116.stdout:229 2023-05-12T09:11:09.003 INFO:teuthology.orchestra.run.smithi116.stdout:229.out 2023-05-12T09:11:09.003 INFO:teuthology.orchestra.run.smithi116.stdout:230 2023-05-12T09:11:09.003 INFO:teuthology.orchestra.run.smithi116.stdout:230.out 2023-05-12T09:11:09.003 INFO:teuthology.orchestra.run.smithi116.stdout:231 2023-05-12T09:11:09.003 INFO:teuthology.orchestra.run.smithi116.stdout:231.out 2023-05-12T09:11:09.003 INFO:teuthology.orchestra.run.smithi116.stdout:232 2023-05-12T09:11:09.004 INFO:teuthology.orchestra.run.smithi116.stdout:232.out 2023-05-12T09:11:09.004 INFO:teuthology.orchestra.run.smithi116.stdout:233 2023-05-12T09:11:09.004 INFO:teuthology.orchestra.run.smithi116.stdout:233.out 2023-05-12T09:11:09.004 INFO:teuthology.orchestra.run.smithi116.stdout:234 2023-05-12T09:11:09.004 INFO:teuthology.orchestra.run.smithi116.stdout:234.out 2023-05-12T09:11:09.004 INFO:teuthology.orchestra.run.smithi116.stdout:235 2023-05-12T09:11:09.004 INFO:teuthology.orchestra.run.smithi116.stdout:235.out 2023-05-12T09:11:09.004 INFO:teuthology.orchestra.run.smithi116.stdout:236 2023-05-12T09:11:09.005 INFO:teuthology.orchestra.run.smithi116.stdout:236.out 2023-05-12T09:11:09.005 INFO:teuthology.orchestra.run.smithi116.stdout:237 2023-05-12T09:11:09.005 INFO:teuthology.orchestra.run.smithi116.stdout:237.out 2023-05-12T09:11:09.005 INFO:teuthology.orchestra.run.smithi116.stdout:238 2023-05-12T09:11:09.005 INFO:teuthology.orchestra.run.smithi116.stdout:238.out 2023-05-12T09:11:09.005 INFO:teuthology.orchestra.run.smithi116.stdout:239 2023-05-12T09:11:09.005 INFO:teuthology.orchestra.run.smithi116.stdout:239.out 2023-05-12T09:11:09.005 INFO:teuthology.orchestra.run.smithi116.stdout:240 2023-05-12T09:11:09.006 INFO:teuthology.orchestra.run.smithi116.stdout:240.out 2023-05-12T09:11:09.006 INFO:teuthology.orchestra.run.smithi116.stdout:241 2023-05-12T09:11:09.006 INFO:teuthology.orchestra.run.smithi116.stdout:241.out 2023-05-12T09:11:09.006 INFO:teuthology.orchestra.run.smithi116.stdout:242 2023-05-12T09:11:09.006 INFO:teuthology.orchestra.run.smithi116.stdout:242.out 2023-05-12T09:11:09.006 INFO:teuthology.orchestra.run.smithi116.stdout:243 2023-05-12T09:11:09.006 INFO:teuthology.orchestra.run.smithi116.stdout:243.out 2023-05-12T09:11:09.006 INFO:teuthology.orchestra.run.smithi116.stdout:244 2023-05-12T09:11:09.007 INFO:teuthology.orchestra.run.smithi116.stdout:244.out 2023-05-12T09:11:09.007 INFO:teuthology.orchestra.run.smithi116.stdout:245 2023-05-12T09:11:09.007 INFO:teuthology.orchestra.run.smithi116.stdout:245.out 2023-05-12T09:11:09.007 INFO:teuthology.orchestra.run.smithi116.stdout:246 2023-05-12T09:11:09.007 INFO:teuthology.orchestra.run.smithi116.stdout:246.out 2023-05-12T09:11:09.007 INFO:teuthology.orchestra.run.smithi116.stdout:247 2023-05-12T09:11:09.007 INFO:teuthology.orchestra.run.smithi116.stdout:247.out 2023-05-12T09:11:09.007 INFO:teuthology.orchestra.run.smithi116.stdout:248 2023-05-12T09:11:09.008 INFO:teuthology.orchestra.run.smithi116.stdout:248.out 2023-05-12T09:11:09.008 INFO:teuthology.orchestra.run.smithi116.stdout:249 2023-05-12T09:11:09.008 INFO:teuthology.orchestra.run.smithi116.stdout:249.out 2023-05-12T09:11:09.008 INFO:teuthology.orchestra.run.smithi116.stdout:250 2023-05-12T09:11:09.008 INFO:teuthology.orchestra.run.smithi116.stdout:250.out 2023-05-12T09:11:09.008 INFO:teuthology.orchestra.run.smithi116.stdout:251 2023-05-12T09:11:09.008 INFO:teuthology.orchestra.run.smithi116.stdout:251.out 2023-05-12T09:11:09.009 INFO:teuthology.orchestra.run.smithi116.stdout:252 2023-05-12T09:11:09.009 INFO:teuthology.orchestra.run.smithi116.stdout:252.out 2023-05-12T09:11:09.009 INFO:teuthology.orchestra.run.smithi116.stdout:253 2023-05-12T09:11:09.009 INFO:teuthology.orchestra.run.smithi116.stdout:253.out 2023-05-12T09:11:09.009 INFO:teuthology.orchestra.run.smithi116.stdout:254 2023-05-12T09:11:09.009 INFO:teuthology.orchestra.run.smithi116.stdout:254.out 2023-05-12T09:11:09.009 INFO:teuthology.orchestra.run.smithi116.stdout:255 2023-05-12T09:11:09.009 INFO:teuthology.orchestra.run.smithi116.stdout:255.out 2023-05-12T09:11:09.010 INFO:teuthology.orchestra.run.smithi116.stdout:256 2023-05-12T09:11:09.010 INFO:teuthology.orchestra.run.smithi116.stdout:256.out 2023-05-12T09:11:09.010 INFO:teuthology.orchestra.run.smithi116.stdout:257 2023-05-12T09:11:09.010 INFO:teuthology.orchestra.run.smithi116.stdout:257.out 2023-05-12T09:11:09.010 INFO:teuthology.orchestra.run.smithi116.stdout:258 2023-05-12T09:11:09.010 INFO:teuthology.orchestra.run.smithi116.stdout:258.out 2023-05-12T09:11:09.010 INFO:teuthology.orchestra.run.smithi116.stdout:259 2023-05-12T09:11:09.010 INFO:teuthology.orchestra.run.smithi116.stdout:259.out 2023-05-12T09:11:09.011 INFO:teuthology.orchestra.run.smithi116.stdout:260 2023-05-12T09:11:09.011 INFO:teuthology.orchestra.run.smithi116.stdout:260.out 2023-05-12T09:11:09.011 INFO:teuthology.orchestra.run.smithi116.stdout:261 2023-05-12T09:11:09.011 INFO:teuthology.orchestra.run.smithi116.stdout:261.out 2023-05-12T09:11:09.011 INFO:teuthology.orchestra.run.smithi116.stdout:262 2023-05-12T09:11:09.011 INFO:teuthology.orchestra.run.smithi116.stdout:262.out 2023-05-12T09:11:09.011 INFO:teuthology.orchestra.run.smithi116.stdout:263 2023-05-12T09:11:09.011 INFO:teuthology.orchestra.run.smithi116.stdout:263.out 2023-05-12T09:11:09.012 INFO:teuthology.orchestra.run.smithi116.stdout:264 2023-05-12T09:11:09.012 INFO:teuthology.orchestra.run.smithi116.stdout:264.out 2023-05-12T09:11:09.012 INFO:teuthology.orchestra.run.smithi116.stdout:265 2023-05-12T09:11:09.012 INFO:teuthology.orchestra.run.smithi116.stdout:265.out 2023-05-12T09:11:09.012 INFO:teuthology.orchestra.run.smithi116.stdout:266 2023-05-12T09:11:09.012 INFO:teuthology.orchestra.run.smithi116.stdout:266.out 2023-05-12T09:11:09.012 INFO:teuthology.orchestra.run.smithi116.stdout:267 2023-05-12T09:11:09.012 INFO:teuthology.orchestra.run.smithi116.stdout:267.out 2023-05-12T09:11:09.013 INFO:teuthology.orchestra.run.smithi116.stdout:268 2023-05-12T09:11:09.013 INFO:teuthology.orchestra.run.smithi116.stdout:268.out 2023-05-12T09:11:09.013 INFO:teuthology.orchestra.run.smithi116.stdout:269 2023-05-12T09:11:09.013 INFO:teuthology.orchestra.run.smithi116.stdout:269.out 2023-05-12T09:11:09.013 INFO:teuthology.orchestra.run.smithi116.stdout:270 2023-05-12T09:11:09.013 INFO:teuthology.orchestra.run.smithi116.stdout:270.out 2023-05-12T09:11:09.013 INFO:teuthology.orchestra.run.smithi116.stdout:271 2023-05-12T09:11:09.013 INFO:teuthology.orchestra.run.smithi116.stdout:271.out 2023-05-12T09:11:09.014 INFO:teuthology.orchestra.run.smithi116.stdout:272 2023-05-12T09:11:09.014 INFO:teuthology.orchestra.run.smithi116.stdout:272.out 2023-05-12T09:11:09.014 INFO:teuthology.orchestra.run.smithi116.stdout:273 2023-05-12T09:11:09.014 INFO:teuthology.orchestra.run.smithi116.stdout:273.out 2023-05-12T09:11:09.014 INFO:teuthology.orchestra.run.smithi116.stdout:274 2023-05-12T09:11:09.014 INFO:teuthology.orchestra.run.smithi116.stdout:274.out 2023-05-12T09:11:09.014 INFO:teuthology.orchestra.run.smithi116.stdout:275 2023-05-12T09:11:09.015 INFO:teuthology.orchestra.run.smithi116.stdout:275.out 2023-05-12T09:11:09.015 INFO:teuthology.orchestra.run.smithi116.stdout:276 2023-05-12T09:11:09.015 INFO:teuthology.orchestra.run.smithi116.stdout:276.out 2023-05-12T09:11:09.015 INFO:teuthology.orchestra.run.smithi116.stdout:277 2023-05-12T09:11:09.015 INFO:teuthology.orchestra.run.smithi116.stdout:277.out 2023-05-12T09:11:09.015 INFO:teuthology.orchestra.run.smithi116.stdout:278 2023-05-12T09:11:09.015 INFO:teuthology.orchestra.run.smithi116.stdout:278.out 2023-05-12T09:11:09.015 INFO:teuthology.orchestra.run.smithi116.stdout:279 2023-05-12T09:11:09.016 INFO:teuthology.orchestra.run.smithi116.stdout:279.out 2023-05-12T09:11:09.016 INFO:teuthology.orchestra.run.smithi116.stdout:280 2023-05-12T09:11:09.016 INFO:teuthology.orchestra.run.smithi116.stdout:280.out 2023-05-12T09:11:09.016 INFO:teuthology.orchestra.run.smithi116.stdout:281 2023-05-12T09:11:09.016 INFO:teuthology.orchestra.run.smithi116.stdout:281.out 2023-05-12T09:11:09.016 INFO:teuthology.orchestra.run.smithi116.stdout:282 2023-05-12T09:11:09.016 INFO:teuthology.orchestra.run.smithi116.stdout:282.out 2023-05-12T09:11:09.016 INFO:teuthology.orchestra.run.smithi116.stdout:283 2023-05-12T09:11:09.017 INFO:teuthology.orchestra.run.smithi116.stdout:283.out 2023-05-12T09:11:09.017 INFO:teuthology.orchestra.run.smithi116.stdout:284 2023-05-12T09:11:09.017 INFO:teuthology.orchestra.run.smithi116.stdout:284.out 2023-05-12T09:11:09.017 INFO:teuthology.orchestra.run.smithi116.stdout:285 2023-05-12T09:11:09.017 INFO:teuthology.orchestra.run.smithi116.stdout:285.out 2023-05-12T09:11:09.017 INFO:teuthology.orchestra.run.smithi116.stdout:286 2023-05-12T09:11:09.017 INFO:teuthology.orchestra.run.smithi116.stdout:286.out 2023-05-12T09:11:09.017 INFO:teuthology.orchestra.run.smithi116.stdout:287 2023-05-12T09:11:09.018 INFO:teuthology.orchestra.run.smithi116.stdout:287.out 2023-05-12T09:11:09.018 INFO:teuthology.orchestra.run.smithi116.stdout:288 2023-05-12T09:11:09.018 INFO:teuthology.orchestra.run.smithi116.stdout:288.out 2023-05-12T09:11:09.018 INFO:teuthology.orchestra.run.smithi116.stdout:289 2023-05-12T09:11:09.018 INFO:teuthology.orchestra.run.smithi116.stdout:289.out 2023-05-12T09:11:09.018 INFO:teuthology.orchestra.run.smithi116.stdout:290 2023-05-12T09:11:09.018 INFO:teuthology.orchestra.run.smithi116.stdout:290.out 2023-05-12T09:11:09.018 INFO:teuthology.orchestra.run.smithi116.stdout:291 2023-05-12T09:11:09.019 INFO:teuthology.orchestra.run.smithi116.stdout:291.out 2023-05-12T09:11:09.019 INFO:teuthology.orchestra.run.smithi116.stdout:292 2023-05-12T09:11:09.019 INFO:teuthology.orchestra.run.smithi116.stdout:292.out 2023-05-12T09:11:09.019 INFO:teuthology.orchestra.run.smithi116.stdout:293 2023-05-12T09:11:09.019 INFO:teuthology.orchestra.run.smithi116.stdout:293.out 2023-05-12T09:11:09.019 INFO:teuthology.orchestra.run.smithi116.stdout:294 2023-05-12T09:11:09.019 INFO:teuthology.orchestra.run.smithi116.stdout:294.out 2023-05-12T09:11:09.019 INFO:teuthology.orchestra.run.smithi116.stdout:295 2023-05-12T09:11:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:295.out 2023-05-12T09:11:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:296 2023-05-12T09:11:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:296.out 2023-05-12T09:11:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:297 2023-05-12T09:11:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:297.out 2023-05-12T09:11:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:298 2023-05-12T09:11:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:298.out 2023-05-12T09:11:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:299 2023-05-12T09:11:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:299.out 2023-05-12T09:11:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:300 2023-05-12T09:11:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:300.out 2023-05-12T09:11:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:301 2023-05-12T09:11:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:301.out 2023-05-12T09:11:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:302 2023-05-12T09:11:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:302.out 2023-05-12T09:11:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:303 2023-05-12T09:11:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:303.out 2023-05-12T09:11:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:304 2023-05-12T09:11:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:304.out 2023-05-12T09:11:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:305 2023-05-12T09:11:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:305.out 2023-05-12T09:11:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:306 2023-05-12T09:11:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:306.out 2023-05-12T09:11:09.023 INFO:teuthology.orchestra.run.smithi116.stdout:307 2023-05-12T09:11:09.023 INFO:teuthology.orchestra.run.smithi116.stdout:307.out 2023-05-12T09:11:09.023 INFO:teuthology.orchestra.run.smithi116.stdout:308 2023-05-12T09:11:09.023 INFO:teuthology.orchestra.run.smithi116.stdout:308.out 2023-05-12T09:11:09.023 INFO:teuthology.orchestra.run.smithi116.stdout:309 2023-05-12T09:11:09.023 INFO:teuthology.orchestra.run.smithi116.stdout:309.out 2023-05-12T09:11:09.023 INFO:teuthology.orchestra.run.smithi116.stdout:310 2023-05-12T09:11:09.023 INFO:teuthology.orchestra.run.smithi116.stdout:310.out 2023-05-12T09:11:09.024 INFO:teuthology.orchestra.run.smithi116.stdout:311 2023-05-12T09:11:09.024 INFO:teuthology.orchestra.run.smithi116.stdout:311.out 2023-05-12T09:11:09.024 INFO:teuthology.orchestra.run.smithi116.stdout:312 2023-05-12T09:11:09.024 INFO:teuthology.orchestra.run.smithi116.stdout:312.out 2023-05-12T09:11:09.024 INFO:teuthology.orchestra.run.smithi116.stdout:313 2023-05-12T09:11:09.024 INFO:teuthology.orchestra.run.smithi116.stdout:313.out 2023-05-12T09:11:09.024 INFO:teuthology.orchestra.run.smithi116.stdout:314 2023-05-12T09:11:09.024 INFO:teuthology.orchestra.run.smithi116.stdout:314.out 2023-05-12T09:11:09.025 INFO:teuthology.orchestra.run.smithi116.stdout:315 2023-05-12T09:11:09.025 INFO:teuthology.orchestra.run.smithi116.stdout:315.out 2023-05-12T09:11:09.025 INFO:teuthology.orchestra.run.smithi116.stdout:316 2023-05-12T09:11:09.025 INFO:teuthology.orchestra.run.smithi116.stdout:316.out 2023-05-12T09:11:09.025 INFO:teuthology.orchestra.run.smithi116.stdout:317 2023-05-12T09:11:09.025 INFO:teuthology.orchestra.run.smithi116.stdout:317.out 2023-05-12T09:11:09.025 INFO:teuthology.orchestra.run.smithi116.stdout:318 2023-05-12T09:11:09.026 INFO:teuthology.orchestra.run.smithi116.stdout:318.out 2023-05-12T09:11:09.026 INFO:teuthology.orchestra.run.smithi116.stdout:319 2023-05-12T09:11:09.026 INFO:teuthology.orchestra.run.smithi116.stdout:319.out 2023-05-12T09:11:09.026 INFO:teuthology.orchestra.run.smithi116.stdout:320 2023-05-12T09:11:09.026 INFO:teuthology.orchestra.run.smithi116.stdout:320.out 2023-05-12T09:11:09.026 INFO:teuthology.orchestra.run.smithi116.stdout:321 2023-05-12T09:11:09.026 INFO:teuthology.orchestra.run.smithi116.stdout:321.out 2023-05-12T09:11:09.026 INFO:teuthology.orchestra.run.smithi116.stdout:322 2023-05-12T09:11:09.027 INFO:teuthology.orchestra.run.smithi116.stdout:322.out 2023-05-12T09:11:09.027 INFO:teuthology.orchestra.run.smithi116.stdout:323 2023-05-12T09:11:09.027 INFO:teuthology.orchestra.run.smithi116.stdout:323.out 2023-05-12T09:11:09.027 INFO:teuthology.orchestra.run.smithi116.stdout:324 2023-05-12T09:11:09.027 INFO:teuthology.orchestra.run.smithi116.stdout:324.out 2023-05-12T09:11:09.027 INFO:teuthology.orchestra.run.smithi116.stdout:325 2023-05-12T09:11:09.027 INFO:teuthology.orchestra.run.smithi116.stdout:325.out 2023-05-12T09:11:09.027 INFO:teuthology.orchestra.run.smithi116.stdout:326 2023-05-12T09:11:09.028 INFO:teuthology.orchestra.run.smithi116.stdout:326.out 2023-05-12T09:11:09.028 INFO:teuthology.orchestra.run.smithi116.stdout:327 2023-05-12T09:11:09.028 INFO:teuthology.orchestra.run.smithi116.stdout:327.out 2023-05-12T09:11:09.028 INFO:teuthology.orchestra.run.smithi116.stdout:328 2023-05-12T09:11:09.028 INFO:teuthology.orchestra.run.smithi116.stdout:328.out 2023-05-12T09:11:09.028 INFO:teuthology.orchestra.run.smithi116.stdout:329 2023-05-12T09:11:09.028 INFO:teuthology.orchestra.run.smithi116.stdout:329.out 2023-05-12T09:11:09.028 INFO:teuthology.orchestra.run.smithi116.stdout:330 2023-05-12T09:11:09.029 INFO:teuthology.orchestra.run.smithi116.stdout:330.out 2023-05-12T09:11:09.029 INFO:teuthology.orchestra.run.smithi116.stdout:331 2023-05-12T09:11:09.029 INFO:teuthology.orchestra.run.smithi116.stdout:331.out 2023-05-12T09:11:09.029 INFO:teuthology.orchestra.run.smithi116.stdout:332 2023-05-12T09:11:09.029 INFO:teuthology.orchestra.run.smithi116.stdout:332.out 2023-05-12T09:11:09.029 INFO:teuthology.orchestra.run.smithi116.stdout:333 2023-05-12T09:11:09.029 INFO:teuthology.orchestra.run.smithi116.stdout:333.out 2023-05-12T09:11:09.030 INFO:teuthology.orchestra.run.smithi116.stdout:334 2023-05-12T09:11:09.030 INFO:teuthology.orchestra.run.smithi116.stdout:334.out 2023-05-12T09:11:09.030 INFO:teuthology.orchestra.run.smithi116.stdout:335 2023-05-12T09:11:09.030 INFO:teuthology.orchestra.run.smithi116.stdout:335.out 2023-05-12T09:11:09.030 INFO:teuthology.orchestra.run.smithi116.stdout:336 2023-05-12T09:11:09.030 INFO:teuthology.orchestra.run.smithi116.stdout:336.out 2023-05-12T09:11:09.030 INFO:teuthology.orchestra.run.smithi116.stdout:337 2023-05-12T09:11:09.030 INFO:teuthology.orchestra.run.smithi116.stdout:337.out 2023-05-12T09:11:09.031 INFO:teuthology.orchestra.run.smithi116.stdout:338 2023-05-12T09:11:09.031 INFO:teuthology.orchestra.run.smithi116.stdout:338.out 2023-05-12T09:11:09.031 INFO:teuthology.orchestra.run.smithi116.stdout:339 2023-05-12T09:11:09.031 INFO:teuthology.orchestra.run.smithi116.stdout:339.out 2023-05-12T09:11:09.031 INFO:teuthology.orchestra.run.smithi116.stdout:340 2023-05-12T09:11:09.031 INFO:teuthology.orchestra.run.smithi116.stdout:340.out 2023-05-12T09:11:09.031 INFO:teuthology.orchestra.run.smithi116.stdout:341 2023-05-12T09:11:09.031 INFO:teuthology.orchestra.run.smithi116.stdout:341.out 2023-05-12T09:11:09.032 INFO:teuthology.orchestra.run.smithi116.stdout:342 2023-05-12T09:11:09.032 INFO:teuthology.orchestra.run.smithi116.stdout:342.out 2023-05-12T09:11:09.032 INFO:teuthology.orchestra.run.smithi116.stdout:343 2023-05-12T09:11:09.032 INFO:teuthology.orchestra.run.smithi116.stdout:343.out 2023-05-12T09:11:09.032 INFO:teuthology.orchestra.run.smithi116.stdout:344 2023-05-12T09:11:09.032 INFO:teuthology.orchestra.run.smithi116.stdout:344.out 2023-05-12T09:11:09.032 INFO:teuthology.orchestra.run.smithi116.stdout:345 2023-05-12T09:11:09.032 INFO:teuthology.orchestra.run.smithi116.stdout:345.out 2023-05-12T09:11:09.033 INFO:teuthology.orchestra.run.smithi116.stdout:346 2023-05-12T09:11:09.033 INFO:teuthology.orchestra.run.smithi116.stdout:346.out 2023-05-12T09:11:09.033 INFO:teuthology.orchestra.run.smithi116.stdout:347 2023-05-12T09:11:09.033 INFO:teuthology.orchestra.run.smithi116.stdout:347.out 2023-05-12T09:11:09.033 INFO:teuthology.orchestra.run.smithi116.stdout:348 2023-05-12T09:11:09.033 INFO:teuthology.orchestra.run.smithi116.stdout:348.out 2023-05-12T09:11:09.033 INFO:teuthology.orchestra.run.smithi116.stdout:349 2023-05-12T09:11:09.033 INFO:teuthology.orchestra.run.smithi116.stdout:349.out 2023-05-12T09:11:09.034 INFO:teuthology.orchestra.run.smithi116.stdout:350 2023-05-12T09:11:09.034 INFO:teuthology.orchestra.run.smithi116.stdout:350.out 2023-05-12T09:11:09.034 INFO:teuthology.orchestra.run.smithi116.stdout:351 2023-05-12T09:11:09.034 INFO:teuthology.orchestra.run.smithi116.stdout:351.out 2023-05-12T09:11:09.034 INFO:teuthology.orchestra.run.smithi116.stdout:352 2023-05-12T09:11:09.034 INFO:teuthology.orchestra.run.smithi116.stdout:352.out 2023-05-12T09:11:09.034 INFO:teuthology.orchestra.run.smithi116.stdout:353 2023-05-12T09:11:09.034 INFO:teuthology.orchestra.run.smithi116.stdout:353.out 2023-05-12T09:11:09.035 INFO:teuthology.orchestra.run.smithi116.stdout:354 2023-05-12T09:11:09.035 INFO:teuthology.orchestra.run.smithi116.stdout:354.out 2023-05-12T09:11:09.035 INFO:teuthology.orchestra.run.smithi116.stdout:355 2023-05-12T09:11:09.035 INFO:teuthology.orchestra.run.smithi116.stdout:355.out 2023-05-12T09:11:09.035 INFO:teuthology.orchestra.run.smithi116.stdout:356 2023-05-12T09:11:09.035 INFO:teuthology.orchestra.run.smithi116.stdout:356.out 2023-05-12T09:11:09.035 INFO:teuthology.orchestra.run.smithi116.stdout:357 2023-05-12T09:11:09.035 INFO:teuthology.orchestra.run.smithi116.stdout:357.out 2023-05-12T09:11:09.036 INFO:teuthology.orchestra.run.smithi116.stdout:358 2023-05-12T09:11:09.036 INFO:teuthology.orchestra.run.smithi116.stdout:358.out 2023-05-12T09:11:09.036 INFO:teuthology.orchestra.run.smithi116.stdout:359 2023-05-12T09:11:09.036 INFO:teuthology.orchestra.run.smithi116.stdout:359.out 2023-05-12T09:11:09.036 INFO:teuthology.orchestra.run.smithi116.stdout:360 2023-05-12T09:11:09.036 INFO:teuthology.orchestra.run.smithi116.stdout:360.out 2023-05-12T09:11:09.036 INFO:teuthology.orchestra.run.smithi116.stdout:361 2023-05-12T09:11:09.036 INFO:teuthology.orchestra.run.smithi116.stdout:361.out 2023-05-12T09:11:09.037 INFO:teuthology.orchestra.run.smithi116.stdout:362 2023-05-12T09:11:09.037 INFO:teuthology.orchestra.run.smithi116.stdout:362.out 2023-05-12T09:11:09.037 INFO:teuthology.orchestra.run.smithi116.stdout:363 2023-05-12T09:11:09.037 INFO:teuthology.orchestra.run.smithi116.stdout:363.out 2023-05-12T09:11:09.037 INFO:teuthology.orchestra.run.smithi116.stdout:364 2023-05-12T09:11:09.037 INFO:teuthology.orchestra.run.smithi116.stdout:364.out 2023-05-12T09:11:09.037 INFO:teuthology.orchestra.run.smithi116.stdout:365 2023-05-12T09:11:09.037 INFO:teuthology.orchestra.run.smithi116.stdout:365.out 2023-05-12T09:11:09.038 INFO:teuthology.orchestra.run.smithi116.stdout:366 2023-05-12T09:11:09.038 INFO:teuthology.orchestra.run.smithi116.stdout:366.out 2023-05-12T09:11:09.038 INFO:teuthology.orchestra.run.smithi116.stdout:367 2023-05-12T09:11:09.038 INFO:teuthology.orchestra.run.smithi116.stdout:367.out 2023-05-12T09:11:09.038 INFO:teuthology.orchestra.run.smithi116.stdout:368 2023-05-12T09:11:09.038 INFO:teuthology.orchestra.run.smithi116.stdout:368.out 2023-05-12T09:11:09.038 INFO:teuthology.orchestra.run.smithi116.stdout:369 2023-05-12T09:11:09.039 INFO:teuthology.orchestra.run.smithi116.stdout:369.out 2023-05-12T09:11:09.039 INFO:teuthology.orchestra.run.smithi116.stdout:370 2023-05-12T09:11:09.039 INFO:teuthology.orchestra.run.smithi116.stdout:370.out 2023-05-12T09:11:09.039 INFO:teuthology.orchestra.run.smithi116.stdout:371 2023-05-12T09:11:09.039 INFO:teuthology.orchestra.run.smithi116.stdout:371.out 2023-05-12T09:11:09.039 INFO:teuthology.orchestra.run.smithi116.stdout:372 2023-05-12T09:11:09.039 INFO:teuthology.orchestra.run.smithi116.stdout:372.out 2023-05-12T09:11:09.039 INFO:teuthology.orchestra.run.smithi116.stdout:373 2023-05-12T09:11:09.040 INFO:teuthology.orchestra.run.smithi116.stdout:373.out 2023-05-12T09:11:09.040 INFO:teuthology.orchestra.run.smithi116.stdout:374 2023-05-12T09:11:09.040 INFO:teuthology.orchestra.run.smithi116.stdout:374.out 2023-05-12T09:11:09.040 INFO:teuthology.orchestra.run.smithi116.stdout:375 2023-05-12T09:11:09.040 INFO:teuthology.orchestra.run.smithi116.stdout:375.out 2023-05-12T09:11:09.040 INFO:teuthology.orchestra.run.smithi116.stdout:376 2023-05-12T09:11:09.040 INFO:teuthology.orchestra.run.smithi116.stdout:376.out 2023-05-12T09:11:09.040 INFO:teuthology.orchestra.run.smithi116.stdout:377 2023-05-12T09:11:09.041 INFO:teuthology.orchestra.run.smithi116.stdout:377.out 2023-05-12T09:11:09.041 INFO:teuthology.orchestra.run.smithi116.stdout:378 2023-05-12T09:11:09.041 INFO:teuthology.orchestra.run.smithi116.stdout:378.out 2023-05-12T09:11:09.041 INFO:teuthology.orchestra.run.smithi116.stdout:379 2023-05-12T09:11:09.041 INFO:teuthology.orchestra.run.smithi116.stdout:379.out 2023-05-12T09:11:09.041 INFO:teuthology.orchestra.run.smithi116.stdout:380 2023-05-12T09:11:09.041 INFO:teuthology.orchestra.run.smithi116.stdout:380.out 2023-05-12T09:11:09.041 INFO:teuthology.orchestra.run.smithi116.stdout:381 2023-05-12T09:11:09.042 INFO:teuthology.orchestra.run.smithi116.stdout:381.out 2023-05-12T09:11:09.042 INFO:teuthology.orchestra.run.smithi116.stdout:382 2023-05-12T09:11:09.042 INFO:teuthology.orchestra.run.smithi116.stdout:382.out 2023-05-12T09:11:09.042 INFO:teuthology.orchestra.run.smithi116.stdout:383 2023-05-12T09:11:09.042 INFO:teuthology.orchestra.run.smithi116.stdout:383.out 2023-05-12T09:11:09.042 INFO:teuthology.orchestra.run.smithi116.stdout:384 2023-05-12T09:11:09.042 INFO:teuthology.orchestra.run.smithi116.stdout:384.out 2023-05-12T09:11:09.043 INFO:teuthology.orchestra.run.smithi116.stdout:385 2023-05-12T09:11:09.043 INFO:teuthology.orchestra.run.smithi116.stdout:385.out 2023-05-12T09:11:09.043 INFO:teuthology.orchestra.run.smithi116.stdout:386 2023-05-12T09:11:09.043 INFO:teuthology.orchestra.run.smithi116.stdout:386.out 2023-05-12T09:11:09.043 INFO:teuthology.orchestra.run.smithi116.stdout:387 2023-05-12T09:11:09.043 INFO:teuthology.orchestra.run.smithi116.stdout:387.out 2023-05-12T09:11:09.043 INFO:teuthology.orchestra.run.smithi116.stdout:388 2023-05-12T09:11:09.043 INFO:teuthology.orchestra.run.smithi116.stdout:388.out 2023-05-12T09:11:09.044 INFO:teuthology.orchestra.run.smithi116.stdout:389 2023-05-12T09:11:09.044 INFO:teuthology.orchestra.run.smithi116.stdout:389.out 2023-05-12T09:11:09.044 INFO:teuthology.orchestra.run.smithi116.stdout:390 2023-05-12T09:11:09.044 INFO:teuthology.orchestra.run.smithi116.stdout:390.out 2023-05-12T09:11:09.044 INFO:teuthology.orchestra.run.smithi116.stdout:391 2023-05-12T09:11:09.044 INFO:teuthology.orchestra.run.smithi116.stdout:391.out 2023-05-12T09:11:09.044 INFO:teuthology.orchestra.run.smithi116.stdout:392 2023-05-12T09:11:09.044 INFO:teuthology.orchestra.run.smithi116.stdout:392.out 2023-05-12T09:11:09.045 INFO:teuthology.orchestra.run.smithi116.stdout:393 2023-05-12T09:11:09.045 INFO:teuthology.orchestra.run.smithi116.stdout:393.out 2023-05-12T09:11:09.045 INFO:teuthology.orchestra.run.smithi116.stdout:394 2023-05-12T09:11:09.045 INFO:teuthology.orchestra.run.smithi116.stdout:394.out 2023-05-12T09:11:09.045 INFO:teuthology.orchestra.run.smithi116.stdout:395 2023-05-12T09:11:09.045 INFO:teuthology.orchestra.run.smithi116.stdout:395.out 2023-05-12T09:11:09.045 INFO:teuthology.orchestra.run.smithi116.stdout:396 2023-05-12T09:11:09.045 INFO:teuthology.orchestra.run.smithi116.stdout:396.out 2023-05-12T09:11:09.046 INFO:teuthology.orchestra.run.smithi116.stdout:397 2023-05-12T09:11:09.046 INFO:teuthology.orchestra.run.smithi116.stdout:397.out 2023-05-12T09:11:09.046 INFO:teuthology.orchestra.run.smithi116.stdout:398 2023-05-12T09:11:09.046 INFO:teuthology.orchestra.run.smithi116.stdout:398.out 2023-05-12T09:11:09.046 INFO:teuthology.orchestra.run.smithi116.stdout:399 2023-05-12T09:11:09.046 INFO:teuthology.orchestra.run.smithi116.stdout:399.out 2023-05-12T09:11:09.046 INFO:teuthology.orchestra.run.smithi116.stdout:400 2023-05-12T09:11:09.046 INFO:teuthology.orchestra.run.smithi116.stdout:400.out 2023-05-12T09:11:09.047 INFO:teuthology.orchestra.run.smithi116.stdout:401 2023-05-12T09:11:09.047 INFO:teuthology.orchestra.run.smithi116.stdout:401.out 2023-05-12T09:11:09.047 INFO:teuthology.orchestra.run.smithi116.stdout:402 2023-05-12T09:11:09.047 INFO:teuthology.orchestra.run.smithi116.stdout:402.out 2023-05-12T09:11:09.047 INFO:teuthology.orchestra.run.smithi116.stdout:403 2023-05-12T09:11:09.047 INFO:teuthology.orchestra.run.smithi116.stdout:403.out 2023-05-12T09:11:09.047 INFO:teuthology.orchestra.run.smithi116.stdout:404 2023-05-12T09:11:09.047 INFO:teuthology.orchestra.run.smithi116.stdout:404.out 2023-05-12T09:11:09.048 INFO:teuthology.orchestra.run.smithi116.stdout:405 2023-05-12T09:11:09.048 INFO:teuthology.orchestra.run.smithi116.stdout:405.out 2023-05-12T09:11:09.048 INFO:teuthology.orchestra.run.smithi116.stdout:406 2023-05-12T09:11:09.048 INFO:teuthology.orchestra.run.smithi116.stdout:406.out 2023-05-12T09:11:09.048 INFO:teuthology.orchestra.run.smithi116.stdout:407 2023-05-12T09:11:09.048 INFO:teuthology.orchestra.run.smithi116.stdout:407.out 2023-05-12T09:11:09.048 INFO:teuthology.orchestra.run.smithi116.stdout:408 2023-05-12T09:11:09.049 INFO:teuthology.orchestra.run.smithi116.stdout:408.out 2023-05-12T09:11:09.049 INFO:teuthology.orchestra.run.smithi116.stdout:409 2023-05-12T09:11:09.049 INFO:teuthology.orchestra.run.smithi116.stdout:409.out 2023-05-12T09:11:09.049 INFO:teuthology.orchestra.run.smithi116.stdout:410 2023-05-12T09:11:09.049 INFO:teuthology.orchestra.run.smithi116.stdout:410.out 2023-05-12T09:11:09.049 INFO:teuthology.orchestra.run.smithi116.stdout:411 2023-05-12T09:11:09.049 INFO:teuthology.orchestra.run.smithi116.stdout:411.out 2023-05-12T09:11:09.049 INFO:teuthology.orchestra.run.smithi116.stdout:412 2023-05-12T09:11:09.050 INFO:teuthology.orchestra.run.smithi116.stdout:412.out 2023-05-12T09:11:09.050 INFO:teuthology.orchestra.run.smithi116.stdout:413 2023-05-12T09:11:09.050 INFO:teuthology.orchestra.run.smithi116.stdout:413.out 2023-05-12T09:11:09.050 INFO:teuthology.orchestra.run.smithi116.stdout:414 2023-05-12T09:11:09.050 INFO:teuthology.orchestra.run.smithi116.stdout:414.out 2023-05-12T09:11:09.050 INFO:teuthology.orchestra.run.smithi116.stdout:415 2023-05-12T09:11:09.050 INFO:teuthology.orchestra.run.smithi116.stdout:415.out 2023-05-12T09:11:09.050 INFO:teuthology.orchestra.run.smithi116.stdout:416 2023-05-12T09:11:09.051 INFO:teuthology.orchestra.run.smithi116.stdout:416.out 2023-05-12T09:11:09.051 INFO:teuthology.orchestra.run.smithi116.stdout:417 2023-05-12T09:11:09.051 INFO:teuthology.orchestra.run.smithi116.stdout:417.out 2023-05-12T09:11:09.051 INFO:teuthology.orchestra.run.smithi116.stdout:418 2023-05-12T09:11:09.051 INFO:teuthology.orchestra.run.smithi116.stdout:418.out 2023-05-12T09:11:09.051 INFO:teuthology.orchestra.run.smithi116.stdout:419 2023-05-12T09:11:09.051 INFO:teuthology.orchestra.run.smithi116.stdout:419.out 2023-05-12T09:11:09.051 INFO:teuthology.orchestra.run.smithi116.stdout:420 2023-05-12T09:11:09.052 INFO:teuthology.orchestra.run.smithi116.stdout:420.out 2023-05-12T09:11:09.052 INFO:teuthology.orchestra.run.smithi116.stdout:421 2023-05-12T09:11:09.052 INFO:teuthology.orchestra.run.smithi116.stdout:421.out 2023-05-12T09:11:09.052 INFO:teuthology.orchestra.run.smithi116.stdout:422 2023-05-12T09:11:09.052 INFO:teuthology.orchestra.run.smithi116.stdout:422.out 2023-05-12T09:11:09.052 INFO:teuthology.orchestra.run.smithi116.stdout:423 2023-05-12T09:11:09.052 INFO:teuthology.orchestra.run.smithi116.stdout:423.out 2023-05-12T09:11:09.052 INFO:teuthology.orchestra.run.smithi116.stdout:424 2023-05-12T09:11:09.053 INFO:teuthology.orchestra.run.smithi116.stdout:424.out 2023-05-12T09:11:09.053 INFO:teuthology.orchestra.run.smithi116.stdout:425 2023-05-12T09:11:09.053 INFO:teuthology.orchestra.run.smithi116.stdout:425.out 2023-05-12T09:11:09.053 INFO:teuthology.orchestra.run.smithi116.stdout:426 2023-05-12T09:11:09.053 INFO:teuthology.orchestra.run.smithi116.stdout:426.out 2023-05-12T09:11:09.053 INFO:teuthology.orchestra.run.smithi116.stdout:427 2023-05-12T09:11:09.053 INFO:teuthology.orchestra.run.smithi116.stdout:427.out 2023-05-12T09:11:09.053 INFO:teuthology.orchestra.run.smithi116.stdout:428 2023-05-12T09:11:09.054 INFO:teuthology.orchestra.run.smithi116.stdout:428.out 2023-05-12T09:11:09.054 INFO:teuthology.orchestra.run.smithi116.stdout:429 2023-05-12T09:11:09.054 INFO:teuthology.orchestra.run.smithi116.stdout:429.out 2023-05-12T09:11:09.054 INFO:teuthology.orchestra.run.smithi116.stdout:430 2023-05-12T09:11:09.054 INFO:teuthology.orchestra.run.smithi116.stdout:430.out 2023-05-12T09:11:09.054 INFO:teuthology.orchestra.run.smithi116.stdout:431 2023-05-12T09:11:09.054 INFO:teuthology.orchestra.run.smithi116.stdout:431.out 2023-05-12T09:11:09.055 INFO:teuthology.orchestra.run.smithi116.stdout:432 2023-05-12T09:11:09.055 INFO:teuthology.orchestra.run.smithi116.stdout:432.out 2023-05-12T09:11:09.055 INFO:teuthology.orchestra.run.smithi116.stdout:433 2023-05-12T09:11:09.055 INFO:teuthology.orchestra.run.smithi116.stdout:433.out 2023-05-12T09:11:09.055 INFO:teuthology.orchestra.run.smithi116.stdout:434 2023-05-12T09:11:09.055 INFO:teuthology.orchestra.run.smithi116.stdout:434.out 2023-05-12T09:11:09.055 INFO:teuthology.orchestra.run.smithi116.stdout:435 2023-05-12T09:11:09.055 INFO:teuthology.orchestra.run.smithi116.stdout:435.out 2023-05-12T09:11:09.056 INFO:teuthology.orchestra.run.smithi116.stdout:436 2023-05-12T09:11:09.056 INFO:teuthology.orchestra.run.smithi116.stdout:436.out 2023-05-12T09:11:09.056 INFO:teuthology.orchestra.run.smithi116.stdout:437 2023-05-12T09:11:09.056 INFO:teuthology.orchestra.run.smithi116.stdout:437.out 2023-05-12T09:11:09.056 INFO:teuthology.orchestra.run.smithi116.stdout:438 2023-05-12T09:11:09.056 INFO:teuthology.orchestra.run.smithi116.stdout:438.out 2023-05-12T09:11:09.056 INFO:teuthology.orchestra.run.smithi116.stdout:439 2023-05-12T09:11:09.056 INFO:teuthology.orchestra.run.smithi116.stdout:439.out 2023-05-12T09:11:09.057 INFO:teuthology.orchestra.run.smithi116.stdout:440 2023-05-12T09:11:09.057 INFO:teuthology.orchestra.run.smithi116.stdout:440.out 2023-05-12T09:11:09.057 INFO:teuthology.orchestra.run.smithi116.stdout:441 2023-05-12T09:11:09.057 INFO:teuthology.orchestra.run.smithi116.stdout:441.out 2023-05-12T09:11:09.057 INFO:teuthology.orchestra.run.smithi116.stdout:442 2023-05-12T09:11:09.057 INFO:teuthology.orchestra.run.smithi116.stdout:442.out 2023-05-12T09:11:09.057 INFO:teuthology.orchestra.run.smithi116.stdout:443 2023-05-12T09:11:09.057 INFO:teuthology.orchestra.run.smithi116.stdout:443.out 2023-05-12T09:11:09.058 INFO:teuthology.orchestra.run.smithi116.stdout:444 2023-05-12T09:11:09.058 INFO:teuthology.orchestra.run.smithi116.stdout:444.out 2023-05-12T09:11:09.058 INFO:teuthology.orchestra.run.smithi116.stdout:445 2023-05-12T09:11:09.058 INFO:teuthology.orchestra.run.smithi116.stdout:445.out 2023-05-12T09:11:09.058 INFO:teuthology.orchestra.run.smithi116.stdout:446 2023-05-12T09:11:09.058 INFO:teuthology.orchestra.run.smithi116.stdout:446.out 2023-05-12T09:11:09.058 INFO:teuthology.orchestra.run.smithi116.stdout:447 2023-05-12T09:11:09.058 INFO:teuthology.orchestra.run.smithi116.stdout:447.out 2023-05-12T09:11:09.059 INFO:teuthology.orchestra.run.smithi116.stdout:448 2023-05-12T09:11:09.059 INFO:teuthology.orchestra.run.smithi116.stdout:448.out 2023-05-12T09:11:09.059 INFO:teuthology.orchestra.run.smithi116.stdout:449 2023-05-12T09:11:09.059 INFO:teuthology.orchestra.run.smithi116.stdout:449.out 2023-05-12T09:11:09.059 INFO:teuthology.orchestra.run.smithi116.stdout:450 2023-05-12T09:11:09.059 INFO:teuthology.orchestra.run.smithi116.stdout:450.out 2023-05-12T09:11:09.059 INFO:teuthology.orchestra.run.smithi116.stdout:451 2023-05-12T09:11:09.059 INFO:teuthology.orchestra.run.smithi116.stdout:451.out 2023-05-12T09:11:09.060 INFO:teuthology.orchestra.run.smithi116.stdout:452 2023-05-12T09:11:09.060 INFO:teuthology.orchestra.run.smithi116.stdout:452.out 2023-05-12T09:11:09.060 INFO:teuthology.orchestra.run.smithi116.stdout:453 2023-05-12T09:11:09.060 INFO:teuthology.orchestra.run.smithi116.stdout:453.out 2023-05-12T09:11:09.060 INFO:teuthology.orchestra.run.smithi116.stdout:454 2023-05-12T09:11:09.060 INFO:teuthology.orchestra.run.smithi116.stdout:454.out 2023-05-12T09:11:09.060 INFO:teuthology.orchestra.run.smithi116.stdout:455 2023-05-12T09:11:09.061 INFO:teuthology.orchestra.run.smithi116.stdout:455.out 2023-05-12T09:11:09.061 INFO:teuthology.orchestra.run.smithi116.stdout:456 2023-05-12T09:11:09.061 INFO:teuthology.orchestra.run.smithi116.stdout:456.out 2023-05-12T09:11:09.061 INFO:teuthology.orchestra.run.smithi116.stdout:457 2023-05-12T09:11:09.061 INFO:teuthology.orchestra.run.smithi116.stdout:457.out 2023-05-12T09:11:09.061 INFO:teuthology.orchestra.run.smithi116.stdout:458 2023-05-12T09:11:09.061 INFO:teuthology.orchestra.run.smithi116.stdout:458.out 2023-05-12T09:11:09.061 INFO:teuthology.orchestra.run.smithi116.stdout:459 2023-05-12T09:11:09.062 INFO:teuthology.orchestra.run.smithi116.stdout:459.out 2023-05-12T09:11:09.062 INFO:teuthology.orchestra.run.smithi116.stdout:460 2023-05-12T09:11:09.062 INFO:teuthology.orchestra.run.smithi116.stdout:460.out 2023-05-12T09:11:09.062 INFO:teuthology.orchestra.run.smithi116.stdout:461 2023-05-12T09:11:09.062 INFO:teuthology.orchestra.run.smithi116.stdout:461.out 2023-05-12T09:11:09.062 INFO:teuthology.orchestra.run.smithi116.stdout:462 2023-05-12T09:11:09.062 INFO:teuthology.orchestra.run.smithi116.stdout:462.out 2023-05-12T09:11:09.062 INFO:teuthology.orchestra.run.smithi116.stdout:463 2023-05-12T09:11:09.063 INFO:teuthology.orchestra.run.smithi116.stdout:463.out 2023-05-12T09:11:09.063 INFO:teuthology.orchestra.run.smithi116.stdout:464 2023-05-12T09:11:09.063 INFO:teuthology.orchestra.run.smithi116.stdout:464.out 2023-05-12T09:11:09.063 INFO:teuthology.orchestra.run.smithi116.stdout:465 2023-05-12T09:11:09.063 INFO:teuthology.orchestra.run.smithi116.stdout:465.out 2023-05-12T09:11:09.063 INFO:teuthology.orchestra.run.smithi116.stdout:466 2023-05-12T09:11:09.063 INFO:teuthology.orchestra.run.smithi116.stdout:466.out 2023-05-12T09:11:09.063 INFO:teuthology.orchestra.run.smithi116.stdout:467 2023-05-12T09:11:09.064 INFO:teuthology.orchestra.run.smithi116.stdout:467.out 2023-05-12T09:11:09.064 INFO:teuthology.orchestra.run.smithi116.stdout:468 2023-05-12T09:11:09.064 INFO:teuthology.orchestra.run.smithi116.stdout:468.out 2023-05-12T09:11:09.064 INFO:teuthology.orchestra.run.smithi116.stdout:469 2023-05-12T09:11:09.064 INFO:teuthology.orchestra.run.smithi116.stdout:469.out 2023-05-12T09:11:09.064 INFO:teuthology.orchestra.run.smithi116.stdout:470 2023-05-12T09:11:09.064 INFO:teuthology.orchestra.run.smithi116.stdout:470.out 2023-05-12T09:11:09.064 INFO:teuthology.orchestra.run.smithi116.stdout:471 2023-05-12T09:11:09.065 INFO:teuthology.orchestra.run.smithi116.stdout:471.out 2023-05-12T09:11:09.065 INFO:teuthology.orchestra.run.smithi116.stdout:472 2023-05-12T09:11:09.065 INFO:teuthology.orchestra.run.smithi116.stdout:472.out 2023-05-12T09:11:09.065 INFO:teuthology.orchestra.run.smithi116.stdout:473 2023-05-12T09:11:09.065 INFO:teuthology.orchestra.run.smithi116.stdout:473.out 2023-05-12T09:11:09.065 INFO:teuthology.orchestra.run.smithi116.stdout:474 2023-05-12T09:11:09.065 INFO:teuthology.orchestra.run.smithi116.stdout:474.out 2023-05-12T09:11:09.065 INFO:teuthology.orchestra.run.smithi116.stdout:475 2023-05-12T09:11:09.066 INFO:teuthology.orchestra.run.smithi116.stdout:475.out 2023-05-12T09:11:09.066 INFO:teuthology.orchestra.run.smithi116.stdout:476 2023-05-12T09:11:09.066 INFO:teuthology.orchestra.run.smithi116.stdout:476.out 2023-05-12T09:11:09.066 INFO:teuthology.orchestra.run.smithi116.stdout:477 2023-05-12T09:11:09.066 INFO:teuthology.orchestra.run.smithi116.stdout:477.out 2023-05-12T09:11:09.066 INFO:teuthology.orchestra.run.smithi116.stdout:478 2023-05-12T09:11:09.066 INFO:teuthology.orchestra.run.smithi116.stdout:478.out 2023-05-12T09:11:09.066 INFO:teuthology.orchestra.run.smithi116.stdout:479 2023-05-12T09:11:09.067 INFO:teuthology.orchestra.run.smithi116.stdout:479.out 2023-05-12T09:11:09.067 INFO:teuthology.orchestra.run.smithi116.stdout:480 2023-05-12T09:11:09.067 INFO:teuthology.orchestra.run.smithi116.stdout:480.out 2023-05-12T09:11:09.067 INFO:teuthology.orchestra.run.smithi116.stdout:481 2023-05-12T09:11:09.067 INFO:teuthology.orchestra.run.smithi116.stdout:481.out 2023-05-12T09:11:09.067 INFO:teuthology.orchestra.run.smithi116.stdout:482 2023-05-12T09:11:09.067 INFO:teuthology.orchestra.run.smithi116.stdout:482.out 2023-05-12T09:11:09.068 INFO:teuthology.orchestra.run.smithi116.stdout:483 2023-05-12T09:11:09.068 INFO:teuthology.orchestra.run.smithi116.stdout:483.out 2023-05-12T09:11:09.068 INFO:teuthology.orchestra.run.smithi116.stdout:484 2023-05-12T09:11:09.068 INFO:teuthology.orchestra.run.smithi116.stdout:484.out 2023-05-12T09:11:09.068 INFO:teuthology.orchestra.run.smithi116.stdout:485 2023-05-12T09:11:09.068 INFO:teuthology.orchestra.run.smithi116.stdout:485.out 2023-05-12T09:11:09.068 INFO:teuthology.orchestra.run.smithi116.stdout:486 2023-05-12T09:11:09.068 INFO:teuthology.orchestra.run.smithi116.stdout:486.out 2023-05-12T09:11:09.069 INFO:teuthology.orchestra.run.smithi116.stdout:487 2023-05-12T09:11:09.069 INFO:teuthology.orchestra.run.smithi116.stdout:487.out 2023-05-12T09:11:09.069 INFO:teuthology.orchestra.run.smithi116.stdout:488 2023-05-12T09:11:09.069 INFO:teuthology.orchestra.run.smithi116.stdout:488.out 2023-05-12T09:11:09.069 INFO:teuthology.orchestra.run.smithi116.stdout:489 2023-05-12T09:11:09.069 INFO:teuthology.orchestra.run.smithi116.stdout:489.out 2023-05-12T09:11:09.069 INFO:teuthology.orchestra.run.smithi116.stdout:490 2023-05-12T09:11:09.069 INFO:teuthology.orchestra.run.smithi116.stdout:490.out 2023-05-12T09:11:09.070 INFO:teuthology.orchestra.run.smithi116.stdout:491 2023-05-12T09:11:09.070 INFO:teuthology.orchestra.run.smithi116.stdout:491.out 2023-05-12T09:11:09.070 INFO:teuthology.orchestra.run.smithi116.stdout:492 2023-05-12T09:11:09.070 INFO:teuthology.orchestra.run.smithi116.stdout:492.out 2023-05-12T09:11:09.070 INFO:teuthology.orchestra.run.smithi116.stdout:493 2023-05-12T09:11:09.070 INFO:teuthology.orchestra.run.smithi116.stdout:493.out 2023-05-12T09:11:09.070 INFO:teuthology.orchestra.run.smithi116.stdout:494 2023-05-12T09:11:09.070 INFO:teuthology.orchestra.run.smithi116.stdout:494.out 2023-05-12T09:11:09.071 INFO:teuthology.orchestra.run.smithi116.stdout:495 2023-05-12T09:11:09.071 INFO:teuthology.orchestra.run.smithi116.stdout:495.out 2023-05-12T09:11:09.071 INFO:teuthology.orchestra.run.smithi116.stdout:496 2023-05-12T09:11:09.071 INFO:teuthology.orchestra.run.smithi116.stdout:496.out 2023-05-12T09:11:09.071 INFO:teuthology.orchestra.run.smithi116.stdout:497 2023-05-12T09:11:09.071 INFO:teuthology.orchestra.run.smithi116.stdout:497.out 2023-05-12T09:11:09.071 INFO:teuthology.orchestra.run.smithi116.stdout:498 2023-05-12T09:11:09.071 INFO:teuthology.orchestra.run.smithi116.stdout:498.out 2023-05-12T09:11:09.072 INFO:teuthology.orchestra.run.smithi116.stdout:499 2023-05-12T09:11:09.072 INFO:teuthology.orchestra.run.smithi116.stdout:499.out 2023-05-12T09:11:09.072 INFO:teuthology.orchestra.run.smithi116.stdout:500 2023-05-12T09:11:09.072 INFO:teuthology.orchestra.run.smithi116.stdout:500.out 2023-05-12T09:11:09.072 INFO:teuthology.orchestra.run.smithi116.stdout:501 2023-05-12T09:11:09.072 INFO:teuthology.orchestra.run.smithi116.stdout:501.out 2023-05-12T09:11:09.072 INFO:teuthology.orchestra.run.smithi116.stdout:502 2023-05-12T09:11:09.073 INFO:teuthology.orchestra.run.smithi116.stdout:502.out 2023-05-12T09:11:09.073 INFO:teuthology.orchestra.run.smithi116.stdout:503 2023-05-12T09:11:09.073 INFO:teuthology.orchestra.run.smithi116.stdout:503.out 2023-05-12T09:11:09.073 INFO:teuthology.orchestra.run.smithi116.stdout:504 2023-05-12T09:11:09.073 INFO:teuthology.orchestra.run.smithi116.stdout:504.out 2023-05-12T09:11:09.073 INFO:teuthology.orchestra.run.smithi116.stdout:505 2023-05-12T09:11:09.073 INFO:teuthology.orchestra.run.smithi116.stdout:505.out 2023-05-12T09:11:09.073 INFO:teuthology.orchestra.run.smithi116.stdout:506 2023-05-12T09:11:09.074 INFO:teuthology.orchestra.run.smithi116.stdout:506.out 2023-05-12T09:11:09.074 INFO:teuthology.orchestra.run.smithi116.stdout:507 2023-05-12T09:11:09.074 INFO:teuthology.orchestra.run.smithi116.stdout:507.out 2023-05-12T09:11:09.074 INFO:teuthology.orchestra.run.smithi116.stdout:508 2023-05-12T09:11:09.074 INFO:teuthology.orchestra.run.smithi116.stdout:508.out 2023-05-12T09:11:09.074 INFO:teuthology.orchestra.run.smithi116.stdout:509 2023-05-12T09:11:09.074 INFO:teuthology.orchestra.run.smithi116.stdout:509.out 2023-05-12T09:11:09.074 INFO:teuthology.orchestra.run.smithi116.stdout:510 2023-05-12T09:11:09.075 INFO:teuthology.orchestra.run.smithi116.stdout:510.out 2023-05-12T09:11:09.075 INFO:teuthology.orchestra.run.smithi116.stdout:511 2023-05-12T09:11:09.075 INFO:teuthology.orchestra.run.smithi116.stdout:511.out 2023-05-12T09:11:09.075 INFO:teuthology.orchestra.run.smithi116.stdout:512 2023-05-12T09:11:09.075 INFO:teuthology.orchestra.run.smithi116.stdout:512.out 2023-05-12T09:11:09.075 INFO:teuthology.orchestra.run.smithi116.stdout:513 2023-05-12T09:11:09.075 INFO:teuthology.orchestra.run.smithi116.stdout:513.out 2023-05-12T09:11:09.075 INFO:teuthology.orchestra.run.smithi116.stdout:514 2023-05-12T09:11:09.076 INFO:teuthology.orchestra.run.smithi116.stdout:514.out 2023-05-12T09:11:09.076 INFO:teuthology.orchestra.run.smithi116.stdout:515 2023-05-12T09:11:09.076 INFO:teuthology.orchestra.run.smithi116.stdout:515.out 2023-05-12T09:11:09.076 INFO:teuthology.orchestra.run.smithi116.stdout:516 2023-05-12T09:11:09.076 INFO:teuthology.orchestra.run.smithi116.stdout:516.out 2023-05-12T09:11:09.076 INFO:teuthology.orchestra.run.smithi116.stdout:517 2023-05-12T09:11:09.076 INFO:teuthology.orchestra.run.smithi116.stdout:517.out 2023-05-12T09:11:09.076 INFO:teuthology.orchestra.run.smithi116.stdout:518 2023-05-12T09:11:09.077 INFO:teuthology.orchestra.run.smithi116.stdout:518.out 2023-05-12T09:11:09.077 INFO:teuthology.orchestra.run.smithi116.stdout:519 2023-05-12T09:11:09.077 INFO:teuthology.orchestra.run.smithi116.stdout:519.out 2023-05-12T09:11:09.077 INFO:teuthology.orchestra.run.smithi116.stdout:520 2023-05-12T09:11:09.077 INFO:teuthology.orchestra.run.smithi116.stdout:520.out 2023-05-12T09:11:09.077 INFO:teuthology.orchestra.run.smithi116.stdout:521 2023-05-12T09:11:09.077 INFO:teuthology.orchestra.run.smithi116.stdout:521.out 2023-05-12T09:11:09.077 INFO:teuthology.orchestra.run.smithi116.stdout:522 2023-05-12T09:11:09.078 INFO:teuthology.orchestra.run.smithi116.stdout:522.out 2023-05-12T09:11:09.078 INFO:teuthology.orchestra.run.smithi116.stdout:523 2023-05-12T09:11:09.078 INFO:teuthology.orchestra.run.smithi116.stdout:523.out 2023-05-12T09:11:09.078 INFO:teuthology.orchestra.run.smithi116.stdout:524 2023-05-12T09:11:09.078 INFO:teuthology.orchestra.run.smithi116.stdout:524.out 2023-05-12T09:11:09.078 INFO:teuthology.orchestra.run.smithi116.stdout:525 2023-05-12T09:11:09.078 INFO:teuthology.orchestra.run.smithi116.stdout:525.out 2023-05-12T09:11:09.078 INFO:teuthology.orchestra.run.smithi116.stdout:526 2023-05-12T09:11:09.079 INFO:teuthology.orchestra.run.smithi116.stdout:526.out 2023-05-12T09:11:09.079 INFO:teuthology.orchestra.run.smithi116.stdout:527 2023-05-12T09:11:09.079 INFO:teuthology.orchestra.run.smithi116.stdout:527.out 2023-05-12T09:11:09.079 INFO:teuthology.orchestra.run.smithi116.stdout:528 2023-05-12T09:11:09.079 INFO:teuthology.orchestra.run.smithi116.stdout:528.out 2023-05-12T09:11:09.079 INFO:teuthology.orchestra.run.smithi116.stdout:529 2023-05-12T09:11:09.079 INFO:teuthology.orchestra.run.smithi116.stdout:529.out 2023-05-12T09:11:09.079 INFO:teuthology.orchestra.run.smithi116.stdout:530 2023-05-12T09:11:09.080 INFO:teuthology.orchestra.run.smithi116.stdout:530.out 2023-05-12T09:11:09.080 INFO:teuthology.orchestra.run.smithi116.stdout:531 2023-05-12T09:11:09.080 INFO:teuthology.orchestra.run.smithi116.stdout:531.out 2023-05-12T09:11:09.080 INFO:teuthology.orchestra.run.smithi116.stdout:532 2023-05-12T09:11:09.080 INFO:teuthology.orchestra.run.smithi116.stdout:532.out 2023-05-12T09:11:09.080 INFO:teuthology.orchestra.run.smithi116.stdout:533 2023-05-12T09:11:09.080 INFO:teuthology.orchestra.run.smithi116.stdout:533.out 2023-05-12T09:11:09.081 INFO:teuthology.orchestra.run.smithi116.stdout:534 2023-05-12T09:11:09.081 INFO:teuthology.orchestra.run.smithi116.stdout:534.out 2023-05-12T09:11:09.081 INFO:teuthology.orchestra.run.smithi116.stdout:535 2023-05-12T09:11:09.081 INFO:teuthology.orchestra.run.smithi116.stdout:535.out 2023-05-12T09:11:09.081 INFO:teuthology.orchestra.run.smithi116.stdout:536 2023-05-12T09:11:09.081 INFO:teuthology.orchestra.run.smithi116.stdout:536.out 2023-05-12T09:11:09.081 INFO:teuthology.orchestra.run.smithi116.stdout:537 2023-05-12T09:11:09.081 INFO:teuthology.orchestra.run.smithi116.stdout:537.out 2023-05-12T09:11:09.082 INFO:teuthology.orchestra.run.smithi116.stdout:538 2023-05-12T09:11:09.082 INFO:teuthology.orchestra.run.smithi116.stdout:538.out 2023-05-12T09:11:09.082 INFO:teuthology.orchestra.run.smithi116.stdout:539 2023-05-12T09:11:09.082 INFO:teuthology.orchestra.run.smithi116.stdout:539.out 2023-05-12T09:11:09.082 INFO:teuthology.orchestra.run.smithi116.stdout:540 2023-05-12T09:11:09.082 INFO:teuthology.orchestra.run.smithi116.stdout:540.out 2023-05-12T09:11:09.082 INFO:teuthology.orchestra.run.smithi116.stdout:541 2023-05-12T09:11:09.082 INFO:teuthology.orchestra.run.smithi116.stdout:541.out 2023-05-12T09:11:09.083 INFO:teuthology.orchestra.run.smithi116.stdout:542 2023-05-12T09:11:09.083 INFO:teuthology.orchestra.run.smithi116.stdout:542.out 2023-05-12T09:11:09.083 INFO:teuthology.orchestra.run.smithi116.stdout:543 2023-05-12T09:11:09.083 INFO:teuthology.orchestra.run.smithi116.stdout:543.out 2023-05-12T09:11:09.083 INFO:teuthology.orchestra.run.smithi116.stdout:544 2023-05-12T09:11:09.083 INFO:teuthology.orchestra.run.smithi116.stdout:544.out 2023-05-12T09:11:09.083 INFO:teuthology.orchestra.run.smithi116.stdout:545 2023-05-12T09:11:09.083 INFO:teuthology.orchestra.run.smithi116.stdout:545.out 2023-05-12T09:11:09.084 INFO:teuthology.orchestra.run.smithi116.stdout:546 2023-05-12T09:11:09.084 INFO:teuthology.orchestra.run.smithi116.stdout:546.out 2023-05-12T09:11:09.084 INFO:teuthology.orchestra.run.smithi116.stdout:547 2023-05-12T09:11:09.084 INFO:teuthology.orchestra.run.smithi116.stdout:547.out 2023-05-12T09:11:09.084 INFO:teuthology.orchestra.run.smithi116.stdout:548 2023-05-12T09:11:09.084 INFO:teuthology.orchestra.run.smithi116.stdout:548.out 2023-05-12T09:11:09.084 INFO:teuthology.orchestra.run.smithi116.stdout:549 2023-05-12T09:11:09.084 INFO:teuthology.orchestra.run.smithi116.stdout:549.out 2023-05-12T09:11:09.085 INFO:teuthology.orchestra.run.smithi116.stdout:550 2023-05-12T09:11:09.085 INFO:teuthology.orchestra.run.smithi116.stdout:550.out 2023-05-12T09:11:09.085 INFO:teuthology.orchestra.run.smithi116.stdout:551 2023-05-12T09:11:09.085 INFO:teuthology.orchestra.run.smithi116.stdout:551.out 2023-05-12T09:11:09.085 INFO:teuthology.orchestra.run.smithi116.stdout:552 2023-05-12T09:11:09.085 INFO:teuthology.orchestra.run.smithi116.stdout:552.out 2023-05-12T09:11:09.085 INFO:teuthology.orchestra.run.smithi116.stdout:553 2023-05-12T09:11:09.085 INFO:teuthology.orchestra.run.smithi116.stdout:553.out 2023-05-12T09:11:09.086 INFO:teuthology.orchestra.run.smithi116.stdout:554 2023-05-12T09:11:09.086 INFO:teuthology.orchestra.run.smithi116.stdout:554.out 2023-05-12T09:11:09.086 INFO:teuthology.orchestra.run.smithi116.stdout:555 2023-05-12T09:11:09.086 INFO:teuthology.orchestra.run.smithi116.stdout:555.out 2023-05-12T09:11:09.086 INFO:teuthology.orchestra.run.smithi116.stdout:556 2023-05-12T09:11:09.086 INFO:teuthology.orchestra.run.smithi116.stdout:556.out 2023-05-12T09:11:09.086 INFO:teuthology.orchestra.run.smithi116.stdout:557 2023-05-12T09:11:09.086 INFO:teuthology.orchestra.run.smithi116.stdout:557.out 2023-05-12T09:11:09.087 INFO:teuthology.orchestra.run.smithi116.stdout:558 2023-05-12T09:11:09.087 INFO:teuthology.orchestra.run.smithi116.stdout:558.out 2023-05-12T09:11:09.087 INFO:teuthology.orchestra.run.smithi116.stdout:559 2023-05-12T09:11:09.087 INFO:teuthology.orchestra.run.smithi116.stdout:559.out 2023-05-12T09:11:09.087 INFO:teuthology.orchestra.run.smithi116.stdout:560 2023-05-12T09:11:09.087 INFO:teuthology.orchestra.run.smithi116.stdout:560.out 2023-05-12T09:11:09.087 INFO:teuthology.orchestra.run.smithi116.stdout:561 2023-05-12T09:11:09.087 INFO:teuthology.orchestra.run.smithi116.stdout:561.out 2023-05-12T09:11:09.088 INFO:teuthology.orchestra.run.smithi116.stdout:562 2023-05-12T09:11:09.088 INFO:teuthology.orchestra.run.smithi116.stdout:562.out 2023-05-12T09:11:09.088 INFO:teuthology.orchestra.run.smithi116.stdout:563 2023-05-12T09:11:09.088 INFO:teuthology.orchestra.run.smithi116.stdout:563.out 2023-05-12T09:11:09.088 INFO:teuthology.orchestra.run.smithi116.stdout:564 2023-05-12T09:11:09.088 INFO:teuthology.orchestra.run.smithi116.stdout:564.out 2023-05-12T09:11:09.088 INFO:teuthology.orchestra.run.smithi116.stdout:565 2023-05-12T09:11:09.088 INFO:teuthology.orchestra.run.smithi116.stdout:565.out 2023-05-12T09:11:09.089 INFO:teuthology.orchestra.run.smithi116.stdout:566 2023-05-12T09:11:09.089 INFO:teuthology.orchestra.run.smithi116.stdout:566.out 2023-05-12T09:11:09.089 INFO:teuthology.orchestra.run.smithi116.stdout:567 2023-05-12T09:11:09.089 INFO:teuthology.orchestra.run.smithi116.stdout:567.out 2023-05-12T09:11:09.089 INFO:teuthology.orchestra.run.smithi116.stdout:568 2023-05-12T09:11:09.089 INFO:teuthology.orchestra.run.smithi116.stdout:568.out 2023-05-12T09:11:09.089 INFO:teuthology.orchestra.run.smithi116.stdout:569 2023-05-12T09:11:09.089 INFO:teuthology.orchestra.run.smithi116.stdout:569.out 2023-05-12T09:11:09.090 INFO:teuthology.orchestra.run.smithi116.stdout:570 2023-05-12T09:11:09.090 INFO:teuthology.orchestra.run.smithi116.stdout:570.out 2023-05-12T09:11:09.090 INFO:teuthology.orchestra.run.smithi116.stdout:571 2023-05-12T09:11:09.090 INFO:teuthology.orchestra.run.smithi116.stdout:571.out 2023-05-12T09:11:09.090 INFO:teuthology.orchestra.run.smithi116.stdout:572 2023-05-12T09:11:09.090 INFO:teuthology.orchestra.run.smithi116.stdout:572.out 2023-05-12T09:11:09.090 INFO:teuthology.orchestra.run.smithi116.stdout:573 2023-05-12T09:11:09.091 INFO:teuthology.orchestra.run.smithi116.stdout:573.out 2023-05-12T09:11:09.091 INFO:teuthology.orchestra.run.smithi116.stdout:574 2023-05-12T09:11:09.091 INFO:teuthology.orchestra.run.smithi116.stdout:574.out 2023-05-12T09:11:09.091 INFO:teuthology.orchestra.run.smithi116.stdout:575 2023-05-12T09:11:09.091 INFO:teuthology.orchestra.run.smithi116.stdout:575.out 2023-05-12T09:11:09.091 INFO:teuthology.orchestra.run.smithi116.stdout:576 2023-05-12T09:11:09.091 INFO:teuthology.orchestra.run.smithi116.stdout:576.out 2023-05-12T09:11:09.091 INFO:teuthology.orchestra.run.smithi116.stdout:577 2023-05-12T09:11:09.092 INFO:teuthology.orchestra.run.smithi116.stdout:577.out 2023-05-12T09:11:09.092 INFO:teuthology.orchestra.run.smithi116.stdout:578 2023-05-12T09:11:09.092 INFO:teuthology.orchestra.run.smithi116.stdout:578.out 2023-05-12T09:11:09.092 INFO:teuthology.orchestra.run.smithi116.stdout:579 2023-05-12T09:11:09.092 INFO:teuthology.orchestra.run.smithi116.stdout:579.out 2023-05-12T09:11:09.092 INFO:teuthology.orchestra.run.smithi116.stdout:580 2023-05-12T09:11:09.092 INFO:teuthology.orchestra.run.smithi116.stdout:580.out 2023-05-12T09:11:09.092 INFO:teuthology.orchestra.run.smithi116.stdout:581 2023-05-12T09:11:09.093 INFO:teuthology.orchestra.run.smithi116.stdout:581.out 2023-05-12T09:11:09.093 INFO:teuthology.orchestra.run.smithi116.stdout:582 2023-05-12T09:11:09.093 INFO:teuthology.orchestra.run.smithi116.stdout:582.out 2023-05-12T09:11:09.093 INFO:teuthology.orchestra.run.smithi116.stdout:583 2023-05-12T09:11:09.093 INFO:teuthology.orchestra.run.smithi116.stdout:583.out 2023-05-12T09:11:09.093 INFO:teuthology.orchestra.run.smithi116.stdout:584 2023-05-12T09:11:09.093 INFO:teuthology.orchestra.run.smithi116.stdout:584.out 2023-05-12T09:11:09.093 INFO:teuthology.orchestra.run.smithi116.stdout:585 2023-05-12T09:11:09.094 INFO:teuthology.orchestra.run.smithi116.stdout:585.out 2023-05-12T09:11:09.094 INFO:teuthology.orchestra.run.smithi116.stdout:586 2023-05-12T09:11:09.094 INFO:teuthology.orchestra.run.smithi116.stdout:586.out 2023-05-12T09:11:09.094 INFO:teuthology.orchestra.run.smithi116.stdout:587 2023-05-12T09:11:09.094 INFO:teuthology.orchestra.run.smithi116.stdout:587.out 2023-05-12T09:11:09.094 INFO:teuthology.orchestra.run.smithi116.stdout:588 2023-05-12T09:11:09.094 INFO:teuthology.orchestra.run.smithi116.stdout:588.out 2023-05-12T09:11:09.094 INFO:teuthology.orchestra.run.smithi116.stdout:589 2023-05-12T09:11:09.095 INFO:teuthology.orchestra.run.smithi116.stdout:589.out 2023-05-12T09:11:09.095 INFO:teuthology.orchestra.run.smithi116.stdout:590 2023-05-12T09:11:09.095 INFO:teuthology.orchestra.run.smithi116.stdout:590.out 2023-05-12T09:11:09.095 INFO:teuthology.orchestra.run.smithi116.stdout:591 2023-05-12T09:11:09.095 INFO:teuthology.orchestra.run.smithi116.stdout:591.out 2023-05-12T09:11:09.095 INFO:teuthology.orchestra.run.smithi116.stdout:592 2023-05-12T09:11:09.095 INFO:teuthology.orchestra.run.smithi116.stdout:592.out 2023-05-12T09:11:09.095 INFO:teuthology.orchestra.run.smithi116.stdout:593 2023-05-12T09:11:09.096 INFO:teuthology.orchestra.run.smithi116.stdout:593.out 2023-05-12T09:11:09.096 INFO:teuthology.orchestra.run.smithi116.stdout:594 2023-05-12T09:11:09.096 INFO:teuthology.orchestra.run.smithi116.stdout:594.out 2023-05-12T09:11:09.096 INFO:teuthology.orchestra.run.smithi116.stdout:595 2023-05-12T09:11:09.096 INFO:teuthology.orchestra.run.smithi116.stdout:595.out 2023-05-12T09:11:09.096 INFO:teuthology.orchestra.run.smithi116.stdout:596 2023-05-12T09:11:09.096 INFO:teuthology.orchestra.run.smithi116.stdout:596.out 2023-05-12T09:11:09.096 INFO:teuthology.orchestra.run.smithi116.stdout:597 2023-05-12T09:11:09.097 INFO:teuthology.orchestra.run.smithi116.stdout:597.out 2023-05-12T09:11:09.097 INFO:teuthology.orchestra.run.smithi116.stdout:598 2023-05-12T09:11:09.097 INFO:teuthology.orchestra.run.smithi116.stdout:598.out 2023-05-12T09:11:09.097 INFO:teuthology.orchestra.run.smithi116.stdout:599 2023-05-12T09:11:09.097 INFO:teuthology.orchestra.run.smithi116.stdout:599.out 2023-05-12T09:11:09.097 INFO:teuthology.orchestra.run.smithi116.stdout:600 2023-05-12T09:11:09.097 INFO:teuthology.orchestra.run.smithi116.stdout:600.out 2023-05-12T09:11:09.097 INFO:teuthology.orchestra.run.smithi116.stdout:601 2023-05-12T09:11:09.098 INFO:teuthology.orchestra.run.smithi116.stdout:601.out 2023-05-12T09:11:09.098 INFO:teuthology.orchestra.run.smithi116.stdout:602 2023-05-12T09:11:09.098 INFO:teuthology.orchestra.run.smithi116.stdout:602.out 2023-05-12T09:11:09.098 INFO:teuthology.orchestra.run.smithi116.stdout:603 2023-05-12T09:11:09.098 INFO:teuthology.orchestra.run.smithi116.stdout:603.out 2023-05-12T09:11:09.098 INFO:teuthology.orchestra.run.smithi116.stdout:604 2023-05-12T09:11:09.098 INFO:teuthology.orchestra.run.smithi116.stdout:604.out 2023-05-12T09:11:09.099 INFO:teuthology.orchestra.run.smithi116.stdout:605 2023-05-12T09:11:09.099 INFO:teuthology.orchestra.run.smithi116.stdout:605.out 2023-05-12T09:11:09.099 INFO:teuthology.orchestra.run.smithi116.stdout:606 2023-05-12T09:11:09.099 INFO:teuthology.orchestra.run.smithi116.stdout:606.out 2023-05-12T09:11:09.099 INFO:teuthology.orchestra.run.smithi116.stdout:607 2023-05-12T09:11:09.099 INFO:teuthology.orchestra.run.smithi116.stdout:607.out 2023-05-12T09:11:09.099 INFO:teuthology.orchestra.run.smithi116.stdout:608 2023-05-12T09:11:09.099 INFO:teuthology.orchestra.run.smithi116.stdout:608.out 2023-05-12T09:11:09.100 INFO:teuthology.orchestra.run.smithi116.stdout:609 2023-05-12T09:11:09.100 INFO:teuthology.orchestra.run.smithi116.stdout:609.out 2023-05-12T09:11:09.100 INFO:teuthology.orchestra.run.smithi116.stdout:610 2023-05-12T09:11:09.100 INFO:teuthology.orchestra.run.smithi116.stdout:610.out 2023-05-12T09:11:09.100 INFO:teuthology.orchestra.run.smithi116.stdout:611 2023-05-12T09:11:09.100 INFO:teuthology.orchestra.run.smithi116.stdout:611.out 2023-05-12T09:11:09.100 INFO:teuthology.orchestra.run.smithi116.stdout:612 2023-05-12T09:11:09.100 INFO:teuthology.orchestra.run.smithi116.stdout:612.out 2023-05-12T09:11:09.101 INFO:teuthology.orchestra.run.smithi116.stdout:613 2023-05-12T09:11:09.101 INFO:teuthology.orchestra.run.smithi116.stdout:613.out 2023-05-12T09:11:09.101 INFO:teuthology.orchestra.run.smithi116.stdout:614 2023-05-12T09:11:09.101 INFO:teuthology.orchestra.run.smithi116.stdout:614.out 2023-05-12T09:11:09.101 INFO:teuthology.orchestra.run.smithi116.stdout:615 2023-05-12T09:11:09.101 INFO:teuthology.orchestra.run.smithi116.stdout:615.out 2023-05-12T09:11:09.101 INFO:teuthology.orchestra.run.smithi116.stdout:616 2023-05-12T09:11:09.101 INFO:teuthology.orchestra.run.smithi116.stdout:616.out 2023-05-12T09:11:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:617 2023-05-12T09:11:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:617.out 2023-05-12T09:11:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:618 2023-05-12T09:11:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:618.out 2023-05-12T09:11:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:619 2023-05-12T09:11:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:619.out 2023-05-12T09:11:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:620 2023-05-12T09:11:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:620.out 2023-05-12T09:11:09.103 INFO:teuthology.orchestra.run.smithi116.stdout:621 2023-05-12T09:11:09.103 INFO:teuthology.orchestra.run.smithi116.stdout:621.out 2023-05-12T09:11:09.103 INFO:teuthology.orchestra.run.smithi116.stdout:622 2023-05-12T09:11:09.103 INFO:teuthology.orchestra.run.smithi116.stdout:622.out 2023-05-12T09:11:09.103 INFO:teuthology.orchestra.run.smithi116.stdout:623 2023-05-12T09:11:09.103 INFO:teuthology.orchestra.run.smithi116.stdout:623.out 2023-05-12T09:11:09.103 INFO:teuthology.orchestra.run.smithi116.stdout:624 2023-05-12T09:11:09.104 INFO:teuthology.orchestra.run.smithi116.stdout:624.out 2023-05-12T09:11:09.104 INFO:teuthology.orchestra.run.smithi116.stdout:625 2023-05-12T09:11:09.104 INFO:teuthology.orchestra.run.smithi116.stdout:625.out 2023-05-12T09:11:09.104 INFO:teuthology.orchestra.run.smithi116.stdout:626 2023-05-12T09:11:09.104 INFO:teuthology.orchestra.run.smithi116.stdout:626.out 2023-05-12T09:11:09.104 INFO:teuthology.orchestra.run.smithi116.stdout:627 2023-05-12T09:11:09.104 INFO:teuthology.orchestra.run.smithi116.stdout:627.out 2023-05-12T09:11:09.104 INFO:teuthology.orchestra.run.smithi116.stdout:628 2023-05-12T09:11:09.105 INFO:teuthology.orchestra.run.smithi116.stdout:628.out 2023-05-12T09:11:09.105 INFO:teuthology.orchestra.run.smithi116.stdout:629 2023-05-12T09:11:09.105 INFO:teuthology.orchestra.run.smithi116.stdout:629.out 2023-05-12T09:11:09.105 INFO:teuthology.orchestra.run.smithi116.stdout:630 2023-05-12T09:11:09.105 INFO:teuthology.orchestra.run.smithi116.stdout:630.out 2023-05-12T09:11:09.105 INFO:teuthology.orchestra.run.smithi116.stdout:631 2023-05-12T09:11:09.105 INFO:teuthology.orchestra.run.smithi116.stdout:631.out 2023-05-12T09:11:09.105 INFO:teuthology.orchestra.run.smithi116.stdout:632 2023-05-12T09:11:09.106 INFO:teuthology.orchestra.run.smithi116.stdout:632.out 2023-05-12T09:11:09.106 INFO:teuthology.orchestra.run.smithi116.stdout:633 2023-05-12T09:11:09.106 INFO:teuthology.orchestra.run.smithi116.stdout:633.out 2023-05-12T09:11:09.106 INFO:teuthology.orchestra.run.smithi116.stdout:634 2023-05-12T09:11:09.106 INFO:teuthology.orchestra.run.smithi116.stdout:634.out 2023-05-12T09:11:09.106 INFO:teuthology.orchestra.run.smithi116.stdout:635 2023-05-12T09:11:09.106 INFO:teuthology.orchestra.run.smithi116.stdout:635.out 2023-05-12T09:11:09.106 INFO:teuthology.orchestra.run.smithi116.stdout:636 2023-05-12T09:11:09.107 INFO:teuthology.orchestra.run.smithi116.stdout:636.out 2023-05-12T09:11:09.107 INFO:teuthology.orchestra.run.smithi116.stdout:637 2023-05-12T09:11:09.107 INFO:teuthology.orchestra.run.smithi116.stdout:637.out 2023-05-12T09:11:09.107 INFO:teuthology.orchestra.run.smithi116.stdout:638 2023-05-12T09:11:09.107 INFO:teuthology.orchestra.run.smithi116.stdout:638.out 2023-05-12T09:11:09.107 INFO:teuthology.orchestra.run.smithi116.stdout:639 2023-05-12T09:11:09.107 INFO:teuthology.orchestra.run.smithi116.stdout:639.out 2023-05-12T09:11:09.107 INFO:teuthology.orchestra.run.smithi116.stdout:640 2023-05-12T09:11:09.108 INFO:teuthology.orchestra.run.smithi116.stdout:640.out 2023-05-12T09:11:09.108 INFO:teuthology.orchestra.run.smithi116.stdout:641 2023-05-12T09:11:09.108 INFO:teuthology.orchestra.run.smithi116.stdout:641.out 2023-05-12T09:11:09.108 INFO:teuthology.orchestra.run.smithi116.stdout:642 2023-05-12T09:11:09.108 INFO:teuthology.orchestra.run.smithi116.stdout:642.out 2023-05-12T09:11:09.108 INFO:teuthology.orchestra.run.smithi116.stdout:643 2023-05-12T09:11:09.108 INFO:teuthology.orchestra.run.smithi116.stdout:643.out 2023-05-12T09:11:09.108 INFO:teuthology.orchestra.run.smithi116.stdout:644 2023-05-12T09:11:09.109 INFO:teuthology.orchestra.run.smithi116.stdout:644.out 2023-05-12T09:11:09.109 INFO:teuthology.orchestra.run.smithi116.stdout:645 2023-05-12T09:11:09.109 INFO:teuthology.orchestra.run.smithi116.stdout:645.out 2023-05-12T09:11:09.109 INFO:teuthology.orchestra.run.smithi116.stdout:646 2023-05-12T09:11:09.109 INFO:teuthology.orchestra.run.smithi116.stdout:646.out 2023-05-12T09:11:09.109 INFO:teuthology.orchestra.run.smithi116.stdout:647 2023-05-12T09:11:09.109 INFO:teuthology.orchestra.run.smithi116.stdout:647.out 2023-05-12T09:11:09.109 INFO:teuthology.orchestra.run.smithi116.stdout:648 2023-05-12T09:11:09.110 INFO:teuthology.orchestra.run.smithi116.stdout:648.out 2023-05-12T09:11:09.110 INFO:teuthology.orchestra.run.smithi116.stdout:649 2023-05-12T09:11:09.110 INFO:teuthology.orchestra.run.smithi116.stdout:649.out 2023-05-12T09:11:09.110 INFO:teuthology.orchestra.run.smithi116.stdout:650 2023-05-12T09:11:09.110 INFO:teuthology.orchestra.run.smithi116.stdout:650.out 2023-05-12T09:11:09.110 INFO:teuthology.orchestra.run.smithi116.stdout:651 2023-05-12T09:11:09.110 INFO:teuthology.orchestra.run.smithi116.stdout:651.out 2023-05-12T09:11:09.111 INFO:teuthology.orchestra.run.smithi116.stdout:652 2023-05-12T09:11:09.111 INFO:teuthology.orchestra.run.smithi116.stdout:652.out 2023-05-12T09:11:09.111 INFO:teuthology.orchestra.run.smithi116.stdout:653 2023-05-12T09:11:09.111 INFO:teuthology.orchestra.run.smithi116.stdout:653.out 2023-05-12T09:11:09.111 INFO:teuthology.orchestra.run.smithi116.stdout:654 2023-05-12T09:11:09.111 INFO:teuthology.orchestra.run.smithi116.stdout:654.out 2023-05-12T09:11:09.111 INFO:teuthology.orchestra.run.smithi116.stdout:655 2023-05-12T09:11:09.111 INFO:teuthology.orchestra.run.smithi116.stdout:655.out 2023-05-12T09:11:09.112 INFO:teuthology.orchestra.run.smithi116.stdout:656 2023-05-12T09:11:09.112 INFO:teuthology.orchestra.run.smithi116.stdout:656.out 2023-05-12T09:11:09.112 INFO:teuthology.orchestra.run.smithi116.stdout:657 2023-05-12T09:11:09.112 INFO:teuthology.orchestra.run.smithi116.stdout:657.out 2023-05-12T09:11:09.112 INFO:teuthology.orchestra.run.smithi116.stdout:658 2023-05-12T09:11:09.112 INFO:teuthology.orchestra.run.smithi116.stdout:658.out 2023-05-12T09:11:09.112 INFO:teuthology.orchestra.run.smithi116.stdout:659 2023-05-12T09:11:09.112 INFO:teuthology.orchestra.run.smithi116.stdout:659.out 2023-05-12T09:11:09.113 INFO:teuthology.orchestra.run.smithi116.stdout:660 2023-05-12T09:11:09.113 INFO:teuthology.orchestra.run.smithi116.stdout:660.out 2023-05-12T09:11:09.113 INFO:teuthology.orchestra.run.smithi116.stdout:661 2023-05-12T09:11:09.113 INFO:teuthology.orchestra.run.smithi116.stdout:661.out 2023-05-12T09:11:09.113 INFO:teuthology.orchestra.run.smithi116.stdout:662 2023-05-12T09:11:09.113 INFO:teuthology.orchestra.run.smithi116.stdout:662.out 2023-05-12T09:11:09.113 INFO:teuthology.orchestra.run.smithi116.stdout:663 2023-05-12T09:11:09.113 INFO:teuthology.orchestra.run.smithi116.stdout:663.out 2023-05-12T09:11:09.114 INFO:teuthology.orchestra.run.smithi116.stdout:664 2023-05-12T09:11:09.114 INFO:teuthology.orchestra.run.smithi116.stdout:664.out 2023-05-12T09:11:09.114 INFO:teuthology.orchestra.run.smithi116.stdout:665 2023-05-12T09:11:09.114 INFO:teuthology.orchestra.run.smithi116.stdout:665.out 2023-05-12T09:11:09.114 INFO:teuthology.orchestra.run.smithi116.stdout:666 2023-05-12T09:11:09.114 INFO:teuthology.orchestra.run.smithi116.stdout:666.out 2023-05-12T09:11:09.114 INFO:teuthology.orchestra.run.smithi116.stdout:667 2023-05-12T09:11:09.114 INFO:teuthology.orchestra.run.smithi116.stdout:667.out 2023-05-12T09:11:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:668 2023-05-12T09:11:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:668.out 2023-05-12T09:11:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:669 2023-05-12T09:11:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:669.out 2023-05-12T09:11:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:670 2023-05-12T09:11:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:670.out 2023-05-12T09:11:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:671 2023-05-12T09:11:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:671.out 2023-05-12T09:11:09.116 INFO:teuthology.orchestra.run.smithi116.stdout:672 2023-05-12T09:11:09.116 INFO:teuthology.orchestra.run.smithi116.stdout:672.out 2023-05-12T09:11:09.116 INFO:teuthology.orchestra.run.smithi116.stdout:673 2023-05-12T09:11:09.116 INFO:teuthology.orchestra.run.smithi116.stdout:673.out 2023-05-12T09:11:09.116 INFO:teuthology.orchestra.run.smithi116.stdout:674 2023-05-12T09:11:09.116 INFO:teuthology.orchestra.run.smithi116.stdout:674.out 2023-05-12T09:11:09.116 INFO:teuthology.orchestra.run.smithi116.stdout:675 2023-05-12T09:11:09.116 INFO:teuthology.orchestra.run.smithi116.stdout:675.out 2023-05-12T09:11:09.117 INFO:teuthology.orchestra.run.smithi116.stdout:676 2023-05-12T09:11:09.117 INFO:teuthology.orchestra.run.smithi116.stdout:676.out 2023-05-12T09:11:09.117 INFO:teuthology.orchestra.run.smithi116.stdout:677 2023-05-12T09:11:09.117 INFO:teuthology.orchestra.run.smithi116.stdout:677.out 2023-05-12T09:11:09.117 INFO:teuthology.orchestra.run.smithi116.stdout:678 2023-05-12T09:11:09.117 INFO:teuthology.orchestra.run.smithi116.stdout:678.out 2023-05-12T09:11:09.117 INFO:teuthology.orchestra.run.smithi116.stdout:679 2023-05-12T09:11:09.117 INFO:teuthology.orchestra.run.smithi116.stdout:679.out 2023-05-12T09:11:09.118 INFO:teuthology.orchestra.run.smithi116.stdout:680 2023-05-12T09:11:09.118 INFO:teuthology.orchestra.run.smithi116.stdout:680.out 2023-05-12T09:11:09.118 INFO:teuthology.orchestra.run.smithi116.stdout:681 2023-05-12T09:11:09.118 INFO:teuthology.orchestra.run.smithi116.stdout:681.out 2023-05-12T09:11:09.118 INFO:teuthology.orchestra.run.smithi116.stdout:682 2023-05-12T09:11:09.118 INFO:teuthology.orchestra.run.smithi116.stdout:682.out 2023-05-12T09:11:09.118 INFO:teuthology.orchestra.run.smithi116.stdout:683 2023-05-12T09:11:09.118 INFO:teuthology.orchestra.run.smithi116.stdout:683.out 2023-05-12T09:11:09.119 INFO:teuthology.orchestra.run.smithi116.stdout:684 2023-05-12T09:11:09.119 INFO:teuthology.orchestra.run.smithi116.stdout:684.out 2023-05-12T09:11:09.119 INFO:teuthology.orchestra.run.smithi116.stdout:685 2023-05-12T09:11:09.119 INFO:teuthology.orchestra.run.smithi116.stdout:685.out 2023-05-12T09:11:09.119 INFO:teuthology.orchestra.run.smithi116.stdout:686 2023-05-12T09:11:09.119 INFO:teuthology.orchestra.run.smithi116.stdout:686.out 2023-05-12T09:11:09.119 INFO:teuthology.orchestra.run.smithi116.stdout:687 2023-05-12T09:11:09.119 INFO:teuthology.orchestra.run.smithi116.stdout:687.out 2023-05-12T09:11:09.120 INFO:teuthology.orchestra.run.smithi116.stdout:688 2023-05-12T09:11:09.120 INFO:teuthology.orchestra.run.smithi116.stdout:688.out 2023-05-12T09:11:09.120 INFO:teuthology.orchestra.run.smithi116.stdout:689 2023-05-12T09:11:09.120 INFO:teuthology.orchestra.run.smithi116.stdout:689.out 2023-05-12T09:11:09.120 INFO:teuthology.orchestra.run.smithi116.stdout:690 2023-05-12T09:11:09.120 INFO:teuthology.orchestra.run.smithi116.stdout:690.out 2023-05-12T09:11:09.120 INFO:teuthology.orchestra.run.smithi116.stdout:691 2023-05-12T09:11:09.121 INFO:teuthology.orchestra.run.smithi116.stdout:691.out 2023-05-12T09:11:09.121 INFO:teuthology.orchestra.run.smithi116.stdout:692 2023-05-12T09:11:09.121 INFO:teuthology.orchestra.run.smithi116.stdout:692.out 2023-05-12T09:11:09.121 INFO:teuthology.orchestra.run.smithi116.stdout:693 2023-05-12T09:11:09.121 INFO:teuthology.orchestra.run.smithi116.stdout:693.out 2023-05-12T09:11:09.121 INFO:teuthology.orchestra.run.smithi116.stdout:694 2023-05-12T09:11:09.121 INFO:teuthology.orchestra.run.smithi116.stdout:694.out 2023-05-12T09:11:09.121 INFO:teuthology.orchestra.run.smithi116.stdout:695 2023-05-12T09:11:09.122 INFO:teuthology.orchestra.run.smithi116.stdout:695.out 2023-05-12T09:11:09.122 INFO:teuthology.orchestra.run.smithi116.stdout:696 2023-05-12T09:11:09.122 INFO:teuthology.orchestra.run.smithi116.stdout:696.out 2023-05-12T09:11:09.122 INFO:teuthology.orchestra.run.smithi116.stdout:697 2023-05-12T09:11:09.122 INFO:teuthology.orchestra.run.smithi116.stdout:697.out 2023-05-12T09:11:09.122 INFO:teuthology.orchestra.run.smithi116.stdout:698 2023-05-12T09:11:09.122 INFO:teuthology.orchestra.run.smithi116.stdout:698.out 2023-05-12T09:11:09.122 INFO:teuthology.orchestra.run.smithi116.stdout:699 2023-05-12T09:11:09.123 INFO:teuthology.orchestra.run.smithi116.stdout:699.out 2023-05-12T09:11:09.123 INFO:teuthology.orchestra.run.smithi116.stdout:700 2023-05-12T09:11:09.123 INFO:teuthology.orchestra.run.smithi116.stdout:700.out 2023-05-12T09:11:09.123 INFO:teuthology.orchestra.run.smithi116.stdout:701 2023-05-12T09:11:09.123 INFO:teuthology.orchestra.run.smithi116.stdout:701.out 2023-05-12T09:11:09.123 INFO:teuthology.orchestra.run.smithi116.stdout:702 2023-05-12T09:11:09.123 INFO:teuthology.orchestra.run.smithi116.stdout:702.out 2023-05-12T09:11:09.123 INFO:teuthology.orchestra.run.smithi116.stdout:703 2023-05-12T09:11:09.124 INFO:teuthology.orchestra.run.smithi116.stdout:703.out 2023-05-12T09:11:09.124 INFO:teuthology.orchestra.run.smithi116.stdout:704 2023-05-12T09:11:09.124 INFO:teuthology.orchestra.run.smithi116.stdout:704.out 2023-05-12T09:11:09.124 INFO:teuthology.orchestra.run.smithi116.stdout:705 2023-05-12T09:11:09.124 INFO:teuthology.orchestra.run.smithi116.stdout:705.out 2023-05-12T09:11:09.124 INFO:teuthology.orchestra.run.smithi116.stdout:706 2023-05-12T09:11:09.124 INFO:teuthology.orchestra.run.smithi116.stdout:706.out 2023-05-12T09:11:09.124 INFO:teuthology.orchestra.run.smithi116.stdout:707 2023-05-12T09:11:09.125 INFO:teuthology.orchestra.run.smithi116.stdout:707.out 2023-05-12T09:11:09.125 INFO:teuthology.orchestra.run.smithi116.stdout:708 2023-05-12T09:11:09.125 INFO:teuthology.orchestra.run.smithi116.stdout:708.out 2023-05-12T09:11:09.125 INFO:teuthology.orchestra.run.smithi116.stdout:709 2023-05-12T09:11:09.125 INFO:teuthology.orchestra.run.smithi116.stdout:709.out 2023-05-12T09:11:09.125 INFO:teuthology.orchestra.run.smithi116.stdout:710 2023-05-12T09:11:09.125 INFO:teuthology.orchestra.run.smithi116.stdout:710.out 2023-05-12T09:11:09.125 INFO:teuthology.orchestra.run.smithi116.stdout:711 2023-05-12T09:11:09.126 INFO:teuthology.orchestra.run.smithi116.stdout:711.out 2023-05-12T09:11:09.126 INFO:teuthology.orchestra.run.smithi116.stdout:712 2023-05-12T09:11:09.126 INFO:teuthology.orchestra.run.smithi116.stdout:712.out 2023-05-12T09:11:09.126 INFO:teuthology.orchestra.run.smithi116.stdout:713 2023-05-12T09:11:09.126 INFO:teuthology.orchestra.run.smithi116.stdout:713.out 2023-05-12T09:11:09.126 INFO:teuthology.orchestra.run.smithi116.stdout:714 2023-05-12T09:11:09.126 INFO:teuthology.orchestra.run.smithi116.stdout:714.out 2023-05-12T09:11:09.126 INFO:teuthology.orchestra.run.smithi116.stdout:715 2023-05-12T09:11:09.127 INFO:teuthology.orchestra.run.smithi116.stdout:715.out 2023-05-12T09:11:09.127 INFO:teuthology.orchestra.run.smithi116.stdout:716 2023-05-12T09:11:09.127 INFO:teuthology.orchestra.run.smithi116.stdout:716.out 2023-05-12T09:11:09.127 INFO:teuthology.orchestra.run.smithi116.stdout:717 2023-05-12T09:11:09.127 INFO:teuthology.orchestra.run.smithi116.stdout:717.out 2023-05-12T09:11:09.127 INFO:teuthology.orchestra.run.smithi116.stdout:718 2023-05-12T09:11:09.127 INFO:teuthology.orchestra.run.smithi116.stdout:718.out 2023-05-12T09:11:09.127 INFO:teuthology.orchestra.run.smithi116.stdout:719 2023-05-12T09:11:09.128 INFO:teuthology.orchestra.run.smithi116.stdout:719.out 2023-05-12T09:11:09.128 INFO:teuthology.orchestra.run.smithi116.stdout:720 2023-05-12T09:11:09.128 INFO:teuthology.orchestra.run.smithi116.stdout:720.out 2023-05-12T09:11:09.128 INFO:teuthology.orchestra.run.smithi116.stdout:721 2023-05-12T09:11:09.128 INFO:teuthology.orchestra.run.smithi116.stdout:721.out 2023-05-12T09:11:09.128 INFO:teuthology.orchestra.run.smithi116.stdout:722 2023-05-12T09:11:09.128 INFO:teuthology.orchestra.run.smithi116.stdout:722.out 2023-05-12T09:11:09.128 INFO:teuthology.orchestra.run.smithi116.stdout:723 2023-05-12T09:11:09.129 INFO:teuthology.orchestra.run.smithi116.stdout:723.out 2023-05-12T09:11:09.129 INFO:teuthology.orchestra.run.smithi116.stdout:724 2023-05-12T09:11:09.129 INFO:teuthology.orchestra.run.smithi116.stdout:724.out 2023-05-12T09:11:09.129 INFO:teuthology.orchestra.run.smithi116.stdout:725 2023-05-12T09:11:09.129 INFO:teuthology.orchestra.run.smithi116.stdout:725.out 2023-05-12T09:11:09.129 INFO:teuthology.orchestra.run.smithi116.stdout:726 2023-05-12T09:11:09.129 INFO:teuthology.orchestra.run.smithi116.stdout:726.out 2023-05-12T09:11:09.129 INFO:teuthology.orchestra.run.smithi116.stdout:727 2023-05-12T09:11:09.130 INFO:teuthology.orchestra.run.smithi116.stdout:727.out 2023-05-12T09:11:09.130 INFO:teuthology.orchestra.run.smithi116.stdout:group.list 2023-05-12T09:11:09.130 INFO:teuthology.orchestra.run.smithi116.stdout:Makefile 2023-05-12T09:11:09.131 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-05-12T09:11:09.545 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:11:09.556 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:11:09.557 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:10.838 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:11:10.842 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:11:14.704 INFO:teuthology.orchestra.run.smithi116.stdout:generic/001 5s 2023-05-12T09:11:14.715 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/001 2023-05-12T09:11:14.716 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:11:14.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:14.724 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:ceph-fuse[124845]: fuse finished with error 0 and tester_r 0 2023-05-12T09:11:14.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:11:14.741 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-05-12T09:11:15.130 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:11:15.141 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:11:15.142 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:15.926 INFO:teuthology.orchestra.run.smithi116.stdout:generic/002 0s 2023-05-12T09:11:15.938 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/002 2023-05-12T09:11:15.938 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:11:15.943 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:15.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:11:15.965 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-05-12T09:11:16.389 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:11:16.400 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:11:16.400 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:16.676 INFO:teuthology.orchestra.run.smithi116.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:11:16.684 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/003 2023-05-12T09:11:16.685 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/003 2023-05-12T09:11:16.685 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:11:16.690 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:16.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:11:16.710 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-05-12T09:11:17.090 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:11:17.101 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:11:17.102 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:17.395 INFO:teuthology.orchestra.run.smithi116.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-05-12T09:11:17.403 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/004 2023-05-12T09:11:17.403 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/004 2023-05-12T09:11:17.403 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:11:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:17.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:11:17.428 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-05-12T09:11:17.808 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:11:17.819 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:11:17.819 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:18.820 INFO:teuthology.orchestra.run.smithi116.stdout:generic/005 1s 2023-05-12T09:11:18.832 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/005 2023-05-12T09:11:18.832 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:11:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:18.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:11:18.860 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-05-12T09:11:19.277 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:11:19.288 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:11:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:40.944 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:11:40.948 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:11:57.378 INFO:teuthology.orchestra.run.smithi116.stdout:generic/006 38s 2023-05-12T09:11:57.389 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/006 2023-05-12T09:11:57.389 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:11:57.394 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:11:57.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:11:57.415 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-05-12T09:11:57.943 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:11:57.966 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:11:57.966 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:12:11.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:12:11.181 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:12:41.593 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:12:41.597 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:13:15.400 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:13:15.413 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:13:27.806 INFO:teuthology.orchestra.run.smithi116.stdout:generic/007 89s 2023-05-12T09:13:27.817 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/007 2023-05-12T09:13:27.818 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:13:27.823 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:13:27.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:13:27.842 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-05-12T09:13:28.268 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:13:28.279 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:13:28.279 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:13:29.946 INFO:teuthology.orchestra.run.smithi116.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-12T09:13:29.954 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/008 2023-05-12T09:13:29.954 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/008 2023-05-12T09:13:29.955 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:13:29.959 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:13:29.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:13:29.980 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-05-12T09:13:30.360 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:13:30.371 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:13:30.371 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:13:32.154 INFO:teuthology.orchestra.run.smithi116.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-12T09:13:32.162 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/009 2023-05-12T09:13:32.163 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/009 2023-05-12T09:13:32.163 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:13:32.167 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:13:32.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:13:32.187 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-05-12T09:13:32.567 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:13:32.577 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:13:32.578 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:13:32.854 INFO:teuthology.orchestra.run.smithi116.stdout:generic/010 [not run] /tmp/tmp.b9w2OCk4k0xfstests-dev/src/dbtest not built 2023-05-12T09:13:32.862 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/010 2023-05-12T09:13:32.862 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/010 2023-05-12T09:13:32.862 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:13:32.867 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:13:32.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:13:32.887 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-05-12T09:13:33.259 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:13:33.271 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:13:33.271 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:13:45.599 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:13:45.604 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:14:15.721 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:14:15.726 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:14:20.618 INFO:teuthology.orchestra.run.smithi116.stdout:generic/011 47s 2023-05-12T09:14:21.914 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/011 2023-05-12T09:14:21.914 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:14:21.920 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:14:21.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:14:21.980 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-05-12T09:14:22.368 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:14:22.379 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:14:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:14:23.991 INFO:teuthology.orchestra.run.smithi116.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T09:14:23.999 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/012 2023-05-12T09:14:23.999 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/012 2023-05-12T09:14:23.999 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:14:24.004 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:14:24.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:14:24.047 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-05-12T09:14:24.450 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:14:24.461 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:14:24.462 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:14:47.169 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:14:47.174 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:15:18.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:15:18.188 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:15:49.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:15:49.091 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:16:19.490 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:16:19.495 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:16:21.367 INFO:teuthology.orchestra.run.smithi116.stdout:generic/013 117s 2023-05-12T09:16:24.800 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/013 2023-05-12T09:16:24.801 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:16:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:16:24.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:16:24.837 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-05-12T09:16:25.455 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:16:25.472 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:16:25.472 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:16:50.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:16:50.536 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:17:22.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:17:22.976 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:17:23.165 INFO:tasks.ceph.mds.c.smithi116.stderr:2023-05-12T09:17:23.162+0000 7fc0547f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169810) UID: 0 2023-05-12T09:17:23.166 INFO:tasks.ceph.mds.a.smithi116.stderr:2023-05-12T09:17:23.162+0000 7fa6111f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169810) UID: 0 2023-05-12T09:20:40.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:20:40.333 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:21:13.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:21:13.529 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:21:16.198 INFO:teuthology.orchestra.run.smithi116.stdout:generic/014 291s 2023-05-12T09:21:16.247 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/014 2023-05-12T09:21:16.248 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:21:16.254 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:16.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:21:16.289 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-05-12T09:21:16.985 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:21:17.000 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:21:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:17.401 INFO:teuthology.orchestra.run.smithi116.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:21:17.415 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/015 2023-05-12T09:21:17.415 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/015 2023-05-12T09:21:17.415 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:21:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:17.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:21:17.460 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-05-12T09:21:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:21:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:21:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:20.775 INFO:teuthology.orchestra.run.smithi116.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T09:21:20.790 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/016 2023-05-12T09:21:20.790 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/016 2023-05-12T09:21:20.790 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:21:20.797 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:20.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:21:20.834 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-05-12T09:21:21.715 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:21:21.740 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:21:21.741 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:22.165 INFO:teuthology.orchestra.run.smithi116.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:21:22.176 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/017 2023-05-12T09:21:22.177 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/017 2023-05-12T09:21:22.177 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:21:22.187 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:22.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:21:22.219 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-05-12T09:21:22.826 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:21:22.849 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:21:22.850 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:23.288 INFO:teuthology.orchestra.run.smithi116.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:21:23.305 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/018 2023-05-12T09:21:23.305 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/018 2023-05-12T09:21:23.305 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:21:23.316 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:23.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:21:23.352 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-05-12T09:21:23.953 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:21:23.968 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:21:23.968 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:24.372 INFO:teuthology.orchestra.run.smithi116.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:21:24.387 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/019 2023-05-12T09:21:24.387 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/019 2023-05-12T09:21:24.387 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:21:24.395 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:24.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:21:24.431 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-05-12T09:21:25.029 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:21:25.051 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:21:25.051 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:43.691 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:21:43.696 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:21:48.385 INFO:teuthology.orchestra.run.smithi116.stdout:generic/020 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/020.out.bad) 2023-05-12T09:21:48.392 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/020.out 2023-05-12 09:09:18.827490980 +0000 2023-05-12T09:21:48.393 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/020.out.bad 2023-05-12 09:21:48.378368134 +0000 2023-05-12T09:21:48.393 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -39,27 +39,6 @@ 2023-05-12T09:21:48.393 INFO:teuthology.orchestra.run.smithi116.stdout: user.snrub="fish2\012" 2023-05-12T09:21:48.394 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:48.394 INFO:teuthology.orchestra.run.smithi116.stdout: *** add lots of attributes 2023-05-12T09:21:48.395 INFO:teuthology.orchestra.run.smithi116.stdout: -*** check 2023-05-12T09:21:48.395 INFO:teuthology.orchestra.run.smithi116.stdout: - *** MAX_ATTRS attribute(s) 2023-05-12T09:21:48.395 INFO:teuthology.orchestra.run.smithi116.stdout: -*** remove lots of attributes 2023-05-12T09:21:48.395 INFO:teuthology.orchestra.run.smithi116.stdout: - *** print attributes 2023-05-12T09:21:48.395 INFO:teuthology.orchestra.run.smithi116.stdout: -# file: 2023-05-12T09:21:48.395 INFO:teuthology.orchestra.run.smithi116.stdout: -user.snrub="fish2\012" 2023-05-12T09:21:48.395 INFO:teuthology.orchestra.run.smithi116.stdout: - 2023-05-12T09:21:48.396 INFO:teuthology.orchestra.run.smithi116.stdout: -*** really long value 2023-05-12T09:21:48.396 INFO:teuthology.orchestra.run.smithi116.stdout: -0000000 00 2023-05-12T09:21:48.396 INFO:teuthology.orchestra.run.smithi116.stdout: -* 2023-05-12T09:21:48.396 INFO:teuthology.orchestra.run.smithi116.stdout: -ATTRSIZE 2023-05-12T09:21:48.396 INFO:teuthology.orchestra.run.smithi116.stdout: -*** set/get/remove really long names (expect failure) 2023-05-12T09:21:48.397 INFO:teuthology.orchestra.run.smithi116.stdout: -attr_set: Invalid argument 2023-05-12T09:21:48.397 INFO:teuthology.orchestra.run.smithi116.stdout: -Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-12T09:21:48.397 INFO:teuthology.orchestra.run.smithi116.stdout: -attr_get: Invalid argument 2023-05-12T09:21:48.397 INFO:teuthology.orchestra.run.smithi116.stdout: -Could not get "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-12T09:21:48.397 INFO:teuthology.orchestra.run.smithi116.stdout: -attr_remove: Invalid argument 2023-05-12T09:21:48.397 INFO:teuthology.orchestra.run.smithi116.stdout: -Could not remove "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-12T09:21:48.397 INFO:teuthology.orchestra.run.smithi116.stdout: -*** check final 2023-05-12T09:21:48.397 INFO:teuthology.orchestra.run.smithi116.stdout: - *** print attributes 2023-05-12T09:21:48.398 INFO:teuthology.orchestra.run.smithi116.stdout: -# file: 2023-05-12T09:21:48.398 INFO:teuthology.orchestra.run.smithi116.stdout: -user.snrub="fish2\012" 2023-05-12T09:21:48.398 INFO:teuthology.orchestra.run.smithi116.stdout: - 2023-05-12T09:21:48.398 INFO:teuthology.orchestra.run.smithi116.stdout: -*** delete 2023-05-12T09:21:48.398 INFO:teuthology.orchestra.run.smithi116.stdout: +attr_set: No space left on device 2023-05-12T09:21:48.398 INFO:teuthology.orchestra.run.smithi116.stdout: +Could not set "attribute_2335" for /tmp/tmp.A6WkqqsMBotest/attribute_172542 2023-05-12T09:21:48.399 INFO:teuthology.orchestra.run.smithi116.stdout: +!!! failed to add "attribute_2335" 2023-05-12T09:21:48.401 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/020 2023-05-12T09:21:48.401 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/020 2023-05-12T09:21:48.401 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T09:21:48.410 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:48.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T09:21:48.441 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T09:21:48.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T09:21:48.442 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-05-12T09:21:49.318 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:21:49.331 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:21:49.331 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:52.087 INFO:teuthology.orchestra.run.smithi116.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T09:21:52.100 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/021 2023-05-12T09:21:52.100 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/021 2023-05-12T09:21:52.101 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:21:52.110 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:52.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:21:52.157 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-05-12T09:21:52.994 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:21:53.012 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:21:53.012 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:55.960 INFO:teuthology.orchestra.run.smithi116.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T09:21:55.971 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/022 2023-05-12T09:21:55.972 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/022 2023-05-12T09:21:55.972 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:21:55.979 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:21:56.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:21:56.031 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-05-12T09:21:56.835 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:21:56.857 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:21:56.857 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:22:13.827 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:22:13.833 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:22:43.980 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:22:43.985 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:23:14.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:23:14.082 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:23:17.051 INFO:teuthology.orchestra.run.smithi116.stdout:generic/023 81s 2023-05-12T09:23:17.063 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/023 2023-05-12T09:23:17.063 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:17.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:17.113 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-05-12T09:23:17.748 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:17.759 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:17.759 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:18.063 INFO:teuthology.orchestra.run.smithi116.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-05-12T09:23:18.071 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/024 2023-05-12T09:23:18.072 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/024 2023-05-12T09:23:18.072 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:18.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:18.106 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-05-12T09:23:18.769 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:18.779 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:18.780 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:19.089 INFO:teuthology.orchestra.run.smithi116.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-05-12T09:23:19.097 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/025 2023-05-12T09:23:19.098 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/025 2023-05-12T09:23:19.098 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:19.103 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:19.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:19.177 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-05-12T09:23:19.790 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:19.801 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:19.802 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:20.153 INFO:teuthology.orchestra.run.smithi116.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-12T09:23:20.161 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/026 2023-05-12T09:23:20.162 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/026 2023-05-12T09:23:20.162 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:20.167 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:20.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:20.186 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-05-12T09:23:20.570 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:20.581 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:20.582 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:20.857 INFO:teuthology.orchestra.run.smithi116.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:20.865 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/027 2023-05-12T09:23:20.866 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/027 2023-05-12T09:23:20.866 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:20.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:20.891 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-05-12T09:23:21.272 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:21.284 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:21.284 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:26.594 INFO:teuthology.orchestra.run.smithi116.stdout:generic/028 5s 2023-05-12T09:23:26.605 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/028 2023-05-12T09:23:26.605 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:26.610 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:26.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:26.631 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-05-12T09:23:27.013 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:27.025 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:27.025 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:27.300 INFO:teuthology.orchestra.run.smithi116.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:27.308 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/029 2023-05-12T09:23:27.308 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/029 2023-05-12T09:23:27.309 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:27.313 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:27.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:27.334 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-05-12T09:23:27.713 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:27.724 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:27.724 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:28.003 INFO:teuthology.orchestra.run.smithi116.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:28.012 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/030 2023-05-12T09:23:28.012 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/030 2023-05-12T09:23:28.012 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:28.017 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:28.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:28.038 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-05-12T09:23:28.416 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:28.427 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:28.702 INFO:teuthology.orchestra.run.smithi116.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:28.710 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/031 2023-05-12T09:23:28.711 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/031 2023-05-12T09:23:28.711 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:28.716 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:28.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:28.736 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-05-12T09:23:29.115 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:29.127 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:29.127 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:29.399 INFO:teuthology.orchestra.run.smithi116.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:29.408 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/032 2023-05-12T09:23:29.408 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/032 2023-05-12T09:23:29.408 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:29.413 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:29.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:29.434 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-05-12T09:23:29.817 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:29.828 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:29.829 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:30.096 INFO:teuthology.orchestra.run.smithi116.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:30.105 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/033 2023-05-12T09:23:30.105 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/033 2023-05-12T09:23:30.106 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:30.110 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:30.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:30.130 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-05-12T09:23:30.509 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:30.520 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:30.846 INFO:teuthology.orchestra.run.smithi116.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:30.854 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/034 2023-05-12T09:23:30.855 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/034 2023-05-12T09:23:30.855 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:30.860 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:30.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:30.880 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-05-12T09:23:31.264 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:31.275 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:31.275 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:31.664 INFO:teuthology.orchestra.run.smithi116.stdout:generic/035 0s 2023-05-12T09:23:31.676 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/035 2023-05-12T09:23:31.676 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:31.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:31.745 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-05-12T09:23:32.365 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:32.376 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:32.376 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:42.807 INFO:teuthology.orchestra.run.smithi116.stdout:generic/036 10s 2023-05-12T09:23:42.819 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/036 2023-05-12T09:23:42.819 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:42.824 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:42.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:42.869 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-05-12T09:23:43.495 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:43.506 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:43.506 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:43.796 INFO:teuthology.orchestra.run.smithi116.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:43.804 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/037 2023-05-12T09:23:43.805 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/037 2023-05-12T09:23:43.805 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:43.810 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:43.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:43.830 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-05-12T09:23:44.197 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:23:44.201 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:23:44.214 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:44.226 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:44.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:44.509 INFO:teuthology.orchestra.run.smithi116.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:44.517 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/038 2023-05-12T09:23:44.517 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/038 2023-05-12T09:23:44.518 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:44.523 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:44.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:44.544 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-05-12T09:23:44.925 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:44.936 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:44.937 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:45.251 INFO:teuthology.orchestra.run.smithi116.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:45.259 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/039 2023-05-12T09:23:45.260 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/039 2023-05-12T09:23:45.260 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:45.265 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:45.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:45.285 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-05-12T09:23:45.665 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:45.676 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:45.676 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:45.984 INFO:teuthology.orchestra.run.smithi116.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:45.992 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/040 2023-05-12T09:23:45.993 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/040 2023-05-12T09:23:45.993 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:45.999 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:46.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:46.019 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-05-12T09:23:46.395 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:46.406 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:46.406 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:46.706 INFO:teuthology.orchestra.run.smithi116.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:46.714 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/041 2023-05-12T09:23:46.715 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/041 2023-05-12T09:23:46.715 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:46.720 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:46.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:46.740 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-05-12T09:23:47.123 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:47.135 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:47.135 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:47.409 INFO:teuthology.orchestra.run.smithi116.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:47.417 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/042 2023-05-12T09:23:47.418 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/042 2023-05-12T09:23:47.418 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:47.423 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:47.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:47.443 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-05-12T09:23:47.834 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:47.845 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:47.845 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:48.123 INFO:teuthology.orchestra.run.smithi116.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:48.131 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/043 2023-05-12T09:23:48.132 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/043 2023-05-12T09:23:48.132 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:48.137 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:48.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:48.158 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-05-12T09:23:48.537 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:48.548 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:48.549 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:48.826 INFO:teuthology.orchestra.run.smithi116.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:48.834 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/044 2023-05-12T09:23:48.834 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/044 2023-05-12T09:23:48.834 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:48.839 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:48.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:48.859 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-05-12T09:23:49.240 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:49.251 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:49.252 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:49.522 INFO:teuthology.orchestra.run.smithi116.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:49.530 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/045 2023-05-12T09:23:49.530 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/045 2023-05-12T09:23:49.530 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:49.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:49.556 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-05-12T09:23:49.943 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:49.954 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:49.954 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:50.228 INFO:teuthology.orchestra.run.smithi116.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:50.236 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/046 2023-05-12T09:23:50.237 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/046 2023-05-12T09:23:50.237 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:50.242 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:50.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:50.262 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-05-12T09:23:50.643 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:50.654 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:50.654 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:50.928 INFO:teuthology.orchestra.run.smithi116.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:50.936 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/047 2023-05-12T09:23:50.937 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/047 2023-05-12T09:23:50.937 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:50.942 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:50.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:50.962 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-05-12T09:23:51.345 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:51.356 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:51.633 INFO:teuthology.orchestra.run.smithi116.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:51.641 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/048 2023-05-12T09:23:51.641 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/048 2023-05-12T09:23:51.641 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:51.647 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:51.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:51.666 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-05-12T09:23:52.047 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:52.058 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:52.059 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:52.336 INFO:teuthology.orchestra.run.smithi116.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:52.344 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/049 2023-05-12T09:23:52.345 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/049 2023-05-12T09:23:52.345 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:52.350 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:52.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:52.374 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-05-12T09:23:52.754 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:52.766 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:52.766 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:53.051 INFO:teuthology.orchestra.run.smithi116.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:53.059 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/050 2023-05-12T09:23:53.060 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/050 2023-05-12T09:23:53.060 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:53.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:53.086 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-05-12T09:23:53.467 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:53.479 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:53.479 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:53.758 INFO:teuthology.orchestra.run.smithi116.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:53.766 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/051 2023-05-12T09:23:53.766 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/051 2023-05-12T09:23:53.767 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:53.772 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:53.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:53.792 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-05-12T09:23:54.176 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:54.187 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:54.463 INFO:teuthology.orchestra.run.smithi116.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:54.471 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/052 2023-05-12T09:23:54.471 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/052 2023-05-12T09:23:54.472 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:54.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:54.499 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-05-12T09:23:54.881 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:54.892 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:54.892 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:55.166 INFO:teuthology.orchestra.run.smithi116.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:55.175 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/053 2023-05-12T09:23:55.175 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/053 2023-05-12T09:23:55.175 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:55.180 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:55.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:55.200 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-05-12T09:23:55.588 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:55.599 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:55.600 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:55.878 INFO:teuthology.orchestra.run.smithi116.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:55.887 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/054 2023-05-12T09:23:55.888 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/054 2023-05-12T09:23:55.888 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:55.893 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:55.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:55.913 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-05-12T09:23:56.302 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:56.313 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:56.313 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:56.591 INFO:teuthology.orchestra.run.smithi116.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:56.599 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/055 2023-05-12T09:23:56.600 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/055 2023-05-12T09:23:56.600 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:56.605 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:56.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:56.626 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-05-12T09:23:57.019 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:57.031 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:57.031 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:57.329 INFO:teuthology.orchestra.run.smithi116.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:57.337 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/056 2023-05-12T09:23:57.338 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/056 2023-05-12T09:23:57.338 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:57.343 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:57.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:57.363 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-05-12T09:23:57.745 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:57.756 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:57.756 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:58.058 INFO:teuthology.orchestra.run.smithi116.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:23:58.066 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/057 2023-05-12T09:23:58.067 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/057 2023-05-12T09:23:58.067 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:23:58.072 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:23:58.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:23:58.092 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-05-12T09:23:58.469 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:23:58.481 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:23:58.481 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:00.113 INFO:teuthology.orchestra.run.smithi116.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T09:24:00.121 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/058 2023-05-12T09:24:00.122 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/058 2023-05-12T09:24:00.122 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:00.127 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:00.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:00.196 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-05-12T09:24:00.808 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:00.819 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:00.819 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:01.124 INFO:teuthology.orchestra.run.smithi116.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:24:01.132 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/059 2023-05-12T09:24:01.133 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/059 2023-05-12T09:24:01.133 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:01.138 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:01.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:01.159 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-05-12T09:24:01.545 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:01.556 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:01.556 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:03.182 INFO:teuthology.orchestra.run.smithi116.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T09:24:03.190 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/060 2023-05-12T09:24:03.191 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/060 2023-05-12T09:24:03.191 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:03.196 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:03.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:03.247 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-05-12T09:24:03.879 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:03.890 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:05.479 INFO:teuthology.orchestra.run.smithi116.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T09:24:05.488 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/061 2023-05-12T09:24:05.488 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/061 2023-05-12T09:24:05.488 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:05.494 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:05.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:05.520 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-05-12T09:24:06.162 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:06.173 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:06.174 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:06.463 INFO:teuthology.orchestra.run.smithi116.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:24:06.471 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/062 2023-05-12T09:24:06.471 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/062 2023-05-12T09:24:06.471 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:06.477 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:06.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:06.497 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-05-12T09:24:06.879 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:06.890 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:08.463 INFO:teuthology.orchestra.run.smithi116.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T09:24:08.472 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/063 2023-05-12T09:24:08.472 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/063 2023-05-12T09:24:08.473 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:08.477 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:08.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:08.553 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-05-12T09:24:09.158 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:09.170 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:09.170 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:09.451 INFO:teuthology.orchestra.run.smithi116.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:24:09.459 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/064 2023-05-12T09:24:09.459 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/064 2023-05-12T09:24:09.459 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:09.464 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:09.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:09.485 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-05-12T09:24:09.867 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:09.878 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:09.879 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:10.187 INFO:teuthology.orchestra.run.smithi116.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:24:10.196 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/065 2023-05-12T09:24:10.196 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/065 2023-05-12T09:24:10.196 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:10.201 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:10.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:10.221 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-05-12T09:24:10.607 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:10.618 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:10.619 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:10.922 INFO:teuthology.orchestra.run.smithi116.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:24:10.930 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/066 2023-05-12T09:24:10.931 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/066 2023-05-12T09:24:10.931 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:10.936 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:10.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:10.956 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-05-12T09:24:11.335 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:11.346 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:11.347 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:11.654 INFO:teuthology.orchestra.run.smithi116.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:24:11.662 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/067 2023-05-12T09:24:11.662 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/067 2023-05-12T09:24:11.663 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:11.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:11.688 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-05-12T09:24:12.074 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:12.085 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:12.380 INFO:teuthology.orchestra.run.smithi116.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:24:12.388 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/068 2023-05-12T09:24:12.389 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/068 2023-05-12T09:24:12.389 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:12.394 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:12.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:12.415 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-05-12T09:24:12.797 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:12.808 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:13.077 INFO:teuthology.orchestra.run.smithi116.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:24:13.086 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/069 2023-05-12T09:24:13.086 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/069 2023-05-12T09:24:13.086 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:24:13.092 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:13.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:24:13.112 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-05-12T09:24:13.497 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:24:13.508 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:24:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:24:14.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:24:14.365 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:24:45.242 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:24:45.246 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:25:15.482 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:25:15.486 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:25:25.741 INFO:teuthology.orchestra.run.smithi116.stdout:generic/070 72s 2023-05-12T09:25:25.759 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/070 2023-05-12T09:25:25.760 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:25:25.769 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:25:25.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:25:25.804 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-05-12T09:25:26.601 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:25:26.620 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:25:26.620 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:25:27.038 INFO:teuthology.orchestra.run.smithi116.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:25:27.054 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/071 2023-05-12T09:25:27.054 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/071 2023-05-12T09:25:27.054 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:25:27.061 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:25:27.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:25:27.097 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-05-12T09:25:27.703 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:25:27.720 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:25:27.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:25:30.235 INFO:teuthology.orchestra.run.smithi116.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-05-12T09:25:30.247 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/072 2023-05-12T09:25:30.247 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/072 2023-05-12T09:25:30.247 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:25:30.253 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:25:30.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:25:30.283 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-05-12T09:25:30.910 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:25:30.927 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:25:30.927 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:25:31.408 INFO:teuthology.orchestra.run.smithi116.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:25:31.420 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/073 2023-05-12T09:25:31.420 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/073 2023-05-12T09:25:31.420 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:25:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:25:31.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:25:31.462 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-05-12T09:25:32.019 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:25:32.038 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:25:32.039 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:25:45.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:25:46.002 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:26:17.484 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:26:17.502 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:26:47.747 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:26:47.754 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:27:19.602 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:27:19.615 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:27:49.818 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:27:49.823 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:28:20.957 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:28:20.962 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:28:56.045 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:28:56.054 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:29:27.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:29:27.083 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:29:57.582 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:29:57.588 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:30:29.075 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:30:29.089 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:30:59.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:30:59.339 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:31:29.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:31:29.535 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:31:29.735 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T09:31:29.731+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203359) UID: 0 2023-05-12T09:31:29.736 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T09:31:29.731+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203359) UID: 0 2023-05-12T09:31:29.736 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T09:31:29.731+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203359) UID: 0 2023-05-12T09:31:29.736 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T09:31:29.732+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203359) UID: 0 2023-05-12T09:36:05.475 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:36:05.481 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:36:05.601 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T09:36:05.597+0000 7f4e7fbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142739) UID: 0 2023-05-12T09:36:05.601 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T09:36:05.597+0000 7fb0059f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142739) UID: 0 2023-05-12T09:36:05.601 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T09:36:05.597+0000 7fe44e3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142739) UID: 0 2023-05-12T09:36:05.602 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T09:36:05.597+0000 7f02559f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142739) UID: 0 2023-05-12T09:39:39.213 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T09:39:39.208+0000 7f02349cb700 -1 bdev(0x55c40db06000 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2023-05-12T09:39:39.214 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T09:39:39.210+0000 7f02399d5700 -1 bdev(0x55c40db06000 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2023-05-12T09:40:48.791 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:40:48.798 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:40:49.212 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T09:40:49.209+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203994) UID: 0 2023-05-12T09:40:49.213 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T09:40:49.208+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203994) UID: 0 2023-05-12T09:40:49.214 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T09:40:49.208+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203994) UID: 0 2023-05-12T09:40:49.214 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T09:40:49.210+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203994) UID: 0 2023-05-12T09:40:52.480 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T09:40:52.476+0000 7fb0059f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142958) UID: 0 2023-05-12T09:40:52.481 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T09:40:52.476+0000 7fe44e3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142958) UID: 0 2023-05-12T09:40:52.481 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T09:40:52.477+0000 7f02559f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142958) UID: 0 2023-05-12T09:40:52.483 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T09:40:52.477+0000 7f4e7fbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142958) UID: 0 2023-05-12T09:49:31.225 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:49:31.258 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:49:31.474 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T09:49:31.469+0000 7fe44e3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143753) UID: 0 2023-05-12T09:49:31.475 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T09:49:31.470+0000 7f4e7fbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143753) UID: 0 2023-05-12T09:49:31.475 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T09:49:31.469+0000 7f02559f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143753) UID: 0 2023-05-12T09:49:31.475 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T09:49:31.469+0000 7fb0059f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143753) UID: 0 2023-05-12T09:49:33.362 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T09:49:33.357+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 204803) UID: 0 2023-05-12T09:49:33.362 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T09:49:33.357+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 204803) UID: 0 2023-05-12T09:49:33.363 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T09:49:33.353+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 204803) UID: 0 2023-05-12T09:49:33.373 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T09:49:33.356+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 204803) UID: 0 2023-05-12T09:54:56.624 INFO:teuthology.orchestra.run.smithi116.stdout:generic/074 1764s 2023-05-12T09:54:56.712 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/074 2023-05-12T09:54:56.713 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:54:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:54:56.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:54:56.761 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-05-12T09:54:59.894 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:54:59.905 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:54:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:46.136 INFO:teuthology.orchestra.run.smithi116.stdout:generic/075 47s 2023-05-12T09:55:46.149 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/075 2023-05-12T09:55:46.149 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:46.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:46.200 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-05-12T09:55:46.929 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:46.941 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:47.217 INFO:teuthology.orchestra.run.smithi116.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:55:47.225 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/076 2023-05-12T09:55:47.226 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/076 2023-05-12T09:55:47.226 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:47.231 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:47.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:47.252 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-05-12T09:55:47.646 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:47.657 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:47.658 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:50.183 INFO:teuthology.orchestra.run.smithi116.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:55:50.191 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/077 2023-05-12T09:55:50.192 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/077 2023-05-12T09:55:50.192 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:50.197 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:50.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:50.217 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-05-12T09:55:50.600 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:50.611 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:50.612 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:50.994 INFO:teuthology.orchestra.run.smithi116.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-05-12T09:55:51.002 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/078 2023-05-12T09:55:51.002 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/078 2023-05-12T09:55:51.002 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:51.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:51.037 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-05-12T09:55:51.778 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:51.789 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:51.790 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:52.124 INFO:teuthology.orchestra.run.smithi116.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-05-12T09:55:52.132 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/079 2023-05-12T09:55:52.133 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/079 2023-05-12T09:55:52.133 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:52.138 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:52.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:52.159 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-05-12T09:55:52.563 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:52.574 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:52.574 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:54.930 INFO:teuthology.orchestra.run.smithi116.stdout:generic/080 2s 2023-05-12T09:55:54.942 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/080 2023-05-12T09:55:54.942 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:54.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:54.970 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-05-12T09:55:55.350 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:55.361 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:55.362 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:55.644 INFO:teuthology.orchestra.run.smithi116.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:55:55.652 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/081 2023-05-12T09:55:55.652 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/081 2023-05-12T09:55:55.653 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:55.658 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:55.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:55.678 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-05-12T09:55:56.071 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:56.081 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:56.082 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:56.445 INFO:teuthology.orchestra.run.smithi116.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:55:56.454 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/082 2023-05-12T09:55:56.454 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/082 2023-05-12T09:55:56.454 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:56.460 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:56.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:56.481 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-05-12T09:55:56.864 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:56.875 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:56.875 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/083 2023-05-12T09:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/083 2023-05-12T09:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:57.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:57.188 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-05-12T09:55:57.576 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:57.587 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:57.857 INFO:teuthology.orchestra.run.smithi116.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:55:57.865 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/084 2023-05-12T09:55:57.865 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/084 2023-05-12T09:55:57.865 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:57.870 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:57.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:57.891 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-05-12T09:55:58.275 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:58.286 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:58.744 INFO:teuthology.orchestra.run.smithi116.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T09:55:58.752 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/085 2023-05-12T09:55:58.753 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/085 2023-05-12T09:55:58.753 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:55:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:55:58.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:55:58.780 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-05-12T09:55:59.171 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:55:59.183 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:55:59.183 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:56:20.396 INFO:teuthology.orchestra.run.smithi116.stdout:generic/086 21s 2023-05-12T09:56:20.610 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/086 2023-05-12T09:56:20.610 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:56:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:56:20.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:56:20.899 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-05-12T09:56:24.088 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:56:24.099 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:56:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:56:24.974 INFO:teuthology.orchestra.run.smithi116.stdout:generic/087 0s 2023-05-12T09:56:24.986 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/087 2023-05-12T09:56:24.987 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:56:24.992 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:56:25.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:56:25.042 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-05-12T09:56:25.762 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:56:25.773 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:56:25.773 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:56:26.192 INFO:teuthology.orchestra.run.smithi116.stdout:generic/088 1s 2023-05-12T09:56:26.204 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/088 2023-05-12T09:56:26.204 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T09:56:26.210 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:56:26.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T09:56:26.246 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-05-12T09:56:26.974 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T09:56:26.985 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T09:56:26.985 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T09:58:07.322 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:58:07.326 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T09:58:07.569 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T09:58:07.565+0000 7f4e7fbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144034) UID: 0 2023-05-12T09:58:07.570 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T09:58:07.565+0000 7fb0059f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144034) UID: 0 2023-05-12T09:58:07.570 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T09:58:07.565+0000 7fe44e3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144034) UID: 0 2023-05-12T09:58:07.570 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T09:58:07.565+0000 7f02559f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144034) UID: 0 2023-05-12T10:01:41.997 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:01:42.003 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:01:42.150 INFO:tasks.ceph.mds.c.smithi116.stderr:2023-05-12T10:01:42.146+0000 7fc0547f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 213088) UID: 0 2023-05-12T10:01:42.151 INFO:tasks.ceph.mds.a.smithi116.stderr:2023-05-12T10:01:42.146+0000 7fa6111f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 213088) UID: 0 2023-05-12T10:05:57.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:05:57.014 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:06:27.456 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:06:27.460 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:06:27.640 INFO:tasks.ceph.mds.c.smithi116.stderr:2023-05-12T10:06:27.637+0000 7fc0547f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 213391) UID: 0 2023-05-12T10:06:27.641 INFO:tasks.ceph.mds.a.smithi116.stderr:2023-05-12T10:06:27.637+0000 7fa6111f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 213391) UID: 0 2023-05-12T10:09:29.346 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:09:29.351 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:09:59.469 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:09:59.474 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:10:29.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:10:29.611 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:11:00.783 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:11:00.788 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:11:30.910 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:11:30.914 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:11:31.006 INFO:tasks.ceph.mds.c.smithi116.stderr:2023-05-12T10:11:31.002+0000 7fc0547f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 215569) UID: 0 2023-05-12T10:11:31.008 INFO:tasks.ceph.mds.a.smithi116.stderr:2023-05-12T10:11:31.002+0000 7fa6111f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 215569) UID: 0 2023-05-12T10:14:27.001 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:14:27.006 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:14:58.223 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:14:58.227 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:15:28.536 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:15:28.541 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:15:58.669 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:15:58.673 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:16:29.934 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:16:29.938 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:16:30.145 INFO:tasks.ceph.mds.a.smithi116.stderr:2023-05-12T10:16:30.141+0000 7fa6111f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 215735) UID: 0 2023-05-12T10:16:30.146 INFO:tasks.ceph.mds.c.smithi116.stderr:2023-05-12T10:16:30.141+0000 7fc0547f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 215735) UID: 0 2023-05-12T10:16:37.792 INFO:teuthology.orchestra.run.smithi116.stdout:generic/089 1210s 2023-05-12T10:16:37.821 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/089 2023-05-12T10:16:37.821 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:16:37.826 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:16:37.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:16:37.855 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-05-12T10:16:38.885 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:16:38.895 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:16:38.896 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:16:39.289 INFO:teuthology.orchestra.run.smithi116.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:16:39.297 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/090 2023-05-12T10:16:39.297 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/090 2023-05-12T10:16:39.298 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:16:39.303 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:16:39.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:16:39.325 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-05-12T10:16:39.717 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:16:39.728 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:16:39.728 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:04.768 INFO:teuthology.orchestra.run.smithi116.stdout:generic/091 145s 2023-05-12T10:19:04.780 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/091 2023-05-12T10:19:04.780 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:19:04.785 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:04.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:19:04.818 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-05-12T10:19:05.500 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:19:05.511 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:19:05.511 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:06.105 INFO:teuthology.orchestra.run.smithi116.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T10:19:06.113 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/092 2023-05-12T10:19:06.113 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/092 2023-05-12T10:19:06.113 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:19:06.118 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:06.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:19:06.167 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-05-12T10:19:06.847 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:19:06.859 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:19:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:07.809 INFO:teuthology.orchestra.run.smithi116.stdout:generic/093 1s 2023-05-12T10:19:07.820 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/093 2023-05-12T10:19:07.820 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:19:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:07.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:19:07.898 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-05-12T10:19:08.564 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:19:08.575 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:19:08.575 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:08.852 INFO:teuthology.orchestra.run.smithi116.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:19:08.860 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/094 2023-05-12T10:19:08.860 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/094 2023-05-12T10:19:08.861 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:19:08.866 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:08.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:19:08.886 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-05-12T10:19:09.267 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:19:09.279 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:19:09.279 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:09.321 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:19:09.325 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:19:09.550 INFO:teuthology.orchestra.run.smithi116.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:19:09.558 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/095 2023-05-12T10:19:09.559 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/095 2023-05-12T10:19:09.559 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:19:09.564 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:09.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:19:09.585 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-05-12T10:19:09.962 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:19:09.973 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:19:09.973 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:10.249 INFO:teuthology.orchestra.run.smithi116.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:19:10.257 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/096 2023-05-12T10:19:10.257 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/096 2023-05-12T10:19:10.257 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:19:10.262 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:10.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:19:10.282 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-05-12T10:19:10.664 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:19:10.675 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:19:10.675 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:11.605 INFO:teuthology.orchestra.run.smithi116.stdout:generic/097 1s 2023-05-12T10:19:11.617 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/097 2023-05-12T10:19:11.617 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:19:11.622 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:11.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:19:11.640 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-05-12T10:19:12.026 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:19:12.037 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:19:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:12.311 INFO:teuthology.orchestra.run.smithi116.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:19:12.319 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/098 2023-05-12T10:19:12.320 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/098 2023-05-12T10:19:12.320 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:19:12.325 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:12.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:19:12.346 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-05-12T10:19:12.728 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:19:12.739 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:19:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:13.088 INFO:teuthology.orchestra.run.smithi116.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-12T10:19:13.096 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/099 2023-05-12T10:19:13.096 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/099 2023-05-12T10:19:13.096 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:19:13.102 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:13.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:19:13.120 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-05-12T10:19:13.507 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:19:13.518 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:19:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:19:39.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:19:39.425 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:20:03.243 INFO:teuthology.orchestra.run.smithi116.stdout:generic/100 50s 2023-05-12T10:20:03.255 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/100 2023-05-12T10:20:03.256 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:03.261 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:03.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:03.305 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-05-12T10:20:04.028 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:04.040 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:04.040 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:04.359 INFO:teuthology.orchestra.run.smithi116.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:20:04.368 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/101 2023-05-12T10:20:04.368 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/101 2023-05-12T10:20:04.368 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:04.373 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:04.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:04.393 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-05-12T10:20:04.773 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:04.784 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:04.784 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:05.066 INFO:teuthology.orchestra.run.smithi116.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:20:05.074 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/102 2023-05-12T10:20:05.074 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/102 2023-05-12T10:20:05.075 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:05.080 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:05.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:05.099 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-05-12T10:20:05.487 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:05.498 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:05.498 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:05.778 INFO:teuthology.orchestra.run.smithi116.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:20:05.786 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/103 2023-05-12T10:20:05.786 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/103 2023-05-12T10:20:05.787 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:05.792 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:05.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:05.811 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-05-12T10:20:06.194 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:06.206 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:06.206 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:06.506 INFO:teuthology.orchestra.run.smithi116.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:20:06.514 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/104 2023-05-12T10:20:06.515 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/104 2023-05-12T10:20:06.515 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:06.520 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:06.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:06.539 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-05-12T10:20:06.920 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:06.931 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:06.931 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:07.237 INFO:teuthology.orchestra.run.smithi116.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:20:07.246 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/105 2023-05-12T10:20:07.246 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/105 2023-05-12T10:20:07.246 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:07.251 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:07.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:07.271 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-05-12T10:20:07.654 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:07.665 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:07.666 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:07.966 INFO:teuthology.orchestra.run.smithi116.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:20:07.974 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/106 2023-05-12T10:20:07.975 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/106 2023-05-12T10:20:07.975 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:07.980 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:07.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:08.000 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-05-12T10:20:08.388 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:08.400 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:08.705 INFO:teuthology.orchestra.run.smithi116.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:20:08.714 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/107 2023-05-12T10:20:08.714 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/107 2023-05-12T10:20:08.714 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:08.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:08.739 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-05-12T10:20:09.124 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:09.136 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:09.136 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:09.570 INFO:teuthology.orchestra.run.smithi116.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:20:09.578 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/108 2023-05-12T10:20:09.578 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/108 2023-05-12T10:20:09.579 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:09.584 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:09.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:09.604 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-05-12T10:20:09.609 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:20:09.651 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:20:09.994 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:10.005 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:10.005 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:10.278 INFO:teuthology.orchestra.run.smithi116.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:20:10.286 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/109 2023-05-12T10:20:10.286 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/109 2023-05-12T10:20:10.286 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:10.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:10.311 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-05-12T10:20:10.699 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:10.709 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:10.710 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:11.070 INFO:teuthology.orchestra.run.smithi116.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:20:11.078 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/110 2023-05-12T10:20:11.078 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/110 2023-05-12T10:20:11.078 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:11.083 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:11.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:11.141 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-05-12T10:20:11.804 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:11.815 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:12.177 INFO:teuthology.orchestra.run.smithi116.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:20:12.185 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/111 2023-05-12T10:20:12.186 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/111 2023-05-12T10:20:12.186 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:20:12.192 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:12.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:20:12.272 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-05-12T10:20:12.922 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:20:12.933 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:20:12.933 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:20:39.748 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:20:39.752 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:21:03.985 INFO:teuthology.orchestra.run.smithi116.stdout:generic/112 51s 2023-05-12T10:21:03.997 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/112 2023-05-12T10:21:03.997 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:21:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:04.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:21:04.043 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-05-12T10:21:04.726 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:21:04.737 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:21:04.738 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:09.878 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:21:09.883 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:21:39.992 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:21:39.997 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:21:50.437 INFO:teuthology.orchestra.run.smithi116.stdout:generic/113 46s 2023-05-12T10:21:50.581 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/113 2023-05-12T10:21:50.581 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:21:50.587 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:50.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:21:50.671 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-05-12T10:21:51.386 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:21:51.397 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:21:51.397 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:52.247 INFO:teuthology.orchestra.run.smithi116.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-05-12T10:21:52.255 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/114 2023-05-12T10:21:52.255 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/114 2023-05-12T10:21:52.255 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:21:52.260 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:52.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:21:52.280 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-05-12T10:21:52.670 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:21:52.681 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:21:52.681 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:53.044 INFO:teuthology.orchestra.run.smithi116.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:21:53.052 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/115 2023-05-12T10:21:53.053 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/115 2023-05-12T10:21:53.053 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:21:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:53.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:21:53.077 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-05-12T10:21:53.791 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:21:53.802 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:21:53.803 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:54.161 INFO:teuthology.orchestra.run.smithi116.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:21:54.169 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/116 2023-05-12T10:21:54.170 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/116 2023-05-12T10:21:54.170 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:21:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:54.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:21:54.195 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-05-12T10:21:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:21:54.906 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:21:54.906 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:55.185 INFO:teuthology.orchestra.run.smithi116.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:21:55.193 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/117 2023-05-12T10:21:55.193 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/117 2023-05-12T10:21:55.194 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:21:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:55.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:21:55.218 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-05-12T10:21:55.601 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:21:55.613 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:21:55.613 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:55.970 INFO:teuthology.orchestra.run.smithi116.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:21:55.979 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/118 2023-05-12T10:21:55.979 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/118 2023-05-12T10:21:55.979 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:21:55.985 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:56.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:21:56.004 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-05-12T10:21:56.709 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:21:56.720 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:21:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:57.077 INFO:teuthology.orchestra.run.smithi116.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:21:57.086 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/119 2023-05-12T10:21:57.086 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/119 2023-05-12T10:21:57.086 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:21:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:57.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:21:57.111 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-05-12T10:21:57.814 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:21:57.826 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:21:57.826 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:58.101 INFO:teuthology.orchestra.run.smithi116.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:21:58.109 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/120 2023-05-12T10:21:58.109 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/120 2023-05-12T10:21:58.110 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:21:58.114 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:58.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:21:58.134 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-05-12T10:21:58.521 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:21:58.532 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:21:58.533 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:58.911 INFO:teuthology.orchestra.run.smithi116.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-12T10:21:58.919 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/121 2023-05-12T10:21:58.919 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/121 2023-05-12T10:21:58.919 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:21:58.924 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:21:58.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:21:58.943 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-05-12T10:21:59.648 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:21:59.659 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:21:59.659 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:22:00.035 INFO:teuthology.orchestra.run.smithi116.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-12T10:22:00.044 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/122 2023-05-12T10:22:00.044 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/122 2023-05-12T10:22:00.044 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:22:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:22:00.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:22:00.068 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-05-12T10:22:00.781 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:22:00.792 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:22:00.792 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:22:01.526 INFO:teuthology.orchestra.run.smithi116.stdout:generic/123 1s 2023-05-12T10:22:01.537 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/123 2023-05-12T10:22:01.538 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:22:01.543 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:22:01.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:22:01.571 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-05-12T10:22:02.264 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:22:02.275 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:22:02.275 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:22:02.874 INFO:teuthology.orchestra.run.smithi116.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:22:02.882 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/124 2023-05-12T10:22:02.882 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/124 2023-05-12T10:22:02.883 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:22:02.888 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:22:02.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:22:02.907 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-05-12T10:22:03.299 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:22:03.310 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:22:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:22:10.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:22:10.169 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:22:40.266 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:22:40.271 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:23:05.508 INFO:teuthology.orchestra.run.smithi116.stdout:generic/125 62s 2023-05-12T10:23:05.521 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/125 2023-05-12T10:23:05.521 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:23:05.527 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:23:05.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:23:05.554 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-05-12T10:23:06.239 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:23:06.250 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:23:06.251 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:23:07.211 INFO:teuthology.orchestra.run.smithi116.stdout:generic/126 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/126.out.bad) 2023-05-12T10:23:07.216 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/126.out 2023-05-12 09:09:18.843490698 +0000 2023-05-12T10:23:07.216 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/126.out.bad 2023-05-12 10:23:07.204866700 +0000 2023-05-12T10:23:07.216 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1,7 +1,7 @@ 2023-05-12T10:23:07.217 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 126 2023-05-12T10:23:07.217 INFO:teuthology.orchestra.run.smithi116.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-05-12T10:23:07.217 INFO:teuthology.orchestra.run.smithi116.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-05-12T10:23:07.217 INFO:teuthology.orchestra.run.smithi116.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-05-12T10:23:07.217 INFO:teuthology.orchestra.run.smithi116.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-05-12T10:23:07.217 INFO:teuthology.orchestra.run.smithi116.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-05-12T10:23:07.217 INFO:teuthology.orchestra.run.smithi116.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-05-12T10:23:07.218 INFO:teuthology.orchestra.run.smithi116.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-05-12T10:23:07.218 INFO:teuthology.orchestra.run.smithi116.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-05-12T10:23:07.218 INFO:teuthology.orchestra.run.smithi116.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-05-12T10:23:07.221 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/126 2023-05-12T10:23:07.222 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/126 2023-05-12T10:23:07.222 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T10:23:07.227 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:23:07.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T10:23:07.246 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T10:23:07.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T10:23:07.247 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-05-12T10:23:07.964 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:23:07.975 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:23:07.975 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:23:10.401 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:23:10.405 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:23:40.548 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:23:40.552 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:24:10.721 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:24:10.725 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:24:40.835 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:24:40.839 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:25:11.350 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:25:11.354 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:25:41.464 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:25:41.468 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:26:12.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:26:12.181 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:26:42.309 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:26:42.314 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:27:12.411 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:27:12.416 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:27:42.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:27:42.523 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:28:12.645 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:28:12.650 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:28:42.750 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:28:42.755 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:29:12.850 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:29:12.854 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:29:42.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:29:42.985 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:30:13.086 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:30:13.090 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:30:43.194 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:30:43.198 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:30:43.281 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T10:30:43.277+0000 7f4e7fbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145274) UID: 0 2023-05-12T10:30:43.281 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T10:30:43.277+0000 7fb0059f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145274) UID: 0 2023-05-12T10:30:43.282 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T10:30:43.277+0000 7fe44e3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145274) UID: 0 2023-05-12T10:30:43.282 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T10:30:43.277+0000 7f02559f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145274) UID: 0 2023-05-12T10:33:36.623 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:33:36.629 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:34:06.760 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:34:06.764 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:34:06.847 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T10:34:06.843+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251088) UID: 0 2023-05-12T10:34:06.847 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T10:34:06.843+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251088) UID: 0 2023-05-12T10:34:06.848 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T10:34:06.843+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251088) UID: 0 2023-05-12T10:34:06.848 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T10:34:06.843+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251088) UID: 0 2023-05-12T10:37:02.985 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:37:02.990 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:37:03.342 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T10:37:03.337+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251136) UID: 0 2023-05-12T10:37:03.342 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T10:37:03.337+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251136) UID: 0 2023-05-12T10:37:03.343 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T10:37:03.337+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251136) UID: 0 2023-05-12T10:37:03.343 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T10:37:03.337+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251136) UID: 0 2023-05-12T10:39:41.399 INFO:teuthology.orchestra.run.smithi116.stdout:generic/127 994s 2023-05-12T10:39:41.410 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/127 2023-05-12T10:39:41.410 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:39:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:41.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:39:41.480 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-05-12T10:39:42.212 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:39:42.223 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:39:42.223 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:42.533 INFO:teuthology.orchestra.run.smithi116.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:39:42.541 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/128 2023-05-12T10:39:42.542 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/128 2023-05-12T10:39:42.542 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:39:42.547 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:42.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:39:42.566 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-05-12T10:39:42.963 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:39:42.974 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:39:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:43.250 INFO:teuthology.orchestra.run.smithi116.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:39:43.258 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/129 2023-05-12T10:39:43.259 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/129 2023-05-12T10:39:43.259 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:39:43.264 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:43.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:39:43.284 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-05-12T10:39:43.675 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:39:43.687 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:39:43.687 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:43.962 INFO:teuthology.orchestra.run.smithi116.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:39:43.971 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/130 2023-05-12T10:39:43.971 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/130 2023-05-12T10:39:43.971 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:39:43.976 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:43.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:39:43.995 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-05-12T10:39:44.381 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:39:44.392 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:39:44.392 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:45.896 INFO:teuthology.orchestra.run.smithi116.stdout:generic/131 1s 2023-05-12T10:39:45.907 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/131 2023-05-12T10:39:45.908 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:39:45.913 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:45.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:39:45.932 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-05-12T10:39:46.618 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:39:46.629 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:39:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:46.901 INFO:teuthology.orchestra.run.smithi116.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:39:46.909 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/132 2023-05-12T10:39:46.910 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/132 2023-05-12T10:39:46.910 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:39:46.915 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:39:46.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:39:46.935 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-05-12T10:39:47.324 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:39:47.335 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:39:47.335 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:40:07.476 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:40:07.480 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:40:37.668 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:40:37.673 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:41:07.799 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:41:07.803 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:41:37.963 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:41:37.968 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:42:09.030 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:42:09.034 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:42:39.140 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:42:39.144 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:43:09.296 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:43:09.300 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:43:39.403 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:43:39.407 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:44:09.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:44:09.505 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:44:39.179 INFO:teuthology.orchestra.run.smithi116.stdout:generic/133 292s 2023-05-12T10:44:39.190 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/133 2023-05-12T10:44:39.191 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:39.196 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:39.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:39.223 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-05-12T10:44:39.615 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:44:39.621 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:44:40.019 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:40.030 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:40.030 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:40.411 INFO:teuthology.orchestra.run.smithi116.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:40.419 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/134 2023-05-12T10:44:40.419 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/134 2023-05-12T10:44:40.420 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:40.425 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:40.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:40.445 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-05-12T10:44:41.147 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:41.158 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:41.159 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:41.490 INFO:teuthology.orchestra.run.smithi116.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:44:41.498 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/135 2023-05-12T10:44:41.498 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/135 2023-05-12T10:44:41.499 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:41.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:41.525 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-05-12T10:44:41.914 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:41.925 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:42.303 INFO:teuthology.orchestra.run.smithi116.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:42.311 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/136 2023-05-12T10:44:42.311 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/136 2023-05-12T10:44:42.311 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:42.316 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:42.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:42.335 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-05-12T10:44:43.048 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:43.060 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:43.060 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:43.426 INFO:teuthology.orchestra.run.smithi116.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:43.434 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/137 2023-05-12T10:44:43.434 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/137 2023-05-12T10:44:43.435 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:43.440 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:43.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:43.459 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-05-12T10:44:44.164 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:44.175 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:44.175 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:44.533 INFO:teuthology.orchestra.run.smithi116.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:44.542 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/138 2023-05-12T10:44:44.542 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/138 2023-05-12T10:44:44.542 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:44.547 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:44.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:44.568 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-05-12T10:44:45.271 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:45.282 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:45.282 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:45.642 INFO:teuthology.orchestra.run.smithi116.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:45.651 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/139 2023-05-12T10:44:45.651 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/139 2023-05-12T10:44:45.651 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:45.656 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:45.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:45.687 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-05-12T10:44:46.385 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:46.396 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:46.396 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:46.752 INFO:teuthology.orchestra.run.smithi116.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:46.760 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/140 2023-05-12T10:44:46.761 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/140 2023-05-12T10:44:46.761 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:46.766 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:46.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:46.789 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-05-12T10:44:47.494 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:47.505 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:47.505 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:47.786 INFO:teuthology.orchestra.run.smithi116.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:44:47.794 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/141 2023-05-12T10:44:47.795 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/141 2023-05-12T10:44:47.795 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:47.800 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:47.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:47.820 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-05-12T10:44:48.207 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:48.218 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:48.219 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:48.575 INFO:teuthology.orchestra.run.smithi116.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:48.584 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/142 2023-05-12T10:44:48.584 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/142 2023-05-12T10:44:48.584 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:48.589 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:48.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:48.610 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-05-12T10:44:49.305 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:49.316 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:49.316 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:49.759 INFO:teuthology.orchestra.run.smithi116.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:49.767 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/143 2023-05-12T10:44:49.767 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/143 2023-05-12T10:44:49.767 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:49.773 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:49.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:49.802 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-05-12T10:44:50.484 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:50.494 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:50.495 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:50.862 INFO:teuthology.orchestra.run.smithi116.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:50.870 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/144 2023-05-12T10:44:50.870 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/144 2023-05-12T10:44:50.870 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:50.875 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:50.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:50.895 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-05-12T10:44:51.602 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:51.613 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:51.614 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:51.967 INFO:teuthology.orchestra.run.smithi116.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:51.975 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/145 2023-05-12T10:44:51.976 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/145 2023-05-12T10:44:51.976 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:52.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:52.052 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-05-12T10:44:52.695 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:52.706 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:52.706 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:53.067 INFO:teuthology.orchestra.run.smithi116.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:53.075 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/146 2023-05-12T10:44:53.075 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/146 2023-05-12T10:44:53.075 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:53.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:53.101 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-05-12T10:44:53.809 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:53.820 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:53.821 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:54.173 INFO:teuthology.orchestra.run.smithi116.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:54.181 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/147 2023-05-12T10:44:54.181 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/147 2023-05-12T10:44:54.182 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:54.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:54.206 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-05-12T10:44:54.905 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:54.916 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:54.916 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:55.279 INFO:teuthology.orchestra.run.smithi116.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:55.287 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/148 2023-05-12T10:44:55.287 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/148 2023-05-12T10:44:55.288 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:55.293 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:55.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:55.313 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-05-12T10:44:56.040 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:56.051 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:56.051 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:56.407 INFO:teuthology.orchestra.run.smithi116.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:56.415 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/149 2023-05-12T10:44:56.415 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/149 2023-05-12T10:44:56.415 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:56.421 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:56.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:56.448 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-05-12T10:44:57.146 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:57.157 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:57.519 INFO:teuthology.orchestra.run.smithi116.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/150 2023-05-12T10:44:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/150 2023-05-12T10:44:57.528 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:57.533 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:57.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:57.562 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-05-12T10:44:58.265 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:58.276 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:58.631 INFO:teuthology.orchestra.run.smithi116.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:58.639 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/151 2023-05-12T10:44:58.639 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/151 2023-05-12T10:44:58.640 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:58.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:58.665 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-05-12T10:44:59.360 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:44:59.371 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:44:59.372 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:59.722 INFO:teuthology.orchestra.run.smithi116.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:44:59.730 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/152 2023-05-12T10:44:59.731 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/152 2023-05-12T10:44:59.731 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:44:59.736 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:44:59.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:44:59.791 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-05-12T10:45:00.459 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:00.471 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:00.826 INFO:teuthology.orchestra.run.smithi116.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:00.834 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/153 2023-05-12T10:45:00.834 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/153 2023-05-12T10:45:00.835 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:00.840 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:00.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:00.877 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-05-12T10:45:01.544 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:01.555 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:01.555 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:01.927 INFO:teuthology.orchestra.run.smithi116.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:01.935 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/154 2023-05-12T10:45:01.935 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/154 2023-05-12T10:45:01.935 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:01.940 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:01.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:01.961 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-05-12T10:45:02.663 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:02.673 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:03.033 INFO:teuthology.orchestra.run.smithi116.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:03.041 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/155 2023-05-12T10:45:03.042 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/155 2023-05-12T10:45:03.042 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:03.047 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:03.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:03.075 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-05-12T10:45:03.771 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:03.782 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:03.782 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:04.146 INFO:teuthology.orchestra.run.smithi116.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:04.154 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/156 2023-05-12T10:45:04.154 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/156 2023-05-12T10:45:04.154 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:04.160 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:04.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:04.202 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-05-12T10:45:04.880 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:04.891 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:04.891 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:05.251 INFO:teuthology.orchestra.run.smithi116.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:05.259 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/157 2023-05-12T10:45:05.259 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/157 2023-05-12T10:45:05.259 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:05.264 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:05.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:05.326 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-05-12T10:45:05.977 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:05.988 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:05.988 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:06.366 INFO:teuthology.orchestra.run.smithi116.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:06.374 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/158 2023-05-12T10:45:06.374 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/158 2023-05-12T10:45:06.374 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:06.379 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:06.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:06.398 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-05-12T10:45:07.107 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:07.120 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:07.120 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:07.500 INFO:teuthology.orchestra.run.smithi116.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-05-12T10:45:07.508 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/159 2023-05-12T10:45:07.508 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/159 2023-05-12T10:45:07.509 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:07.514 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:07.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:07.535 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-05-12T10:45:07.922 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:07.933 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:07.933 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:08.256 INFO:teuthology.orchestra.run.smithi116.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-05-12T10:45:08.264 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/160 2023-05-12T10:45:08.264 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/160 2023-05-12T10:45:08.264 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:08.270 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:08.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:08.290 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-05-12T10:45:08.676 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:08.687 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:08.687 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:08.968 INFO:teuthology.orchestra.run.smithi116.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:08.976 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/161 2023-05-12T10:45:08.977 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/161 2023-05-12T10:45:08.977 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:08.982 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:09.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:09.001 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-05-12T10:45:09.389 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:09.400 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:09.401 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:09.677 INFO:teuthology.orchestra.run.smithi116.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:09.685 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/162 2023-05-12T10:45:09.686 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/162 2023-05-12T10:45:09.686 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:09.691 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:09.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:09.712 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-05-12T10:45:09.735 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:45:09.759 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:45:10.099 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:10.110 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:10.110 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:10.386 INFO:teuthology.orchestra.run.smithi116.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:10.394 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/163 2023-05-12T10:45:10.394 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/163 2023-05-12T10:45:10.394 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:10.400 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:10.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:10.420 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-05-12T10:45:10.805 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:10.817 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:10.817 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:11.095 INFO:teuthology.orchestra.run.smithi116.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:11.103 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/164 2023-05-12T10:45:11.103 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/164 2023-05-12T10:45:11.104 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:11.109 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:11.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:11.127 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-05-12T10:45:11.523 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:11.534 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:11.534 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:11.812 INFO:teuthology.orchestra.run.smithi116.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:11.820 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/165 2023-05-12T10:45:11.821 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/165 2023-05-12T10:45:11.821 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:11.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:11.845 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-05-12T10:45:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:12.240 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:12.526 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/166 2023-05-12T10:45:12.526 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/166 2023-05-12T10:45:12.526 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:12.531 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:12.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:12.551 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-05-12T10:45:12.944 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:12.955 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:12.955 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:13.233 INFO:teuthology.orchestra.run.smithi116.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:13.241 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/167 2023-05-12T10:45:13.242 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/167 2023-05-12T10:45:13.242 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:13.247 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:13.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:13.266 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-05-12T10:45:13.651 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:13.662 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:13.939 INFO:teuthology.orchestra.run.smithi116.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:13.947 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/168 2023-05-12T10:45:13.948 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/168 2023-05-12T10:45:13.948 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:13.953 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:13.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:13.974 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-05-12T10:45:14.362 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:14.373 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:14.373 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:14.658 INFO:teuthology.orchestra.run.smithi116.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:14.666 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/169 2023-05-12T10:45:14.667 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/169 2023-05-12T10:45:14.667 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:14.672 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:14.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:14.692 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-05-12T10:45:15.074 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:15.086 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:15.086 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:15.360 INFO:teuthology.orchestra.run.smithi116.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:15.368 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/170 2023-05-12T10:45:15.369 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/170 2023-05-12T10:45:15.369 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:15.374 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:15.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:15.393 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-05-12T10:45:15.786 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:15.797 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:15.797 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:16.085 INFO:teuthology.orchestra.run.smithi116.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:16.093 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/171 2023-05-12T10:45:16.094 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/171 2023-05-12T10:45:16.094 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:16.099 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:16.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:16.118 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-05-12T10:45:16.505 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:16.516 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:16.813 INFO:teuthology.orchestra.run.smithi116.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:16.821 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/172 2023-05-12T10:45:16.822 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/172 2023-05-12T10:45:16.822 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:16.827 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:16.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:16.847 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-05-12T10:45:17.237 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:17.248 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:17.248 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:17.536 INFO:teuthology.orchestra.run.smithi116.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:17.544 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/173 2023-05-12T10:45:17.545 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/173 2023-05-12T10:45:17.545 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:17.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:17.570 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-05-12T10:45:17.959 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:17.970 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:17.970 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:18.260 INFO:teuthology.orchestra.run.smithi116.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:18.269 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/174 2023-05-12T10:45:18.269 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/174 2023-05-12T10:45:18.269 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:18.274 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:18.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:18.293 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-05-12T10:45:18.682 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:18.693 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:18.693 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:18.976 INFO:teuthology.orchestra.run.smithi116.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:18.985 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/175 2023-05-12T10:45:18.985 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/175 2023-05-12T10:45:18.985 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:18.990 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:19.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:19.009 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-05-12T10:45:19.398 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:19.409 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:19.410 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:19.701 INFO:teuthology.orchestra.run.smithi116.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:19.710 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/176 2023-05-12T10:45:19.710 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/176 2023-05-12T10:45:19.710 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:19.715 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:19.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:19.734 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-05-12T10:45:20.120 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:20.132 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:20.484 INFO:teuthology.orchestra.run.smithi116.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:20.492 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/177 2023-05-12T10:45:20.493 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/177 2023-05-12T10:45:20.493 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:20.498 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:20.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:20.517 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-05-12T10:45:20.910 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:20.922 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:20.922 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:21.284 INFO:teuthology.orchestra.run.smithi116.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:21.292 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/178 2023-05-12T10:45:21.293 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/178 2023-05-12T10:45:21.293 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:21.298 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:21.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:21.332 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-05-12T10:45:22.025 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:22.037 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:22.037 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:22.558 INFO:teuthology.orchestra.run.smithi116.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:22.566 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/179 2023-05-12T10:45:22.566 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/179 2023-05-12T10:45:22.567 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:22.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:22.620 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-05-12T10:45:23.297 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:23.308 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:23.308 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:23.668 INFO:teuthology.orchestra.run.smithi116.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:23.676 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/180 2023-05-12T10:45:23.676 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/180 2023-05-12T10:45:23.677 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:23.682 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:23.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:23.715 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-05-12T10:45:24.416 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:24.427 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:24.428 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:24.789 INFO:teuthology.orchestra.run.smithi116.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:24.797 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/181 2023-05-12T10:45:24.798 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/181 2023-05-12T10:45:24.798 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:24.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:24.842 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-05-12T10:45:25.523 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:25.534 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:25.534 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:25.906 INFO:teuthology.orchestra.run.smithi116.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-12T10:45:25.915 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/182 2023-05-12T10:45:25.915 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/182 2023-05-12T10:45:25.915 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:25.920 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:25.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:25.940 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-05-12T10:45:26.657 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:26.668 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:26.668 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:26.945 INFO:teuthology.orchestra.run.smithi116.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:26.953 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/183 2023-05-12T10:45:26.953 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/183 2023-05-12T10:45:26.953 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:26.959 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:26.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:26.980 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-05-12T10:45:27.368 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:27.379 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:27.379 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:27.747 INFO:teuthology.orchestra.run.smithi116.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/184.out.bad) 2023-05-12T10:45:27.752 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/184.out 2023-05-12 09:09:18.851490557 +0000 2023-05-12T10:45:27.753 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/184.out.bad 2023-05-12 10:45:27.740108518 +0000 2023-05-12T10:45:27.753 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1 +1,2 @@ 2023-05-12T10:45:27.753 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 184 2023-05-12T10:45:27.753 INFO:teuthology.orchestra.run.smithi116.stdout: +/tmp/tmp.b9w2OCk4k0xfstests-dev/tests/generic/184: line 23: /tmp/tmp.A6WkqqsMBotest/null: Permission denied 2023-05-12T10:45:27.758 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/184 2023-05-12T10:45:27.758 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/184 2023-05-12T10:45:27.758 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T10:45:27.763 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:27.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T10:45:27.782 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T10:45:27.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T10:45:27.783 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-05-12T10:45:28.176 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:28.186 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:28.187 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:28.477 INFO:teuthology.orchestra.run.smithi116.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:28.485 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/185 2023-05-12T10:45:28.485 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/185 2023-05-12T10:45:28.485 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:28.490 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:28.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:28.511 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-05-12T10:45:28.893 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:28.904 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:28.905 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:29.188 INFO:teuthology.orchestra.run.smithi116.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:29.196 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/186 2023-05-12T10:45:29.196 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/186 2023-05-12T10:45:29.197 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:29.202 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:29.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:29.221 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-05-12T10:45:29.612 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:29.623 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:29.623 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:29.895 INFO:teuthology.orchestra.run.smithi116.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:29.903 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/187 2023-05-12T10:45:29.904 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/187 2023-05-12T10:45:29.904 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:29.909 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:29.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:29.928 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-05-12T10:45:30.314 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:30.325 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:30.325 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:30.614 INFO:teuthology.orchestra.run.smithi116.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:30.622 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/188 2023-05-12T10:45:30.622 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/188 2023-05-12T10:45:30.623 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:30.628 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:30.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:30.648 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-05-12T10:45:31.031 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:31.042 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:31.318 INFO:teuthology.orchestra.run.smithi116.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:31.326 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/189 2023-05-12T10:45:31.327 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/189 2023-05-12T10:45:31.327 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:31.332 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:31.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:31.352 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-05-12T10:45:31.739 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:31.751 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:31.751 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:32.024 INFO:teuthology.orchestra.run.smithi116.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:32.032 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/190 2023-05-12T10:45:32.032 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/190 2023-05-12T10:45:32.033 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:32.038 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:32.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:32.057 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-05-12T10:45:32.443 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:32.454 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:32.454 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:32.732 INFO:teuthology.orchestra.run.smithi116.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:32.740 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/191 2023-05-12T10:45:32.741 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/191 2023-05-12T10:45:32.741 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:32.746 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:32.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:32.767 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-05-12T10:45:33.152 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:33.164 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:33.164 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:39.041 INFO:teuthology.orchestra.run.smithi116.stdout:generic/192 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/192.out.bad) 2023-05-12T10:45:39.047 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/192.out 2023-05-12 09:09:18.853490522 +0000 2023-05-12T10:45:39.047 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/192.out.bad 2023-05-12 10:45:39.035917210 +0000 2023-05-12T10:45:39.047 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1,5 +1,6 @@ 2023-05-12T10:45:39.047 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 192 2023-05-12T10:45:39.047 INFO:teuthology.orchestra.run.smithi116.stdout: sleep for 5 seconds 2023-05-12T10:45:39.047 INFO:teuthology.orchestra.run.smithi116.stdout: test 2023-05-12T10:45:39.047 INFO:teuthology.orchestra.run.smithi116.stdout: -delta1 is in range 2023-05-12T10:45:39.048 INFO:teuthology.orchestra.run.smithi116.stdout: +delta1 has value of 0 2023-05-12T10:45:39.048 INFO:teuthology.orchestra.run.smithi116.stdout: +delta1 is NOT in range 5 .. 7 2023-05-12T10:45:39.048 INFO:teuthology.orchestra.run.smithi116.stdout: delta2 is in range 2023-05-12T10:45:39.052 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/192 2023-05-12T10:45:39.052 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/192 2023-05-12T10:45:39.052 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T10:45:39.057 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:39.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T10:45:39.076 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T10:45:39.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T10:45:39.077 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-05-12T10:45:39.469 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:39.480 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:39.857 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:45:39.862 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:45:41.152 INFO:teuthology.orchestra.run.smithi116.stdout:generic/193 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/193.out.bad) 2023-05-12T10:45:41.157 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/193.out 2023-05-12 09:09:18.853490522 +0000 2023-05-12T10:45:41.157 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/193.out.bad 2023-05-12 10:45:41.144881492 +0000 2023-05-12T10:45:41.157 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -24,7 +24,6 @@ 2023-05-12T10:45:41.157 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:41.157 INFO:teuthology.orchestra.run.smithi116.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-05-12T10:45:41.158 INFO:teuthology.orchestra.run.smithi116.stdout: user: chmod a+r on root owned file (should fail) 2023-05-12T10:45:41.158 INFO:teuthology.orchestra.run.smithi116.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-05-12T10:45:41.158 INFO:teuthology.orchestra.run.smithi116.stdout: check that the sgid bit is cleared 2023-05-12T10:45:41.158 INFO:teuthology.orchestra.run.smithi116.stdout: -rw-rw-rw- 2023-05-12T10:45:41.158 INFO:teuthology.orchestra.run.smithi116.stdout: check that suid bit is not cleared 2023-05-12T10:45:41.162 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/193 2023-05-12T10:45:41.162 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/193 2023-05-12T10:45:41.163 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T10:45:41.168 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:41.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T10:45:41.236 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T10:45:41.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T10:45:41.237 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-05-12T10:45:41.894 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:41.905 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:41.905 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:42.185 INFO:teuthology.orchestra.run.smithi116.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:42.193 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/194 2023-05-12T10:45:42.193 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/194 2023-05-12T10:45:42.193 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:42.199 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:42.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:42.219 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-05-12T10:45:42.617 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:42.628 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:42.629 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:42.910 INFO:teuthology.orchestra.run.smithi116.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:42.918 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/195 2023-05-12T10:45:42.919 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/195 2023-05-12T10:45:42.919 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:42.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:42.944 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-05-12T10:45:43.332 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:43.343 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:43.344 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:43.624 INFO:teuthology.orchestra.run.smithi116.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:43.632 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/196 2023-05-12T10:45:43.632 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/196 2023-05-12T10:45:43.633 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:43.638 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:43.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:43.658 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-05-12T10:45:44.046 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:44.057 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:44.333 INFO:teuthology.orchestra.run.smithi116.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:44.341 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/197 2023-05-12T10:45:44.341 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/197 2023-05-12T10:45:44.341 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:44.346 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:44.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:44.366 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-05-12T10:45:44.757 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:44.768 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:44.768 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:45.967 INFO:teuthology.orchestra.run.smithi116.stdout:generic/198 1s 2023-05-12T10:45:45.978 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/198 2023-05-12T10:45:45.979 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:45.983 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:46.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:46.004 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-05-12T10:45:46.711 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:46.722 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:46.722 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:47.039 INFO:teuthology.orchestra.run.smithi116.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:47.047 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/199 2023-05-12T10:45:47.047 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/199 2023-05-12T10:45:47.047 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:47.053 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:47.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:47.073 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-05-12T10:45:47.460 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:47.471 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:47.471 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:47.764 INFO:teuthology.orchestra.run.smithi116.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:47.772 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/200 2023-05-12T10:45:47.773 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/200 2023-05-12T10:45:47.773 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:47.778 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:47.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:47.798 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-05-12T10:45:48.184 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:48.195 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:48.195 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:48.472 INFO:teuthology.orchestra.run.smithi116.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:48.481 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/201 2023-05-12T10:45:48.481 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/201 2023-05-12T10:45:48.481 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:48.486 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:48.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:48.507 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-05-12T10:45:48.898 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:48.909 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:48.909 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:49.187 INFO:teuthology.orchestra.run.smithi116.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:49.195 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/202 2023-05-12T10:45:49.195 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/202 2023-05-12T10:45:49.195 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:49.200 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:49.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:49.220 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-05-12T10:45:49.609 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:49.620 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:49.904 INFO:teuthology.orchestra.run.smithi116.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:49.912 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/203 2023-05-12T10:45:49.913 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/203 2023-05-12T10:45:49.913 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:49.918 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:49.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:49.938 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-05-12T10:45:50.327 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:50.338 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:51.286 INFO:teuthology.orchestra.run.smithi116.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:51.296 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/204 2023-05-12T10:45:51.296 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/204 2023-05-12T10:45:51.296 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:51.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:51.323 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-05-12T10:45:51.714 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:51.725 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:51.725 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:52.002 INFO:teuthology.orchestra.run.smithi116.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:52.010 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/205 2023-05-12T10:45:52.010 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/205 2023-05-12T10:45:52.010 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:52.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:52.035 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-05-12T10:45:52.420 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:52.431 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:52.431 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:52.718 INFO:teuthology.orchestra.run.smithi116.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:45:52.726 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/206 2023-05-12T10:45:52.727 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/206 2023-05-12T10:45:52.727 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:45:52.732 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:45:52.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:45:52.752 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-05-12T10:45:53.138 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:45:53.149 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:45:53.149 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:46:09.987 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:46:09.991 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:46:14.407 INFO:teuthology.orchestra.run.smithi116.stdout:generic/207 21s 2023-05-12T10:46:14.419 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/207 2023-05-12T10:46:14.420 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:46:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:46:14.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:46:14.486 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-05-12T10:46:15.148 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:46:15.159 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:46:15.160 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:46:40.147 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:46:40.151 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:47:10.298 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:47:10.303 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:47:40.537 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:47:40.542 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:48:11.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:48:11.032 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:48:41.158 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:48:41.162 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:49:11.264 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:49:11.268 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:49:35.618 INFO:teuthology.orchestra.run.smithi116.stdout:generic/208 200s 2023-05-12T10:49:35.629 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/208 2023-05-12T10:49:35.629 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:49:35.634 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:35.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:49:35.705 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-05-12T10:49:36.361 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:49:36.372 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:49:36.372 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:41.370 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:49:41.374 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:49:46.873 INFO:teuthology.orchestra.run.smithi116.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/209.out.bad) 2023-05-12T10:49:46.924 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/209.out 2023-05-12 09:09:18.855490487 +0000 2023-05-12T10:49:46.924 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/209.out.bad 2023-05-12 10:49:46.832740734 +0000 2023-05-12T10:49:46.924 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1,2 +1,2 @@ 2023-05-12T10:49:46.924 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 209 2023-05-12T10:49:46.924 INFO:teuthology.orchestra.run.smithi116.stdout: -test ran for 30 seconds without error 2023-05-12T10:49:46.924 INFO:teuthology.orchestra.run.smithi116.stdout: +reader found old byte at pos 4096 2023-05-12T10:49:46.925 INFO:teuthology.orchestra.run.smithi116.stdout: \ No newline at end of file 2023-05-12T10:49:46.944 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/209 2023-05-12T10:49:46.944 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/209 2023-05-12T10:49:46.945 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T10:49:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:47.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T10:49:47.011 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T10:49:47.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T10:49:47.012 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-05-12T10:49:47.490 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:49:47.502 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:49:47.502 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:47.917 INFO:teuthology.orchestra.run.smithi116.stdout:generic/210 0s 2023-05-12T10:49:47.929 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/210 2023-05-12T10:49:47.929 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:49:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:47.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:49:47.955 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-05-12T10:49:48.639 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:49:48.651 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:49:48.651 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:49.462 INFO:teuthology.orchestra.run.smithi116.stdout:generic/211 1s 2023-05-12T10:49:49.473 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/211 2023-05-12T10:49:49.473 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:49:49.478 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:49.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:49:49.499 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-05-12T10:49:49.882 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:49:49.893 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:49:49.894 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:50.292 INFO:teuthology.orchestra.run.smithi116.stdout:generic/212 1s 2023-05-12T10:49:50.303 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/212 2023-05-12T10:49:50.303 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:49:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:50.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:49:50.329 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-05-12T10:49:50.716 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:49:50.727 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:49:50.728 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:51.402 INFO:teuthology.orchestra.run.smithi116.stdout:generic/213 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/213.out.bad) 2023-05-12T10:49:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/213.out 2023-05-12 09:09:18.856490469 +0000 2023-05-12T10:49:51.407 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/213.out.bad 2023-05-12 10:49:51.396663878 +0000 2023-05-12T10:49:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1,4 +1,3 @@ 2023-05-12T10:49:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 213 2023-05-12T10:49:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: We should get: fallocate: No space left on device 2023-05-12T10:49:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-05-12T10:49:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: -fallocate: No space left on device 2023-05-12T10:49:51.413 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/213 2023-05-12T10:49:51.413 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/213 2023-05-12T10:49:51.413 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T10:49:51.418 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:51.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T10:49:51.462 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T10:49:51.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T10:49:51.463 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-05-12T10:49:52.261 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:49:52.275 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:49:52.276 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:53.332 INFO:teuthology.orchestra.run.smithi116.stdout:generic/214 1s 2023-05-12T10:49:53.350 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/214 2023-05-12T10:49:53.350 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:49:53.358 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:53.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:49:53.390 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-05-12T10:49:54.268 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:49:54.288 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:49:54.289 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:58.335 INFO:teuthology.orchestra.run.smithi116.stdout:generic/215 4s 2023-05-12T10:49:58.357 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/215 2023-05-12T10:49:58.357 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:49:58.364 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:58.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:49:58.397 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-05-12T10:49:58.996 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:49:59.019 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:49:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:59.433 INFO:teuthology.orchestra.run.smithi116.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:49:59.443 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/216 2023-05-12T10:49:59.443 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/216 2023-05-12T10:49:59.444 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:49:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:49:59.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:49:59.486 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-05-12T10:50:00.100 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:00.117 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:00.117 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:00.515 INFO:teuthology.orchestra.run.smithi116.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:00.525 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/217 2023-05-12T10:50:00.526 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/217 2023-05-12T10:50:00.526 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:00.534 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:00.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:00.566 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-05-12T10:50:01.190 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:01.211 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:01.212 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:01.631 INFO:teuthology.orchestra.run.smithi116.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:01.643 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/218 2023-05-12T10:50:01.643 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/218 2023-05-12T10:50:01.644 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:01.651 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:01.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:01.688 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-05-12T10:50:02.315 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:02.331 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:02.331 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:02.726 INFO:teuthology.orchestra.run.smithi116.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:02.741 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/219 2023-05-12T10:50:02.741 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/219 2023-05-12T10:50:02.741 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:02.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:02.790 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-05-12T10:50:03.403 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:03.420 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:03.848 INFO:teuthology.orchestra.run.smithi116.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:03.860 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/220 2023-05-12T10:50:03.861 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/220 2023-05-12T10:50:03.861 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:03.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:03.906 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-05-12T10:50:04.492 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:04.509 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:06.025 INFO:teuthology.orchestra.run.smithi116.stdout:generic/221 2s 2023-05-12T10:50:06.042 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/221 2023-05-12T10:50:06.042 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:06.051 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:06.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:06.085 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-05-12T10:50:06.630 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:06.641 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:06.641 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:07.043 INFO:teuthology.orchestra.run.smithi116.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:07.056 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/222 2023-05-12T10:50:07.056 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/222 2023-05-12T10:50:07.057 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:07.066 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:07.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:07.097 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-05-12T10:50:07.676 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:07.695 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:07.696 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:08.148 INFO:teuthology.orchestra.run.smithi116.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:08.161 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/223 2023-05-12T10:50:08.161 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/223 2023-05-12T10:50:08.162 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:08.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:08.202 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-05-12T10:50:08.779 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:08.792 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:08.793 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:09.501 INFO:teuthology.orchestra.run.smithi116.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:09.511 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/224 2023-05-12T10:50:09.511 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/224 2023-05-12T10:50:09.512 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:09.519 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:09.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:09.562 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-05-12T10:50:10.189 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:10.203 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:10.204 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:10.616 INFO:teuthology.orchestra.run.smithi116.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:10.628 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/225 2023-05-12T10:50:10.629 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/225 2023-05-12T10:50:10.629 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:10.638 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:10.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:10.674 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-05-12T10:50:11.253 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:11.273 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:11.273 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:11.686 INFO:teuthology.orchestra.run.smithi116.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:11.698 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/226 2023-05-12T10:50:11.698 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/226 2023-05-12T10:50:11.698 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:11.708 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:11.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:11.746 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-05-12T10:50:12.358 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:12.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:50:12.366 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:50:12.374 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:12.375 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:12.815 INFO:teuthology.orchestra.run.smithi116.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:12.837 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/227 2023-05-12T10:50:12.837 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/227 2023-05-12T10:50:12.837 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:12.845 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:12.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:12.881 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-05-12T10:50:13.481 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:13.500 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:14.673 INFO:teuthology.orchestra.run.smithi116.stdout:generic/228 1s 2023-05-12T10:50:15.313 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/228 2023-05-12T10:50:15.313 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:15.320 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:15.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:15.356 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-05-12T10:50:16.279 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:16.303 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:16.303 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:16.735 INFO:teuthology.orchestra.run.smithi116.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:16.747 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/229 2023-05-12T10:50:16.748 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/229 2023-05-12T10:50:16.748 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:16.759 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:16.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:16.789 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-05-12T10:50:17.411 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:17.425 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:17.834 INFO:teuthology.orchestra.run.smithi116.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:17.845 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/230 2023-05-12T10:50:17.845 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/230 2023-05-12T10:50:17.845 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:17.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:17.883 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-05-12T10:50:18.481 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:18.503 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:18.928 INFO:teuthology.orchestra.run.smithi116.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:18.943 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/231 2023-05-12T10:50:18.943 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/231 2023-05-12T10:50:18.943 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:18.951 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:18.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:18.989 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-05-12T10:50:19.583 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:19.597 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:19.597 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:20.051 INFO:teuthology.orchestra.run.smithi116.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:20.062 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/232 2023-05-12T10:50:20.063 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/232 2023-05-12T10:50:20.063 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:20.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:20.106 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-05-12T10:50:20.695 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:20.707 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:21.115 INFO:teuthology.orchestra.run.smithi116.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:21.127 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/233 2023-05-12T10:50:21.127 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/233 2023-05-12T10:50:21.128 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:21.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:21.174 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-05-12T10:50:21.760 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:21.777 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:21.777 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:22.187 INFO:teuthology.orchestra.run.smithi116.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:22.199 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/234 2023-05-12T10:50:22.200 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/234 2023-05-12T10:50:22.200 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:22.206 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:22.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:22.238 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-05-12T10:50:22.845 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:22.866 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:23.315 INFO:teuthology.orchestra.run.smithi116.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:23.329 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/235 2023-05-12T10:50:23.329 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/235 2023-05-12T10:50:23.329 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:23.339 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:23.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:23.373 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-05-12T10:50:23.978 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:23.997 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:23.998 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:25.605 INFO:teuthology.orchestra.run.smithi116.stdout:generic/236 1s 2023-05-12T10:50:25.625 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/236 2023-05-12T10:50:25.625 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:25.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:25.671 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-05-12T10:50:26.505 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:26.522 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:27.043 INFO:teuthology.orchestra.run.smithi116.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-12T10:50:27.053 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/237 2023-05-12T10:50:27.053 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/237 2023-05-12T10:50:27.053 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:27.060 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:27.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:27.094 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-05-12T10:50:27.674 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:27.693 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:27.693 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:28.109 INFO:teuthology.orchestra.run.smithi116.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:50:28.122 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/238 2023-05-12T10:50:28.123 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/238 2023-05-12T10:50:28.123 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:50:28.132 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:28.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:50:28.160 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-05-12T10:50:28.764 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:50:28.778 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:50:28.779 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:50:44.080 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:50:44.087 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:51:14.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:51:14.321 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:51:45.067 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:51:45.082 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:52:15.311 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:52:15.357 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:52:45.589 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:52:45.603 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:52:45.820 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T10:52:45.815+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 304950) UID: 0 2023-05-12T10:52:45.820 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T10:52:45.816+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 304950) UID: 0 2023-05-12T10:52:45.821 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T10:52:45.816+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 304950) UID: 0 2023-05-12T10:52:45.821 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T10:52:45.816+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 304950) UID: 0 2023-05-12T10:52:51.583 INFO:teuthology.orchestra.run.smithi116.stdout:generic/239 143s 2023-05-12T10:52:51.603 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/239 2023-05-12T10:52:51.603 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:52:51.643 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:52:51.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:52:51.684 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-05-12T10:52:52.680 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:52:52.695 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:52:52.696 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:52:57.173 INFO:teuthology.orchestra.run.smithi116.stdout:generic/240 5s 2023-05-12T10:52:57.221 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/240 2023-05-12T10:52:57.222 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:52:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:52:57.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:52:57.259 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-05-12T10:52:58.712 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:52:58.731 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:52:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:13.445 INFO:teuthology.orchestra.run.smithi116.stdout:generic/241 75s 2023-05-12T10:54:13.462 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/241 2023-05-12T10:54:13.462 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:54:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:13.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:54:13.512 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-05-12T10:54:14.544 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:54:14.559 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:54:14.560 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:15.056 INFO:teuthology.orchestra.run.smithi116.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:54:15.068 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/242 2023-05-12T10:54:15.068 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/242 2023-05-12T10:54:15.068 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:54:15.076 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:15.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:54:15.108 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-05-12T10:54:15.796 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:54:15.814 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:54:15.814 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:16.330 INFO:teuthology.orchestra.run.smithi116.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:54:16.346 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/243 2023-05-12T10:54:16.346 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/243 2023-05-12T10:54:16.347 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:54:16.357 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:16.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:54:16.391 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-05-12T10:54:17.052 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:54:17.076 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:54:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:18.171 INFO:teuthology.orchestra.run.smithi116.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-12T10:54:18.183 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/244 2023-05-12T10:54:18.184 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/244 2023-05-12T10:54:18.184 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:54:18.191 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:18.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:54:18.229 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-05-12T10:54:18.858 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:54:18.876 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:54:18.877 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:19.673 INFO:teuthology.orchestra.run.smithi116.stdout:generic/245 1s 2023-05-12T10:54:20.253 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/245 2023-05-12T10:54:20.253 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:54:20.262 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:20.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:54:20.297 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-05-12T10:54:21.194 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:54:21.218 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:54:21.219 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:23.304 INFO:teuthology.orchestra.run.smithi116.stdout:generic/246 2s 2023-05-12T10:54:23.323 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/246 2023-05-12T10:54:23.323 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:54:23.332 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:54:23.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:54:23.377 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-05-12T10:54:24.377 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:54:24.401 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:54:24.401 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:22.320 INFO:teuthology.orchestra.run.smithi116.stdout:generic/247 58s 2023-05-12T10:55:22.337 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/247 2023-05-12T10:55:22.338 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:22.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:22.376 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-05-12T10:55:23.892 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:23.908 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:24.557 INFO:teuthology.orchestra.run.smithi116.stdout:generic/248 1s 2023-05-12T10:55:24.579 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/248 2023-05-12T10:55:24.580 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:24.589 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:24.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:24.624 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-05-12T10:55:25.291 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:25.307 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:25.308 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:29.637 INFO:teuthology.orchestra.run.smithi116.stdout:generic/249 4s 2023-05-12T10:55:29.655 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/249 2023-05-12T10:55:29.655 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:29.668 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:29.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:29.706 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-05-12T10:55:30.719 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:30.735 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:30.735 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:31.296 INFO:teuthology.orchestra.run.smithi116.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:55:31.311 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/250 2023-05-12T10:55:31.311 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/250 2023-05-12T10:55:31.311 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:31.317 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:31.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:31.349 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-05-12T10:55:32.024 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:32.045 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:32.046 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:32.508 INFO:teuthology.orchestra.run.smithi116.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:55:32.525 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/251 2023-05-12T10:55:32.525 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/251 2023-05-12T10:55:32.525 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:32.533 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:32.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:32.573 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-05-12T10:55:33.235 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:33.258 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:33.258 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:33.767 INFO:teuthology.orchestra.run.smithi116.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:55:33.784 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/252 2023-05-12T10:55:33.784 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/252 2023-05-12T10:55:33.785 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:33.793 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:33.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:33.833 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-05-12T10:55:34.507 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:34.523 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:34.993 INFO:teuthology.orchestra.run.smithi116.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:55:35.005 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/253 2023-05-12T10:55:35.006 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/253 2023-05-12T10:55:35.006 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:35.016 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:35.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:35.051 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-05-12T10:55:35.726 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:35.747 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:35.747 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:36.238 INFO:teuthology.orchestra.run.smithi116.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:55:36.251 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/254 2023-05-12T10:55:36.252 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/254 2023-05-12T10:55:36.252 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:36.258 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:36.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:36.287 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-05-12T10:55:36.956 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:36.967 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:40.168 INFO:teuthology.orchestra.run.smithi116.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T10:55:40.182 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/255 2023-05-12T10:55:40.183 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/255 2023-05-12T10:55:40.183 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:40.321 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:40.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:40.354 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-05-12T10:55:41.303 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:41.329 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:41.330 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:44.047 INFO:teuthology.orchestra.run.smithi116.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:55:44.061 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/256 2023-05-12T10:55:44.062 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/256 2023-05-12T10:55:44.062 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:44.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:44.105 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-05-12T10:55:44.794 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:44.810 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:44.810 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:47.810 INFO:teuthology.orchestra.run.smithi116.stdout:generic/257 3s 2023-05-12T10:55:47.829 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/257 2023-05-12T10:55:47.829 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:47.839 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:47.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:47.872 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-05-12T10:55:48.891 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:48.908 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:48.908 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:49.486 INFO:teuthology.orchestra.run.smithi116.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/258.out.bad) 2023-05-12T10:55:49.496 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/258.out 2023-05-12 09:09:18.862490364 +0000 2023-05-12T10:55:49.496 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/258.out.bad 2023-05-12 10:55:49.478613391 +0000 2023-05-12T10:55:49.497 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1,5 +1,6 @@ 2023-05-12T10:55:49.497 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 258 2023-05-12T10:55:49.497 INFO:teuthology.orchestra.run.smithi116.stdout: Creating file with timestamp of Jan 1, 1960 2023-05-12T10:55:49.497 INFO:teuthology.orchestra.run.smithi116.stdout: Testing for negative seconds since epoch 2023-05-12T10:55:49.497 INFO:teuthology.orchestra.run.smithi116.stdout: -Remounting to flush cache 2023-05-12T10:55:49.497 INFO:teuthology.orchestra.run.smithi116.stdout: -Testing for negative seconds since epoch 2023-05-12T10:55:49.498 INFO:teuthology.orchestra.run.smithi116.stdout: +Timestamp wrapped: 3979351756 2023-05-12T10:55:49.498 INFO:teuthology.orchestra.run.smithi116.stdout: +Timestamp wrapped 2023-05-12T10:55:49.498 INFO:teuthology.orchestra.run.smithi116.stdout: +(see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/258.full for details) 2023-05-12T10:55:49.505 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/258 2023-05-12T10:55:49.505 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/258 2023-05-12T10:55:49.505 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T10:55:49.513 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:49.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T10:55:49.541 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T10:55:49.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T10:55:49.542 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-05-12T10:55:50.491 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:50.515 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:50.515 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:51.318 INFO:teuthology.orchestra.run.smithi116.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:55:51.333 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/259 2023-05-12T10:55:51.333 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/259 2023-05-12T10:55:51.333 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:51.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:51.381 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-05-12T10:55:52.054 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:52.075 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:52.076 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:52.562 INFO:teuthology.orchestra.run.smithi116.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:55:52.579 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/260 2023-05-12T10:55:52.579 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/260 2023-05-12T10:55:52.579 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:52.589 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:52.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:52.630 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-05-12T10:55:53.339 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:53.358 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:53.358 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:53.854 INFO:teuthology.orchestra.run.smithi116.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:55:53.867 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/261 2023-05-12T10:55:53.868 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/261 2023-05-12T10:55:53.868 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:53.878 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:53.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:53.918 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-05-12T10:55:54.607 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:54.621 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:55.098 INFO:teuthology.orchestra.run.smithi116.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:55:55.111 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/262 2023-05-12T10:55:55.112 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/262 2023-05-12T10:55:55.112 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:55:55.121 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:55:55.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:55:55.165 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-05-12T10:55:55.865 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:55:55.890 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:55:55.890 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:56:45.154 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:56:45.159 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:56:45.416 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T10:56:45.412+0000 7f4e7fbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146600) UID: 0 2023-05-12T10:56:45.416 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T10:56:45.412+0000 7fb0059f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146600) UID: 0 2023-05-12T10:56:45.417 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T10:56:45.412+0000 7fe44e3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146600) UID: 0 2023-05-12T10:56:45.417 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T10:56:45.412+0000 7f02559f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146600) UID: 0 2023-05-12T10:56:59.586 INFO:teuthology.orchestra.run.smithi116.stdout:generic/263 64s 2023-05-12T10:56:59.597 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/263 2023-05-12T10:56:59.597 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:56:59.603 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:56:59.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:56:59.643 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-05-12T10:57:00.347 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:00.358 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:00.358 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:00.661 INFO:teuthology.orchestra.run.smithi116.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:00.669 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/264 2023-05-12T10:57:00.669 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/264 2023-05-12T10:57:00.669 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:00.675 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:00.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:00.695 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-05-12T10:57:01.080 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:01.091 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:03.414 INFO:teuthology.orchestra.run.smithi116.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:03.424 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/265 2023-05-12T10:57:03.424 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/265 2023-05-12T10:57:03.424 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:03.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:03.451 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-05-12T10:57:03.835 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:03.846 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:04.202 INFO:teuthology.orchestra.run.smithi116.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:04.210 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/266 2023-05-12T10:57:04.210 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/266 2023-05-12T10:57:04.210 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:04.215 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:04.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:04.235 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-05-12T10:57:04.616 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:04.627 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:04.627 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:04.928 INFO:teuthology.orchestra.run.smithi116.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:04.936 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/267 2023-05-12T10:57:04.936 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/267 2023-05-12T10:57:04.937 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:04.942 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:04.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:04.961 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-05-12T10:57:05.343 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:05.354 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:05.660 INFO:teuthology.orchestra.run.smithi116.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:05.668 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/268 2023-05-12T10:57:05.668 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/268 2023-05-12T10:57:05.668 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:05.673 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:05.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:05.693 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-05-12T10:57:06.080 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:06.091 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:06.091 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:06.366 INFO:teuthology.orchestra.run.smithi116.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:06.374 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/269 2023-05-12T10:57:06.374 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/269 2023-05-12T10:57:06.374 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:06.379 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:06.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:06.399 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-05-12T10:57:06.782 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:06.793 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:07.083 INFO:teuthology.orchestra.run.smithi116.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-12T10:57:07.091 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/270 2023-05-12T10:57:07.092 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/270 2023-05-12T10:57:07.092 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:07.097 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:07.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:07.117 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-05-12T10:57:07.506 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:07.517 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:07.517 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:07.824 INFO:teuthology.orchestra.run.smithi116.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:07.832 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/271 2023-05-12T10:57:07.832 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/271 2023-05-12T10:57:07.833 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:07.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:07.858 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-05-12T10:57:08.243 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:08.254 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:08.561 INFO:teuthology.orchestra.run.smithi116.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:08.569 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/272 2023-05-12T10:57:08.570 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/272 2023-05-12T10:57:08.570 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:08.575 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:08.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:08.595 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-05-12T10:57:08.981 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:08.992 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:08.993 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:09.271 INFO:teuthology.orchestra.run.smithi116.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:09.279 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/273 2023-05-12T10:57:09.279 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/273 2023-05-12T10:57:09.280 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:09.284 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:09.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:09.304 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-05-12T10:57:09.698 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:09.709 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:09.709 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:09.990 INFO:teuthology.orchestra.run.smithi116.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:09.998 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/274 2023-05-12T10:57:09.999 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/274 2023-05-12T10:57:09.999 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:10.004 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:10.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:10.024 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-05-12T10:57:10.405 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:10.416 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:10.416 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:10.691 INFO:teuthology.orchestra.run.smithi116.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:10.699 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/275 2023-05-12T10:57:10.699 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/275 2023-05-12T10:57:10.699 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:10.705 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:10.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:10.725 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-05-12T10:57:11.105 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:11.116 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:11.116 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:11.431 INFO:teuthology.orchestra.run.smithi116.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:11.439 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/276 2023-05-12T10:57:11.439 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/276 2023-05-12T10:57:11.439 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:11.445 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:11.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:11.465 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-05-12T10:57:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:11.857 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:12.142 INFO:teuthology.orchestra.run.smithi116.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:12.150 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/277 2023-05-12T10:57:12.150 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/277 2023-05-12T10:57:12.150 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:12.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:12.175 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-05-12T10:57:12.554 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:12.565 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:12.565 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:12.872 INFO:teuthology.orchestra.run.smithi116.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:12.880 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/278 2023-05-12T10:57:12.880 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/278 2023-05-12T10:57:12.880 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:12.885 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:12.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:12.905 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-05-12T10:57:13.284 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:13.295 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:13.296 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:13.604 INFO:teuthology.orchestra.run.smithi116.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:13.612 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/279 2023-05-12T10:57:13.612 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/279 2023-05-12T10:57:13.613 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:13.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:13.638 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-05-12T10:57:14.026 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:14.037 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:14.037 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:14.359 INFO:teuthology.orchestra.run.smithi116.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:14.367 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/280 2023-05-12T10:57:14.367 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/280 2023-05-12T10:57:14.368 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:14.373 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:14.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:14.392 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-05-12T10:57:14.777 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:14.788 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:14.788 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:15.093 INFO:teuthology.orchestra.run.smithi116.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:15.101 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/281 2023-05-12T10:57:15.101 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/281 2023-05-12T10:57:15.101 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:15.106 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:15.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:15.125 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-05-12T10:57:15.507 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:15.518 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:15.827 INFO:teuthology.orchestra.run.smithi116.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:15.835 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/282 2023-05-12T10:57:15.835 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/282 2023-05-12T10:57:15.836 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:15.841 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:15.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:15.861 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-05-12T10:57:16.243 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:16.254 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:16.254 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:16.562 INFO:teuthology.orchestra.run.smithi116.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:16.570 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/283 2023-05-12T10:57:16.570 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/283 2023-05-12T10:57:16.571 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:16.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:16.596 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-05-12T10:57:16.977 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:16.988 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:17.267 INFO:teuthology.orchestra.run.smithi116.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:57:17.275 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/284 2023-05-12T10:57:17.275 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/284 2023-05-12T10:57:17.276 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:17.281 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:17.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:17.301 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-05-12T10:57:17.683 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:17.694 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:17.695 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:20.107 INFO:teuthology.orchestra.run.smithi116.stdout:generic/285 3s 2023-05-12T10:57:20.118 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/285 2023-05-12T10:57:20.119 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:57:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:57:20.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:57:20.144 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-05-12T10:57:20.859 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:57:20.870 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:57:20.870 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:13.384 INFO:teuthology.orchestra.run.smithi116.stdout:generic/286 53s 2023-05-12T10:58:13.396 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/286 2023-05-12T10:58:13.396 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:13.401 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:13.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:13.422 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-05-12T10:58:14.226 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:14.239 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:14.523 INFO:teuthology.orchestra.run.smithi116.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:14.531 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/287 2023-05-12T10:58:14.531 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/287 2023-05-12T10:58:14.532 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:14.537 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:14.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:14.557 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-05-12T10:58:14.938 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:14.949 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:14.949 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:15.224 INFO:teuthology.orchestra.run.smithi116.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:15.232 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/288 2023-05-12T10:58:15.232 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/288 2023-05-12T10:58:15.232 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:15.238 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:15.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:15.257 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-05-12T10:58:15.641 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:15.652 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:15.652 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:15.934 INFO:teuthology.orchestra.run.smithi116.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:15.942 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/289 2023-05-12T10:58:15.942 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/289 2023-05-12T10:58:15.942 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:15.947 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:15.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:15.967 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-05-12T10:58:16.348 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:16.359 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:16.360 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:16.647 INFO:teuthology.orchestra.run.smithi116.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:16.655 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/290 2023-05-12T10:58:16.655 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/290 2023-05-12T10:58:16.656 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:16.661 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:16.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:16.680 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-05-12T10:58:17.066 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:17.077 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:17.358 INFO:teuthology.orchestra.run.smithi116.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:17.366 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/291 2023-05-12T10:58:17.366 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/291 2023-05-12T10:58:17.366 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:17.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:17.392 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-05-12T10:58:17.774 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:17.785 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:17.785 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:18.071 INFO:teuthology.orchestra.run.smithi116.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/292 2023-05-12T10:58:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/292 2023-05-12T10:58:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:18.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:18.103 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-05-12T10:58:18.490 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:18.501 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:18.777 INFO:teuthology.orchestra.run.smithi116.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:18.785 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/293 2023-05-12T10:58:18.785 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/293 2023-05-12T10:58:18.786 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:18.791 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:18.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:18.810 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-05-12T10:58:19.197 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:19.208 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:19.208 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:19.480 INFO:teuthology.orchestra.run.smithi116.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:19.488 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/294 2023-05-12T10:58:19.489 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/294 2023-05-12T10:58:19.489 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:19.494 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:19.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:19.515 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-05-12T10:58:19.904 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:19.915 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:19.915 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:20.193 INFO:teuthology.orchestra.run.smithi116.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:20.201 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/295 2023-05-12T10:58:20.201 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/295 2023-05-12T10:58:20.202 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:20.206 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:20.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:20.226 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-05-12T10:58:20.622 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:20.633 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:20.911 INFO:teuthology.orchestra.run.smithi116.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:20.919 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/296 2023-05-12T10:58:20.920 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/296 2023-05-12T10:58:20.920 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:20.925 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:20.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:20.945 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-05-12T10:58:21.330 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:21.341 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:21.342 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:21.620 INFO:teuthology.orchestra.run.smithi116.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:21.629 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/297 2023-05-12T10:58:21.629 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/297 2023-05-12T10:58:21.629 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:21.634 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:21.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:21.655 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-05-12T10:58:22.036 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:22.047 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:22.047 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:22.332 INFO:teuthology.orchestra.run.smithi116.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:22.340 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/298 2023-05-12T10:58:22.340 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/298 2023-05-12T10:58:22.340 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:22.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:22.365 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-05-12T10:58:22.749 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:22.759 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:22.760 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:23.043 INFO:teuthology.orchestra.run.smithi116.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:23.051 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/299 2023-05-12T10:58:23.051 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/299 2023-05-12T10:58:23.051 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:23.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:23.077 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-05-12T10:58:23.459 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:23.470 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:23.471 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:23.750 INFO:teuthology.orchestra.run.smithi116.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:23.758 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/300 2023-05-12T10:58:23.758 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/300 2023-05-12T10:58:23.758 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:23.763 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:23.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:23.783 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-05-12T10:58:24.165 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:24.176 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:24.176 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:24.453 INFO:teuthology.orchestra.run.smithi116.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:24.461 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/301 2023-05-12T10:58:24.461 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/301 2023-05-12T10:58:24.461 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:24.467 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:24.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:24.486 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-05-12T10:58:24.872 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:24.883 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:24.884 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:25.166 INFO:teuthology.orchestra.run.smithi116.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:25.174 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/302 2023-05-12T10:58:25.174 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/302 2023-05-12T10:58:25.174 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:25.179 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:25.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:25.199 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-05-12T10:58:25.586 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:25.597 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:25.959 INFO:teuthology.orchestra.run.smithi116.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T10:58:25.967 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/303 2023-05-12T10:58:25.967 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/303 2023-05-12T10:58:25.967 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:25.972 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:26.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:26.036 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-05-12T10:58:26.692 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:26.703 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:26.703 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:27.080 INFO:teuthology.orchestra.run.smithi116.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-12T10:58:27.089 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/304 2023-05-12T10:58:27.089 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/304 2023-05-12T10:58:27.089 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:27.094 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:27.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:27.113 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-05-12T10:58:27.818 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:27.831 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:27.831 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:28.112 INFO:teuthology.orchestra.run.smithi116.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:28.120 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/305 2023-05-12T10:58:28.120 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/305 2023-05-12T10:58:28.121 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:28.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:28.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:28.145 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-05-12T10:58:28.528 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:28.539 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:28.540 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:28.817 INFO:teuthology.orchestra.run.smithi116.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:28.825 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/306 2023-05-12T10:58:28.825 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/306 2023-05-12T10:58:28.825 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:28.831 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:28.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:28.850 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-05-12T10:58:29.232 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:29.243 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:29.243 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:29.525 INFO:teuthology.orchestra.run.smithi116.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T10:58:29.533 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/307 2023-05-12T10:58:29.534 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/307 2023-05-12T10:58:29.534 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:29.539 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:29.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:29.559 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-05-12T10:58:29.948 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:29.959 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:29.959 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:30.296 INFO:teuthology.orchestra.run.smithi116.stdout:generic/308 1s 2023-05-12T10:58:30.308 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/308 2023-05-12T10:58:30.308 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:30.313 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:30.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:30.333 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-05-12T10:58:30.728 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:30.739 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:30.740 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:33.226 INFO:teuthology.orchestra.run.smithi116.stdout:generic/309 3s 2023-05-12T10:58:33.238 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/309 2023-05-12T10:58:33.238 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T10:58:33.244 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:58:33.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T10:58:33.282 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-05-12T10:58:33.952 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T10:58:33.963 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T10:58:33.963 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T10:59:25.656 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:59:25.660 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:59:55.766 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T10:59:55.770 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:00:03.535 INFO:teuthology.orchestra.run.smithi116.stdout:generic/310 90s 2023-05-12T11:00:03.547 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/310 2023-05-12T11:00:03.547 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:03.552 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:03.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:03.594 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-05-12T11:00:04.349 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:04.361 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:04.361 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:04.916 INFO:teuthology.orchestra.run.smithi116.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:00:04.924 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/311 2023-05-12T11:00:04.925 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/311 2023-05-12T11:00:04.925 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:04.930 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:04.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:04.949 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-05-12T11:00:05.343 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:05.354 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:05.667 INFO:teuthology.orchestra.run.smithi116.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:00:05.675 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/312 2023-05-12T11:00:05.675 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/312 2023-05-12T11:00:05.675 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:05.681 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:05.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:05.701 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-05-12T11:00:06.082 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:06.093 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:06.094 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:10.480 INFO:teuthology.orchestra.run.smithi116.stdout:generic/313 4s 2023-05-12T11:00:10.493 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/313 2023-05-12T11:00:10.493 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:10.499 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:10.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:10.519 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-05-12T11:00:10.913 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:10.924 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:10.925 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:11.703 INFO:teuthology.orchestra.run.smithi116.stdout:generic/314 1s 2023-05-12T11:00:11.714 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/314 2023-05-12T11:00:11.714 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:11.719 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:11.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:11.739 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-05-12T11:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:15.813 INFO:teuthology.orchestra.run.smithi116.stdout:generic/315 3s 2023-05-12T11:00:15.825 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/315 2023-05-12T11:00:15.825 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:15.831 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:15.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:15.893 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-05-12T11:00:16.566 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:16.576 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:18.173 INFO:teuthology.orchestra.run.smithi116.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T11:00:18.181 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/316 2023-05-12T11:00:18.181 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/316 2023-05-12T11:00:18.181 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:18.186 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:18.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:18.207 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-05-12T11:00:18.897 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:18.908 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:18.908 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:19.190 INFO:teuthology.orchestra.run.smithi116.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:00:19.198 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/317 2023-05-12T11:00:19.198 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/317 2023-05-12T11:00:19.198 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:19.204 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:19.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:19.228 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-05-12T11:00:19.613 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:19.624 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:19.624 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:19.899 INFO:teuthology.orchestra.run.smithi116.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:00:19.907 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/318 2023-05-12T11:00:19.907 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/318 2023-05-12T11:00:19.907 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:19.912 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:19.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:19.931 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-05-12T11:00:20.318 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:20.329 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:20.329 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:20.685 INFO:teuthology.orchestra.run.smithi116.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-12T11:00:20.693 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/319 2023-05-12T11:00:20.693 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/319 2023-05-12T11:00:20.693 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:20.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:20.718 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-05-12T11:00:21.113 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:21.124 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:21.406 INFO:teuthology.orchestra.run.smithi116.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:00:21.414 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/320 2023-05-12T11:00:21.414 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/320 2023-05-12T11:00:21.415 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:21.420 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:21.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:21.440 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-05-12T11:00:21.836 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:21.847 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:21.848 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:22.152 INFO:teuthology.orchestra.run.smithi116.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:00:22.160 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/321 2023-05-12T11:00:22.160 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/321 2023-05-12T11:00:22.160 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:22.165 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:22.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:22.186 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-05-12T11:00:22.577 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:22.588 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:22.588 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:22.889 INFO:teuthology.orchestra.run.smithi116.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:00:22.897 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/322 2023-05-12T11:00:22.897 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/322 2023-05-12T11:00:22.898 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:00:22.903 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:22.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:00:22.922 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-05-12T11:00:23.309 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:00:23.320 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:00:23.320 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:00:25.880 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:00:25.886 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:00:56.289 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:00:56.294 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:01:28.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:01:28.846 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:01:58.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:01:58.995 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:02:26.998 INFO:teuthology.orchestra.run.smithi116.stdout:generic/323 123s 2023-05-12T11:02:27.012 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/323 2023-05-12T11:02:27.012 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:27.018 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:27.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:27.086 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-05-12T11:02:27.747 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:27.758 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:27.758 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:28.098 INFO:teuthology.orchestra.run.smithi116.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:28.106 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/324 2023-05-12T11:02:28.107 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/324 2023-05-12T11:02:28.107 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:28.112 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:28.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:28.131 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-05-12T11:02:28.520 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:28.531 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:28.532 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:28.893 INFO:teuthology.orchestra.run.smithi116.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:28.901 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/325 2023-05-12T11:02:28.902 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/325 2023-05-12T11:02:28.902 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:28.907 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:28.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:28.926 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-05-12T11:02:29.309 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:29.320 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:29.320 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:29.601 INFO:teuthology.orchestra.run.smithi116.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:29.609 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/326 2023-05-12T11:02:29.609 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/326 2023-05-12T11:02:29.610 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:29.614 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:29.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:29.633 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-05-12T11:02:30.017 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:30.028 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:30.311 INFO:teuthology.orchestra.run.smithi116.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:30.319 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/327 2023-05-12T11:02:30.319 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/327 2023-05-12T11:02:30.319 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:30.324 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:30.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:30.343 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-05-12T11:02:30.729 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:30.740 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:30.740 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:31.024 INFO:teuthology.orchestra.run.smithi116.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:31.032 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/328 2023-05-12T11:02:31.032 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/328 2023-05-12T11:02:31.033 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:31.038 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:31.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:31.056 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-05-12T11:02:31.446 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:31.457 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:31.767 INFO:teuthology.orchestra.run.smithi116.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:31.775 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/329 2023-05-12T11:02:31.775 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/329 2023-05-12T11:02:31.775 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:31.780 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:31.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:31.800 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-05-12T11:02:32.105 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:02:32.108 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:02:32.189 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:32.200 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:32.201 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:32.228 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T11:02:32.224+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 398987) UID: 0 2023-05-12T11:02:32.228 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T11:02:32.224+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 398987) UID: 0 2023-05-12T11:02:32.229 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T11:02:32.224+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 398987) UID: 0 2023-05-12T11:02:32.229 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T11:02:32.224+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 398987) UID: 0 2023-05-12T11:02:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:32.489 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/330 2023-05-12T11:02:32.489 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/330 2023-05-12T11:02:32.489 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:32.494 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:32.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:32.516 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-05-12T11:02:32.911 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:32.922 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:32.922 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:33.853 INFO:teuthology.orchestra.run.smithi116.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:33.862 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/331 2023-05-12T11:02:33.862 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/331 2023-05-12T11:02:33.862 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:33.868 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:33.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:33.887 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-05-12T11:02:34.278 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:34.290 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:34.290 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:34.572 INFO:teuthology.orchestra.run.smithi116.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:34.581 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/332 2023-05-12T11:02:34.581 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/332 2023-05-12T11:02:34.581 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:34.587 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:34.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:34.608 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-05-12T11:02:35.033 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:35.045 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:35.046 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:35.358 INFO:teuthology.orchestra.run.smithi116.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:35.367 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/333 2023-05-12T11:02:35.367 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/333 2023-05-12T11:02:35.367 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:35.372 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:35.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:35.392 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-05-12T11:02:35.790 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:35.800 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:36.116 INFO:teuthology.orchestra.run.smithi116.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:36.124 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/334 2023-05-12T11:02:36.124 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/334 2023-05-12T11:02:36.124 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:36.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:36.149 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-05-12T11:02:36.543 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:36.554 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:36.935 INFO:teuthology.orchestra.run.smithi116.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:36.944 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/335 2023-05-12T11:02:36.944 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/335 2023-05-12T11:02:36.944 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:36.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:36.968 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-05-12T11:02:37.352 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:37.363 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:37.698 INFO:teuthology.orchestra.run.smithi116.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:37.707 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/336 2023-05-12T11:02:37.707 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/336 2023-05-12T11:02:37.707 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:37.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:37.732 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-05-12T11:02:38.121 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:38.132 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:38.132 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:38.423 INFO:teuthology.orchestra.run.smithi116.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:38.431 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/337 2023-05-12T11:02:38.431 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/337 2023-05-12T11:02:38.432 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:38.437 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:38.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:38.457 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-05-12T11:02:38.843 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:38.854 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:38.854 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:39.186 INFO:teuthology.orchestra.run.smithi116.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:39.195 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/338 2023-05-12T11:02:39.195 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/338 2023-05-12T11:02:39.195 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:39.200 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:39.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:39.222 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-05-12T11:02:39.610 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:39.621 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:39.621 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:39.935 INFO:teuthology.orchestra.run.smithi116.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:39.943 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/339 2023-05-12T11:02:39.943 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/339 2023-05-12T11:02:39.943 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:39.949 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:39.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:39.969 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-05-12T11:02:40.374 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:40.385 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:40.385 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:40.659 INFO:teuthology.orchestra.run.smithi116.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:40.668 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/340 2023-05-12T11:02:40.668 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/340 2023-05-12T11:02:40.668 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:40.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:40.695 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-05-12T11:02:41.092 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:41.103 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:41.598 INFO:teuthology.orchestra.run.smithi116.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:41.606 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/341 2023-05-12T11:02:41.606 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/341 2023-05-12T11:02:41.606 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:41.611 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:41.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:41.632 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-05-12T11:02:42.064 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:42.076 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:42.076 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:42.425 INFO:teuthology.orchestra.run.smithi116.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:42.433 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/342 2023-05-12T11:02:42.434 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/342 2023-05-12T11:02:42.434 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:42.439 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:42.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:42.459 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-05-12T11:02:42.858 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:42.870 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:43.199 INFO:teuthology.orchestra.run.smithi116.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:43.208 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/343 2023-05-12T11:02:43.208 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/343 2023-05-12T11:02:43.209 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:43.215 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:43.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:43.236 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-05-12T11:02:43.630 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:43.642 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:43.642 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:43.923 INFO:teuthology.orchestra.run.smithi116.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:43.931 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/344 2023-05-12T11:02:43.931 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/344 2023-05-12T11:02:43.931 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:43.937 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:43.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:43.957 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-05-12T11:02:44.353 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:44.364 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:44.365 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:44.650 INFO:teuthology.orchestra.run.smithi116.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:44.658 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/345 2023-05-12T11:02:44.658 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/345 2023-05-12T11:02:44.658 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:44.663 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:44.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:44.683 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-05-12T11:02:45.075 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:45.086 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:45.371 INFO:teuthology.orchestra.run.smithi116.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:45.380 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/346 2023-05-12T11:02:45.380 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/346 2023-05-12T11:02:45.380 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:45.385 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:45.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:45.405 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-05-12T11:02:45.799 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:45.810 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:45.810 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:46.426 INFO:teuthology.orchestra.run.smithi116.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:46.441 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/347 2023-05-12T11:02:46.441 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/347 2023-05-12T11:02:46.441 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:46.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:46.493 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-05-12T11:02:47.132 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:47.175 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:47.176 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:47.689 INFO:teuthology.orchestra.run.smithi116.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:47.697 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/348 2023-05-12T11:02:47.697 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/348 2023-05-12T11:02:47.697 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:47.702 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:47.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:47.722 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-05-12T11:02:48.419 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:48.430 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:48.431 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:50.413 INFO:teuthology.orchestra.run.smithi116.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-12T11:02:50.422 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/349 2023-05-12T11:02:50.423 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/349 2023-05-12T11:02:50.423 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:50.429 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:50.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:50.449 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-05-12T11:02:50.849 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:50.860 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:50.860 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:53.512 INFO:teuthology.orchestra.run.smithi116.stdout:generic/350 3s 2023-05-12T11:02:53.546 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/350 2023-05-12T11:02:53.546 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:53.552 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:53.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:53.572 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-05-12T11:02:53.968 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:53.979 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:55.683 INFO:teuthology.orchestra.run.smithi116.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-12T11:02:55.691 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/351 2023-05-12T11:02:55.692 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/351 2023-05-12T11:02:55.692 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:55.697 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:55.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:55.717 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-05-12T11:02:56.459 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:56.471 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:56.471 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:56.965 INFO:teuthology.orchestra.run.smithi116.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:56.974 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/352 2023-05-12T11:02:56.974 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/352 2023-05-12T11:02:56.975 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:56.981 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:57.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:57.001 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-05-12T11:02:57.391 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:57.403 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:57.403 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:57.704 INFO:teuthology.orchestra.run.smithi116.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:57.713 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/353 2023-05-12T11:02:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/353 2023-05-12T11:02:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:57.720 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:57.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:57.741 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-05-12T11:02:58.147 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:58.158 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:58.449 INFO:teuthology.orchestra.run.smithi116.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:02:58.457 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/354 2023-05-12T11:02:58.458 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/354 2023-05-12T11:02:58.458 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:02:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:02:58.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:02:58.483 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-05-12T11:02:58.879 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:02:58.890 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:02:58.890 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:00.286 INFO:teuthology.orchestra.run.smithi116.stdout:generic/355 2s 2023-05-12T11:03:00.298 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/355 2023-05-12T11:03:00.299 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:00.305 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:00.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:00.326 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-05-12T11:03:01.083 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:01.094 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:01.496 INFO:teuthology.orchestra.run.smithi116.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:01.504 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/356 2023-05-12T11:03:01.505 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/356 2023-05-12T11:03:01.505 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:01.510 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:01.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:01.531 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-05-12T11:03:01.921 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:01.932 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:01.932 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:02.221 INFO:teuthology.orchestra.run.smithi116.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:02.229 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/357 2023-05-12T11:03:02.229 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/357 2023-05-12T11:03:02.229 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:02.235 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:02.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:02.255 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-05-12T11:03:02.654 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:02.665 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:02.666 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:02.958 INFO:teuthology.orchestra.run.smithi116.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:02.966 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/358 2023-05-12T11:03:02.967 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/358 2023-05-12T11:03:02.967 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:02.972 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:02.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:02.992 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-05-12T11:03:03.386 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:03.397 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:03.397 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:03.690 INFO:teuthology.orchestra.run.smithi116.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:03.699 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/359 2023-05-12T11:03:03.700 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/359 2023-05-12T11:03:03.700 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:03.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:03.726 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-05-12T11:03:04.129 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:04.140 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:04.141 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:04.668 INFO:teuthology.orchestra.run.smithi116.stdout:generic/360 0s 2023-05-12T11:03:04.680 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/360 2023-05-12T11:03:04.680 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:04.685 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:04.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:04.706 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-05-12T11:03:05.110 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:05.121 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:05.620 INFO:teuthology.orchestra.run.smithi116.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/361 2023-05-12T11:03:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/361 2023-05-12T11:03:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:05.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:05.654 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-05-12T11:03:06.058 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:06.070 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:06.070 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:06.373 INFO:teuthology.orchestra.run.smithi116.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:06.382 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/362 2023-05-12T11:03:06.382 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/362 2023-05-12T11:03:06.383 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:06.389 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:06.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:06.409 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-05-12T11:03:06.804 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:06.815 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:07.113 INFO:teuthology.orchestra.run.smithi116.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:07.121 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/363 2023-05-12T11:03:07.121 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/363 2023-05-12T11:03:07.122 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:07.127 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:07.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:07.147 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-05-12T11:03:07.547 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:07.558 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:07.558 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:07.885 INFO:teuthology.orchestra.run.smithi116.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:07.893 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/364 2023-05-12T11:03:07.893 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/364 2023-05-12T11:03:07.893 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:07.899 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:07.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:07.919 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-05-12T11:03:08.314 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:08.325 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:08.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:08.606 INFO:teuthology.orchestra.run.smithi116.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:08.614 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/365 2023-05-12T11:03:08.615 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/365 2023-05-12T11:03:08.615 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:08.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:08.642 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-05-12T11:03:09.037 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:09.048 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:09.323 INFO:teuthology.orchestra.run.smithi116.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:09.331 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/366 2023-05-12T11:03:09.332 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/366 2023-05-12T11:03:09.332 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:09.337 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:09.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:09.356 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-05-12T11:03:09.754 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:09.765 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:09.765 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:10.054 INFO:teuthology.orchestra.run.smithi116.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:10.062 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/367 2023-05-12T11:03:10.062 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/367 2023-05-12T11:03:10.063 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:10.068 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:10.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:10.088 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-05-12T11:03:10.478 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:10.490 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:10.490 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:10.770 INFO:teuthology.orchestra.run.smithi116.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:10.779 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/368 2023-05-12T11:03:10.779 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/368 2023-05-12T11:03:10.779 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:10.784 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:10.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:10.804 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-05-12T11:03:11.192 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:11.203 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:11.477 INFO:teuthology.orchestra.run.smithi116.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:11.485 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/369 2023-05-12T11:03:11.485 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/369 2023-05-12T11:03:11.486 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:11.491 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:11.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:11.511 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-05-12T11:03:11.901 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:11.912 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:11.913 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:12.197 INFO:teuthology.orchestra.run.smithi116.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:12.206 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/370 2023-05-12T11:03:12.206 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/370 2023-05-12T11:03:12.206 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:12.258 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:12.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:12.277 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-05-12T11:03:12.687 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:12.698 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:12.981 INFO:teuthology.orchestra.run.smithi116.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:12.989 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/371 2023-05-12T11:03:12.989 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/371 2023-05-12T11:03:12.989 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:12.994 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:13.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:13.016 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-05-12T11:03:13.407 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:13.418 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:13.419 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:13.700 INFO:teuthology.orchestra.run.smithi116.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:13.709 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/372 2023-05-12T11:03:13.709 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/372 2023-05-12T11:03:13.709 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:13.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:13.735 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-05-12T11:03:14.132 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:14.143 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:14.144 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:14.428 INFO:teuthology.orchestra.run.smithi116.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:14.436 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/373 2023-05-12T11:03:14.436 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/373 2023-05-12T11:03:14.436 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:14.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:14.461 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-05-12T11:03:14.849 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:14.860 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:14.860 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:15.138 INFO:teuthology.orchestra.run.smithi116.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:15.146 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/374 2023-05-12T11:03:15.146 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/374 2023-05-12T11:03:15.147 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:15.152 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:15.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:15.171 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-05-12T11:03:15.577 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:15.589 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:15.937 INFO:teuthology.orchestra.run.smithi116.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-12T11:03:15.946 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/375 2023-05-12T11:03:15.946 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/375 2023-05-12T11:03:15.946 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:15.951 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:15.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:15.971 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-05-12T11:03:16.367 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:16.378 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:16.379 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:16.824 INFO:teuthology.orchestra.run.smithi116.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:16.833 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/376 2023-05-12T11:03:16.833 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/376 2023-05-12T11:03:16.834 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:16.840 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:16.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:16.859 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-05-12T11:03:17.255 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:17.266 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:17.266 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:17.556 INFO:teuthology.orchestra.run.smithi116.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:17.564 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/377 2023-05-12T11:03:17.564 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/377 2023-05-12T11:03:17.565 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:17.570 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:17.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:17.592 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-05-12T11:03:17.981 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:17.992 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:19.409 INFO:teuthology.orchestra.run.smithi116.stdout:generic/378 1s 2023-05-12T11:03:19.421 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/378 2023-05-12T11:03:19.421 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:19.428 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:19.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:19.472 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-05-12T11:03:20.173 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:20.184 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:20.184 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:20.531 INFO:teuthology.orchestra.run.smithi116.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:20.539 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/379 2023-05-12T11:03:20.539 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/379 2023-05-12T11:03:20.539 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:20.544 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:20.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:20.565 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-05-12T11:03:20.970 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:20.981 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:20.982 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:21.269 INFO:teuthology.orchestra.run.smithi116.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:21.277 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/380 2023-05-12T11:03:21.278 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/380 2023-05-12T11:03:21.278 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:21.283 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:21.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:21.303 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-05-12T11:03:21.700 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:21.712 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:21.712 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:22.010 INFO:teuthology.orchestra.run.smithi116.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:22.019 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/381 2023-05-12T11:03:22.020 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/381 2023-05-12T11:03:22.020 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:22.060 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:22.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:22.082 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-05-12T11:03:22.473 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:22.484 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:22.485 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:22.777 INFO:teuthology.orchestra.run.smithi116.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:22.786 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/382 2023-05-12T11:03:22.786 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/382 2023-05-12T11:03:22.786 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:22.792 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:22.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:22.815 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-05-12T11:03:23.212 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:23.224 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:23.224 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:23.518 INFO:teuthology.orchestra.run.smithi116.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:23.526 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/383 2023-05-12T11:03:23.526 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/383 2023-05-12T11:03:23.526 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:23.531 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:23.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:23.551 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-05-12T11:03:23.935 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:23.946 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:23.946 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:24.246 INFO:teuthology.orchestra.run.smithi116.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-12T11:03:24.254 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/384 2023-05-12T11:03:24.254 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/384 2023-05-12T11:03:24.254 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:24.259 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:24.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:24.280 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-05-12T11:03:24.676 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:24.688 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:24.688 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:24.980 INFO:teuthology.orchestra.run.smithi116.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:24.989 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/385 2023-05-12T11:03:24.990 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/385 2023-05-12T11:03:24.990 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:24.996 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:25.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:25.016 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-05-12T11:03:25.431 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:25.443 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:25.444 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:25.738 INFO:teuthology.orchestra.run.smithi116.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-12T11:03:25.747 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/386 2023-05-12T11:03:25.747 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/386 2023-05-12T11:03:25.747 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:25.754 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:25.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:25.774 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-05-12T11:03:26.165 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:26.176 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:26.177 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:26.458 INFO:teuthology.orchestra.run.smithi116.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:26.467 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/387 2023-05-12T11:03:26.467 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/387 2023-05-12T11:03:26.467 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:26.472 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:26.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:26.493 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-05-12T11:03:26.879 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:26.889 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:27.195 INFO:teuthology.orchestra.run.smithi116.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:27.203 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/388 2023-05-12T11:03:27.203 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/388 2023-05-12T11:03:27.203 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:27.208 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:27.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:27.229 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-05-12T11:03:27.624 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:27.635 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:27.964 INFO:teuthology.orchestra.run.smithi116.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-05-12T11:03:27.972 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/389 2023-05-12T11:03:27.972 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/389 2023-05-12T11:03:27.973 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:27.977 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:27.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:27.999 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-05-12T11:03:28.384 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:28.394 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:28.719 INFO:teuthology.orchestra.run.smithi116.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:03:28.727 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/390 2023-05-12T11:03:28.728 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/390 2023-05-12T11:03:28.728 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:03:28.733 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:03:28.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:03:28.754 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-05-12T11:03:29.161 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:03:29.172 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:03:29.172 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:14.220 INFO:teuthology.orchestra.run.smithi116.stdout:generic/391 44s 2023-05-12T11:04:14.565 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/391 2023-05-12T11:04:14.565 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:14.570 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:14.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:14.907 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-05-12T11:04:20.071 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:20.081 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:20.533 INFO:teuthology.orchestra.run.smithi116.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:20.542 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/392 2023-05-12T11:04:20.542 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/392 2023-05-12T11:04:20.543 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:20.549 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:20.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:20.570 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-05-12T11:04:21.097 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:21.110 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:21.448 INFO:teuthology.orchestra.run.smithi116.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:21.457 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/393 2023-05-12T11:04:21.457 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/393 2023-05-12T11:04:21.457 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:21.462 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:21.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:21.483 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-05-12T11:04:21.874 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:21.885 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:21.885 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:22.267 INFO:teuthology.orchestra.run.smithi116.stdout:generic/394 1s 2023-05-12T11:04:22.279 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/394 2023-05-12T11:04:22.279 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:22.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:22.306 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-05-12T11:04:23.249 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:23.271 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:23.271 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:23.777 INFO:teuthology.orchestra.run.smithi116.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:23.785 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/395 2023-05-12T11:04:23.785 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/395 2023-05-12T11:04:23.785 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:23.790 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:23.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:23.811 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-05-12T11:04:24.244 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:24.255 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:24.255 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:24.597 INFO:teuthology.orchestra.run.smithi116.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:24.606 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/396 2023-05-12T11:04:24.607 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/396 2023-05-12T11:04:24.607 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:24.613 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:24.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:24.633 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-05-12T11:04:25.034 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:25.045 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:25.045 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:25.463 INFO:teuthology.orchestra.run.smithi116.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:25.470 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/397 2023-05-12T11:04:25.471 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/397 2023-05-12T11:04:25.471 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:25.476 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:25.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:25.497 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-05-12T11:04:25.899 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:25.910 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:25.910 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:26.287 INFO:teuthology.orchestra.run.smithi116.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:26.295 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/398 2023-05-12T11:04:26.295 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/398 2023-05-12T11:04:26.295 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:26.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:26.322 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-05-12T11:04:26.720 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:26.731 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:26.731 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:27.085 INFO:teuthology.orchestra.run.smithi116.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:27.094 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/399 2023-05-12T11:04:27.094 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/399 2023-05-12T11:04:27.094 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:27.099 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:27.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:27.119 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-05-12T11:04:27.510 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:27.522 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:27.522 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:27.825 INFO:teuthology.orchestra.run.smithi116.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-12T11:04:27.834 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/400 2023-05-12T11:04:27.834 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/400 2023-05-12T11:04:27.834 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:27.840 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:27.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:27.862 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-05-12T11:04:28.259 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:28.270 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:28.270 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:28.576 INFO:teuthology.orchestra.run.smithi116.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:28.584 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/401 2023-05-12T11:04:28.584 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/401 2023-05-12T11:04:28.585 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:28.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:28.609 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-05-12T11:04:29.002 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:29.013 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:29.014 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:29.307 INFO:teuthology.orchestra.run.smithi116.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:29.315 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/402 2023-05-12T11:04:29.315 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/402 2023-05-12T11:04:29.315 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:29.321 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:29.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:29.341 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-05-12T11:04:29.752 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:29.763 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:30.061 INFO:teuthology.orchestra.run.smithi116.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:30.069 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/403 2023-05-12T11:04:30.070 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/403 2023-05-12T11:04:30.070 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:30.075 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:30.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:30.096 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-05-12T11:04:30.498 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:30.509 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:30.509 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:32.213 INFO:teuthology.orchestra.run.smithi116.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-12T11:04:32.221 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/404 2023-05-12T11:04:32.221 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/404 2023-05-12T11:04:32.221 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:32.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:32.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:32.246 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-05-12T11:04:33.024 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:33.035 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:33.036 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:33.862 INFO:teuthology.orchestra.run.smithi116.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:33.871 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/405 2023-05-12T11:04:33.871 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/405 2023-05-12T11:04:33.871 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:33.876 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:33.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:33.895 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-05-12T11:04:34.282 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:34.293 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:34.294 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:34.570 INFO:teuthology.orchestra.run.smithi116.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:34.578 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/406 2023-05-12T11:04:34.578 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/406 2023-05-12T11:04:34.579 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:34.584 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:34.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:34.603 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-05-12T11:04:34.996 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:35.007 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:35.008 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:35.419 INFO:teuthology.orchestra.run.smithi116.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T11:04:35.427 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/407 2023-05-12T11:04:35.427 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/407 2023-05-12T11:04:35.427 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:35.432 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:35.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:35.452 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-05-12T11:04:36.190 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:36.201 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:36.202 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:36.589 INFO:teuthology.orchestra.run.smithi116.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-12T11:04:36.598 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/408 2023-05-12T11:04:36.598 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/408 2023-05-12T11:04:36.598 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:36.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:36.624 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-05-12T11:04:37.362 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:37.375 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:38.085 INFO:teuthology.orchestra.run.smithi116.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:38.094 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/409 2023-05-12T11:04:38.094 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/409 2023-05-12T11:04:38.094 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:38.100 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:38.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:38.121 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-05-12T11:04:38.520 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:38.532 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:38.532 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:38.857 INFO:teuthology.orchestra.run.smithi116.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:38.865 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/410 2023-05-12T11:04:38.865 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/410 2023-05-12T11:04:38.866 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:38.871 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:38.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:38.891 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-05-12T11:04:39.290 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:39.301 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:39.302 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:39.594 INFO:teuthology.orchestra.run.smithi116.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:39.602 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/411 2023-05-12T11:04:39.602 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/411 2023-05-12T11:04:39.602 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:39.608 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:39.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:39.628 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-05-12T11:04:40.056 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:40.067 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:40.068 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:40.343 INFO:teuthology.orchestra.run.smithi116.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:40.351 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/412 2023-05-12T11:04:40.352 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/412 2023-05-12T11:04:40.352 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:40.357 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:40.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:40.377 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-05-12T11:04:40.769 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:40.780 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:41.070 INFO:teuthology.orchestra.run.smithi116.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:41.078 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/413 2023-05-12T11:04:41.078 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/413 2023-05-12T11:04:41.078 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:41.084 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:41.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:41.102 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-05-12T11:04:41.491 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:41.502 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:41.780 INFO:teuthology.orchestra.run.smithi116.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:41.788 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/414 2023-05-12T11:04:41.789 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/414 2023-05-12T11:04:41.789 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:41.794 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:41.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:41.814 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-05-12T11:04:42.204 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:42.216 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:42.216 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:42.503 INFO:teuthology.orchestra.run.smithi116.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:42.511 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/415 2023-05-12T11:04:42.511 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/415 2023-05-12T11:04:42.512 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:42.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:42.536 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-05-12T11:04:42.929 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:42.940 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:43.316 INFO:teuthology.orchestra.run.smithi116.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:43.324 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/416 2023-05-12T11:04:43.324 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/416 2023-05-12T11:04:43.324 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:43.329 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:43.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:43.349 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-05-12T11:04:43.741 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:43.752 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:43.753 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:44.023 INFO:teuthology.orchestra.run.smithi116.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:44.031 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/417 2023-05-12T11:04:44.032 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/417 2023-05-12T11:04:44.032 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:44.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:44.057 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-05-12T11:04:44.449 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:44.460 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:44.461 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:44.802 INFO:teuthology.orchestra.run.smithi116.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-05-12T11:04:44.810 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/418 2023-05-12T11:04:44.811 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/418 2023-05-12T11:04:44.811 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:44.816 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:44.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:44.835 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-05-12T11:04:45.232 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:45.243 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:45.586 INFO:teuthology.orchestra.run.smithi116.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:45.595 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/419 2023-05-12T11:04:45.595 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/419 2023-05-12T11:04:45.595 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:45.600 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:45.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:45.619 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-05-12T11:04:46.005 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:46.016 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:46.016 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:47.637 INFO:teuthology.orchestra.run.smithi116.stdout:generic/420 1s 2023-05-12T11:04:47.649 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/420 2023-05-12T11:04:47.649 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:47.654 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:47.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:47.674 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-05-12T11:04:48.367 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:48.379 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:48.380 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:48.744 INFO:teuthology.orchestra.run.smithi116.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:48.752 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/421 2023-05-12T11:04:48.752 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/421 2023-05-12T11:04:48.752 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:48.757 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:48.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:48.777 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-05-12T11:04:49.165 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:49.176 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:49.176 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:49.465 INFO:teuthology.orchestra.run.smithi116.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:49.473 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/422 2023-05-12T11:04:49.474 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/422 2023-05-12T11:04:49.474 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:49.479 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:49.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:49.499 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-05-12T11:04:49.893 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:49.904 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:49.904 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:50.398 INFO:teuthology.orchestra.run.smithi116.stdout:generic/423 1s 2023-05-12T11:04:50.410 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/423 2023-05-12T11:04:50.410 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:50.415 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:50.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:50.435 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-05-12T11:04:51.136 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:51.147 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:51.148 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:51.501 INFO:teuthology.orchestra.run.smithi116.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-05-12T11:04:51.509 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/424 2023-05-12T11:04:51.509 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/424 2023-05-12T11:04:51.509 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:51.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:51.534 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-05-12T11:04:51.919 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:51.930 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:51.931 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:52.230 INFO:teuthology.orchestra.run.smithi116.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:04:52.239 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/425 2023-05-12T11:04:52.239 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/425 2023-05-12T11:04:52.239 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:04:52.244 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:04:52.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:04:52.263 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-05-12T11:04:52.656 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:04:52.667 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:04:52.667 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:09.590 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:05:09.595 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:05:39.495 INFO:teuthology.orchestra.run.smithi116.stdout:generic/426 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/426.out.bad) 2023-05-12T11:05:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/426.out 2023-05-12 09:09:18.887489923 +0000 2023-05-12T11:05:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/426.out.bad 2023-05-12 11:05:39.462590800 +0000 2023-05-12T11:05:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1,5 +1,701 @@ 2023-05-12T11:05:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 426 2023-05-12T11:05:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: test_file_handles TEST_DIR/426-dir -d 2023-05-12T11:05:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000161) opened an unlinked file! 2023-05-12T11:05:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000162) opened an unlinked file! 2023-05-12T11:05:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000163) opened an unlinked file! 2023-05-12T11:05:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000164) opened an unlinked file! 2023-05-12T11:05:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000165) opened an unlinked file! 2023-05-12T11:05:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000166) opened an unlinked file! 2023-05-12T11:05:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000167) opened an unlinked file! 2023-05-12T11:05:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000168) opened an unlinked file! 2023-05-12T11:05:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000169) opened an unlinked file! 2023-05-12T11:05:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000170) opened an unlinked file! 2023-05-12T11:05:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000171) opened an unlinked file! 2023-05-12T11:05:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000172) opened an unlinked file! 2023-05-12T11:05:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000173) opened an unlinked file! 2023-05-12T11:05:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000174) opened an unlinked file! 2023-05-12T11:05:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000175) opened an unlinked file! 2023-05-12T11:05:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000176) opened an unlinked file! 2023-05-12T11:05:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000177) opened an unlinked file! 2023-05-12T11:05:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000178) opened an unlinked file! 2023-05-12T11:05:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000179) opened an unlinked file! 2023-05-12T11:05:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000180) opened an unlinked file! 2023-05-12T11:05:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000181) opened an unlinked file! 2023-05-12T11:05:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000182) opened an unlinked file! 2023-05-12T11:05:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000183) opened an unlinked file! 2023-05-12T11:05:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000184) opened an unlinked file! 2023-05-12T11:05:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000185) opened an unlinked file! 2023-05-12T11:05:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000186) opened an unlinked file! 2023-05-12T11:05:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000187) opened an unlinked file! 2023-05-12T11:05:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000188) opened an unlinked file! 2023-05-12T11:05:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000189) opened an unlinked file! 2023-05-12T11:05:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000190) opened an unlinked file! 2023-05-12T11:05:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000191) opened an unlinked file! 2023-05-12T11:05:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000192) opened an unlinked file! 2023-05-12T11:05:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000193) opened an unlinked file! 2023-05-12T11:05:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000194) opened an unlinked file! 2023-05-12T11:05:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000195) opened an unlinked file! 2023-05-12T11:05:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000196) opened an unlinked file! 2023-05-12T11:05:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000197) opened an unlinked file! 2023-05-12T11:05:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000198) opened an unlinked file! 2023-05-12T11:05:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000199) opened an unlinked file! 2023-05-12T11:05:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000200) opened an unlinked file! 2023-05-12T11:05:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000201) opened an unlinked file! 2023-05-12T11:05:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000202) opened an unlinked file! 2023-05-12T11:05:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000203) opened an unlinked file! 2023-05-12T11:05:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000204) opened an unlinked file! 2023-05-12T11:05:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000205) opened an unlinked file! 2023-05-12T11:05:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000206) opened an unlinked file! 2023-05-12T11:05:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000207) opened an unlinked file! 2023-05-12T11:05:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000208) opened an unlinked file! 2023-05-12T11:05:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000209) opened an unlinked file! 2023-05-12T11:05:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000210) opened an unlinked file! 2023-05-12T11:05:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000211) opened an unlinked file! 2023-05-12T11:05:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000212) opened an unlinked file! 2023-05-12T11:05:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000213) opened an unlinked file! 2023-05-12T11:05:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000214) opened an unlinked file! 2023-05-12T11:05:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000215) opened an unlinked file! 2023-05-12T11:05:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000216) opened an unlinked file! 2023-05-12T11:05:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000217) opened an unlinked file! 2023-05-12T11:05:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000218) opened an unlinked file! 2023-05-12T11:05:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000219) opened an unlinked file! 2023-05-12T11:05:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000220) opened an unlinked file! 2023-05-12T11:05:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000221) opened an unlinked file! 2023-05-12T11:05:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000222) opened an unlinked file! 2023-05-12T11:05:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000223) opened an unlinked file! 2023-05-12T11:05:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000224) opened an unlinked file! 2023-05-12T11:05:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000225) opened an unlinked file! 2023-05-12T11:05:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000226) opened an unlinked file! 2023-05-12T11:05:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000227) opened an unlinked file! 2023-05-12T11:05:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000228) opened an unlinked file! 2023-05-12T11:05:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000229) opened an unlinked file! 2023-05-12T11:05:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000230) opened an unlinked file! 2023-05-12T11:05:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000231) opened an unlinked file! 2023-05-12T11:05:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000232) opened an unlinked file! 2023-05-12T11:05:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000233) opened an unlinked file! 2023-05-12T11:05:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000234) opened an unlinked file! 2023-05-12T11:05:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000235) opened an unlinked file! 2023-05-12T11:05:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000236) opened an unlinked file! 2023-05-12T11:05:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000237) opened an unlinked file! 2023-05-12T11:05:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000238) opened an unlinked file! 2023-05-12T11:05:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000239) opened an unlinked file! 2023-05-12T11:05:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000240) opened an unlinked file! 2023-05-12T11:05:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000241) opened an unlinked file! 2023-05-12T11:05:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000242) opened an unlinked file! 2023-05-12T11:05:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000243) opened an unlinked file! 2023-05-12T11:05:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000244) opened an unlinked file! 2023-05-12T11:05:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000245) opened an unlinked file! 2023-05-12T11:05:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000246) opened an unlinked file! 2023-05-12T11:05:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000247) opened an unlinked file! 2023-05-12T11:05:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000248) opened an unlinked file! 2023-05-12T11:05:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000249) opened an unlinked file! 2023-05-12T11:05:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000250) opened an unlinked file! 2023-05-12T11:05:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000251) opened an unlinked file! 2023-05-12T11:05:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000252) opened an unlinked file! 2023-05-12T11:05:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000253) opened an unlinked file! 2023-05-12T11:05:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000254) opened an unlinked file! 2023-05-12T11:05:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000255) opened an unlinked file! 2023-05-12T11:05:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000256) opened an unlinked file! 2023-05-12T11:05:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000257) opened an unlinked file! 2023-05-12T11:05:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000258) opened an unlinked file! 2023-05-12T11:05:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000259) opened an unlinked file! 2023-05-12T11:05:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000260) opened an unlinked file! 2023-05-12T11:05:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000261) opened an unlinked file! 2023-05-12T11:05:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000262) opened an unlinked file! 2023-05-12T11:05:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000263) opened an unlinked file! 2023-05-12T11:05:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000264) opened an unlinked file! 2023-05-12T11:05:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000265) opened an unlinked file! 2023-05-12T11:05:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000266) opened an unlinked file! 2023-05-12T11:05:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000267) opened an unlinked file! 2023-05-12T11:05:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000268) opened an unlinked file! 2023-05-12T11:05:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000269) opened an unlinked file! 2023-05-12T11:05:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000270) opened an unlinked file! 2023-05-12T11:05:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000271) opened an unlinked file! 2023-05-12T11:05:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000272) opened an unlinked file! 2023-05-12T11:05:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000273) opened an unlinked file! 2023-05-12T11:05:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000274) opened an unlinked file! 2023-05-12T11:05:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000275) opened an unlinked file! 2023-05-12T11:05:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000276) opened an unlinked file! 2023-05-12T11:05:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000277) opened an unlinked file! 2023-05-12T11:05:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000278) opened an unlinked file! 2023-05-12T11:05:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000279) opened an unlinked file! 2023-05-12T11:05:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000280) opened an unlinked file! 2023-05-12T11:05:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000281) opened an unlinked file! 2023-05-12T11:05:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000282) opened an unlinked file! 2023-05-12T11:05:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000283) opened an unlinked file! 2023-05-12T11:05:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000284) opened an unlinked file! 2023-05-12T11:05:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000285) opened an unlinked file! 2023-05-12T11:05:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000286) opened an unlinked file! 2023-05-12T11:05:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000287) opened an unlinked file! 2023-05-12T11:05:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000288) opened an unlinked file! 2023-05-12T11:05:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000289) opened an unlinked file! 2023-05-12T11:05:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000290) opened an unlinked file! 2023-05-12T11:05:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000291) opened an unlinked file! 2023-05-12T11:05:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000292) opened an unlinked file! 2023-05-12T11:05:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000293) opened an unlinked file! 2023-05-12T11:05:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000294) opened an unlinked file! 2023-05-12T11:05:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000295) opened an unlinked file! 2023-05-12T11:05:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000296) opened an unlinked file! 2023-05-12T11:05:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000297) opened an unlinked file! 2023-05-12T11:05:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000298) opened an unlinked file! 2023-05-12T11:05:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000299) opened an unlinked file! 2023-05-12T11:05:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000300) opened an unlinked file! 2023-05-12T11:05:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000301) opened an unlinked file! 2023-05-12T11:05:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000302) opened an unlinked file! 2023-05-12T11:05:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000303) opened an unlinked file! 2023-05-12T11:05:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000304) opened an unlinked file! 2023-05-12T11:05:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000305) opened an unlinked file! 2023-05-12T11:05:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000306) opened an unlinked file! 2023-05-12T11:05:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000307) opened an unlinked file! 2023-05-12T11:05:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000308) opened an unlinked file! 2023-05-12T11:05:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000309) opened an unlinked file! 2023-05-12T11:05:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000310) opened an unlinked file! 2023-05-12T11:05:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000311) opened an unlinked file! 2023-05-12T11:05:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000312) opened an unlinked file! 2023-05-12T11:05:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000313) opened an unlinked file! 2023-05-12T11:05:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000314) opened an unlinked file! 2023-05-12T11:05:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000315) opened an unlinked file! 2023-05-12T11:05:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000316) opened an unlinked file! 2023-05-12T11:05:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000317) opened an unlinked file! 2023-05-12T11:05:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000318) opened an unlinked file! 2023-05-12T11:05:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000319) opened an unlinked file! 2023-05-12T11:05:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000320) opened an unlinked file! 2023-05-12T11:05:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000321) opened an unlinked file! 2023-05-12T11:05:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000322) opened an unlinked file! 2023-05-12T11:05:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000323) opened an unlinked file! 2023-05-12T11:05:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000324) opened an unlinked file! 2023-05-12T11:05:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000325) opened an unlinked file! 2023-05-12T11:05:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000326) opened an unlinked file! 2023-05-12T11:05:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000327) opened an unlinked file! 2023-05-12T11:05:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000328) opened an unlinked file! 2023-05-12T11:05:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000329) opened an unlinked file! 2023-05-12T11:05:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000330) opened an unlinked file! 2023-05-12T11:05:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000331) opened an unlinked file! 2023-05-12T11:05:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000332) opened an unlinked file! 2023-05-12T11:05:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000333) opened an unlinked file! 2023-05-12T11:05:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000334) opened an unlinked file! 2023-05-12T11:05:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000335) opened an unlinked file! 2023-05-12T11:05:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000336) opened an unlinked file! 2023-05-12T11:05:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000337) opened an unlinked file! 2023-05-12T11:05:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000338) opened an unlinked file! 2023-05-12T11:05:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000339) opened an unlinked file! 2023-05-12T11:05:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000340) opened an unlinked file! 2023-05-12T11:05:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000341) opened an unlinked file! 2023-05-12T11:05:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000342) opened an unlinked file! 2023-05-12T11:05:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000343) opened an unlinked file! 2023-05-12T11:05:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000344) opened an unlinked file! 2023-05-12T11:05:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000345) opened an unlinked file! 2023-05-12T11:05:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000346) opened an unlinked file! 2023-05-12T11:05:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000347) opened an unlinked file! 2023-05-12T11:05:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000348) opened an unlinked file! 2023-05-12T11:05:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000349) opened an unlinked file! 2023-05-12T11:05:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000350) opened an unlinked file! 2023-05-12T11:05:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000351) opened an unlinked file! 2023-05-12T11:05:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000352) opened an unlinked file! 2023-05-12T11:05:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000353) opened an unlinked file! 2023-05-12T11:05:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000354) opened an unlinked file! 2023-05-12T11:05:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000355) opened an unlinked file! 2023-05-12T11:05:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000356) opened an unlinked file! 2023-05-12T11:05:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000357) opened an unlinked file! 2023-05-12T11:05:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000358) opened an unlinked file! 2023-05-12T11:05:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000359) opened an unlinked file! 2023-05-12T11:05:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000360) opened an unlinked file! 2023-05-12T11:05:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000361) opened an unlinked file! 2023-05-12T11:05:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000362) opened an unlinked file! 2023-05-12T11:05:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000363) opened an unlinked file! 2023-05-12T11:05:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000364) opened an unlinked file! 2023-05-12T11:05:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000365) opened an unlinked file! 2023-05-12T11:05:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000366) opened an unlinked file! 2023-05-12T11:05:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000367) opened an unlinked file! 2023-05-12T11:05:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000368) opened an unlinked file! 2023-05-12T11:05:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000369) opened an unlinked file! 2023-05-12T11:05:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000370) opened an unlinked file! 2023-05-12T11:05:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000371) opened an unlinked file! 2023-05-12T11:05:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000372) opened an unlinked file! 2023-05-12T11:05:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000373) opened an unlinked file! 2023-05-12T11:05:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000374) opened an unlinked file! 2023-05-12T11:05:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000375) opened an unlinked file! 2023-05-12T11:05:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000376) opened an unlinked file! 2023-05-12T11:05:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000377) opened an unlinked file! 2023-05-12T11:05:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000378) opened an unlinked file! 2023-05-12T11:05:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000379) opened an unlinked file! 2023-05-12T11:05:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000380) opened an unlinked file! 2023-05-12T11:05:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000381) opened an unlinked file! 2023-05-12T11:05:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000382) opened an unlinked file! 2023-05-12T11:05:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000383) opened an unlinked file! 2023-05-12T11:05:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000384) opened an unlinked file! 2023-05-12T11:05:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000385) opened an unlinked file! 2023-05-12T11:05:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000386) opened an unlinked file! 2023-05-12T11:05:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000387) opened an unlinked file! 2023-05-12T11:05:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000388) opened an unlinked file! 2023-05-12T11:05:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000389) opened an unlinked file! 2023-05-12T11:05:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000390) opened an unlinked file! 2023-05-12T11:05:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000391) opened an unlinked file! 2023-05-12T11:05:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000392) opened an unlinked file! 2023-05-12T11:05:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000393) opened an unlinked file! 2023-05-12T11:05:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000394) opened an unlinked file! 2023-05-12T11:05:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000395) opened an unlinked file! 2023-05-12T11:05:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000396) opened an unlinked file! 2023-05-12T11:05:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000397) opened an unlinked file! 2023-05-12T11:05:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000398) opened an unlinked file! 2023-05-12T11:05:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000399) opened an unlinked file! 2023-05-12T11:05:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000400) opened an unlinked file! 2023-05-12T11:05:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000401) opened an unlinked file! 2023-05-12T11:05:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000402) opened an unlinked file! 2023-05-12T11:05:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000403) opened an unlinked file! 2023-05-12T11:05:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000404) opened an unlinked file! 2023-05-12T11:05:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000405) opened an unlinked file! 2023-05-12T11:05:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000406) opened an unlinked file! 2023-05-12T11:05:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000407) opened an unlinked file! 2023-05-12T11:05:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000408) opened an unlinked file! 2023-05-12T11:05:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000409) opened an unlinked file! 2023-05-12T11:05:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000410) opened an unlinked file! 2023-05-12T11:05:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000411) opened an unlinked file! 2023-05-12T11:05:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000412) opened an unlinked file! 2023-05-12T11:05:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000413) opened an unlinked file! 2023-05-12T11:05:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000414) opened an unlinked file! 2023-05-12T11:05:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000415) opened an unlinked file! 2023-05-12T11:05:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000416) opened an unlinked file! 2023-05-12T11:05:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000417) opened an unlinked file! 2023-05-12T11:05:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000418) opened an unlinked file! 2023-05-12T11:05:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000419) opened an unlinked file! 2023-05-12T11:05:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000420) opened an unlinked file! 2023-05-12T11:05:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000421) opened an unlinked file! 2023-05-12T11:05:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000422) opened an unlinked file! 2023-05-12T11:05:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000423) opened an unlinked file! 2023-05-12T11:05:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000424) opened an unlinked file! 2023-05-12T11:05:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000425) opened an unlinked file! 2023-05-12T11:05:39.549 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000426) opened an unlinked file! 2023-05-12T11:05:39.549 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000427) opened an unlinked file! 2023-05-12T11:05:39.549 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000428) opened an unlinked file! 2023-05-12T11:05:39.549 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000429) opened an unlinked file! 2023-05-12T11:05:39.549 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000430) opened an unlinked file! 2023-05-12T11:05:39.549 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000431) opened an unlinked file! 2023-05-12T11:05:39.549 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000432) opened an unlinked file! 2023-05-12T11:05:39.549 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000433) opened an unlinked file! 2023-05-12T11:05:39.550 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000434) opened an unlinked file! 2023-05-12T11:05:39.550 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000435) opened an unlinked file! 2023-05-12T11:05:39.550 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000436) opened an unlinked file! 2023-05-12T11:05:39.550 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000437) opened an unlinked file! 2023-05-12T11:05:39.550 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000438) opened an unlinked file! 2023-05-12T11:05:39.550 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000439) opened an unlinked file! 2023-05-12T11:05:39.550 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000440) opened an unlinked file! 2023-05-12T11:05:39.550 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000441) opened an unlinked file! 2023-05-12T11:05:39.551 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000442) opened an unlinked file! 2023-05-12T11:05:39.551 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000443) opened an unlinked file! 2023-05-12T11:05:39.551 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000444) opened an unlinked file! 2023-05-12T11:05:39.551 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000445) opened an unlinked file! 2023-05-12T11:05:39.551 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000446) opened an unlinked file! 2023-05-12T11:05:39.551 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000447) opened an unlinked file! 2023-05-12T11:05:39.551 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000448) opened an unlinked file! 2023-05-12T11:05:39.552 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000449) opened an unlinked file! 2023-05-12T11:05:39.552 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000450) opened an unlinked file! 2023-05-12T11:05:39.552 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000451) opened an unlinked file! 2023-05-12T11:05:39.552 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000452) opened an unlinked file! 2023-05-12T11:05:39.552 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000453) opened an unlinked file! 2023-05-12T11:05:39.552 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000454) opened an unlinked file! 2023-05-12T11:05:39.553 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000455) opened an unlinked file! 2023-05-12T11:05:39.553 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000456) opened an unlinked file! 2023-05-12T11:05:39.553 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000457) opened an unlinked file! 2023-05-12T11:05:39.553 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000458) opened an unlinked file! 2023-05-12T11:05:39.553 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000459) opened an unlinked file! 2023-05-12T11:05:39.553 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000460) opened an unlinked file! 2023-05-12T11:05:39.553 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000461) opened an unlinked file! 2023-05-12T11:05:39.553 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000462) opened an unlinked file! 2023-05-12T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000463) opened an unlinked file! 2023-05-12T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000464) opened an unlinked file! 2023-05-12T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000465) opened an unlinked file! 2023-05-12T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000466) opened an unlinked file! 2023-05-12T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000467) opened an unlinked file! 2023-05-12T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000468) opened an unlinked file! 2023-05-12T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000469) opened an unlinked file! 2023-05-12T11:05:39.555 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000470) opened an unlinked file! 2023-05-12T11:05:39.555 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000471) opened an unlinked file! 2023-05-12T11:05:39.555 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000472) opened an unlinked file! 2023-05-12T11:05:39.555 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000473) opened an unlinked file! 2023-05-12T11:05:39.555 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000474) opened an unlinked file! 2023-05-12T11:05:39.555 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000475) opened an unlinked file! 2023-05-12T11:05:39.555 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000476) opened an unlinked file! 2023-05-12T11:05:39.555 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000477) opened an unlinked file! 2023-05-12T11:05:39.556 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000478) opened an unlinked file! 2023-05-12T11:05:39.556 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000479) opened an unlinked file! 2023-05-12T11:05:39.556 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000480) opened an unlinked file! 2023-05-12T11:05:39.556 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000481) opened an unlinked file! 2023-05-12T11:05:39.556 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000482) opened an unlinked file! 2023-05-12T11:05:39.556 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000483) opened an unlinked file! 2023-05-12T11:05:39.556 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000484) opened an unlinked file! 2023-05-12T11:05:39.556 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000485) opened an unlinked file! 2023-05-12T11:05:39.557 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000486) opened an unlinked file! 2023-05-12T11:05:39.557 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000487) opened an unlinked file! 2023-05-12T11:05:39.557 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000488) opened an unlinked file! 2023-05-12T11:05:39.557 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000489) opened an unlinked file! 2023-05-12T11:05:39.557 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000490) opened an unlinked file! 2023-05-12T11:05:39.557 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000491) opened an unlinked file! 2023-05-12T11:05:39.557 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000492) opened an unlinked file! 2023-05-12T11:05:39.558 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000493) opened an unlinked file! 2023-05-12T11:05:39.558 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000494) opened an unlinked file! 2023-05-12T11:05:39.558 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000495) opened an unlinked file! 2023-05-12T11:05:39.558 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000496) opened an unlinked file! 2023-05-12T11:05:39.558 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000497) opened an unlinked file! 2023-05-12T11:05:39.558 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000498) opened an unlinked file! 2023-05-12T11:05:39.558 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000499) opened an unlinked file! 2023-05-12T11:05:39.558 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000500) opened an unlinked file! 2023-05-12T11:05:39.559 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000501) opened an unlinked file! 2023-05-12T11:05:39.559 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000502) opened an unlinked file! 2023-05-12T11:05:39.559 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000503) opened an unlinked file! 2023-05-12T11:05:39.559 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000504) opened an unlinked file! 2023-05-12T11:05:39.559 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000505) opened an unlinked file! 2023-05-12T11:05:39.559 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000506) opened an unlinked file! 2023-05-12T11:05:39.559 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000507) opened an unlinked file! 2023-05-12T11:05:39.559 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000508) opened an unlinked file! 2023-05-12T11:05:39.560 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000509) opened an unlinked file! 2023-05-12T11:05:39.560 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000510) opened an unlinked file! 2023-05-12T11:05:39.560 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000511) opened an unlinked file! 2023-05-12T11:05:39.560 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000512) opened an unlinked file! 2023-05-12T11:05:39.560 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000513) opened an unlinked file! 2023-05-12T11:05:39.560 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000514) opened an unlinked file! 2023-05-12T11:05:39.560 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000515) opened an unlinked file! 2023-05-12T11:05:39.560 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000516) opened an unlinked file! 2023-05-12T11:05:39.561 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000517) opened an unlinked file! 2023-05-12T11:05:39.561 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000518) opened an unlinked file! 2023-05-12T11:05:39.561 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000519) opened an unlinked file! 2023-05-12T11:05:39.561 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000520) opened an unlinked file! 2023-05-12T11:05:39.561 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000521) opened an unlinked file! 2023-05-12T11:05:39.561 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000522) opened an unlinked file! 2023-05-12T11:05:39.561 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000523) opened an unlinked file! 2023-05-12T11:05:39.562 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000524) opened an unlinked file! 2023-05-12T11:05:39.562 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000525) opened an unlinked file! 2023-05-12T11:05:39.562 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000526) opened an unlinked file! 2023-05-12T11:05:39.562 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000527) opened an unlinked file! 2023-05-12T11:05:39.562 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000528) opened an unlinked file! 2023-05-12T11:05:39.562 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000529) opened an unlinked file! 2023-05-12T11:05:39.562 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000530) opened an unlinked file! 2023-05-12T11:05:39.562 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000531) opened an unlinked file! 2023-05-12T11:05:39.563 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000532) opened an unlinked file! 2023-05-12T11:05:39.563 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000533) opened an unlinked file! 2023-05-12T11:05:39.563 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000534) opened an unlinked file! 2023-05-12T11:05:39.563 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000535) opened an unlinked file! 2023-05-12T11:05:39.563 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000536) opened an unlinked file! 2023-05-12T11:05:39.563 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000537) opened an unlinked file! 2023-05-12T11:05:39.563 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000538) opened an unlinked file! 2023-05-12T11:05:39.563 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000539) opened an unlinked file! 2023-05-12T11:05:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000540) opened an unlinked file! 2023-05-12T11:05:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000541) opened an unlinked file! 2023-05-12T11:05:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000542) opened an unlinked file! 2023-05-12T11:05:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000543) opened an unlinked file! 2023-05-12T11:05:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000544) opened an unlinked file! 2023-05-12T11:05:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000545) opened an unlinked file! 2023-05-12T11:05:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000546) opened an unlinked file! 2023-05-12T11:05:39.565 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000547) opened an unlinked file! 2023-05-12T11:05:39.565 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000548) opened an unlinked file! 2023-05-12T11:05:39.565 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000549) opened an unlinked file! 2023-05-12T11:05:39.565 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000550) opened an unlinked file! 2023-05-12T11:05:39.565 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000551) opened an unlinked file! 2023-05-12T11:05:39.565 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000552) opened an unlinked file! 2023-05-12T11:05:39.565 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000553) opened an unlinked file! 2023-05-12T11:05:39.565 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000554) opened an unlinked file! 2023-05-12T11:05:39.566 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000555) opened an unlinked file! 2023-05-12T11:05:39.566 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000556) opened an unlinked file! 2023-05-12T11:05:39.566 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000557) opened an unlinked file! 2023-05-12T11:05:39.566 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000558) opened an unlinked file! 2023-05-12T11:05:39.566 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000559) opened an unlinked file! 2023-05-12T11:05:39.566 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000560) opened an unlinked file! 2023-05-12T11:05:39.566 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000561) opened an unlinked file! 2023-05-12T11:05:39.566 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000562) opened an unlinked file! 2023-05-12T11:05:39.567 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000563) opened an unlinked file! 2023-05-12T11:05:39.567 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000564) opened an unlinked file! 2023-05-12T11:05:39.567 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000565) opened an unlinked file! 2023-05-12T11:05:39.567 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000566) opened an unlinked file! 2023-05-12T11:05:39.567 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000567) opened an unlinked file! 2023-05-12T11:05:39.567 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000568) opened an unlinked file! 2023-05-12T11:05:39.567 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000569) opened an unlinked file! 2023-05-12T11:05:39.568 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000570) opened an unlinked file! 2023-05-12T11:05:39.568 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000571) opened an unlinked file! 2023-05-12T11:05:39.568 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000572) opened an unlinked file! 2023-05-12T11:05:39.568 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000573) opened an unlinked file! 2023-05-12T11:05:39.568 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000574) opened an unlinked file! 2023-05-12T11:05:39.568 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000575) opened an unlinked file! 2023-05-12T11:05:39.568 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000576) opened an unlinked file! 2023-05-12T11:05:39.568 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000577) opened an unlinked file! 2023-05-12T11:05:39.569 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000578) opened an unlinked file! 2023-05-12T11:05:39.569 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000579) opened an unlinked file! 2023-05-12T11:05:39.569 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000580) opened an unlinked file! 2023-05-12T11:05:39.569 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000581) opened an unlinked file! 2023-05-12T11:05:39.569 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000582) opened an unlinked file! 2023-05-12T11:05:39.569 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000583) opened an unlinked file! 2023-05-12T11:05:39.569 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000584) opened an unlinked file! 2023-05-12T11:05:39.569 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000585) opened an unlinked file! 2023-05-12T11:05:39.570 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000586) opened an unlinked file! 2023-05-12T11:05:39.570 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000587) opened an unlinked file! 2023-05-12T11:05:39.570 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000588) opened an unlinked file! 2023-05-12T11:05:39.570 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000589) opened an unlinked file! 2023-05-12T11:05:39.570 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000590) opened an unlinked file! 2023-05-12T11:05:39.570 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000591) opened an unlinked file! 2023-05-12T11:05:39.570 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000592) opened an unlinked file! 2023-05-12T11:05:39.570 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000593) opened an unlinked file! 2023-05-12T11:05:39.571 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000594) opened an unlinked file! 2023-05-12T11:05:39.571 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000595) opened an unlinked file! 2023-05-12T11:05:39.571 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000596) opened an unlinked file! 2023-05-12T11:05:39.571 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000597) opened an unlinked file! 2023-05-12T11:05:39.571 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000598) opened an unlinked file! 2023-05-12T11:05:39.571 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000599) opened an unlinked file! 2023-05-12T11:05:39.571 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000600) opened an unlinked file! 2023-05-12T11:05:39.571 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000601) opened an unlinked file! 2023-05-12T11:05:39.572 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000602) opened an unlinked file! 2023-05-12T11:05:39.572 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000603) opened an unlinked file! 2023-05-12T11:05:39.572 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000604) opened an unlinked file! 2023-05-12T11:05:39.572 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000605) opened an unlinked file! 2023-05-12T11:05:39.572 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000606) opened an unlinked file! 2023-05-12T11:05:39.572 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000607) opened an unlinked file! 2023-05-12T11:05:39.572 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000608) opened an unlinked file! 2023-05-12T11:05:39.573 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000609) opened an unlinked file! 2023-05-12T11:05:39.573 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000610) opened an unlinked file! 2023-05-12T11:05:39.573 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000611) opened an unlinked file! 2023-05-12T11:05:39.573 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000612) opened an unlinked file! 2023-05-12T11:05:39.573 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000613) opened an unlinked file! 2023-05-12T11:05:39.573 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000614) opened an unlinked file! 2023-05-12T11:05:39.573 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000615) opened an unlinked file! 2023-05-12T11:05:39.573 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000616) opened an unlinked file! 2023-05-12T11:05:39.574 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000617) opened an unlinked file! 2023-05-12T11:05:39.574 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000618) opened an unlinked file! 2023-05-12T11:05:39.574 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000619) opened an unlinked file! 2023-05-12T11:05:39.574 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000620) opened an unlinked file! 2023-05-12T11:05:39.574 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000621) opened an unlinked file! 2023-05-12T11:05:39.574 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000622) opened an unlinked file! 2023-05-12T11:05:39.574 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000623) opened an unlinked file! 2023-05-12T11:05:39.575 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000624) opened an unlinked file! 2023-05-12T11:05:39.575 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000625) opened an unlinked file! 2023-05-12T11:05:39.575 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000626) opened an unlinked file! 2023-05-12T11:05:39.575 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000627) opened an unlinked file! 2023-05-12T11:05:39.575 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000628) opened an unlinked file! 2023-05-12T11:05:39.575 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000629) opened an unlinked file! 2023-05-12T11:05:39.575 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000630) opened an unlinked file! 2023-05-12T11:05:39.575 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000631) opened an unlinked file! 2023-05-12T11:05:39.576 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000632) opened an unlinked file! 2023-05-12T11:05:39.576 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000633) opened an unlinked file! 2023-05-12T11:05:39.576 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000634) opened an unlinked file! 2023-05-12T11:05:39.576 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000635) opened an unlinked file! 2023-05-12T11:05:39.576 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000636) opened an unlinked file! 2023-05-12T11:05:39.576 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000637) opened an unlinked file! 2023-05-12T11:05:39.576 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000638) opened an unlinked file! 2023-05-12T11:05:39.576 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000639) opened an unlinked file! 2023-05-12T11:05:39.577 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000640) opened an unlinked file! 2023-05-12T11:05:39.577 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000641) opened an unlinked file! 2023-05-12T11:05:39.577 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000642) opened an unlinked file! 2023-05-12T11:05:39.577 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000643) opened an unlinked file! 2023-05-12T11:05:39.577 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000811) opened an unlinked file! 2023-05-12T11:05:39.577 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000812) opened an unlinked file! 2023-05-12T11:05:39.577 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000813) opened an unlinked file! 2023-05-12T11:05:39.578 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000814) opened an unlinked file! 2023-05-12T11:05:39.578 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000815) opened an unlinked file! 2023-05-12T11:05:39.578 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000816) opened an unlinked file! 2023-05-12T11:05:39.578 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000817) opened an unlinked file! 2023-05-12T11:05:39.578 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000818) opened an unlinked file! 2023-05-12T11:05:39.578 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000819) opened an unlinked file! 2023-05-12T11:05:39.578 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000820) opened an unlinked file! 2023-05-12T11:05:39.578 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000821) opened an unlinked file! 2023-05-12T11:05:39.579 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000822) opened an unlinked file! 2023-05-12T11:05:39.579 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000823) opened an unlinked file! 2023-05-12T11:05:39.579 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000824) opened an unlinked file! 2023-05-12T11:05:39.579 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000825) opened an unlinked file! 2023-05-12T11:05:39.579 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000826) opened an unlinked file! 2023-05-12T11:05:39.579 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000827) opened an unlinked file! 2023-05-12T11:05:39.579 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000828) opened an unlinked file! 2023-05-12T11:05:39.579 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000829) opened an unlinked file! 2023-05-12T11:05:39.580 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000830) opened an unlinked file! 2023-05-12T11:05:39.580 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000831) opened an unlinked file! 2023-05-12T11:05:39.580 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000832) opened an unlinked file! 2023-05-12T11:05:39.580 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000833) opened an unlinked file! 2023-05-12T11:05:39.580 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000834) opened an unlinked file! 2023-05-12T11:05:39.580 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000835) opened an unlinked file! 2023-05-12T11:05:39.580 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000836) opened an unlinked file! 2023-05-12T11:05:39.580 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000837) opened an unlinked file! 2023-05-12T11:05:39.581 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000838) opened an unlinked file! 2023-05-12T11:05:39.581 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000839) opened an unlinked file! 2023-05-12T11:05:39.581 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000840) opened an unlinked file! 2023-05-12T11:05:39.581 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000841) opened an unlinked file! 2023-05-12T11:05:39.581 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000842) opened an unlinked file! 2023-05-12T11:05:39.581 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000843) opened an unlinked file! 2023-05-12T11:05:39.581 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000844) opened an unlinked file! 2023-05-12T11:05:39.582 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000845) opened an unlinked file! 2023-05-12T11:05:39.582 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000846) opened an unlinked file! 2023-05-12T11:05:39.582 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000847) opened an unlinked file! 2023-05-12T11:05:39.582 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000848) opened an unlinked file! 2023-05-12T11:05:39.582 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000849) opened an unlinked file! 2023-05-12T11:05:39.582 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000850) opened an unlinked file! 2023-05-12T11:05:39.582 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000851) opened an unlinked file! 2023-05-12T11:05:39.582 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000852) opened an unlinked file! 2023-05-12T11:05:39.583 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000853) opened an unlinked file! 2023-05-12T11:05:39.583 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000854) opened an unlinked file! 2023-05-12T11:05:39.583 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000855) opened an unlinked file! 2023-05-12T11:05:39.583 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000856) opened an unlinked file! 2023-05-12T11:05:39.583 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000857) opened an unlinked file! 2023-05-12T11:05:39.583 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000858) opened an unlinked file! 2023-05-12T11:05:39.583 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000859) opened an unlinked file! 2023-05-12T11:05:39.583 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000860) opened an unlinked file! 2023-05-12T11:05:39.584 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000861) opened an unlinked file! 2023-05-12T11:05:39.584 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000862) opened an unlinked file! 2023-05-12T11:05:39.584 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000863) opened an unlinked file! 2023-05-12T11:05:39.584 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000864) opened an unlinked file! 2023-05-12T11:05:39.584 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000865) opened an unlinked file! 2023-05-12T11:05:39.584 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000866) opened an unlinked file! 2023-05-12T11:05:39.584 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000867) opened an unlinked file! 2023-05-12T11:05:39.584 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000868) opened an unlinked file! 2023-05-12T11:05:39.585 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000869) opened an unlinked file! 2023-05-12T11:05:39.585 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000870) opened an unlinked file! 2023-05-12T11:05:39.585 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000871) opened an unlinked file! 2023-05-12T11:05:39.585 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000872) opened an unlinked file! 2023-05-12T11:05:39.585 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000873) opened an unlinked file! 2023-05-12T11:05:39.585 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000874) opened an unlinked file! 2023-05-12T11:05:39.585 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000875) opened an unlinked file! 2023-05-12T11:05:39.586 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000876) opened an unlinked file! 2023-05-12T11:05:39.586 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000877) opened an unlinked file! 2023-05-12T11:05:39.586 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000878) opened an unlinked file! 2023-05-12T11:05:39.586 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000879) opened an unlinked file! 2023-05-12T11:05:39.586 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000880) opened an unlinked file! 2023-05-12T11:05:39.586 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000881) opened an unlinked file! 2023-05-12T11:05:39.586 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000882) opened an unlinked file! 2023-05-12T11:05:39.586 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000883) opened an unlinked file! 2023-05-12T11:05:39.587 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000884) opened an unlinked file! 2023-05-12T11:05:39.587 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000885) opened an unlinked file! 2023-05-12T11:05:39.587 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000886) opened an unlinked file! 2023-05-12T11:05:39.587 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000887) opened an unlinked file! 2023-05-12T11:05:39.587 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000888) opened an unlinked file! 2023-05-12T11:05:39.587 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000889) opened an unlinked file! 2023-05-12T11:05:39.587 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000890) opened an unlinked file! 2023-05-12T11:05:39.587 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000891) opened an unlinked file! 2023-05-12T11:05:39.588 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000892) opened an unlinked file! 2023-05-12T11:05:39.588 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000893) opened an unlinked file! 2023-05-12T11:05:39.588 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000894) opened an unlinked file! 2023-05-12T11:05:39.588 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000895) opened an unlinked file! 2023-05-12T11:05:39.588 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000896) opened an unlinked file! 2023-05-12T11:05:39.588 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000897) opened an unlinked file! 2023-05-12T11:05:39.588 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000898) opened an unlinked file! 2023-05-12T11:05:39.589 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000899) opened an unlinked file! 2023-05-12T11:05:39.589 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000900) opened an unlinked file! 2023-05-12T11:05:39.589 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000901) opened an unlinked file! 2023-05-12T11:05:39.589 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000902) opened an unlinked file! 2023-05-12T11:05:39.589 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000903) opened an unlinked file! 2023-05-12T11:05:39.589 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000904) opened an unlinked file! 2023-05-12T11:05:39.589 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000905) opened an unlinked file! 2023-05-12T11:05:39.589 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000906) opened an unlinked file! 2023-05-12T11:05:39.590 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000907) opened an unlinked file! 2023-05-12T11:05:39.590 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000908) opened an unlinked file! 2023-05-12T11:05:39.590 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000909) opened an unlinked file! 2023-05-12T11:05:39.590 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000910) opened an unlinked file! 2023-05-12T11:05:39.590 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000911) opened an unlinked file! 2023-05-12T11:05:39.590 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000912) opened an unlinked file! 2023-05-12T11:05:39.590 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000913) opened an unlinked file! 2023-05-12T11:05:39.590 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000914) opened an unlinked file! 2023-05-12T11:05:39.591 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000915) opened an unlinked file! 2023-05-12T11:05:39.591 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000916) opened an unlinked file! 2023-05-12T11:05:39.591 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000917) opened an unlinked file! 2023-05-12T11:05:39.591 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000918) opened an unlinked file! 2023-05-12T11:05:39.591 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000919) opened an unlinked file! 2023-05-12T11:05:39.591 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000920) opened an unlinked file! 2023-05-12T11:05:39.591 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000921) opened an unlinked file! 2023-05-12T11:05:39.591 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000922) opened an unlinked file! 2023-05-12T11:05:39.592 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000923) opened an unlinked file! 2023-05-12T11:05:39.592 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000924) opened an unlinked file! 2023-05-12T11:05:39.592 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000925) opened an unlinked file! 2023-05-12T11:05:39.592 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000926) opened an unlinked file! 2023-05-12T11:05:39.592 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000927) opened an unlinked file! 2023-05-12T11:05:39.592 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000928) opened an unlinked file! 2023-05-12T11:05:39.592 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000929) opened an unlinked file! 2023-05-12T11:05:39.593 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000930) opened an unlinked file! 2023-05-12T11:05:39.593 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000931) opened an unlinked file! 2023-05-12T11:05:39.593 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000932) opened an unlinked file! 2023-05-12T11:05:39.593 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000933) opened an unlinked file! 2023-05-12T11:05:39.593 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000934) opened an unlinked file! 2023-05-12T11:05:39.593 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000935) opened an unlinked file! 2023-05-12T11:05:39.593 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000936) opened an unlinked file! 2023-05-12T11:05:39.593 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000937) opened an unlinked file! 2023-05-12T11:05:39.594 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000938) opened an unlinked file! 2023-05-12T11:05:39.594 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000939) opened an unlinked file! 2023-05-12T11:05:39.594 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000940) opened an unlinked file! 2023-05-12T11:05:39.594 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000941) opened an unlinked file! 2023-05-12T11:05:39.594 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000942) opened an unlinked file! 2023-05-12T11:05:39.594 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000943) opened an unlinked file! 2023-05-12T11:05:39.594 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000944) opened an unlinked file! 2023-05-12T11:05:39.594 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000945) opened an unlinked file! 2023-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000946) opened an unlinked file! 2023-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000947) opened an unlinked file! 2023-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000948) opened an unlinked file! 2023-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000949) opened an unlinked file! 2023-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000950) opened an unlinked file! 2023-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000951) opened an unlinked file! 2023-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000952) opened an unlinked file! 2023-05-12T11:05:39.595 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000953) opened an unlinked file! 2023-05-12T11:05:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000954) opened an unlinked file! 2023-05-12T11:05:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000955) opened an unlinked file! 2023-05-12T11:05:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000956) opened an unlinked file! 2023-05-12T11:05:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000957) opened an unlinked file! 2023-05-12T11:05:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000958) opened an unlinked file! 2023-05-12T11:05:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000959) opened an unlinked file! 2023-05-12T11:05:39.596 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000960) opened an unlinked file! 2023-05-12T11:05:39.597 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000961) opened an unlinked file! 2023-05-12T11:05:39.597 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000962) opened an unlinked file! 2023-05-12T11:05:39.597 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000963) opened an unlinked file! 2023-05-12T11:05:39.597 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000964) opened an unlinked file! 2023-05-12T11:05:39.597 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000965) opened an unlinked file! 2023-05-12T11:05:39.597 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000966) opened an unlinked file! 2023-05-12T11:05:39.597 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000967) opened an unlinked file! 2023-05-12T11:05:39.597 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000968) opened an unlinked file! 2023-05-12T11:05:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000969) opened an unlinked file! 2023-05-12T11:05:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000970) opened an unlinked file! 2023-05-12T11:05:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000971) opened an unlinked file! 2023-05-12T11:05:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000972) opened an unlinked file! 2023-05-12T11:05:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000973) opened an unlinked file! 2023-05-12T11:05:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000974) opened an unlinked file! 2023-05-12T11:05:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000975) opened an unlinked file! 2023-05-12T11:05:39.598 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000976) opened an unlinked file! 2023-05-12T11:05:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000977) opened an unlinked file! 2023-05-12T11:05:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000978) opened an unlinked file! 2023-05-12T11:05:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000979) opened an unlinked file! 2023-05-12T11:05:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000980) opened an unlinked file! 2023-05-12T11:05:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000981) opened an unlinked file! 2023-05-12T11:05:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000982) opened an unlinked file! 2023-05-12T11:05:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000983) opened an unlinked file! 2023-05-12T11:05:39.599 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000984) opened an unlinked file! 2023-05-12T11:05:39.600 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000985) opened an unlinked file! 2023-05-12T11:05:39.600 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000986) opened an unlinked file! 2023-05-12T11:05:39.600 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000987) opened an unlinked file! 2023-05-12T11:05:39.600 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000988) opened an unlinked file! 2023-05-12T11:05:39.600 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000989) opened an unlinked file! 2023-05-12T11:05:39.600 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000990) opened an unlinked file! 2023-05-12T11:05:39.600 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000991) opened an unlinked file! 2023-05-12T11:05:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000992) opened an unlinked file! 2023-05-12T11:05:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000993) opened an unlinked file! 2023-05-12T11:05:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000994) opened an unlinked file! 2023-05-12T11:05:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000995) opened an unlinked file! 2023-05-12T11:05:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000996) opened an unlinked file! 2023-05-12T11:05:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000997) opened an unlinked file! 2023-05-12T11:05:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000998) opened an unlinked file! 2023-05-12T11:05:39.601 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file000999) opened an unlinked file! 2023-05-12T11:05:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001000) opened an unlinked file! 2023-05-12T11:05:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001001) opened an unlinked file! 2023-05-12T11:05:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001002) opened an unlinked file! 2023-05-12T11:05:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001003) opened an unlinked file! 2023-05-12T11:05:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001004) opened an unlinked file! 2023-05-12T11:05:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001005) opened an unlinked file! 2023-05-12T11:05:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001006) opened an unlinked file! 2023-05-12T11:05:39.602 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001007) opened an unlinked file! 2023-05-12T11:05:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001008) opened an unlinked file! 2023-05-12T11:05:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001009) opened an unlinked file! 2023-05-12T11:05:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001010) opened an unlinked file! 2023-05-12T11:05:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001011) opened an unlinked file! 2023-05-12T11:05:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001012) opened an unlinked file! 2023-05-12T11:05:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001013) opened an unlinked file! 2023-05-12T11:05:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001014) opened an unlinked file! 2023-05-12T11:05:39.603 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001015) opened an unlinked file! 2023-05-12T11:05:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001016) opened an unlinked file! 2023-05-12T11:05:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001017) opened an unlinked file! 2023-05-12T11:05:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001018) opened an unlinked file! 2023-05-12T11:05:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001019) opened an unlinked file! 2023-05-12T11:05:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001020) opened an unlinked file! 2023-05-12T11:05:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001021) opened an unlinked file! 2023-05-12T11:05:39.604 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001022) opened an unlinked file! 2023-05-12T11:05:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/426-dir/file001023) opened an unlinked file! 2023-05-12T11:05:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: test_file_handles TEST_DIR/426-dir 2023-05-12T11:05:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: test_file_handles TEST_DIR/426-dir -l 2023-05-12T11:05:39.605 INFO:teuthology.orchestra.run.smithi116.stdout: test_file_handles TEST_DIR/426-dir -u 2023-05-12T11:05:39.606 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/426 2023-05-12T11:05:39.606 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/426 2023-05-12T11:05:39.606 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T11:05:39.606 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:39.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T11:05:39.729 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T11:05:39.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T11:05:39.729 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-05-12T11:05:40.298 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:05:40.303 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:05:40.964 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:40.975 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:40.975 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:41.297 INFO:teuthology.orchestra.run.smithi116.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:05:41.305 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/427 2023-05-12T11:05:41.305 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/427 2023-05-12T11:05:41.306 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:05:41.311 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:41.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:05:41.331 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-05-12T11:05:41.722 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:41.733 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:41.734 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:42.099 INFO:teuthology.orchestra.run.smithi116.stdout:generic/428 1s 2023-05-12T11:05:42.110 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/428 2023-05-12T11:05:42.111 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:05:42.116 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:42.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:05:42.137 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-05-12T11:05:42.525 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:42.536 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:42.536 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:42.871 INFO:teuthology.orchestra.run.smithi116.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:05:42.879 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/429 2023-05-12T11:05:42.879 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/429 2023-05-12T11:05:42.880 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:05:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:42.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:05:42.904 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-05-12T11:05:43.288 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:43.299 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:43.299 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:43.860 INFO:teuthology.orchestra.run.smithi116.stdout:generic/430 0s 2023-05-12T11:05:43.872 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/430 2023-05-12T11:05:43.872 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:05:43.877 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:43.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:05:43.897 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-05-12T11:05:44.564 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:44.575 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:45.084 INFO:teuthology.orchestra.run.smithi116.stdout:generic/431 1s 2023-05-12T11:05:45.095 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/431 2023-05-12T11:05:45.095 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:05:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:45.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:05:45.120 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-05-12T11:05:45.794 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:45.806 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:45.806 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:46.353 INFO:teuthology.orchestra.run.smithi116.stdout:generic/432 1s 2023-05-12T11:05:46.365 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/432 2023-05-12T11:05:46.365 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:05:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:46.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:05:46.390 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-05-12T11:05:47.099 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:47.110 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:47.110 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:47.587 INFO:teuthology.orchestra.run.smithi116.stdout:generic/433 0s 2023-05-12T11:05:47.598 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/433 2023-05-12T11:05:47.599 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:05:47.604 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:47.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:05:47.623 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-05-12T11:05:48.320 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:48.331 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:48.331 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:48.806 INFO:teuthology.orchestra.run.smithi116.stdout:generic/434 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/434.out.bad) 2023-05-12T11:05:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/434.out 2023-05-12 09:09:18.888489905 +0000 2023-05-12T11:05:48.811 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/434.out.bad 2023-05-12 11:05:48.800431253 +0000 2023-05-12T11:05:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -9,6 +9,6 @@ 2023-05-12T11:05:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: copy_range: Bad file descriptor 2023-05-12T11:05:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-05-12T11:05:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: Try to copy to a device 2023-05-12T11:05:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: -copy_range: Invalid argument 2023-05-12T11:05:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: +/tmp/tmp.A6WkqqsMBotest/test-434/dev1: Permission denied 2023-05-12T11:05:48.812 INFO:teuthology.orchestra.run.smithi116.stdout: Try to copy to a fifo 2023-05-12T11:05:48.813 INFO:teuthology.orchestra.run.smithi116.stdout: copy_range: Invalid argument 2023-05-12T11:05:48.817 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/434 2023-05-12T11:05:48.817 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/434 2023-05-12T11:05:48.817 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T11:05:48.822 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:48.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T11:05:48.845 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T11:05:48.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T11:05:48.846 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-05-12T11:05:49.523 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:49.534 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:49.878 INFO:teuthology.orchestra.run.smithi116.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:05:49.886 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/435 2023-05-12T11:05:49.886 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/435 2023-05-12T11:05:49.886 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:05:49.892 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:49.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:05:49.912 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-05-12T11:05:50.295 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:50.306 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:51.563 INFO:teuthology.orchestra.run.smithi116.stdout:generic/436 1s 2023-05-12T11:05:51.575 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/436 2023-05-12T11:05:51.575 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:05:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:51.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:05:51.599 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-05-12T11:05:52.313 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:52.324 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:52.325 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:53.422 INFO:teuthology.orchestra.run.smithi116.stdout:generic/437 1s 2023-05-12T11:05:53.434 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/437 2023-05-12T11:05:53.434 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:05:53.439 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:05:53.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:05:53.458 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-05-12T11:05:53.845 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:05:53.855 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:05:53.856 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:06:10.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:06:10.479 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:06:40.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:06:40.733 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:07:10.934 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:07:10.939 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:07:36.007 INFO:teuthology.orchestra.run.smithi116.stdout:generic/438 102s 2023-05-12T11:07:36.019 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/438 2023-05-12T11:07:36.019 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:36.024 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:36.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:36.044 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-05-12T11:07:36.428 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:36.439 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:36.440 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:36.725 INFO:teuthology.orchestra.run.smithi116.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:36.733 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/439 2023-05-12T11:07:36.733 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/439 2023-05-12T11:07:36.734 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:36.739 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:36.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:36.759 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-05-12T11:07:37.146 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:37.157 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:37.503 INFO:teuthology.orchestra.run.smithi116.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:37.511 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/440 2023-05-12T11:07:37.512 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/440 2023-05-12T11:07:37.512 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:37.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:37.536 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-05-12T11:07:37.928 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:37.939 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:37.939 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:38.317 INFO:teuthology.orchestra.run.smithi116.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:38.325 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/441 2023-05-12T11:07:38.326 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/441 2023-05-12T11:07:38.326 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:38.331 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:38.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:38.350 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-05-12T11:07:38.740 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:38.751 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:38.752 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:39.055 INFO:teuthology.orchestra.run.smithi116.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:39.063 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/442 2023-05-12T11:07:39.063 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/442 2023-05-12T11:07:39.064 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:39.069 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:39.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:39.089 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-05-12T11:07:39.482 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:39.493 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:39.848 INFO:teuthology.orchestra.run.smithi116.stdout:generic/443 0s 2023-05-12T11:07:39.860 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/443 2023-05-12T11:07:39.860 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:39.865 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:39.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:39.885 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-05-12T11:07:40.271 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:40.282 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:40.282 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:40.629 INFO:teuthology.orchestra.run.smithi116.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-12T11:07:40.637 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/444 2023-05-12T11:07:40.638 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/444 2023-05-12T11:07:40.638 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:40.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:40.662 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-05-12T11:07:41.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:07:41.042 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:07:41.052 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:41.064 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:42.428 INFO:teuthology.orchestra.run.smithi116.stdout:generic/445 1s 2023-05-12T11:07:42.439 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/445 2023-05-12T11:07:42.440 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:42.445 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:42.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:42.464 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-05-12T11:07:43.141 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:43.152 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:43.152 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:43.424 INFO:teuthology.orchestra.run.smithi116.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:43.433 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/446 2023-05-12T11:07:43.433 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/446 2023-05-12T11:07:43.433 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:43.438 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:43.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:43.458 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-05-12T11:07:43.842 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:43.853 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:43.853 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:44.145 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/447 2023-05-12T11:07:44.145 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/447 2023-05-12T11:07:44.145 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:44.150 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:44.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:44.169 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-05-12T11:07:44.559 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:44.570 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:45.941 INFO:teuthology.orchestra.run.smithi116.stdout:generic/448 1s 2023-05-12T11:07:45.952 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/448 2023-05-12T11:07:45.953 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:45.958 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:46.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:46.017 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-05-12T11:07:46.667 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:46.678 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:46.972 INFO:teuthology.orchestra.run.smithi116.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:46.980 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/449 2023-05-12T11:07:46.980 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/449 2023-05-12T11:07:46.981 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:47.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:47.005 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-05-12T11:07:47.389 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:47.400 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:47.400 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:48.778 INFO:teuthology.orchestra.run.smithi116.stdout:generic/450 1s 2023-05-12T11:07:48.789 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/450 2023-05-12T11:07:48.789 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:48.794 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:48.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:48.813 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-05-12T11:07:49.484 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:49.496 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:49.496 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:50.038 INFO:teuthology.orchestra.run.smithi116.stdout:generic/451 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/451.out.bad) 2023-05-12T11:07:50.043 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/451.out 2023-05-12 09:09:18.891489853 +0000 2023-05-12T11:07:50.043 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/451.out.bad 2023-05-12 11:07:50.032359743 +0000 2023-05-12T11:07:50.043 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1,2 +1,5 @@ 2023-05-12T11:07:50.043 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 451 2023-05-12T11:07:50.043 INFO:teuthology.orchestra.run.smithi116.stdout: +get stale data from buffer read 2023-05-12T11:07:50.044 INFO:teuthology.orchestra.run.smithi116.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-05-12T11:07:50.044 INFO:teuthology.orchestra.run.smithi116.stdout: +000a0000 2023-05-12T11:07:50.044 INFO:teuthology.orchestra.run.smithi116.stdout: Silence is golden 2023-05-12T11:07:50.048 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/451 2023-05-12T11:07:50.048 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/451 2023-05-12T11:07:50.048 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T11:07:50.054 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:50.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T11:07:50.074 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T11:07:50.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T11:07:50.074 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-05-12T11:07:50.783 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:50.795 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:50.795 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/452 2023-05-12T11:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/452 2023-05-12T11:07:51.084 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:51.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:51.108 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-05-12T11:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:51.794 INFO:teuthology.orchestra.run.smithi116.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:51.802 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/453 2023-05-12T11:07:51.802 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/453 2023-05-12T11:07:51.802 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:51.808 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:51.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:51.827 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-05-12T11:07:52.216 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:52.227 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:52.227 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:52.509 INFO:teuthology.orchestra.run.smithi116.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:52.517 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/454 2023-05-12T11:07:52.517 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/454 2023-05-12T11:07:52.517 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:52.523 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:52.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:52.542 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-05-12T11:07:52.935 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:52.946 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:52.946 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:53.384 INFO:teuthology.orchestra.run.smithi116.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:53.392 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/455 2023-05-12T11:07:53.392 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/455 2023-05-12T11:07:53.392 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:53.397 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:53.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:53.417 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-05-12T11:07:53.803 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:53.814 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:53.814 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:54.117 INFO:teuthology.orchestra.run.smithi116.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:54.125 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/456 2023-05-12T11:07:54.125 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/456 2023-05-12T11:07:54.125 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:54.131 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:54.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:54.150 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-05-12T11:07:54.546 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:54.557 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:54.938 INFO:teuthology.orchestra.run.smithi116.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:54.946 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/457 2023-05-12T11:07:54.947 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/457 2023-05-12T11:07:54.947 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:54.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:54.971 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-05-12T11:07:55.358 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:55.369 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:55.370 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:55.649 INFO:teuthology.orchestra.run.smithi116.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:55.657 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/458 2023-05-12T11:07:55.657 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/458 2023-05-12T11:07:55.658 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:55.663 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:55.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:55.682 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-05-12T11:07:56.070 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:56.081 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:56.081 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:56.475 INFO:teuthology.orchestra.run.smithi116.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:56.484 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/459 2023-05-12T11:07:56.484 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/459 2023-05-12T11:07:56.484 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:56.489 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:56.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:56.509 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-05-12T11:07:56.903 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:56.914 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:56.915 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:57.193 INFO:teuthology.orchestra.run.smithi116.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:57.201 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/460 2023-05-12T11:07:57.201 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/460 2023-05-12T11:07:57.202 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:57.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:57.226 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-05-12T11:07:57.613 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:57.915 INFO:teuthology.orchestra.run.smithi116.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:57.923 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/461 2023-05-12T11:07:57.923 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/461 2023-05-12T11:07:57.923 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:57.929 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:57.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:57.948 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-05-12T11:07:58.338 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:58.349 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:58.349 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:58.641 INFO:teuthology.orchestra.run.smithi116.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:07:58.650 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/462 2023-05-12T11:07:58.650 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/462 2023-05-12T11:07:58.650 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:58.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:58.675 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-05-12T11:07:59.064 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:07:59.075 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:07:59.075 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:59.457 INFO:teuthology.orchestra.run.smithi116.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T11:07:59.466 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/463 2023-05-12T11:07:59.466 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/463 2023-05-12T11:07:59.466 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:07:59.471 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:07:59.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:07:59.490 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-05-12T11:08:00.206 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:00.217 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:00.218 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/464 2023-05-12T11:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/464 2023-05-12T11:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:00.508 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:00.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:00.527 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-05-12T11:08:00.913 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:00.924 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:00.925 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:11.329 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:08:11.333 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:08:16.500 INFO:teuthology.orchestra.run.smithi116.stdout:generic/465 16s 2023-05-12T11:08:16.576 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/465 2023-05-12T11:08:16.576 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:16.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:16.655 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-05-12T11:08:17.238 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:17.250 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:17.250 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:17.529 INFO:teuthology.orchestra.run.smithi116.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:17.537 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/466 2023-05-12T11:08:17.537 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/466 2023-05-12T11:08:17.537 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:17.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:17.561 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-05-12T11:08:17.955 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:17.966 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:17.966 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:30.954 INFO:teuthology.orchestra.run.smithi116.stdout:generic/467 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/467.out.bad) 2023-05-12T11:08:30.977 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/467.out 2023-05-12 09:09:18.893489818 +0000 2023-05-12T11:08:30.978 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/467.out.bad 2023-05-12 11:08:30.932660825 +0000 2023-05-12T11:08:30.978 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1,5 +1,15 @@ 2023-05-12T11:08:30.978 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 467 2023-05-12T11:08:30.978 INFO:teuthology.orchestra.run.smithi116.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-05-12T11:08:30.978 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/467-dir/file000000) opened an unlinked file! 2023-05-12T11:08:30.978 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/467-dir/file000001) opened an unlinked file! 2023-05-12T11:08:30.978 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/467-dir/file000002) opened an unlinked file! 2023-05-12T11:08:30.979 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/467-dir/file000003) opened an unlinked file! 2023-05-12T11:08:30.979 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/467-dir/file000004) opened an unlinked file! 2023-05-12T11:08:30.979 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/467-dir/file000005) opened an unlinked file! 2023-05-12T11:08:30.979 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/467-dir/file000006) opened an unlinked file! 2023-05-12T11:08:30.979 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/467-dir/file000007) opened an unlinked file! 2023-05-12T11:08:30.979 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/467-dir/file000008) opened an unlinked file! 2023-05-12T11:08:30.979 INFO:teuthology.orchestra.run.smithi116.stdout: +open_by_handle(/tmp/tmp.A6WkqqsMBotest/467-dir/file000009) opened an unlinked file! 2023-05-12T11:08:30.979 INFO:teuthology.orchestra.run.smithi116.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-05-12T11:08:30.980 INFO:teuthology.orchestra.run.smithi116.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-05-12T11:08:30.980 INFO:teuthology.orchestra.run.smithi116.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-05-12T11:08:31.002 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/467 2023-05-12T11:08:31.002 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/467 2023-05-12T11:08:31.002 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T11:08:31.032 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:31.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T11:08:31.236 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T11:08:31.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T11:08:31.237 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-05-12T11:08:32.421 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:32.432 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:32.432 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:32.754 INFO:teuthology.orchestra.run.smithi116.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:32.763 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/468 2023-05-12T11:08:32.763 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/468 2023-05-12T11:08:32.763 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:32.768 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:32.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:32.789 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-05-12T11:08:33.197 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:33.208 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:33.208 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:36.086 INFO:teuthology.orchestra.run.smithi116.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-12T11:08:36.094 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/469 2023-05-12T11:08:36.095 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/469 2023-05-12T11:08:36.095 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:36.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:36.120 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-05-12T11:08:36.824 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:36.835 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/470 2023-05-12T11:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/470 2023-05-12T11:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:37.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:37.232 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-05-12T11:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:38.022 INFO:teuthology.orchestra.run.smithi116.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-05-12T11:08:38.030 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/471 2023-05-12T11:08:38.031 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/471 2023-05-12T11:08:38.031 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:38.035 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:38.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:38.054 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-05-12T11:08:38.763 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:38.774 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:38.774 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:39.076 INFO:teuthology.orchestra.run.smithi116.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:39.084 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/472 2023-05-12T11:08:39.084 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/472 2023-05-12T11:08:39.085 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:39.090 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:39.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:39.109 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-05-12T11:08:39.496 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:39.507 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:39.871 INFO:teuthology.orchestra.run.smithi116.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-12T11:08:39.879 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/473 2023-05-12T11:08:39.879 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/473 2023-05-12T11:08:39.879 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:39.884 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:39.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:39.903 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-05-12T11:08:40.292 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:40.303 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:40.303 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:40.601 INFO:teuthology.orchestra.run.smithi116.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:40.608 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/474 2023-05-12T11:08:40.609 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/474 2023-05-12T11:08:40.609 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:40.614 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:40.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:40.634 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-05-12T11:08:41.027 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:41.038 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:41.039 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/475 2023-05-12T11:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/475 2023-05-12T11:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:41.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:41.418 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-05-12T11:08:41.571 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:08:41.575 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:08:41.816 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:41.827 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:41.827 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:42.123 INFO:teuthology.orchestra.run.smithi116.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:42.131 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/476 2023-05-12T11:08:42.132 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/476 2023-05-12T11:08:42.132 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:42.137 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:42.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:42.156 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-05-12T11:08:42.555 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:42.566 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:50.036 INFO:teuthology.orchestra.run.smithi116.stdout:generic/477 7s 2023-05-12T11:08:50.116 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/477 2023-05-12T11:08:50.116 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:50.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:50.178 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-05-12T11:08:51.218 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:51.229 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:51.229 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:52.087 INFO:teuthology.orchestra.run.smithi116.stdout:generic/478 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/478.out.bad) 2023-05-12T11:08:52.092 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/478.out 2023-05-12 09:09:18.895489782 +0000 2023-05-12T11:08:52.092 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/478.out.bad 2023-05-12 11:08:52.080299447 +0000 2023-05-12T11:08:52.092 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -10,7 +10,7 @@ 2023-05-12T11:08:52.093 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.093 INFO:teuthology.orchestra.run.smithi116.stdout: get wrlck 2023-05-12T11:08:52.093 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.093 INFO:teuthology.orchestra.run.smithi116.stdout: -lock could be placed 2023-05-12T11:08:52.093 INFO:teuthology.orchestra.run.smithi116.stdout: +get wrlck 2023-05-12T11:08:52.093 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.093 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.094 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.094 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -25,7 +25,7 @@ 2023-05-12T11:08:52.094 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.094 INFO:teuthology.orchestra.run.smithi116.stdout: get wrlck 2023-05-12T11:08:52.094 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.094 INFO:teuthology.orchestra.run.smithi116.stdout: -lock could be placed 2023-05-12T11:08:52.094 INFO:teuthology.orchestra.run.smithi116.stdout: +get wrlck 2023-05-12T11:08:52.095 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.095 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.095 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.095 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -37,7 +37,7 @@ 2023-05-12T11:08:52.095 INFO:teuthology.orchestra.run.smithi116.stdout: get rdlck 2023-05-12T11:08:52.095 INFO:teuthology.orchestra.run.smithi116.stdout: get rdlck 2023-05-12T11:08:52.095 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.095 INFO:teuthology.orchestra.run.smithi116.stdout: -lock could be placed 2023-05-12T11:08:52.096 INFO:teuthology.orchestra.run.smithi116.stdout: +get rdlck 2023-05-12T11:08:52.096 INFO:teuthology.orchestra.run.smithi116.stdout: get rdlck 2023-05-12T11:08:52.096 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.096 INFO:teuthology.orchestra.run.smithi116.stdout: get rdlck 2023-05-12T11:08:52.096 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -46,7 +46,7 @@ 2023-05-12T11:08:52.096 INFO:teuthology.orchestra.run.smithi116.stdout: get rdlck 2023-05-12T11:08:52.096 INFO:teuthology.orchestra.run.smithi116.stdout: get rdlck 2023-05-12T11:08:52.096 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.097 INFO:teuthology.orchestra.run.smithi116.stdout: -lock could be placed 2023-05-12T11:08:52.097 INFO:teuthology.orchestra.run.smithi116.stdout: +get rdlck 2023-05-12T11:08:52.097 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.097 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.097 INFO:teuthology.orchestra.run.smithi116.stdout: lock could be placed 2023-05-12T11:08:52.098 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/478 2023-05-12T11:08:52.098 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/478 2023-05-12T11:08:52.098 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T11:08:52.103 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:52.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T11:08:52.121 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T11:08:52.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T11:08:52.122 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-05-12T11:08:52.511 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:52.522 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:52.522 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:52.886 INFO:teuthology.orchestra.run.smithi116.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:52.895 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/479 2023-05-12T11:08:52.895 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/479 2023-05-12T11:08:52.895 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:52.900 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:52.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:52.920 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-05-12T11:08:53.307 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:53.319 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:53.319 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:53.627 INFO:teuthology.orchestra.run.smithi116.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:53.635 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/480 2023-05-12T11:08:53.635 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/480 2023-05-12T11:08:53.635 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:53.641 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:53.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:53.660 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-05-12T11:08:54.054 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:54.066 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:54.066 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:54.366 INFO:teuthology.orchestra.run.smithi116.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:54.374 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/481 2023-05-12T11:08:54.374 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/481 2023-05-12T11:08:54.374 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:54.380 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:54.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:54.399 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-05-12T11:08:54.787 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:54.799 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:54.799 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:55.207 INFO:teuthology.orchestra.run.smithi116.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:55.216 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/482 2023-05-12T11:08:55.216 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/482 2023-05-12T11:08:55.216 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:55.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:55.241 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-05-12T11:08:55.623 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:55.634 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:55.634 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:55.936 INFO:teuthology.orchestra.run.smithi116.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:55.944 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/483 2023-05-12T11:08:55.944 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/483 2023-05-12T11:08:55.944 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:55.950 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:55.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:55.969 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-05-12T11:08:56.350 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:56.361 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:56.361 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:56.668 INFO:teuthology.orchestra.run.smithi116.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:56.676 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/484 2023-05-12T11:08:56.676 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/484 2023-05-12T11:08:56.676 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:56.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:56.702 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-05-12T11:08:57.088 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:57.099 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:57.100 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-12T11:08:58.738 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/485 2023-05-12T11:08:58.738 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/485 2023-05-12T11:08:58.738 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:58.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:58.764 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-05-12T11:08:59.479 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:08:59.490 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:08:59.491 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:59.828 INFO:teuthology.orchestra.run.smithi116.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:08:59.836 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/486 2023-05-12T11:08:59.836 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/486 2023-05-12T11:08:59.836 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:08:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:08:59.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:08:59.861 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-05-12T11:09:00.246 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:00.257 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:00.257 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:00.562 INFO:teuthology.orchestra.run.smithi116.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:00.570 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/487 2023-05-12T11:09:00.571 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/487 2023-05-12T11:09:00.571 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:00.576 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:00.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:00.597 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-05-12T11:09:00.985 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:00.996 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:00.996 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:01.271 INFO:teuthology.orchestra.run.smithi116.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:01.279 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/488 2023-05-12T11:09:01.279 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/488 2023-05-12T11:09:01.279 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:01.285 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:01.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:01.304 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-05-12T11:09:01.696 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:01.708 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:01.708 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:02.021 INFO:teuthology.orchestra.run.smithi116.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:02.029 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/489 2023-05-12T11:09:02.030 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/489 2023-05-12T11:09:02.030 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:02.035 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:02.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:02.054 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-05-12T11:09:02.437 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:02.452 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:02.452 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:03.720 INFO:teuthology.orchestra.run.smithi116.stdout:generic/490 1s 2023-05-12T11:09:03.732 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/490 2023-05-12T11:09:03.732 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:03.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:03.759 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-05-12T11:09:04.481 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:04.492 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:04.794 INFO:teuthology.orchestra.run.smithi116.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:04.802 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/491 2023-05-12T11:09:04.802 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/491 2023-05-12T11:09:04.802 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:04.808 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:04.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:04.828 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-05-12T11:09:05.215 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:05.226 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:05.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:05.520 INFO:teuthology.orchestra.run.smithi116.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:05.528 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/492 2023-05-12T11:09:05.528 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/492 2023-05-12T11:09:05.528 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:05.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:05.554 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-05-12T11:09:05.940 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:05.951 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:05.951 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:06.229 INFO:teuthology.orchestra.run.smithi116.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:06.237 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/493 2023-05-12T11:09:06.238 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/493 2023-05-12T11:09:06.238 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:06.243 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:06.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:06.263 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-05-12T11:09:06.648 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:06.659 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:06.659 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:06.941 INFO:teuthology.orchestra.run.smithi116.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:06.949 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/494 2023-05-12T11:09:06.949 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/494 2023-05-12T11:09:06.949 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:06.955 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:06.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:06.974 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-05-12T11:09:07.358 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:07.369 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:07.370 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:07.644 INFO:teuthology.orchestra.run.smithi116.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:07.652 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/495 2023-05-12T11:09:07.652 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/495 2023-05-12T11:09:07.652 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:07.658 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:07.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:07.678 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-05-12T11:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:08.372 INFO:teuthology.orchestra.run.smithi116.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:08.380 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/496 2023-05-12T11:09:08.380 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/496 2023-05-12T11:09:08.380 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:08.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:08.405 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-05-12T11:09:08.795 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:08.806 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:08.806 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:09.094 INFO:teuthology.orchestra.run.smithi116.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/497 2023-05-12T11:09:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/497 2023-05-12T11:09:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:09.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:09.127 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-05-12T11:09:09.514 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:09.525 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:09.525 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:09.836 INFO:teuthology.orchestra.run.smithi116.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:09.844 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/498 2023-05-12T11:09:09.844 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/498 2023-05-12T11:09:09.844 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:09.849 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:09.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:09.869 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-05-12T11:09:10.254 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:10.265 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:10.266 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:10.542 INFO:teuthology.orchestra.run.smithi116.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:10.550 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/499 2023-05-12T11:09:10.550 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/499 2023-05-12T11:09:10.551 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:10.556 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:10.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:10.576 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-05-12T11:09:10.964 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:10.976 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:10.976 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:11.326 INFO:teuthology.orchestra.run.smithi116.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:11.334 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/500 2023-05-12T11:09:11.334 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/500 2023-05-12T11:09:11.334 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:11.339 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:11.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:11.360 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-05-12T11:09:11.725 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:09:11.729 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:09:11.755 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:11.767 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:11.767 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:12.085 INFO:teuthology.orchestra.run.smithi116.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:12.094 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/501 2023-05-12T11:09:12.094 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/501 2023-05-12T11:09:12.094 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:12.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:12.120 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-05-12T11:09:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:12.525 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:12.828 INFO:teuthology.orchestra.run.smithi116.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:12.836 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/502 2023-05-12T11:09:12.837 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/502 2023-05-12T11:09:12.837 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:12.842 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:12.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:12.862 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-05-12T11:09:13.250 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:13.261 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:13.261 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:13.547 INFO:teuthology.orchestra.run.smithi116.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:13.555 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/503 2023-05-12T11:09:13.555 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/503 2023-05-12T11:09:13.556 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:13.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:13.580 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-05-12T11:09:13.970 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:13.981 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:13.981 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:14.329 INFO:teuthology.orchestra.run.smithi116.stdout:generic/504 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/504.out.bad) 2023-05-12T11:09:14.334 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/504.out 2023-05-12 09:09:18.898489730 +0000 2023-05-12T11:09:14.335 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/504.out.bad 2023-05-12 11:09:14.323919306 +0000 2023-05-12T11:09:14.335 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1,2 +1,3 @@ 2023-05-12T11:09:14.335 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 504 2023-05-12T11:09:14.335 INFO:teuthology.orchestra.run.smithi116.stdout: +lock info not found 2023-05-12T11:09:14.335 INFO:teuthology.orchestra.run.smithi116.stdout: Silence is golden 2023-05-12T11:09:14.340 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/504 2023-05-12T11:09:14.340 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/504 2023-05-12T11:09:14.340 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T11:09:14.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:14.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T11:09:14.364 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T11:09:14.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T11:09:14.365 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-05-12T11:09:14.753 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:14.764 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:14.764 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:15.040 INFO:teuthology.orchestra.run.smithi116.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:15.048 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/505 2023-05-12T11:09:15.048 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/505 2023-05-12T11:09:15.048 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:15.054 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:15.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:15.073 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-05-12T11:09:15.464 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:15.475 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:15.475 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:15.765 INFO:teuthology.orchestra.run.smithi116.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:15.773 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/506 2023-05-12T11:09:15.773 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/506 2023-05-12T11:09:15.773 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:15.779 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:15.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:15.799 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-05-12T11:09:16.190 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:16.201 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-05-12T11:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/507 2023-05-12T11:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/507 2023-05-12T11:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:16.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:16.594 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-05-12T11:09:16.983 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:16.994 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:17.297 INFO:teuthology.orchestra.run.smithi116.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-05-12T11:09:17.305 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/508 2023-05-12T11:09:17.305 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/508 2023-05-12T11:09:17.305 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:17.311 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:17.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:17.331 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-05-12T11:09:17.722 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:17.732 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:17.733 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:18.039 INFO:teuthology.orchestra.run.smithi116.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:18.047 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/509 2023-05-12T11:09:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/509 2023-05-12T11:09:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:18.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:18.072 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-05-12T11:09:18.455 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:18.466 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:18.768 INFO:teuthology.orchestra.run.smithi116.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:18.776 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/510 2023-05-12T11:09:18.776 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/510 2023-05-12T11:09:18.776 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:18.782 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:18.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:18.802 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-05-12T11:09:19.189 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:19.200 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:19.200 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:19.475 INFO:teuthology.orchestra.run.smithi116.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:19.484 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/511 2023-05-12T11:09:19.484 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/511 2023-05-12T11:09:19.484 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:19.489 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:19.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:19.509 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-05-12T11:09:19.898 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:19.909 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:19.910 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:20.208 INFO:teuthology.orchestra.run.smithi116.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:20.216 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/512 2023-05-12T11:09:20.217 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/512 2023-05-12T11:09:20.217 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:20.222 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:20.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:20.242 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-05-12T11:09:20.624 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:20.635 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:20.954 INFO:teuthology.orchestra.run.smithi116.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:20.962 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/513 2023-05-12T11:09:20.962 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/513 2023-05-12T11:09:20.962 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:20.968 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:20.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:20.989 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-05-12T11:09:21.377 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:21.389 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:21.389 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:21.677 INFO:teuthology.orchestra.run.smithi116.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:21.686 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/514 2023-05-12T11:09:21.686 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/514 2023-05-12T11:09:21.686 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:21.691 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:21.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:21.711 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-05-12T11:09:22.101 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:22.112 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:22.113 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:22.404 INFO:teuthology.orchestra.run.smithi116.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:22.412 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/515 2023-05-12T11:09:22.412 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/515 2023-05-12T11:09:22.412 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:22.418 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:22.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:22.437 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-05-12T11:09:22.824 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:22.835 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:22.835 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:23.213 INFO:teuthology.orchestra.run.smithi116.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-12T11:09:23.222 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/516 2023-05-12T11:09:23.222 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/516 2023-05-12T11:09:23.222 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:23.227 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:23.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:23.246 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-05-12T11:09:23.959 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:23.970 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:23.970 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:24.244 INFO:teuthology.orchestra.run.smithi116.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:24.252 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/517 2023-05-12T11:09:24.252 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/517 2023-05-12T11:09:24.253 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:24.258 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:24.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:24.277 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-05-12T11:09:24.669 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:24.680 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:24.680 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:24.960 INFO:teuthology.orchestra.run.smithi116.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:24.968 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/518 2023-05-12T11:09:24.969 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/518 2023-05-12T11:09:24.969 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:24.974 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:24.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:24.994 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-05-12T11:09:25.382 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:25.393 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:25.393 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:25.670 INFO:teuthology.orchestra.run.smithi116.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:25.678 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/519 2023-05-12T11:09:25.679 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/519 2023-05-12T11:09:25.679 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:25.684 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:25.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:25.703 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-05-12T11:09:26.086 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:26.097 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:26.409 INFO:teuthology.orchestra.run.smithi116.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T11:09:26.417 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/520 2023-05-12T11:09:26.417 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/520 2023-05-12T11:09:26.418 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T11:09:26.423 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:26.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T11:09:26.444 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-05-12T11:09:26.832 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T11:09:26.843 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T11:09:26.844 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T11:09:42.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:09:42.008 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:10:12.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:10:12.182 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:10:42.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:10:42.313 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:11:12.482 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:11:12.486 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:11:42.592 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:11:42.596 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:12:12.722 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:12:12.727 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:12:42.819 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:12:42.824 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:13:12.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:13:12.970 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:13:43.081 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:13:43.086 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:14:14.212 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:14:14.216 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:14:44.569 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:14:44.573 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:15:14.774 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:15:14.778 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:15:44.873 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:15:44.877 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:16:14.970 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:16:14.974 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:16:15.057 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T11:16:15.054+0000 7f4e7fbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147521) UID: 0 2023-05-12T11:16:15.058 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T11:16:15.054+0000 7fb0059f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147521) UID: 0 2023-05-12T11:16:15.058 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T11:16:15.054+0000 7fe44e3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147521) UID: 0 2023-05-12T11:16:15.059 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T11:16:15.054+0000 7f02559f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147521) UID: 0 2023-05-12T11:19:04.151 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:19:04.156 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:19:04.267 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T11:19:04.263+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 505199) UID: 0 2023-05-12T11:19:04.268 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T11:19:04.264+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 505199) UID: 0 2023-05-12T11:19:04.268 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T11:19:04.264+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 505199) UID: 0 2023-05-12T11:19:04.269 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T11:19:04.264+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 505199) UID: 0 2023-05-12T11:22:24.600 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:22:24.604 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:22:54.713 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:22:54.717 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:22:54.802 INFO:tasks.ceph.mds.c.smithi116.stderr:2023-05-12T11:22:54.799+0000 7fc0547f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 505290) UID: 0 2023-05-12T11:22:54.803 INFO:tasks.ceph.mds.a.smithi116.stderr:2023-05-12T11:22:54.799+0000 7fa6111f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 505290) UID: 0 2023-05-12T11:25:46.799 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:25:46.803 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:26:16.964 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:26:16.968 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:26:47.070 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:26:47.074 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:27:17.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:27:17.177 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:27:47.298 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:27:47.302 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:28:17.410 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:28:17.414 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:28:47.558 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:28:47.562 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:29:18.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:29:18.394 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:29:48.495 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:29:48.500 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:30:18.585 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:30:18.589 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:30:48.883 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:30:48.887 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:31:18.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:31:18.994 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:31:49.093 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:31:49.098 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:32:19.350 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:32:19.354 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:32:49.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:32:49.452 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:33:19.761 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:33:19.765 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:33:49.894 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:33:49.898 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:34:19.997 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:34:20.002 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:34:50.103 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:34:50.107 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:35:20.208 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:35:20.213 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:35:50.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:35:50.331 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:36:20.470 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:36:20.474 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:36:51.041 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:36:51.045 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:37:21.171 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:37:21.175 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:37:51.303 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:37:51.308 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:38:22.322 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:38:22.327 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:38:52.432 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:38:52.437 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:39:22.671 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:39:22.676 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:39:53.011 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:39:53.015 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:40:23.209 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:40:23.213 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:40:53.314 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:40:53.317 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:41:24.103 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:41:24.107 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:41:54.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:41:54.216 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:42:24.325 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:42:24.329 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:42:24.410 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T11:42:24.406+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506287) UID: 0 2023-05-12T11:42:24.411 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T11:42:24.406+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506287) UID: 0 2023-05-12T11:42:24.411 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T11:42:24.407+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506287) UID: 0 2023-05-12T11:42:24.411 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T11:42:24.407+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506287) UID: 0 2023-05-12T11:45:18.065 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:45:18.069 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:45:48.244 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:45:48.248 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:46:19.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:46:19.014 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:46:49.115 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:46:49.120 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:47:19.218 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:47:19.224 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:47:49.320 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:47:49.324 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:48:19.469 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:48:19.473 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:48:49.603 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:48:49.608 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:49:19.881 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:49:19.886 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:49:49.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:49:49.994 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:50:20.095 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:50:20.099 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:50:50.200 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:50:50.205 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:51:20.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:51:20.321 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:51:50.455 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:51:50.460 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:52:21.761 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:52:21.765 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:52:51.866 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:52:51.870 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:53:21.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:53:21.969 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:53:52.071 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:53:52.076 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:54:22.174 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:54:22.178 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:54:53.197 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:54:53.227 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:55:23.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:55:23.335 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:55:53.455 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:55:53.459 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:56:23.586 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:56:23.590 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:56:53.738 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:56:53.742 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:57:23.833 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:57:23.837 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:57:53.955 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:57:53.959 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T11:57:54.042 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T11:57:54.038+0000 7f4e7fbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149425) UID: 0 2023-05-12T11:57:54.042 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T11:57:54.038+0000 7fe44e3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149425) UID: 0 2023-05-12T11:57:54.043 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T11:57:54.038+0000 7f02559f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149425) UID: 0 2023-05-12T11:57:54.043 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T11:57:54.038+0000 7fb0059f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149425) UID: 0 2023-05-12T12:00:08.933 INFO:teuthology.orchestra.run.smithi116.stdout:generic/521 3042s 2023-05-12T12:00:08.962 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/521 2023-05-12T12:00:08.963 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:00:08.968 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:00:08.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:00:09.000 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-05-12T12:00:09.946 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:00:09.956 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:00:09.957 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:00:37.511 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:00:37.515 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:01:07.731 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:01:07.736 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:01:37.863 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:01:37.867 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:02:08.037 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:02:08.041 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:02:38.267 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:02:38.272 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:03:08.375 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:03:08.379 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:03:38.473 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:03:38.477 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:04:08.608 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:04:08.613 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:04:38.722 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:04:38.726 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:05:08.825 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:05:08.829 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:05:38.923 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:05:38.927 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:06:09.039 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:06:09.044 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:06:39.878 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:06:39.882 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:07:09.983 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:07:09.988 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:07:40.089 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:07:40.094 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:08:10.262 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:08:10.266 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:08:40.436 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:08:40.440 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:09:10.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:09:10.573 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:09:40.687 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:09:40.692 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:10:10.788 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:10:10.793 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:10:40.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:10:40.970 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:11:11.097 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:11:11.101 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:11:41.278 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:11:41.282 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:12:12.248 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:12:12.252 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:12:42.366 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:12:42.371 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:13:12.488 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:13:12.492 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:13:42.601 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:13:42.607 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:14:12.724 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:14:12.728 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:14:43.039 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:14:43.043 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:15:13.153 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:15:13.157 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:15:43.261 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:15:43.265 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:15:43.344 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T12:15:43.340+0000 7f4e7fbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 150341) UID: 0 2023-05-12T12:15:43.344 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T12:15:43.341+0000 7fb0059f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 150341) UID: 0 2023-05-12T12:15:43.345 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T12:15:43.341+0000 7fe44e3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 150341) UID: 0 2023-05-12T12:15:43.345 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T12:15:43.341+0000 7f02559f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 150341) UID: 0 2023-05-12T12:18:23.086 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:18:23.090 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:18:53.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:18:53.215 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:19:23.343 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:19:23.348 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:19:53.874 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:19:53.878 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:20:23.997 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:20:24.001 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:20:24.175 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T12:20:24.171+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508631) UID: 0 2023-05-12T12:20:24.175 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T12:20:24.171+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508631) UID: 0 2023-05-12T12:20:24.176 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T12:20:24.171+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508631) UID: 0 2023-05-12T12:20:24.176 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T12:20:24.171+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508631) UID: 0 2023-05-12T12:23:30.082 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:23:30.086 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:24:00.477 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:24:00.481 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:24:30.576 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:24:30.580 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:25:00.673 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:25:00.677 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:25:31.480 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:25:31.485 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:26:01.584 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:26:01.589 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:26:31.709 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:26:31.713 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:27:01.821 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:27:01.826 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:27:32.002 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:27:32.007 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:28:02.100 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:28:02.105 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:28:32.264 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:28:32.269 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:29:02.431 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:29:02.436 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:29:32.622 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:29:32.626 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:30:03.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:30:03.327 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:30:33.441 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:30:33.446 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:30:33.529 INFO:tasks.ceph.mds.c.smithi116.stderr:2023-05-12T12:30:33.525+0000 7fc0547f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 509092) UID: 0 2023-05-12T12:30:33.529 INFO:tasks.ceph.mds.a.smithi116.stderr:2023-05-12T12:30:33.525+0000 7fa6111f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 509092) UID: 0 2023-05-12T12:33:27.952 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:33:27.957 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:33:58.152 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:33:58.157 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:34:28.265 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:34:28.269 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:34:58.377 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:34:58.381 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:35:28.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:35:28.538 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:35:58.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:35:58.737 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:36:28.838 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:36:28.842 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:36:58.953 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:36:58.958 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:37:29.067 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:37:29.070 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:38:00.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:38:00.387 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:38:30.539 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:38:30.543 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:38:47.107 INFO:teuthology.orchestra.run.smithi116.stdout:generic/522 2318s 2023-05-12T12:38:47.144 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/522 2023-05-12T12:38:47.145 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:47.150 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:47.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:47.170 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-05-12T12:38:47.707 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:47.719 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:47.719 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:48.018 INFO:teuthology.orchestra.run.smithi116.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:48.026 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/523 2023-05-12T12:38:48.026 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/523 2023-05-12T12:38:48.027 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:48.032 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:48.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:48.052 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-05-12T12:38:48.437 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:48.448 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:48.449 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:48.721 INFO:teuthology.orchestra.run.smithi116.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:48.729 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/524 2023-05-12T12:38:48.729 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/524 2023-05-12T12:38:48.729 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:48.735 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:48.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:48.754 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-05-12T12:38:49.138 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:49.149 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:49.149 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:49.426 INFO:teuthology.orchestra.run.smithi116.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:49.434 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/525 2023-05-12T12:38:49.434 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/525 2023-05-12T12:38:49.434 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:49.439 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:49.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:49.459 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-05-12T12:38:49.847 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:49.858 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:49.858 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:50.226 INFO:teuthology.orchestra.run.smithi116.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:50.235 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/526 2023-05-12T12:38:50.235 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/526 2023-05-12T12:38:50.235 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:50.240 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:50.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:50.260 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-05-12T12:38:50.655 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:50.666 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:50.666 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:50.972 INFO:teuthology.orchestra.run.smithi116.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:50.981 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/527 2023-05-12T12:38:50.981 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/527 2023-05-12T12:38:50.981 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:51.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:51.006 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-05-12T12:38:51.397 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:51.408 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:51.408 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:51.741 INFO:teuthology.orchestra.run.smithi116.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-05-12T12:38:51.750 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/528 2023-05-12T12:38:51.750 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/528 2023-05-12T12:38:51.750 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:51.755 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:51.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:51.775 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-05-12T12:38:52.165 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:52.176 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:52.176 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:52.500 INFO:teuthology.orchestra.run.smithi116.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-12T12:38:52.508 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/529 2023-05-12T12:38:52.509 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/529 2023-05-12T12:38:52.509 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:52.514 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:52.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:52.533 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-05-12T12:38:52.921 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:52.932 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:52.933 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:53.207 INFO:teuthology.orchestra.run.smithi116.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:53.215 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/530 2023-05-12T12:38:53.215 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/530 2023-05-12T12:38:53.215 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:53.220 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:53.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:53.240 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-05-12T12:38:53.621 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:53.632 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:53.632 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:53.912 INFO:teuthology.orchestra.run.smithi116.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:53.920 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/531 2023-05-12T12:38:53.921 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/531 2023-05-12T12:38:53.921 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:53.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:53.947 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-05-12T12:38:54.332 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:54.343 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:54.343 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:54.695 INFO:teuthology.orchestra.run.smithi116.stdout:generic/532 0s 2023-05-12T12:38:54.707 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/532 2023-05-12T12:38:54.707 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:54.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:54.732 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-05-12T12:38:55.120 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:55.131 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:55.131 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:55.791 INFO:teuthology.orchestra.run.smithi116.stdout:generic/533 0s 2023-05-12T12:38:55.802 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/533 2023-05-12T12:38:55.802 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:55.808 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:55.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:55.826 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-05-12T12:38:56.210 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:56.221 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:56.221 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:56.538 INFO:teuthology.orchestra.run.smithi116.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:56.546 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/534 2023-05-12T12:38:56.546 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/534 2023-05-12T12:38:56.546 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:56.552 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:56.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:56.572 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-05-12T12:38:56.962 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:56.973 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:56.973 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:57.276 INFO:teuthology.orchestra.run.smithi116.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:57.284 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/535 2023-05-12T12:38:57.284 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/535 2023-05-12T12:38:57.285 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:57.290 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:57.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:57.310 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-05-12T12:38:57.702 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:57.714 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:57.714 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:57.989 INFO:teuthology.orchestra.run.smithi116.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:57.997 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/536 2023-05-12T12:38:57.997 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/536 2023-05-12T12:38:57.998 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:58.003 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:58.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:58.022 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-05-12T12:38:58.405 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:58.417 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:58.691 INFO:teuthology.orchestra.run.smithi116.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T12:38:58.700 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/537 2023-05-12T12:38:58.700 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/537 2023-05-12T12:38:58.700 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T12:38:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:38:58.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T12:38:58.725 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-05-12T12:38:59.116 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T12:38:59.127 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T12:38:59.127 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T12:39:00.637 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:39:00.641 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:39:30.897 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:39:30.902 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:40:00.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:40:01.000 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:40:01.089 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T12:40:01.086+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 517188) UID: 0 2023-05-12T12:40:01.090 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T12:40:01.086+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 517188) UID: 0 2023-05-12T12:40:01.090 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T12:40:01.086+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 517188) UID: 0 2023-05-12T12:40:01.091 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T12:40:01.086+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 517188) UID: 0 2023-05-12T12:43:03.597 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:43:03.601 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:43:33.767 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:43:33.771 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:44:03.881 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:44:03.886 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:44:33.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:44:33.993 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:45:04.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:45:04.147 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:45:34.256 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:45:34.260 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:46:04.899 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:46:04.903 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:46:35.010 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:46:35.014 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:47:05.157 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:47:05.162 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:47:35.943 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:47:35.947 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:48:06.057 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:48:06.061 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:48:36.182 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:48:36.187 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:49:06.286 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:49:06.291 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:49:36.384 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:49:36.388 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:50:06.516 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:50:06.520 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:50:36.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:50:36.651 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:51:06.945 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:51:06.949 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:51:37.050 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:51:37.055 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:52:07.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:52:07.152 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:52:37.247 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:52:37.251 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:53:07.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:53:07.364 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:53:37.559 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:53:37.564 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:54:07.749 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:54:07.756 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:54:37.851 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:54:37.856 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:55:07.967 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:55:07.971 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:55:38.592 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:55:38.597 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:56:08.694 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:56:08.698 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:56:39.159 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:56:39.163 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:57:09.260 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:57:09.264 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:57:39.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:57:39.363 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:58:09.456 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:58:09.461 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:58:39.597 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:58:39.602 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:59:09.695 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:59:09.700 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:59:39.851 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T12:59:39.856 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:00:10.082 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:00:10.086 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:00:40.404 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:00:40.408 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:00:40.492 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T13:00:40.489+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521036) UID: 0 2023-05-12T13:00:40.493 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T13:00:40.489+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521036) UID: 0 2023-05-12T13:00:40.493 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T13:00:40.489+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521036) UID: 0 2023-05-12T13:00:40.494 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T13:00:40.489+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521036) UID: 0 2023-05-12T13:03:41.597 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:03:41.602 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:04:11.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:04:11.974 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:04:42.067 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:04:42.072 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:04:42.153 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T13:04:42.150+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521676) UID: 0 2023-05-12T13:04:42.154 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T13:04:42.150+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521676) UID: 0 2023-05-12T13:04:42.154 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T13:04:42.150+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521676) UID: 0 2023-05-12T13:04:42.154 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T13:04:42.150+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521676) UID: 0 2023-05-12T13:07:46.233 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:07:46.237 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:08:16.359 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:08:16.364 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:08:46.460 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:08:46.465 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:09:16.583 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:09:16.587 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:09:47.511 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:09:47.515 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:10:17.624 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:10:17.628 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:10:47.745 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:10:47.766 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:11:17.857 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:11:17.861 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:11:48.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:11:48.036 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:12:18.130 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:12:18.135 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:12:48.380 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:12:48.384 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:13:18.483 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:13:18.487 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:13:48.599 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:13:48.604 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:14:18.730 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:14:18.735 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:14:48.885 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:14:48.889 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:15:18.983 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:15:18.987 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:15:49.087 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:15:49.092 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:16:19.187 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:16:19.192 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:16:49.285 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:16:49.289 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:17:19.837 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:17:19.842 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:17:49.944 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:17:49.948 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:18:20.100 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:18:20.104 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:18:50.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:18:50.343 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:19:20.478 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:19:20.483 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:19:50.674 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:19:50.678 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:20:20.855 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:20:20.860 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:20:50.961 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:20:50.965 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:21:21.099 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:21:21.103 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:21:51.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:21:51.335 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:22:21.436 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:22:21.441 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:22:51.559 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:22:51.563 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:23:21.682 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:23:21.686 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:23:21.767 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T13:23:21.764+0000 7f9b609f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 525060) UID: 0 2023-05-12T13:23:21.767 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T13:23:21.764+0000 7f9f9b5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 525060) UID: 0 2023-05-12T13:23:21.768 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T13:23:21.764+0000 7f3f34df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 525060) UID: 0 2023-05-12T13:23:21.768 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T13:23:21.764+0000 7f447abf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 525060) UID: 0 2023-05-12T13:25:37.439 INFO:teuthology.orchestra.run.smithi116.stdout:generic/538 2798s 2023-05-12T13:25:37.468 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/538 2023-05-12T13:25:37.468 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:37.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:37.533 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-05-12T13:25:38.424 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:38.436 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:38.436 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:41.198 INFO:teuthology.orchestra.run.smithi116.stdout:generic/539 3s 2023-05-12T13:25:41.210 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/539 2023-05-12T13:25:41.210 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:41.215 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:41.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:41.238 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-05-12T13:25:42.005 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:42.017 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:42.017 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:42.734 INFO:teuthology.orchestra.run.smithi116.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:42.742 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/540 2023-05-12T13:25:42.742 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/540 2023-05-12T13:25:42.742 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:42.748 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:42.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:42.771 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-05-12T13:25:43.168 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:43.180 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:43.180 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:43.459 INFO:teuthology.orchestra.run.smithi116.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:43.469 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/541 2023-05-12T13:25:43.469 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/541 2023-05-12T13:25:43.469 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:43.475 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:43.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:43.497 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-05-12T13:25:43.893 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:43.904 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:43.904 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:44.184 INFO:teuthology.orchestra.run.smithi116.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:44.192 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/542 2023-05-12T13:25:44.192 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/542 2023-05-12T13:25:44.192 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:44.197 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:44.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:44.219 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-05-12T13:25:44.609 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:44.620 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:44.897 INFO:teuthology.orchestra.run.smithi116.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:44.905 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/543 2023-05-12T13:25:44.905 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/543 2023-05-12T13:25:44.906 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:44.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:44.933 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-05-12T13:25:45.326 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:45.337 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:45.337 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:45.628 INFO:teuthology.orchestra.run.smithi116.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:45.637 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/544 2023-05-12T13:25:45.637 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/544 2023-05-12T13:25:45.637 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:45.642 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:45.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:45.664 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-05-12T13:25:46.082 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:46.093 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:46.482 INFO:teuthology.orchestra.run.smithi116.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-05-12T13:25:46.490 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/545 2023-05-12T13:25:46.491 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/545 2023-05-12T13:25:46.491 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:46.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:46.518 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-05-12T13:25:46.939 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:46.950 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:47.393 INFO:teuthology.orchestra.run.smithi116.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:47.402 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/546 2023-05-12T13:25:47.402 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/546 2023-05-12T13:25:47.402 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:47.407 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:47.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:47.431 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-05-12T13:25:47.820 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:47.831 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:47.831 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:48.165 INFO:teuthology.orchestra.run.smithi116.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:48.174 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/547 2023-05-12T13:25:48.175 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/547 2023-05-12T13:25:48.175 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:48.182 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:48.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:48.206 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-05-12T13:25:48.603 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:48.614 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:48.614 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:48.983 INFO:teuthology.orchestra.run.smithi116.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:48.991 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/548 2023-05-12T13:25:48.991 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/548 2023-05-12T13:25:48.991 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:48.996 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:49.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:49.017 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-05-12T13:25:49.409 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:49.420 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:49.420 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:49.768 INFO:teuthology.orchestra.run.smithi116.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:49.776 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/549 2023-05-12T13:25:49.776 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/549 2023-05-12T13:25:49.777 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:49.782 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:49.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:49.803 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-05-12T13:25:50.187 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:50.198 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:50.199 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:50.542 INFO:teuthology.orchestra.run.smithi116.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:50.550 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/550 2023-05-12T13:25:50.550 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/550 2023-05-12T13:25:50.551 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:50.556 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:50.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:50.577 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-05-12T13:25:50.964 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:50.975 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:51.259 INFO:teuthology.orchestra.run.smithi116.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:51.267 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/551 2023-05-12T13:25:51.268 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/551 2023-05-12T13:25:51.268 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:51.273 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:51.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:51.294 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-05-12T13:25:51.679 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:51.690 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:51.690 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:51.999 INFO:teuthology.orchestra.run.smithi116.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:52.007 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/552 2023-05-12T13:25:52.007 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/552 2023-05-12T13:25:52.008 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:52.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:52.033 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-05-12T13:25:52.425 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:52.437 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:52.437 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:52.858 INFO:teuthology.orchestra.run.smithi116.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-05-12T13:25:52.867 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/553 2023-05-12T13:25:52.867 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/553 2023-05-12T13:25:52.867 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:52.872 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:52.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:52.969 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-05-12T13:25:53.601 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:53.613 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:53.613 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:53.887 INFO:teuthology.orchestra.run.smithi116.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:53.896 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/554 2023-05-12T13:25:53.896 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/554 2023-05-12T13:25:53.896 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:53.901 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:53.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:53.922 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-05-12T13:25:54.312 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:54.323 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:54.324 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:54.697 INFO:teuthology.orchestra.run.smithi116.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-05-12T13:25:54.705 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/555 2023-05-12T13:25:54.705 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/555 2023-05-12T13:25:54.706 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:54.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:54.738 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-05-12T13:25:55.447 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:55.459 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:55.459 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:55.736 INFO:teuthology.orchestra.run.smithi116.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:55.744 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/556 2023-05-12T13:25:55.744 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/556 2023-05-12T13:25:55.745 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:55.750 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:55.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:55.771 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-05-12T13:25:56.154 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:56.165 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:56.165 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:56.469 INFO:teuthology.orchestra.run.smithi116.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:56.477 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/557 2023-05-12T13:25:56.478 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/557 2023-05-12T13:25:56.478 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:56.483 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:56.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:56.503 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-05-12T13:25:56.889 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:56.900 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:56.900 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:57.189 INFO:teuthology.orchestra.run.smithi116.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:57.197 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/558 2023-05-12T13:25:57.198 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/558 2023-05-12T13:25:57.198 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:57.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:57.224 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-05-12T13:25:57.613 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:57.624 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:57.902 INFO:teuthology.orchestra.run.smithi116.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:57.910 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/559 2023-05-12T13:25:57.910 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/559 2023-05-12T13:25:57.911 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:57.916 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:57.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:57.937 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-05-12T13:25:58.329 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:58.340 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:58.340 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:58.619 INFO:teuthology.orchestra.run.smithi116.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:58.627 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/560 2023-05-12T13:25:58.628 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/560 2023-05-12T13:25:58.628 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:58.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:58.655 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-05-12T13:25:59.043 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:59.054 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:59.054 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:59.338 INFO:teuthology.orchestra.run.smithi116.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:25:59.345 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/561 2023-05-12T13:25:59.345 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/561 2023-05-12T13:25:59.345 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:25:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:25:59.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:25:59.372 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-05-12T13:25:59.757 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:25:59.768 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:25:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:00.046 INFO:teuthology.orchestra.run.smithi116.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:00.054 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/562 2023-05-12T13:26:00.055 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/562 2023-05-12T13:26:00.055 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:00.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:00.082 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-05-12T13:26:00.466 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:00.477 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:00.798 INFO:teuthology.orchestra.run.smithi116.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:00.806 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/563 2023-05-12T13:26:00.807 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/563 2023-05-12T13:26:00.807 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:00.812 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:00.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:00.833 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-05-12T13:26:01.230 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:01.241 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:01.242 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:01.814 INFO:teuthology.orchestra.run.smithi116.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-05-12T13:26:01.823 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/564 2023-05-12T13:26:01.823 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/564 2023-05-12T13:26:01.823 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:01.828 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:01.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:01.866 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-05-12T13:26:02.550 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:02.562 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:02.562 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:02.848 INFO:teuthology.orchestra.run.smithi116.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:02.856 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/565 2023-05-12T13:26:02.856 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/565 2023-05-12T13:26:02.857 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:02.862 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:02.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:02.884 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-05-12T13:26:03.272 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:03.283 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:03.557 INFO:teuthology.orchestra.run.smithi116.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:03.566 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/566 2023-05-12T13:26:03.566 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/566 2023-05-12T13:26:03.566 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:03.571 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:03.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:03.592 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-05-12T13:26:03.983 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:03.994 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:03.995 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:04.270 INFO:teuthology.orchestra.run.smithi116.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:04.279 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/567 2023-05-12T13:26:04.279 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/567 2023-05-12T13:26:04.279 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:04.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:04.304 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-05-12T13:26:04.689 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:04.700 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:04.701 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:05.192 INFO:teuthology.orchestra.run.smithi116.stdout:generic/568 1s 2023-05-12T13:26:05.221 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/568 2023-05-12T13:26:05.221 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:05.232 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:05.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:05.315 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-05-12T13:26:05.829 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:05.840 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:05.840 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:06.201 INFO:teuthology.orchestra.run.smithi116.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:06.209 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/569 2023-05-12T13:26:06.209 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/569 2023-05-12T13:26:06.209 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:06.214 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:06.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:06.237 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-05-12T13:26:06.626 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:06.638 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:06.638 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:06.920 INFO:teuthology.orchestra.run.smithi116.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:06.928 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/570 2023-05-12T13:26:06.928 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/570 2023-05-12T13:26:06.929 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:06.934 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:06.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:06.954 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-05-12T13:26:07.342 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:07.353 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:07.353 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:13.831 INFO:teuthology.orchestra.run.smithi116.stdout:generic/571 6s 2023-05-12T13:26:13.844 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/571 2023-05-12T13:26:13.844 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:13.849 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:13.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:13.873 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-05-12T13:26:14.587 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:14.598 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:14.599 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:14.890 INFO:teuthology.orchestra.run.smithi116.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:14.898 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/572 2023-05-12T13:26:14.899 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/572 2023-05-12T13:26:14.899 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:14.904 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:14.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:14.924 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-05-12T13:26:15.309 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:15.320 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:15.320 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:15.599 INFO:teuthology.orchestra.run.smithi116.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:15.607 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/573 2023-05-12T13:26:15.608 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/573 2023-05-12T13:26:15.608 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:15.613 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:15.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:15.634 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-05-12T13:26:16.022 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:16.033 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:16.034 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:16.313 INFO:teuthology.orchestra.run.smithi116.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:16.321 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/574 2023-05-12T13:26:16.322 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/574 2023-05-12T13:26:16.322 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:16.327 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:16.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:16.348 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-05-12T13:26:16.736 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:16.747 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:16.747 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:17.031 INFO:teuthology.orchestra.run.smithi116.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:17.039 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/575 2023-05-12T13:26:17.040 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/575 2023-05-12T13:26:17.040 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:17.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:17.067 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-05-12T13:26:17.455 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:17.466 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:17.807 INFO:teuthology.orchestra.run.smithi116.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:17.815 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/576 2023-05-12T13:26:17.816 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/576 2023-05-12T13:26:17.816 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:17.821 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:17.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:17.845 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-05-12T13:26:18.228 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:18.239 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:18.239 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:18.519 INFO:teuthology.orchestra.run.smithi116.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:18.528 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/577 2023-05-12T13:26:18.528 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/577 2023-05-12T13:26:18.529 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:18.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:18.554 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-05-12T13:26:18.907 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:26:18.911 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:26:18.942 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:18.954 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:18.954 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:19.322 INFO:teuthology.orchestra.run.smithi116.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T13:26:19.330 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/578 2023-05-12T13:26:19.330 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/578 2023-05-12T13:26:19.331 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:19.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:19.376 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-05-12T13:26:20.075 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:20.086 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:20.385 INFO:teuthology.orchestra.run.smithi116.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:20.393 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/579 2023-05-12T13:26:20.394 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/579 2023-05-12T13:26:20.394 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:20.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:20.421 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-05-12T13:26:20.807 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:20.818 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:20.818 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:21.159 INFO:teuthology.orchestra.run.smithi116.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:21.168 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/580 2023-05-12T13:26:21.168 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/580 2023-05-12T13:26:21.168 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:21.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:21.195 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-05-12T13:26:21.580 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:21.591 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:21.591 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:22.332 INFO:teuthology.orchestra.run.smithi116.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:22.340 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/581 2023-05-12T13:26:22.340 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/581 2023-05-12T13:26:22.340 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:22.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:22.366 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-05-12T13:26:22.758 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:22.769 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:22.769 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:23.111 INFO:teuthology.orchestra.run.smithi116.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:23.119 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/582 2023-05-12T13:26:23.120 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/582 2023-05-12T13:26:23.120 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:23.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:23.146 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-05-12T13:26:23.539 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:23.550 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:23.550 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:23.891 INFO:teuthology.orchestra.run.smithi116.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:23.900 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/583 2023-05-12T13:26:23.900 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/583 2023-05-12T13:26:23.900 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:23.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:23.926 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-05-12T13:26:24.311 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:24.322 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:24.322 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:24.676 INFO:teuthology.orchestra.run.smithi116.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:24.684 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/584 2023-05-12T13:26:24.685 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/584 2023-05-12T13:26:24.685 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:24.690 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:24.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:24.711 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-05-12T13:26:25.098 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:25.109 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:25.109 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:25.387 INFO:teuthology.orchestra.run.smithi116.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:25.396 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/585 2023-05-12T13:26:25.396 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/585 2023-05-12T13:26:25.396 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:25.401 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:25.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:25.422 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-05-12T13:26:25.807 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:25.819 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:48.830 INFO:teuthology.orchestra.run.smithi116.stdout:generic/586 23s 2023-05-12T13:26:48.841 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/586 2023-05-12T13:26:48.842 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:48.847 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:48.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:48.888 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-05-12T13:26:49.109 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:26:49.119 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:26:49.583 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:49.594 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:50.059 INFO:teuthology.orchestra.run.smithi116.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-12T13:26:50.068 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/587 2023-05-12T13:26:50.068 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/587 2023-05-12T13:26:50.068 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:50.073 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:50.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:50.094 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-05-12T13:26:50.489 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:50.500 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:50.501 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:50.809 INFO:teuthology.orchestra.run.smithi116.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:50.818 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/588 2023-05-12T13:26:50.818 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/588 2023-05-12T13:26:50.818 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:50.823 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:50.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:50.845 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-05-12T13:26:51.245 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:51.256 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:51.256 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:51.545 INFO:teuthology.orchestra.run.smithi116.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:51.553 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/589 2023-05-12T13:26:51.554 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/589 2023-05-12T13:26:51.554 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:51.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:51.581 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-05-12T13:26:51.968 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:51.979 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:52.259 INFO:teuthology.orchestra.run.smithi116.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:52.268 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/590 2023-05-12T13:26:52.268 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/590 2023-05-12T13:26:52.268 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:52.273 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:52.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:52.294 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-05-12T13:26:52.688 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:52.699 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:52.699 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:53.189 INFO:teuthology.orchestra.run.smithi116.stdout:generic/591 1s 2023-05-12T13:26:53.201 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/591 2023-05-12T13:26:53.201 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:53.206 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:53.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:53.227 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-05-12T13:26:53.937 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:53.949 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:54.299 INFO:teuthology.orchestra.run.smithi116.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:54.308 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/592 2023-05-12T13:26:54.308 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/592 2023-05-12T13:26:54.308 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:54.313 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:54.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:54.334 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-05-12T13:26:54.731 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:54.742 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:54.742 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:55.087 INFO:teuthology.orchestra.run.smithi116.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:55.095 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/593 2023-05-12T13:26:55.095 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/593 2023-05-12T13:26:55.096 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:55.101 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:55.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:55.122 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-05-12T13:26:55.511 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:55.522 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:55.805 INFO:teuthology.orchestra.run.smithi116.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:55.813 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/594 2023-05-12T13:26:55.813 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/594 2023-05-12T13:26:55.814 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:55.818 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:55.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:55.839 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-05-12T13:26:56.233 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:56.245 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:56.245 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:56.593 INFO:teuthology.orchestra.run.smithi116.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:26:56.601 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/595 2023-05-12T13:26:56.601 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/595 2023-05-12T13:26:56.601 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:56.607 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:56.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:56.629 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-05-12T13:26:57.021 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:57.033 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:57.033 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:57.392 INFO:teuthology.orchestra.run.smithi116.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-05-12T13:26:57.401 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/596 2023-05-12T13:26:57.401 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/596 2023-05-12T13:26:57.401 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:26:57.406 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:57.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:26:57.427 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-05-12T13:26:57.819 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:57.830 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:57.830 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:58.761 INFO:teuthology.orchestra.run.smithi116.stdout:generic/597 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/597.out.bad) 2023-05-12T13:26:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/597.out 2023-05-12 09:09:18.913489465 +0000 2023-05-12T13:26:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/597.out.bad 2023-05-12 13:26:58.755248310 +0000 2023-05-12T13:26:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -4,11 +4,11 @@ 2023-05-12T13:26:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: fs.protected_symlinks = 0 2023-05-12T13:26:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: successfully followed symlink 2023-05-12T13:26:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: fs.protected_symlinks = 1 2023-05-12T13:26:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: -Permission denied 2023-05-12T13:26:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: +successfully followed symlink 2023-05-12T13:26:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: == Test hardlink create protection when 2023-05-12T13:26:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: == process != target owner and process cannot read target 2023-05-12T13:26:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: fs.protected_hardlinks = 0 2023-05-12T13:26:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: -successfully created hardlink 2023-05-12T13:26:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: +Permission denied 2023-05-12T13:26:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: fs.protected_hardlinks = 1 2023-05-12T13:26:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-05-12T13:26:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: +Permission denied 2023-05-12T13:26:58.771 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/597 2023-05-12T13:26:58.772 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/597 2023-05-12T13:26:58.772 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T13:26:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:26:58.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T13:26:58.848 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T13:26:58.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T13:26:58.849 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-05-12T13:26:59.518 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:26:59.529 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:26:59.530 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:00.702 INFO:teuthology.orchestra.run.smithi116.stdout:generic/598 - output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/598.out.bad) 2023-05-12T13:27:00.707 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/598.out 2023-05-12 09:09:18.913489465 +0000 2023-05-12T13:27:00.708 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/598.out.bad 2023-05-12 13:27:00.697215031 +0000 2023-05-12T13:27:00.708 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -5,13 +5,10 @@ 2023-05-12T13:27:00.708 INFO:teuthology.orchestra.run.smithi116.stdout: = only group writable dir 2023-05-12T13:27:00.708 INFO:teuthology.orchestra.run.smithi116.stdout: fs.protected_regular = 1 2023-05-12T13:27:00.708 INFO:teuthology.orchestra.run.smithi116.stdout: = group & world writable dir 2023-05-12T13:27:00.709 INFO:teuthology.orchestra.run.smithi116.stdout: -Permission denied 2023-05-12T13:27:00.709 INFO:teuthology.orchestra.run.smithi116.stdout: = only group writable dir 2023-05-12T13:27:00.709 INFO:teuthology.orchestra.run.smithi116.stdout: fs.protected_regular = 2 2023-05-12T13:27:00.709 INFO:teuthology.orchestra.run.smithi116.stdout: = group & world writable dir 2023-05-12T13:27:00.709 INFO:teuthology.orchestra.run.smithi116.stdout: -Permission denied 2023-05-12T13:27:00.709 INFO:teuthology.orchestra.run.smithi116.stdout: = only group writable dir 2023-05-12T13:27:00.709 INFO:teuthology.orchestra.run.smithi116.stdout: -Permission denied 2023-05-12T13:27:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-05-12T13:27:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: fs.protected_fifos = 0 2023-05-12T13:27:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -19,10 +16,7 @@ 2023-05-12T13:27:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: = only group writable dir 2023-05-12T13:27:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: fs.protected_fifos = 1 2023-05-12T13:27:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: = group & world writable dir 2023-05-12T13:27:00.710 INFO:teuthology.orchestra.run.smithi116.stdout: -Permission denied 2023-05-12T13:27:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: = only group writable dir 2023-05-12T13:27:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: fs.protected_fifos = 2 2023-05-12T13:27:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: = group & world writable dir 2023-05-12T13:27:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: -Permission denied 2023-05-12T13:27:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: = only group writable dir 2023-05-12T13:27:00.711 INFO:teuthology.orchestra.run.smithi116.stdout: -Permission denied 2023-05-12T13:27:00.713 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/598 2023-05-12T13:27:00.713 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/598 2023-05-12T13:27:00.713 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T13:27:00.718 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:00.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T13:27:00.742 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T13:27:00.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T13:27:00.743 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-05-12T13:27:01.449 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:01.460 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:01.460 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:01.736 INFO:teuthology.orchestra.run.smithi116.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:01.745 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/599 2023-05-12T13:27:01.745 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/599 2023-05-12T13:27:01.745 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:01.750 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:01.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:01.772 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-05-12T13:27:02.167 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:02.178 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:02.178 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:02.473 INFO:teuthology.orchestra.run.smithi116.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:02.481 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/600 2023-05-12T13:27:02.481 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/600 2023-05-12T13:27:02.481 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:02.487 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:02.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:02.509 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-05-12T13:27:02.894 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:02.905 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:02.906 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:03.182 INFO:teuthology.orchestra.run.smithi116.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:03.191 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/601 2023-05-12T13:27:03.191 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/601 2023-05-12T13:27:03.191 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:03.196 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:03.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:03.218 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-05-12T13:27:03.607 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:03.619 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:03.619 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:03.969 INFO:teuthology.orchestra.run.smithi116.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:03.977 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/602 2023-05-12T13:27:03.978 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/602 2023-05-12T13:27:03.978 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:03.983 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:04.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:04.004 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-05-12T13:27:04.399 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:04.410 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:04.411 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:04.694 INFO:teuthology.orchestra.run.smithi116.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:04.702 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/603 2023-05-12T13:27:04.702 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/603 2023-05-12T13:27:04.702 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:04.707 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:04.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:04.729 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-05-12T13:27:05.122 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:05.133 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:05.411 INFO:teuthology.orchestra.run.smithi116.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:05.420 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/604 2023-05-12T13:27:05.420 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/604 2023-05-12T13:27:05.420 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:05.425 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:05.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:05.447 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-05-12T13:27:05.836 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:05.847 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:05.847 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:06.132 INFO:teuthology.orchestra.run.smithi116.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:06.141 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/605 2023-05-12T13:27:06.141 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/605 2023-05-12T13:27:06.141 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:06.146 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:06.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:06.167 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-05-12T13:27:06.560 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:06.571 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:06.572 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:06.853 INFO:teuthology.orchestra.run.smithi116.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:06.861 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/606 2023-05-12T13:27:06.861 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/606 2023-05-12T13:27:06.862 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:06.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:06.887 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-05-12T13:27:07.277 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:07.288 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:07.288 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:07.566 INFO:teuthology.orchestra.run.smithi116.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:07.574 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/607 2023-05-12T13:27:07.574 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/607 2023-05-12T13:27:07.574 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:07.579 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:07.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:07.601 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-05-12T13:27:07.988 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:07.999 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:07.999 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:08.278 INFO:teuthology.orchestra.run.smithi116.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:08.286 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/608 2023-05-12T13:27:08.286 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/608 2023-05-12T13:27:08.286 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:08.291 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:08.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:08.313 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-05-12T13:27:08.700 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:08.712 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:09.347 INFO:teuthology.orchestra.run.smithi116.stdout:generic/609 1s 2023-05-12T13:27:09.360 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/609 2023-05-12T13:27:09.360 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:09.365 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:09.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:09.419 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-05-12T13:27:10.097 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:10.108 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:10.108 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:10.385 INFO:teuthology.orchestra.run.smithi116.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:10.393 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/610 2023-05-12T13:27:10.393 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/610 2023-05-12T13:27:10.393 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:10.398 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:10.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:10.420 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-05-12T13:27:10.807 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:10.819 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:10.819 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:11.100 INFO:teuthology.orchestra.run.smithi116.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:11.109 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/611 2023-05-12T13:27:11.109 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/611 2023-05-12T13:27:11.109 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:11.114 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:11.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:11.135 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-05-12T13:27:11.524 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:11.536 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:11.536 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:12.120 INFO:teuthology.orchestra.run.smithi116.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T13:27:12.129 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/612 2023-05-12T13:27:12.129 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/612 2023-05-12T13:27:12.129 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:12.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:12.156 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-05-12T13:27:12.875 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:12.885 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:12.886 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:13.230 INFO:teuthology.orchestra.run.smithi116.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:13.239 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/613 2023-05-12T13:27:13.239 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/613 2023-05-12T13:27:13.239 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:13.244 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:13.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:13.265 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-05-12T13:27:13.650 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:13.661 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:13.944 INFO:teuthology.orchestra.run.smithi116.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:13.951 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/614 2023-05-12T13:27:13.952 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/614 2023-05-12T13:27:13.952 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:13.957 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:13.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:13.977 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-05-12T13:27:14.371 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:14.382 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:14.383 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:14.660 INFO:teuthology.orchestra.run.smithi116.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:14.668 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/615 2023-05-12T13:27:14.668 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/615 2023-05-12T13:27:14.668 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:14.673 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:14.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:14.694 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-05-12T13:27:15.081 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:15.092 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:15.092 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:15.378 INFO:teuthology.orchestra.run.smithi116.stdout:generic/616 [not run] kernel does not support IO_URING 2023-05-12T13:27:15.386 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/616 2023-05-12T13:27:15.387 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/616 2023-05-12T13:27:15.387 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:15.392 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:15.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:15.413 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-05-12T13:27:15.811 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:15.822 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:15.822 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:16.168 INFO:teuthology.orchestra.run.smithi116.stdout:generic/617 [not run] kernel does not support IO_URING 2023-05-12T13:27:16.176 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/617 2023-05-12T13:27:16.176 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/617 2023-05-12T13:27:16.176 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:16.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:16.203 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-05-12T13:27:16.587 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:16.598 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:16.598 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:16.879 INFO:teuthology.orchestra.run.smithi116.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:16.887 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/618 2023-05-12T13:27:16.887 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/618 2023-05-12T13:27:16.887 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:16.893 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:16.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:16.914 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-05-12T13:27:17.299 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:17.311 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:17.311 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:17.600 INFO:teuthology.orchestra.run.smithi116.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:17.608 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/619 2023-05-12T13:27:17.609 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/619 2023-05-12T13:27:17.609 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:17.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:17.635 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-05-12T13:27:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:18.042 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:18.372 INFO:teuthology.orchestra.run.smithi116.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:18.380 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/620 2023-05-12T13:27:18.381 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/620 2023-05-12T13:27:18.381 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:18.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:18.407 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-05-12T13:27:18.797 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:18.808 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:18.809 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:19.154 INFO:teuthology.orchestra.run.smithi116.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:19.162 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/621 2023-05-12T13:27:19.163 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/621 2023-05-12T13:27:19.163 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:19.168 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:19.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:19.189 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-05-12T13:27:19.406 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:27:19.410 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:27:19.578 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:19.589 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:19.590 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:19.867 INFO:teuthology.orchestra.run.smithi116.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:19.876 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/622 2023-05-12T13:27:19.876 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/622 2023-05-12T13:27:19.876 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:19.881 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:19.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:19.903 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-05-12T13:27:20.296 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:20.308 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:20.308 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:20.593 INFO:teuthology.orchestra.run.smithi116.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:20.601 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/623 2023-05-12T13:27:20.601 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/623 2023-05-12T13:27:20.601 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:20.606 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:20.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:20.627 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-05-12T13:27:21.012 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:21.023 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:21.303 INFO:teuthology.orchestra.run.smithi116.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:21.311 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/624 2023-05-12T13:27:21.312 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/624 2023-05-12T13:27:21.312 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:21.317 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:21.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:21.339 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-05-12T13:27:21.721 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:21.732 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:21.733 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:22.009 INFO:teuthology.orchestra.run.smithi116.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:22.018 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/625 2023-05-12T13:27:22.018 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/625 2023-05-12T13:27:22.018 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:22.023 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:22.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:22.044 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-05-12T13:27:22.429 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:22.440 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:22.441 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:22.728 INFO:teuthology.orchestra.run.smithi116.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:22.736 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/626 2023-05-12T13:27:22.737 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/626 2023-05-12T13:27:22.737 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:22.742 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:22.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:22.762 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-05-12T13:27:23.151 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:23.162 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:23.163 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:23.452 INFO:teuthology.orchestra.run.smithi116.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:23.460 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/627 2023-05-12T13:27:23.460 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/627 2023-05-12T13:27:23.460 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:23.465 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:23.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:23.486 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-05-12T13:27:23.872 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:23.883 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:24.199 INFO:teuthology.orchestra.run.smithi116.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:24.207 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/628 2023-05-12T13:27:24.208 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/628 2023-05-12T13:27:24.208 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:24.213 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:24.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:24.234 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-05-12T13:27:24.624 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:24.635 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:24.636 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:24.944 INFO:teuthology.orchestra.run.smithi116.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:24.952 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/629 2023-05-12T13:27:24.953 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/629 2023-05-12T13:27:24.953 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:24.958 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:24.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:24.979 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-05-12T13:27:25.366 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:25.378 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:25.378 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:25.655 INFO:teuthology.orchestra.run.smithi116.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:25.664 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/630 2023-05-12T13:27:25.664 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/630 2023-05-12T13:27:25.664 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:25.669 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:25.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:25.689 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-05-12T13:27:26.075 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:26.086 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:26.364 INFO:teuthology.orchestra.run.smithi116.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:26.372 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/631 2023-05-12T13:27:26.373 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/631 2023-05-12T13:27:26.373 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:26.378 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:26.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:26.399 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-05-12T13:27:26.779 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:26.791 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:26.791 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:33.059 INFO:teuthology.orchestra.run.smithi116.stdout:generic/632 7s 2023-05-12T13:27:33.070 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/632 2023-05-12T13:27:33.070 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:33.075 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:33.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:33.096 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-05-12T13:27:33.481 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:33.493 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:33.493 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:34.110 INFO:teuthology.orchestra.run.smithi116.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/633.out.bad) 2023-05-12T13:27:34.128 INFO:teuthology.orchestra.run.smithi116.stdout: --- tests/generic/633.out 2023-05-12 09:09:18.918489377 +0000 2023-05-12T13:27:34.129 INFO:teuthology.orchestra.run.smithi116.stdout: +++ /tmp/tmp.b9w2OCk4k0xfstests-dev/results//generic/633.out.bad 2023-05-12 13:27:34.099642604 +0000 2023-05-12T13:27:34.129 INFO:teuthology.orchestra.run.smithi116.stdout: @@ -1,2 +1,3 @@ 2023-05-12T13:27:34.129 INFO:teuthology.orchestra.run.smithi116.stdout: QA output created by 633 2023-05-12T13:27:34.129 INFO:teuthology.orchestra.run.smithi116.stdout: Silence is golden 2023-05-12T13:27:34.129 INFO:teuthology.orchestra.run.smithi116.stdout: +vfstest.c: 2418: run_test - Success - failure: setid binaries on regular mounts 2023-05-12T13:27:34.145 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/633 2023-05-12T13:27:34.145 INFO:teuthology.orchestra.run.smithi116.stdout:Failures: generic/633 2023-05-12T13:27:34.146 INFO:teuthology.orchestra.run.smithi116.stdout:Failed 1 of 1 tests 2023-05-12T13:27:34.173 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:34.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T13:27:34.253 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-12T13:27:34.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-12T13:27:34.254 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-05-12T13:27:34.833 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:34.844 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:34.845 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:35.126 INFO:teuthology.orchestra.run.smithi116.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:35.134 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/634 2023-05-12T13:27:35.135 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/634 2023-05-12T13:27:35.135 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:35.140 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:35.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:35.161 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-05-12T13:27:35.552 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:35.563 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:35.563 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:35.836 INFO:teuthology.orchestra.run.smithi116.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:35.844 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/635 2023-05-12T13:27:35.844 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/635 2023-05-12T13:27:35.844 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:35.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:35.871 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-05-12T13:27:36.256 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:36.268 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:36.268 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:36.551 INFO:teuthology.orchestra.run.smithi116.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:36.559 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/636 2023-05-12T13:27:36.559 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/636 2023-05-12T13:27:36.559 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:36.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:36.586 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-05-12T13:27:36.971 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:36.982 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:38.503 INFO:teuthology.orchestra.run.smithi116.stdout:generic/637 1s 2023-05-12T13:27:38.515 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/637 2023-05-12T13:27:38.516 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:38.521 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:38.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:38.542 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-05-12T13:27:39.280 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:39.291 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:39.291 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:39.648 INFO:teuthology.orchestra.run.smithi116.stdout:generic/638 0s 2023-05-12T13:27:39.660 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/638 2023-05-12T13:27:39.660 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:39.666 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:39.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:39.688 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-05-12T13:27:40.074 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:40.086 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:40.086 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:44.407 INFO:teuthology.orchestra.run.smithi116.stdout:generic/639 4s 2023-05-12T13:27:44.419 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/639 2023-05-12T13:27:44.420 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:44.425 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:44.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:44.444 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-05-12T13:27:44.830 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:44.842 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:45.149 INFO:teuthology.orchestra.run.smithi116.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:45.157 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/640 2023-05-12T13:27:45.158 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/640 2023-05-12T13:27:45.158 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:45.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:45.183 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-05-12T13:27:45.575 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:45.586 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:45.586 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:45.861 INFO:teuthology.orchestra.run.smithi116.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:45.869 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/641 2023-05-12T13:27:45.870 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/641 2023-05-12T13:27:45.870 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:45.875 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:45.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:45.895 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-05-12T13:27:46.279 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:46.290 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:46.291 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:46.583 INFO:teuthology.orchestra.run.smithi116.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:46.591 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/642 2023-05-12T13:27:46.591 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/642 2023-05-12T13:27:46.592 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:46.596 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:46.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:46.617 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-05-12T13:27:47.008 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:47.019 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:47.019 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:47.297 INFO:teuthology.orchestra.run.smithi116.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:47.306 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/643 2023-05-12T13:27:47.306 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/643 2023-05-12T13:27:47.306 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:47.311 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:47.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:47.333 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-05-12T13:27:47.717 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:47.728 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:47.729 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:48.007 INFO:teuthology.orchestra.run.smithi116.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-05-12T13:27:48.015 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/644 2023-05-12T13:27:48.016 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/644 2023-05-12T13:27:48.016 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:48.021 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:48.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:48.041 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-05-12T13:27:48.427 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:48.438 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:48.439 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:48.717 INFO:teuthology.orchestra.run.smithi116.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-05-12T13:27:48.725 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/645 2023-05-12T13:27:48.725 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/645 2023-05-12T13:27:48.725 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:48.730 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:48.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:48.751 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-05-12T13:27:49.140 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:49.151 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:49.152 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:49.429 INFO:teuthology.orchestra.run.smithi116.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:49.438 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/646 2023-05-12T13:27:49.438 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/646 2023-05-12T13:27:49.438 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:49.443 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:49.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:49.464 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-05-12T13:27:49.527 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:27:49.531 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:27:49.853 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:49.864 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:49.864 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:50.349 INFO:teuthology.orchestra.run.smithi116.stdout:generic/647 1s 2023-05-12T13:27:50.361 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/647 2023-05-12T13:27:50.361 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:50.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:50.388 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-05-12T13:27:51.088 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:51.098 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:51.098 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:51.422 INFO:teuthology.orchestra.run.smithi116.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-05-12T13:27:51.430 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/648 2023-05-12T13:27:51.430 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/648 2023-05-12T13:27:51.431 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:51.435 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:51.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:51.456 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-05-12T13:27:51.848 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:51.859 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:51.859 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:52.232 INFO:teuthology.orchestra.run.smithi116.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-12T13:27:52.240 INFO:teuthology.orchestra.run.smithi116.stdout:Ran: generic/649 2023-05-12T13:27:52.240 INFO:teuthology.orchestra.run.smithi116.stdout:Not run: generic/649 2023-05-12T13:27:52.241 INFO:teuthology.orchestra.run.smithi116.stdout:Passed all 1 tests 2023-05-12T13:27:52.246 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:27:52.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-12T13:27:52.275 DEBUG:teuthology.orchestra.run.smithi116:> (cd /tmp/tmp.b9w2OCk4k0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-05-12T13:27:52.976 INFO:teuthology.orchestra.run.smithi116.stdout:FSTYP -- ceph-fuse 2023-05-12T13:27:52.987 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM -- Linux/x86_64 smithi116 6.3.0-g6f2d7574b970 #1 SMP PREEMPT_DYNAMIC Fri May 12 08:33:02 UTC 2023 2023-05-12T13:27:52.988 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-05-12T13:28:06.255 INFO:tasks.ceph.osd.2.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f44703f8700 time 2023-05-12T13:28:06.190134+0000 2023-05-12T13:28:06.255 INFO:tasks.ceph.osd.2.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-05-12T13:28:06.267 INFO:tasks.ceph.osd.2.smithi116.stderr: ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev) 2023-05-12T13:28:06.267 INFO:tasks.ceph.osd.2.smithi116.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55f3c2533daf] 2023-05-12T13:28:06.267 INFO:tasks.ceph.osd.2.smithi116.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x55f3c3146f08] 2023-05-12T13:28:06.268 INFO:tasks.ceph.osd.2.smithi116.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f3c31495a1] 2023-05-12T13:28:06.268 INFO:tasks.ceph.osd.2.smithi116.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f44870081ca] 2023-05-12T13:28:06.268 INFO:tasks.ceph.osd.2.smithi116.stderr: 5: clone() 2023-05-12T13:28:06.268 INFO:tasks.ceph.osd.2.smithi116.stderr:*** Caught signal (Aborted) ** 2023-05-12T13:28:06.268 INFO:tasks.ceph.osd.2.smithi116.stderr: in thread 7f44703f8700 thread_name:bstore_aio 2023-05-12T13:28:06.272 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T13:28:06.170+0000 7f4469beb700 -1 bdev(0x55f3c71b6380 /var/lib/ceph/osd/ceph-2/block) _sync_write pwritev error: (5) Input/output error 2023-05-12T13:28:06.272 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T13:28:06.170+0000 7f44703f8700 -1 bdev(0x55f3c71b6380 /var/lib/ceph/osd/ceph-2/block) _aio_thread got r=-5 ((5) Input/output error) 2023-05-12T13:28:06.287 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T13:28:06.264+0000 7f44703f8700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f44703f8700 time 2023-05-12T13:28:06.190134+0000 2023-05-12T13:28:06.287 INFO:tasks.ceph.osd.2.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-05-12T13:28:06.287 INFO:tasks.ceph.osd.2.smithi116.stderr: 2023-05-12T13:28:06.287 INFO:tasks.ceph.osd.2.smithi116.stderr: ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev) 2023-05-12T13:28:06.287 INFO:tasks.ceph.osd.2.smithi116.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55f3c2533daf] 2023-05-12T13:28:06.287 INFO:tasks.ceph.osd.2.smithi116.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x55f3c3146f08] 2023-05-12T13:28:06.287 INFO:tasks.ceph.osd.2.smithi116.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f3c31495a1] 2023-05-12T13:28:06.288 INFO:tasks.ceph.osd.2.smithi116.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f44870081ca] 2023-05-12T13:28:06.288 INFO:tasks.ceph.osd.2.smithi116.stderr: 5: clone() 2023-05-12T13:28:06.288 INFO:tasks.ceph.osd.2.smithi116.stderr: 2023-05-12T13:28:06.298 INFO:tasks.ceph.osd.2.smithi116.stderr: ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev) 2023-05-12T13:28:06.298 INFO:tasks.ceph.osd.2.smithi116.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f4487012cf0] 2023-05-12T13:28:06.299 INFO:tasks.ceph.osd.2.smithi116.stderr: 2: gsignal() 2023-05-12T13:28:06.299 INFO:tasks.ceph.osd.2.smithi116.stderr: 3: abort() 2023-05-12T13:28:06.299 INFO:tasks.ceph.osd.2.smithi116.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55f3c2533e6f] 2023-05-12T13:28:06.299 INFO:tasks.ceph.osd.2.smithi116.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x55f3c3146f08] 2023-05-12T13:28:06.299 INFO:tasks.ceph.osd.2.smithi116.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f3c31495a1] 2023-05-12T13:28:06.299 INFO:tasks.ceph.osd.2.smithi116.stderr: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f44870081ca] 2023-05-12T13:28:06.299 INFO:tasks.ceph.osd.2.smithi116.stderr: 8: clone() 2023-05-12T13:28:06.383 INFO:tasks.ceph.osd.2.smithi116.stderr:2023-05-12T13:28:06.356+0000 7f44703f8700 -1 *** Caught signal (Aborted) ** 2023-05-12T13:28:06.383 INFO:tasks.ceph.osd.2.smithi116.stderr: in thread 7f44703f8700 thread_name:bstore_aio 2023-05-12T13:28:06.383 INFO:tasks.ceph.osd.2.smithi116.stderr: 2023-05-12T13:28:06.384 INFO:tasks.ceph.osd.2.smithi116.stderr: ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev) 2023-05-12T13:28:06.384 INFO:tasks.ceph.osd.2.smithi116.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f4487012cf0] 2023-05-12T13:28:06.384 INFO:tasks.ceph.osd.2.smithi116.stderr: 2: gsignal() 2023-05-12T13:28:06.384 INFO:tasks.ceph.osd.2.smithi116.stderr: 3: abort() 2023-05-12T13:28:06.384 INFO:tasks.ceph.osd.2.smithi116.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55f3c2533e6f] 2023-05-12T13:28:06.384 INFO:tasks.ceph.osd.2.smithi116.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x55f3c3146f08] 2023-05-12T13:28:06.385 INFO:tasks.ceph.osd.2.smithi116.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f3c31495a1] 2023-05-12T13:28:06.385 INFO:tasks.ceph.osd.2.smithi116.stderr: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f44870081ca] 2023-05-12T13:28:06.385 INFO:tasks.ceph.osd.2.smithi116.stderr: 8: clone() 2023-05-12T13:28:06.385 INFO:tasks.ceph.osd.2.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-05-12T13:28:06.385 INFO:tasks.ceph.osd.2.smithi116.stderr: 2023-05-12T13:28:06.414 INFO:tasks.ceph.osd.2.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f4470bf9700 time 2023-05-12T13:28:06.393008+0000 2023-05-12T13:28:06.414 INFO:tasks.ceph.osd.2.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-05-12T13:28:06.415 INFO:tasks.ceph.osd.2.smithi116.stderr: ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev) 2023-05-12T13:28:06.415 INFO:tasks.ceph.osd.2.smithi116.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55f3c2533daf] 2023-05-12T13:28:06.415 INFO:tasks.ceph.osd.2.smithi116.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x55f3c3146f08] 2023-05-12T13:28:06.415 INFO:tasks.ceph.osd.2.smithi116.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f3c31495a1] 2023-05-12T13:28:06.415 INFO:tasks.ceph.osd.2.smithi116.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f44870081ca] 2023-05-12T13:28:06.415 INFO:tasks.ceph.osd.2.smithi116.stderr: 5: clone() 2023-05-12T13:28:14.493 INFO:tasks.ceph.osd.2.smithi116.stderr:daemon-helper: command crashed with signal 6 2023-05-12T13:28:18.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-05-12T13:28:19.641 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:28:19.646 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:28:24.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~7s 2023-05-12T13:28:31.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~13s 2023-05-12T13:28:37.847 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2023-05-12T13:28:44.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~26s 2023-05-12T13:28:50.192 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:28:50.199 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:28:51.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~33s 2023-05-12T13:28:57.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~40s 2023-05-12T13:29:04.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~46s 2023-05-12T13:29:10.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2023-05-12T13:29:17.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2023-05-12T13:29:20.456 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:29:20.461 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:29:24.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~66s 2023-05-12T13:29:30.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~73s 2023-05-12T13:29:37.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~79s 2023-05-12T13:29:43.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~86s 2023-05-12T13:29:47.717 INFO:tasks.ceph.osd.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f9f915f9700 time 2023-05-12T13:29:47.704619+0000 2023-05-12T13:29:47.717 INFO:tasks.ceph.osd.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-05-12T13:29:47.717 INFO:tasks.ceph.osd.0.smithi116.stderr: ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev) 2023-05-12T13:29:47.718 INFO:tasks.ceph.osd.0.smithi116.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55fec2096daf] 2023-05-12T13:29:47.718 INFO:tasks.ceph.osd.0.smithi116.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x55fec2ca9f08] 2023-05-12T13:29:47.718 INFO:tasks.ceph.osd.0.smithi116.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fec2cac5a1] 2023-05-12T13:29:47.718 INFO:tasks.ceph.osd.0.smithi116.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f9fa7a081ca] 2023-05-12T13:29:47.718 INFO:tasks.ceph.osd.0.smithi116.stderr: 5: clone() 2023-05-12T13:29:47.718 INFO:tasks.ceph.osd.0.smithi116.stderr:*** Caught signal (Aborted) ** 2023-05-12T13:29:47.718 INFO:tasks.ceph.osd.0.smithi116.stderr: in thread 7f9f915f9700 thread_name:bstore_aio 2023-05-12T13:29:47.719 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T13:29:47.703+0000 7f9f915f9700 -1 bdev(0x55fec562a000 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-5 ((5) Input/output error) 2023-05-12T13:29:47.719 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T13:29:47.713+0000 7f9f90df8700 -1 bdev(0x55fec562a380 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-5 ((5) Input/output error) 2023-05-12T13:29:47.719 INFO:tasks.ceph.osd.0.smithi116.stderr:2023-05-12T13:29:47.714+0000 7f9f915f9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f9f915f9700 time 2023-05-12T13:29:47.704619+0000 2023-05-12T13:29:47.720 INFO:tasks.ceph.osd.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-05-12T13:29:47.720 INFO:tasks.ceph.osd.0.smithi116.stderr: 2023-05-12T13:29:47.720 INFO:tasks.ceph.osd.0.smithi116.stderr: ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev) 2023-05-12T13:29:47.720 INFO:tasks.ceph.osd.0.smithi116.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55fec2096daf] 2023-05-12T13:29:47.720 INFO:tasks.ceph.osd.0.smithi116.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x55fec2ca9f08] 2023-05-12T13:29:47.720 INFO:tasks.ceph.osd.0.smithi116.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fec2cac5a1] 2023-05-12T13:29:47.720 INFO:tasks.ceph.osd.0.smithi116.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f9fa7a081ca] 2023-05-12T13:29:47.721 INFO:tasks.ceph.osd.0.smithi116.stderr: 5: clone() 2023-05-12T13:29:47.721 INFO:tasks.ceph.osd.0.smithi116.stderr: 2023-05-12T13:29:47.728 INFO:tasks.ceph.osd.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f9f90df8700 time 2023-05-12T13:29:47.714839+0000 2023-05-12T13:29:47.728 INFO:tasks.ceph.osd.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3871-g5a6b166b/rpm/el8/BUILD/ceph-18.0.0-3871-g5a6b166b/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-05-12T13:29:47.732 INFO:tasks.ceph.osd.0.smithi116.stderr: ceph version 18.0.0-3871-g5a6b166b (5a6b166b7c43e2b5890833e75dd257ab21264ded) reef (dev) 2023-05-12T13:29:47.732 INFO:tasks.ceph.osd.0.smithi116.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55fec2096daf] 2023-05-12T13:29:47.732 INFO:tasks.ceph.osd.0.smithi116.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x55fec2ca9f08] 2023-05-12T13:29:47.732 INFO:tasks.ceph.osd.0.smithi116.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fec2cac5a1] 2023-05-12T13:29:47.732 INFO:tasks.ceph.osd.0.smithi116.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f9fa7a081ca] 2023-05-12T13:29:47.732 INFO:tasks.ceph.osd.0.smithi116.stderr: 5: clone() 2023-05-12T13:29:50.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~93s 2023-05-12T13:29:50.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:29:50.720 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:29:57.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2023-05-12T13:29:58.366 INFO:tasks.ceph.osd.0.smithi116.stderr:daemon-helper: command crashed with signal 6 2023-05-12T13:30:03.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-05-12T13:30:03.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~106s 2023-05-12T13:30:10.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~7s 2023-05-12T13:30:10.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~112s 2023-05-12T13:30:16.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~13s 2023-05-12T13:30:16.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~119s 2023-05-12T13:30:23.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2023-05-12T13:30:23.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~125s 2023-05-12T13:30:24.506 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:30:24.512 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:30:29.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~26s 2023-05-12T13:30:29.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~132s 2023-05-12T13:30:36.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~33s 2023-05-12T13:30:36.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~138s 2023-05-12T13:30:42.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~39s 2023-05-12T13:30:42.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2023-05-12T13:30:49.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~46s 2023-05-12T13:30:49.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~151s 2023-05-12T13:30:54.834 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:30:54.842 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:30:55.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~52s 2023-05-12T13:30:55.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~158s 2023-05-12T13:31:02.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~59s 2023-05-12T13:31:02.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~164s 2023-05-12T13:31:08.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2023-05-12T13:31:08.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~171s 2023-05-12T13:31:15.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~72s 2023-05-12T13:31:15.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~177s 2023-05-12T13:31:21.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~78s 2023-05-12T13:31:21.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~184s 2023-05-12T13:31:25.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:31:25.015 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:31:28.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~85s 2023-05-12T13:31:28.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~190s 2023-05-12T13:31:34.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~91s 2023-05-12T13:31:34.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~197s 2023-05-12T13:31:41.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~98s 2023-05-12T13:31:41.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~203s 2023-05-12T13:31:47.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~104s 2023-05-12T13:31:47.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~210s 2023-05-12T13:31:54.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~111s 2023-05-12T13:31:54.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~216s 2023-05-12T13:31:55.222 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:31:55.228 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:32:00.912 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~117s 2023-05-12T13:32:00.912 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~223s 2023-05-12T13:32:07.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~124s 2023-05-12T13:32:07.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~230s 2023-05-12T13:32:13.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~130s 2023-05-12T13:32:13.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~236s 2023-05-12T13:32:20.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~137s 2023-05-12T13:32:20.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~243s 2023-05-12T13:32:25.370 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:32:25.376 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:32:26.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~143s 2023-05-12T13:32:26.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~249s 2023-05-12T13:32:33.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~150s 2023-05-12T13:32:33.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~256s 2023-05-12T13:32:39.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~156s 2023-05-12T13:32:39.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~262s 2023-05-12T13:32:46.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~163s 2023-05-12T13:32:46.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~269s 2023-05-12T13:32:53.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~169s 2023-05-12T13:32:53.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~275s 2023-05-12T13:32:55.609 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:32:55.616 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:32:59.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~176s 2023-05-12T13:32:59.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~282s 2023-05-12T13:33:06.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~182s 2023-05-12T13:33:06.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~288s 2023-05-12T13:33:12.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~189s 2023-05-12T13:33:12.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~295s 2023-05-12T13:33:19.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~195s 2023-05-12T13:33:19.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~301s 2023-05-12T13:33:19.051 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-05-12T13:33:19.051 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T13:33:19.051 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T13:33:19.167 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345872k,nr_inodes=4086468,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 ceph-fuse /tmp/tmp.A6WkqqsMBotest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-05-12T13:33:19.168 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi116.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-05-12T13:33:19.168 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T13:33:19.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T13:33:19.168 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-12T13:33:19.305 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-05-12T13:33:19.306 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T13:33:19.409 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345872k,nr_inodes=4086468,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 ceph-fuse /tmp/tmp.A6WkqqsMBotest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-05-12T13:33:19.410 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi116.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-05-12T13:33:19.410 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2023-05-12T13:33:19.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T13:33:19.411 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-12T13:33:19.521 INFO:teuthology.orchestra.run.smithi116.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-05-12T13:33:19.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T13:33:19.524 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T13:33:19.524 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T13:33:19.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345792k,nr_inodes=4086448,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3274996k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-05-12T13:33:19.586 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi182.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-05-12T13:33:19.586 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi182.front.sepia.ceph.com 2023-05-12T13:33:19.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T13:33:19.587 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-12T13:33:19.692 INFO:teuthology.orchestra.run.smithi182.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-05-12T13:33:19.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T13:33:19.694 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-05-12T13:33:19.694 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-12T13:33:19.736 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345792k,nr_inodes=4086448,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3274996k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-05-12T13:33:19.736 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi182.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-05-12T13:33:19.737 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi182.front.sepia.ceph.com 2023-05-12T13:33:19.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-12T13:33:19.737 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-12T13:33:19.817 INFO:teuthology.orchestra.run.smithi182.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-05-12T13:33:19.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-12T13:33:21.327 INFO:tasks.ceph.osd.1:Sent signal 15 2023-05-12T13:33:21.328 INFO:tasks.ceph.osd.3:Sent signal 15 2023-05-12T13:33:21.328 INFO:tasks.ceph.osd.4:Sent signal 15 2023-05-12T13:33:21.328 INFO:tasks.ceph.osd.5:Sent signal 15 2023-05-12T13:33:21.329 INFO:tasks.ceph.osd.6:Sent signal 15 2023-05-12T13:33:21.329 INFO:tasks.ceph.osd.7:Sent signal 15 2023-05-12T13:33:21.329 INFO:tasks.ceph.mds.a:Sent signal 15 2023-05-12T13:33:21.330 INFO:tasks.ceph.mds.c:Sent signal 15 2023-05-12T13:33:21.330 INFO:tasks.ceph.mds.b:Sent signal 15 2023-05-12T13:33:21.330 INFO:tasks.ceph.mds.d:Sent signal 15 2023-05-12T13:33:21.331 INFO:tasks.ceph.mon.a:Sent signal 15 2023-05-12T13:33:21.331 INFO:tasks.ceph.mon.b:Sent signal 15 2023-05-12T13:33:21.331 INFO:tasks.ceph.mon.c:Sent signal 15 2023-05-12T13:33:21.332 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-05-12T13:33:21.332 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-05-12T13:33:21.333 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T13:33:21.325+0000 7f3f34df9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 104396) UID: 0 2023-05-12T13:33:21.333 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T13:33:21.325+0000 7f3f34df9700 -1 osd.1 45 *** Got signal Terminated *** 2023-05-12T13:33:21.333 INFO:tasks.ceph.osd.1.smithi116.stderr:2023-05-12T13:33:21.325+0000 7f3f34df9700 -1 osd.1 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-12T13:33:21.334 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T13:33:21.325+0000 7f9b609f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 104405) UID: 0 2023-05-12T13:33:21.334 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T13:33:21.325+0000 7f9b609f9700 -1 osd.3 45 *** Got signal Terminated *** 2023-05-12T13:33:21.334 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-05-12T13:33:21.325+0000 7f9b609f9700 -1 osd.3 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-12T13:33:21.334 INFO:tasks.ceph.mds.a.smithi116.stderr:2023-05-12T13:33:21.327+0000 7fa6111f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 122886) UID: 0 2023-05-12T13:33:21.334 INFO:tasks.ceph.mds.a.smithi116.stderr:2023-05-12T13:33:21.327+0000 7fa6111f9700 -1 mds.a *** got signal Terminated *** 2023-05-12T13:33:21.335 INFO:tasks.ceph.mds.c.smithi116.stderr:2023-05-12T13:33:21.328+0000 7fc0547f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 122887) UID: 0 2023-05-12T13:33:21.335 INFO:tasks.ceph.mds.c.smithi116.stderr:2023-05-12T13:33:21.328+0000 7fc0547f9700 -1 mds.c *** got signal Terminated *** 2023-05-12T13:33:21.335 INFO:tasks.ceph.mon.a.smithi116.stderr:2023-05-12T13:33:21.329+0000 7fe4e05ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 104067) UID: 0 2023-05-12T13:33:21.335 INFO:tasks.ceph.mon.a.smithi116.stderr:2023-05-12T13:33:21.329+0000 7fe4e05ff700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-05-12T13:33:21.418 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T13:33:21.415+0000 7f4e7fbf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 133267) UID: 0 2023-05-12T13:33:21.418 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T13:33:21.415+0000 7f4e7fbf9700 -1 osd.5 45 *** Got signal Terminated *** 2023-05-12T13:33:21.419 INFO:tasks.ceph.osd.5.smithi182.stderr:2023-05-12T13:33:21.415+0000 7f4e7fbf9700 -1 osd.5 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-12T13:33:21.419 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T13:33:21.415+0000 7fb0059f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 133271) UID: 0 2023-05-12T13:33:21.419 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T13:33:21.415+0000 7fb0059f9700 -1 osd.7 45 *** Got signal Terminated *** 2023-05-12T13:33:21.419 INFO:tasks.ceph.osd.7.smithi182.stderr:2023-05-12T13:33:21.415+0000 7fb0059f9700 -1 osd.7 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-12T13:33:21.420 INFO:tasks.ceph.mds.d.smithi182.stderr:2023-05-12T13:33:21.415+0000 7f8bef5f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 141143) UID: 0 2023-05-12T13:33:21.420 INFO:tasks.ceph.mds.d.smithi182.stderr:2023-05-12T13:33:21.415+0000 7f8bef5f9700 -1 mds.d *** got signal Terminated *** 2023-05-12T13:33:21.420 INFO:tasks.ceph.mds.b.smithi182.stderr:2023-05-12T13:33:21.415+0000 7fc57e7f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 141144) UID: 0 2023-05-12T13:33:21.420 INFO:tasks.ceph.mds.b.smithi182.stderr:2023-05-12T13:33:21.415+0000 7fc57e7f9700 -1 mds.b *** got signal Terminated *** 2023-05-12T13:33:21.421 INFO:tasks.ceph.mon.b.smithi182.stderr:2023-05-12T13:33:21.415+0000 7f05187ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 130714) UID: 0 2023-05-12T13:33:21.421 INFO:tasks.ceph.mon.b.smithi182.stderr:2023-05-12T13:33:21.415+0000 7f05187ff700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-05-12T13:33:21.421 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T13:33:21.415+0000 7f02559f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 133266) UID: 0 2023-05-12T13:33:21.421 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T13:33:21.415+0000 7f02559f9700 -1 osd.6 45 *** Got signal Terminated *** 2023-05-12T13:33:21.422 INFO:tasks.ceph.osd.6.smithi182.stderr:2023-05-12T13:33:21.415+0000 7f02559f9700 -1 osd.6 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-12T13:33:21.422 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T13:33:21.415+0000 7fe44e3f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 133263) UID: 0 2023-05-12T13:33:21.422 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T13:33:21.415+0000 7fe44e3f9700 -1 osd.4 45 *** Got signal Terminated *** 2023-05-12T13:33:21.423 INFO:tasks.ceph.osd.4.smithi182.stderr:2023-05-12T13:33:21.415+0000 7fe44e3f9700 -1 osd.4 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-12T13:33:21.423 INFO:tasks.ceph.mon.c.smithi182.stderr:2023-05-12T13:33:21.415+0000 7fe7461ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 130716) UID: 0 2023-05-12T13:33:21.423 INFO:tasks.ceph.mon.c.smithi182.stderr:2023-05-12T13:33:21.415+0000 7fe7461ff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-05-12T13:33:21.618 INFO:tasks.ceph.mgr.x.smithi182.stderr:daemon-helper: command crashed with signal 15 2023-05-12T13:33:25.910 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:33:25.916 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:33:56.030 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:33:56.037 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:34:26.162 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:34:26.170 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:34:56.478 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:34:56.484 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:35:26.608 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:35:26.616 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:35:56.823 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:35:56.828 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:36:27.272 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:36:27.280 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:36:57.469 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:36:57.475 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:37:27.658 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:37:27.663 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:37:57.919 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:37:57.925 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:38:28.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:38:28.183 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:38:58.299 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:38:58.304 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:39:28.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:39:28.527 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:39:58.820 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:39:58.828 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:40:29.015 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:40:29.020 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:40:59.255 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:40:59.263 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:41:29.470 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:41:29.474 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:41:59.870 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:41:59.877 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:42:30.062 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:42:30.069 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:43:00.353 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:43:00.362 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:43:30.706 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:43:30.712 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:44:00.906 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:44:00.912 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:44:31.125 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:44:31.134 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:45:01.350 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:45:01.356 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:45:31.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:45:31.533 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:46:01.711 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:46:01.716 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:46:31.884 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:46:31.892 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:47:02.140 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:47:02.149 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:47:32.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:47:32.428 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:48:02.921 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:48:02.929 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:48:33.046 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:48:33.053 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:49:03.234 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:49:03.240 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:49:33.616 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:49:33.623 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:50:03.873 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:50:03.878 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:50:34.067 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:50:34.075 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:51:04.391 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:51:04.399 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:51:34.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:51:34.808 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:52:05.005 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:52:05.012 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:52:35.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:52:35.184 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:53:05.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:53:05.298 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:53:35.504 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:53:35.512 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:54:05.802 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:54:05.809 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:54:35.971 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:54:35.978 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:55:06.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:55:06.151 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:55:36.291 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:55:36.296 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:56:06.478 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:56:06.484 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:56:36.653 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:56:36.662 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:57:06.877 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:57:06.883 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:57:37.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:57:37.027 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:58:07.204 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:58:07.210 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:58:37.468 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:58:37.474 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:59:07.785 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:59:07.793 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:59:38.239 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T13:59:38.250 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:00:08.494 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:00:08.499 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:00:38.613 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:00:38.622 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:01:08.790 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:01:08.796 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:01:39.125 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:01:39.134 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:02:09.350 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:02:09.355 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:02:39.560 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:02:39.565 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:03:09.869 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:03:09.874 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:03:39.979 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:03:39.984 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:04:10.095 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:04:10.099 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:04:40.266 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:04:40.271 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:05:10.442 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:05:10.448 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:05:40.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:05:40.656 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:06:10.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:06:10.934 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:06:41.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:06:41.184 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:07:11.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:07:11.445 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:07:41.710 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:07:41.715 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:08:11.833 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:08:11.841 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:08:42.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:08:42.239 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:09:12.523 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:09:12.528 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:09:42.708 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:09:42.714 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:10:12.890 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:10:12.895 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:10:43.129 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:10:43.136 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:11:13.312 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:11:13.320 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:11:43.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:11:43.447 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:12:13.646 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:12:13.653 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:12:43.826 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:12:43.834 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:13:14.115 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:13:14.123 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:13:44.334 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:13:44.343 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:14:14.591 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:14:14.597 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:14:44.787 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:14:44.792 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:15:15.002 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:15:15.009 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:15:45.158 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:15:45.166 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:16:15.430 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:16:15.436 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:16:45.623 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:16:45.631 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:17:15.810 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:17:15.818 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:17:46.015 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:17:46.023 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:18:16.222 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:18:16.227 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:18:46.491 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:18:46.500 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:19:16.700 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:19:16.705 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:19:46.815 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:19:46.820 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:20:17.054 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:20:17.058 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:20:47.238 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:20:47.246 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:21:17.587 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:21:17.592 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:21:47.826 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:21:47.834 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:22:18.050 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:22:18.058 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:22:48.204 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:22:48.212 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:23:18.470 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:23:18.475 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:23:48.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:23:48.648 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:24:18.864 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:24:18.870 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:24:49.051 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:24:49.057 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:25:19.251 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:25:19.256 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:25:49.532 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:25:49.540 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:26:19.838 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:26:19.843 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:26:50.005 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:26:50.014 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:27:20.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:27:20.204 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:27:50.362 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:27:50.371 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:28:20.659 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:28:20.668 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:28:50.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:28:50.948 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:29:21.138 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:29:21.147 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:29:51.343 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:29:51.351 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:30:21.632 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:30:21.640 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:30:51.846 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:30:51.854 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:31:22.082 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:31:22.091 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:31:52.387 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:31:52.398 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:32:22.579 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:32:22.585 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:32:52.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:32:52.749 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:33:22.959 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:33:22.964 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:33:53.213 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:33:53.221 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:34:23.493 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:34:23.502 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:34:53.715 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:34:53.720 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:35:23.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:35:23.906 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:35:54.110 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:35:54.119 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:36:24.288 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:36:24.294 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:36:54.555 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:36:54.560 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:37:24.732 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:37:24.740 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:37:54.890 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:37:54.896 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:38:25.113 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:38:25.121 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:38:55.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:38:55.324 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:39:25.546 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:39:25.554 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:39:55.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:39:55.836 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:40:25.993 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:40:25.998 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:40:56.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:40:56.205 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:41:26.471 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:41:26.477 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:41:56.585 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:41:56.593 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:42:26.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:42:26.839 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:42:57.097 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:42:57.102 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:43:27.444 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:43:27.449 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:43:57.735 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:43:57.743 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:44:27.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:44:27.920 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:44:58.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:44:58.216 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:45:28.414 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:45:28.422 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:45:58.543 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:45:58.550 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:46:28.741 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:46:28.749 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:46:58.960 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:46:58.968 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:47:29.373 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:47:29.378 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:47:59.619 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:47:59.627 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:48:29.819 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:48:29.824 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:49:00.133 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:49:00.138 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:49:30.313 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:49:30.319 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:50:00.590 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:50:00.596 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:50:30.798 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:50:30.806 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:51:01.015 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:51:01.023 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:51:31.462 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:51:31.469 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:52:01.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:52:01.673 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:52:31.877 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:52:31.886 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:53:02.103 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:53:02.111 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:53:32.325 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:53:32.331 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:54:02.706 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:54:02.711 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:54:33.004 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:54:33.013 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:55:03.283 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:55:03.291 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:55:33.439 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:55:33.444 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:56:03.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:56:03.718 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:56:33.948 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:56:33.953 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:57:04.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:57:04.338 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:57:34.559 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:57:34.566 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:58:04.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:58:04.746 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:58:34.896 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:58:34.904 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:59:05.095 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:59:05.104 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:59:35.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T14:59:35.323 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:00:05.461 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:00:05.466 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:00:35.728 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:00:35.733 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:01:05.959 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:01:05.965 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:01:36.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:01:36.339 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:02:06.529 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:02:06.536 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:02:36.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:02:36.695 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:03:06.797 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:03:06.801 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:03:36.963 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:03:36.969 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:04:07.185 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:04:07.189 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:04:37.387 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:04:37.392 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:05:07.792 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:05:07.800 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:05:37.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:05:37.947 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:06:08.139 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:06:08.146 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:06:38.378 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:06:38.387 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:07:08.784 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:07:08.790 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:07:38.914 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:07:38.923 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:08:09.117 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:08:09.125 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:08:39.307 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:08:39.315 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:09:09.628 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:09:09.637 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:09:39.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:09:39.868 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:10:10.034 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:10:10.041 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:10:40.222 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:10:40.230 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:11:10.402 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:11:10.410 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:11:40.628 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:11:40.636 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:12:10.825 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:12:10.833 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:12:40.998 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:12:41.005 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:13:11.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:13:11.208 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:13:41.473 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:13:41.479 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:14:11.695 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:14:11.701 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:14:41.849 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:14:41.857 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:15:12.062 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:15:12.068 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:15:42.255 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:15:42.260 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:16:12.445 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:16:12.454 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:16:42.625 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:16:42.629 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:17:12.857 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:17:12.862 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:17:43.028 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:17:43.033 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:18:13.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:18:13.153 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:18:43.389 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:18:43.394 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:19:13.584 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:19:13.590 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:19:43.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:19:43.864 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:20:14.106 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:20:14.112 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:20:44.279 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:20:44.284 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:21:14.526 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:21:14.531 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:21:44.679 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:21:44.688 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:22:14.871 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:22:14.879 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:22:45.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:22:45.092 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:23:15.313 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:23:15.322 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:23:45.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:23:45.802 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:24:15.923 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:24:15.932 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:24:46.182 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:24:46.190 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:25:16.446 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:25:16.452 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:25:46.654 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:25:46.663 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:26:16.874 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:26:16.883 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:26:47.087 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:26:47.092 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:27:17.300 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:27:17.305 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:27:47.437 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:27:47.444 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:28:17.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:28:17.575 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:28:47.783 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:28:47.789 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:29:17.949 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:29:17.958 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:29:48.220 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:29:48.229 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:30:18.493 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:30:18.498 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:30:48.764 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:30:48.772 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:31:18.986 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:31:18.990 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:31:49.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:31:49.181 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:32:19.415 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:32:19.423 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:32:49.745 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:32:49.749 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:33:19.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:33:19.861 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:33:50.123 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:33:50.130 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:34:20.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:34:20.323 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:34:50.577 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:34:50.584 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:35:20.685 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:35:20.693 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:35:50.970 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:35:50.978 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:36:21.123 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:36:21.131 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:36:51.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:36:51.336 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:37:21.534 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:37:21.542 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:37:51.773 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:37:51.778 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:38:21.988 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:38:21.993 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:38:52.235 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:38:52.244 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:39:22.484 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:39:22.489 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:39:52.702 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:39:52.710 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:40:22.960 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:40:22.968 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:40:53.198 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:40:53.203 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:41:23.372 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:41:23.380 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:41:53.652 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:41:53.658 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:42:23.943 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:42:23.950 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:42:54.310 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:42:54.316 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:43:24.570 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:43:24.575 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:43:54.772 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:43:54.780 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:44:25.203 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:44:25.211 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:44:55.403 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:44:55.411 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:45:25.592 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:45:25.601 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:45:55.861 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:45:55.869 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:46:26.132 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:46:26.137 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:46:56.327 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:46:56.335 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:47:26.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:47:26.525 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:47:56.700 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:47:56.707 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:48:26.933 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:48:26.939 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:48:57.114 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:48:57.119 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:49:27.297 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:49:27.306 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:49:57.788 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:49:57.793 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:50:27.964 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:50:27.973 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:50:58.373 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:50:58.379 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:51:28.578 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:51:28.585 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:51:58.790 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:51:58.799 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:52:29.073 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:52:29.079 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:52:59.329 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:52:59.334 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:53:29.592 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:53:29.600 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:53:59.876 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:53:59.882 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:54:30.020 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:54:30.029 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:55:00.226 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:55:00.236 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:55:30.405 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:55:30.410 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:56:00.516 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:56:00.521 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:56:30.671 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:56:30.679 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:57:00.864 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:57:00.872 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:57:31.053 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:57:31.058 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:58:01.241 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:58:01.247 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:58:31.395 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:58:31.403 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:59:01.644 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:59:01.653 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:59:31.950 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T15:59:31.958 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:00:02.105 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:00:02.110 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:00:32.297 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:00:32.302 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:01:02.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:01:02.513 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:01:32.803 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:01:32.808 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:02:03.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:02:03.033 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:02:33.445 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:02:33.453 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:03:03.739 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:03:03.747 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:03:34.011 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:03:34.016 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:04:04.249 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:04:04.258 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:04:34.539 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:04:34.544 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:05:04.767 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:05:04.826 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:05:34.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:05:34.989 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:06:05.272 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:06:05.281 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:06:35.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:06:35.475 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:07:05.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:07:05.740 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:07:35.887 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:07:35.895 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:08:06.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:08:06.150 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:08:36.442 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:08:36.450 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:09:06.748 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:09:06.757 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:09:37.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:09:37.008 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:10:07.114 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:10:07.123 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:10:37.356 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:10:37.364 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:11:07.756 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:11:07.761 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:11:37.930 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:11:37.935 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:12:08.205 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:12:08.213 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:12:38.503 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:12:38.512 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:13:08.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:13:08.815 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:13:39.012 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:13:39.019 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:14:09.134 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:14:09.141 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:14:39.392 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:14:39.398 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:15:09.656 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:15:09.664 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:15:39.785 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:15:39.793 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:16:10.001 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:16:10.009 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:16:40.207 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:16:40.212 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:17:10.364 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:17:10.372 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:17:40.559 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:17:40.567 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:18:10.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:18:10.734 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:18:40.895 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:18:40.900 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:19:11.048 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:19:11.056 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:19:41.289 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:19:41.295 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:20:11.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:20:11.529 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:20:41.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:20:41.783 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:21:11.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:21:11.986 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:21:42.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:21:42.186 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:22:12.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:22:12.394 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:22:42.569 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:22:42.578 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:23:12.845 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:23:12.850 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:23:43.008 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:23:43.017 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:24:13.283 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:24:13.288 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:24:43.460 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:24:43.469 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:25:13.661 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:25:13.666 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:25:43.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:25:43.875 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:26:13.996 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:26:14.002 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:26:44.169 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:26:44.177 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:27:14.400 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:27:14.408 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:27:44.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:27:44.672 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:28:14.816 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:28:14.822 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:28:44.972 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:28:44.977 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:29:15.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:29:15.088 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:29:45.278 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:29:45.287 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:30:15.500 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:30:15.507 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:30:45.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:30:45.655 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:31:15.829 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:31:15.834 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:31:46.029 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:31:46.037 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:32:16.273 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:32:16.278 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:32:46.487 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:32:46.495 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:33:16.709 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:33:16.718 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:33:46.932 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:33:46.938 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:34:17.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:34:17.153 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:34:47.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:34:47.337 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:35:17.502 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:35:17.507 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:35:47.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:35:47.696 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:36:17.951 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:36:17.959 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:36:48.215 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:36:48.223 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:37:18.384 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:37:18.391 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:37:48.626 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:37:48.633 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:38:18.832 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:38:18.836 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:38:49.025 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:38:49.032 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:39:19.247 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:39:19.255 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:39:49.448 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:39:49.456 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:40:19.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:40:19.737 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:40:50.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:40:50.014 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:41:20.203 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:41:20.212 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:41:50.512 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:41:50.517 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:42:20.682 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:42:20.688 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:42:50.932 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:42:50.939 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:43:21.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:43:21.195 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:43:51.373 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:43:51.378 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:44:21.569 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:44:21.577 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:44:51.758 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:44:51.767 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:45:22.041 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:45:22.050 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:45:52.245 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:45:52.253 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:46:22.463 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:46:22.472 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:46:52.699 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:46:52.703 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:47:22.879 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:47:22.888 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:47:53.188 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:47:53.195 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:48:23.374 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:48:23.379 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:48:53.548 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:48:53.556 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:49:23.821 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:49:23.828 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:49:54.051 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:49:54.060 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:50:24.321 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:50:24.329 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:50:54.537 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:50:54.545 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:51:24.734 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:51:24.743 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:51:55.023 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:51:55.029 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:52:25.302 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:52:25.310 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:52:55.524 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:52:55.533 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:53:25.815 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:53:25.820 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:53:55.987 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:53:55.996 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:54:26.267 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:54:26.276 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:54:56.564 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:54:56.572 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:55:26.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:55:26.750 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:55:56.956 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:55:56.965 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:56:27.239 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:56:27.245 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:56:57.462 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:56:57.466 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:57:27.730 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:57:27.736 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:57:58.006 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:57:58.012 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:58:28.188 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:58:28.197 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:58:58.442 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:58:58.448 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:59:28.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:59:28.648 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:59:58.887 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T16:59:58.892 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:00:29.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:00:29.093 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:00:59.337 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:00:59.346 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:01:29.561 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:01:29.570 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:01:59.817 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:01:59.822 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:02:30.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:02:30.087 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:03:00.344 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:03:00.349 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:03:30.556 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:03:30.564 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:04:00.772 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:04:00.780 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:04:31.021 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:04:31.029 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:05:01.233 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:05:01.241 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:05:31.514 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:05:31.519 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:06:01.720 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:06:01.728 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:06:31.983 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:06:31.989 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:07:02.239 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:07:02.244 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:07:32.520 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:07:32.529 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:08:02.758 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:08:02.767 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:08:33.030 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:08:33.039 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:09:03.294 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:09:03.314 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:09:33.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:09:33.534 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:10:03.747 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:10:03.754 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:10:34.073 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:10:34.082 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:11:04.333 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:11:04.340 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:11:34.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:11:34.552 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:12:04.766 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:12:04.775 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:12:35.066 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:12:35.071 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:13:05.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:13:05.369 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:13:35.654 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:13:35.659 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:14:05.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:14:05.950 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:14:36.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:14:36.172 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:15:06.375 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:15:06.383 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:15:36.651 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:15:36.659 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:16:06.924 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:16:06.932 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:16:37.170 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:16:37.178 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:17:07.441 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:17:07.449 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:17:37.595 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:17:37.600 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:18:07.817 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:18:07.825 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:18:38.100 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:18:38.106 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:19:08.364 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:19:08.371 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:19:38.660 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:19:38.665 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:20:08.799 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:20:08.804 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:20:39.006 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:20:39.011 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:21:09.185 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:21:09.191 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:21:39.375 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:21:39.380 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:22:09.603 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:22:09.611 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:22:39.852 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:22:40.063 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:23:10.208 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:23:10.217 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:23:40.503 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:23:40.512 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:24:10.794 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:24:10.800 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:24:40.998 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:24:41.006 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:25:11.247 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:25:11.255 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:25:41.441 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:25:41.449 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:26:11.630 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:26:11.638 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:26:41.839 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:26:41.844 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:27:12.117 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:27:12.122 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:27:42.288 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:27:42.294 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:28:12.544 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:28:12.552 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:28:42.761 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:28:42.769 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:29:13.033 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:29:13.041 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:29:43.194 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:29:43.202 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:30:13.461 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:30:13.470 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:30:43.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:30:43.723 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:31:13.946 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:31:13.955 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:31:44.117 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:31:44.125 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:32:14.292 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:32:14.298 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:32:44.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:32:44.526 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:33:14.697 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:33:14.705 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:33:44.876 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:33:44.884 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:34:15.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:34:15.046 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:34:45.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:34:45.261 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:35:15.534 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:35:15.543 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:35:45.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:35:45.836 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:36:16.120 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:36:16.125 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:36:46.347 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:36:46.356 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:37:16.630 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:37:16.638 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:37:46.821 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:37:46.832 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:38:17.092 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:38:17.141 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:38:47.356 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:38:47.365 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:39:17.567 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:39:17.582 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:39:47.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:39:47.875 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:40:18.089 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:40:18.101 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:40:48.379 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:40:48.387 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:41:18.702 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:41:18.710 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:41:48.941 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:41:48.952 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:42:19.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:42:19.184 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:42:49.346 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:42:49.351 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:43:19.539 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:43:19.548 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:43:49.826 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:43:49.835 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:44:20.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:44:20.016 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:44:50.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:44:50.325 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:45:20.515 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:45:20.523 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:45:50.693 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:45:50.701 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:46:20.898 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:46:20.906 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:46:51.186 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:46:51.192 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:47:21.388 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:47:21.396 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:47:51.598 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:47:51.606 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:48:21.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:48:21.805 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:48:52.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:48:52.017 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:49:22.195 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:49:22.200 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:49:52.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:49:52.389 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:50:22.583 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:50:22.589 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:50:52.806 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:50:52.813 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:51:23.210 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:51:23.218 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:51:53.392 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:51:53.400 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:52:23.678 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:52:23.686 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:52:53.950 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:52:53.958 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:53:24.073 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:53:24.081 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:53:54.279 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:53:54.284 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:54:24.448 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:54:24.457 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:54:54.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:54:54.670 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:55:24.879 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:55:24.884 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:55:55.118 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:55:55.122 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:56:25.291 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:56:25.298 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:56:55.495 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:56:55.503 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:57:25.784 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:57:25.793 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:57:56.066 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:57:56.072 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:58:26.261 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:58:26.267 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:58:56.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:58:56.510 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:59:26.798 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:59:26.810 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:59:57.004 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T17:59:57.011 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:00:27.206 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:00:27.214 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:00:57.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:00:57.397 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:01:27.569 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:01:27.577 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:01:57.777 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:01:57.785 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:02:28.074 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:02:28.082 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:02:58.347 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:02:58.352 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:03:28.552 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:03:28.557 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:03:58.832 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:03:58.841 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:04:29.137 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:04:29.143 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:04:59.418 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:04:59.426 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:05:29.671 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:05:29.680 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:05:59.945 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:05:59.953 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:06:30.210 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:06:30.218 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:07:00.464 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:07:00.473 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:07:30.745 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:07:30.753 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:08:01.013 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:08:01.021 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:08:31.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:08:31.209 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:09:01.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:09:01.655 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:09:31.930 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:09:31.937 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:10:02.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:10:02.149 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:10:32.345 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:10:32.353 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:11:02.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:11:02.576 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:11:32.782 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:11:32.788 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:12:03.072 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:12:03.077 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:12:33.247 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:12:33.253 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:13:03.450 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:13:03.456 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:13:33.707 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:13:33.712 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:14:03.812 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:14:03.820 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:14:34.093 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:14:34.099 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:15:04.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:15:04.369 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:15:34.646 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:15:34.654 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:16:04.784 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:16:04.789 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:16:35.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:16:35.045 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:17:05.293 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:17:05.301 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:17:35.726 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:17:35.734 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:18:05.991 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:18:05.998 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:18:36.226 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:18:36.233 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:19:06.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:19:06.508 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:19:36.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:19:36.785 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:20:07.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:20:07.093 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:20:37.352 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:20:37.357 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:21:07.529 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:21:07.537 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:21:37.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:21:37.817 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:22:08.067 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:22:08.072 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:22:38.339 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:22:38.347 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:23:08.511 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:23:08.517 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:23:38.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:23:38.760 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:24:08.853 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:24:08.862 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:24:39.092 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:24:39.101 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:25:09.276 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:25:09.284 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:25:39.548 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:25:39.554 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:26:09.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:26:09.799 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:26:39.963 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:26:39.969 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:27:10.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:27:10.182 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:27:40.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:27:40.428 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:28:10.725 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:28:10.733 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:28:40.945 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:28:40.953 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:29:11.236 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:29:11.245 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:29:41.467 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:29:41.472 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:30:11.747 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:30:11.752 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:30:41.953 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:30:41.958 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:31:12.214 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:31:12.223 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:31:42.514 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:31:42.520 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:32:12.812 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:32:12.820 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:32:43.058 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:32:43.067 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:33:13.380 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:33:13.389 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:33:43.560 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:33:43.567 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:34:13.788 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:34:13.796 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:34:44.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:34:44.046 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:35:14.243 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:35:14.251 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:35:44.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:35:44.537 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:36:14.763 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:36:14.770 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:36:44.960 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:36:44.965 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:37:15.153 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:37:15.158 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:37:45.363 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:37:45.373 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:38:15.561 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:38:15.567 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:38:45.750 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:38:45.756 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:39:15.947 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:39:15.955 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:39:46.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:39:46.092 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:40:16.224 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:40:16.232 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:40:46.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:40:46.425 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:41:16.591 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:41:16.599 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:41:46.815 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:41:46.821 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:42:17.068 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:42:17.076 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:42:47.285 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:42:47.294 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:43:17.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:43:17.514 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:43:47.718 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:43:47.727 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:44:17.924 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:44:17.930 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:44:48.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:44:48.192 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:45:18.412 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:45:18.419 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:45:48.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:45:48.656 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:46:18.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:46:18.948 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:46:49.195 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:46:49.203 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:47:19.418 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:47:19.509 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:47:49.850 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:47:49.855 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:48:20.101 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:48:20.109 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:48:50.238 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:48:50.246 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:49:20.419 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:49:20.425 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:49:50.677 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:49:50.686 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:50:20.908 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:50:20.917 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:50:51.122 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:50:51.131 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:51:21.379 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:51:21.387 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:51:51.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:51:51.655 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:52:21.871 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:52:21.877 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:52:52.093 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:52:52.098 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:53:22.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:53:22.317 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:53:52.536 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:53:52.544 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:54:22.794 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:54:22.801 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:54:53.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:54:53.012 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:55:23.269 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:55:23.277 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:55:53.577 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:55:53.584 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:56:23.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:56:23.786 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:56:54.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:56:54.032 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:57:24.257 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:57:24.265 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:57:54.470 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:57:54.479 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:58:24.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:58:24.762 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:58:54.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:58:54.935 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:59:25.132 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:59:25.141 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:59:55.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T18:59:55.428 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:00:25.659 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:00:25.664 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:00:55.853 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:00:55.858 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:01:26.094 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:01:26.103 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:01:56.385 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:01:56.391 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:02:26.579 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:02:26.585 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:02:56.864 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:02:56.872 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:03:27.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:03:27.185 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:03:57.460 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:03:57.465 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:04:27.731 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:04:27.738 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:04:57.920 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:04:57.929 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:05:28.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:05:28.210 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:05:58.416 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:05:58.425 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:06:28.713 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:06:28.717 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:06:58.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:06:58.928 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:07:29.156 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:07:29.163 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:07:59.421 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:07:59.427 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:08:29.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:08:29.698 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:08:59.890 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:08:59.941 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:09:30.154 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:09:30.160 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:10:00.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:10:00.322 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:10:30.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:10:30.612 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:11:00.780 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:11:00.785 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:11:31.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:11:31.082 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:12:01.273 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:12:01.279 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:12:31.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:12:31.522 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:13:01.746 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:13:01.751 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:13:31.906 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:13:31.912 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:14:02.212 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:14:02.218 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:14:32.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:14:32.481 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:15:02.686 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:15:02.693 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:15:32.919 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:15:32.928 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:16:03.226 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:16:03.234 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:16:33.458 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:16:33.467 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:17:03.747 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:17:03.756 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:17:34.011 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:17:34.019 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:18:04.423 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:18:04.432 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:18:34.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:18:34.644 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:19:04.902 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:19:04.912 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:19:35.191 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:19:35.200 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:20:05.413 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:20:05.422 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:20:35.669 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:20:35.677 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:21:05.908 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:21:05.918 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:21:36.122 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:21:36.131 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:22:06.319 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:22:06.327 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:22:36.449 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:22:36.454 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:23:06.628 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:23:06.634 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:23:36.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:23:36.780 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:24:06.880 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:24:06.885 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:24:37.001 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:24:37.010 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:25:07.218 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:25:07.226 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:25:37.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:25:37.541 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:26:07.746 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:26:07.751 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:26:37.883 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:26:37.888 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:27:08.074 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:27:08.079 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:27:38.228 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:27:38.236 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:28:08.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:28:08.369 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:28:38.566 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:28:38.574 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:29:08.762 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:29:08.770 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:29:39.112 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:29:39.116 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:30:09.299 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:30:09.311 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:30:39.552 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:30:39.559 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:31:09.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:31:09.750 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:31:39.924 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:31:39.929 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:32:10.144 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:32:10.150 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:32:40.329 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:32:40.338 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:33:10.525 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:33:10.533 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:33:40.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:33:40.713 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:34:10.999 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:34:11.005 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:34:41.232 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:34:41.238 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:35:11.477 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:35:11.483 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:35:41.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:35:41.673 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:36:11.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:36:11.846 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:36:42.029 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:36:42.037 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:37:12.223 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:37:12.232 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:37:42.415 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:37:42.420 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:38:12.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:38:12.614 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:38:42.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:38:42.783 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:39:12.974 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:39:12.982 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:39:43.171 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:39:43.179 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:40:13.385 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:40:13.394 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:40:43.583 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:40:43.588 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:41:13.702 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:41:13.708 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:41:43.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:41:43.910 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:42:14.113 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:42:14.122 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:42:44.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:42:44.337 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:43:14.473 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:43:14.479 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:43:44.674 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:43:44.680 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:44:14.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:44:14.844 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:44:44.992 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:44:45.000 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:45:15.174 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:45:15.182 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:45:45.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:45:45.346 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:46:15.527 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:46:15.535 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:46:45.715 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:46:45.723 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:47:15.895 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:47:15.900 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:47:46.015 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:47:46.019 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:48:16.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:48:16.152 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:48:46.354 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:48:46.360 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:49:16.552 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:49:16.558 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:49:46.757 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:49:46.763 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:50:16.919 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:50:16.926 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:50:47.032 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:50:47.042 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:51:17.258 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:51:17.263 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:51:47.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:51:47.368 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:52:17.577 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:52:17.586 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:52:47.824 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:52:47.833 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:53:18.080 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:53:18.085 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:53:48.327 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:53:48.332 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:54:18.480 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:54:18.488 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:54:48.746 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:54:48.754 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:55:19.044 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:55:19.053 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:55:49.257 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:55:49.266 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:56:19.488 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:56:19.497 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:56:49.986 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:56:49.991 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:57:20.131 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:57:20.137 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:57:50.335 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:57:50.340 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:58:20.482 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:58:20.491 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:58:50.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:58:50.671 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:59:20.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:59:20.910 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:59:51.103 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T19:59:51.113 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:00:21.317 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:00:21.323 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:00:51.477 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:00:51.485 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:01:21.686 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:01:21.695 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:01:51.900 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:01:51.908 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:02:22.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:02:22.197 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:02:52.485 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:02:52.491 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:03:22.714 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:03:22.720 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:03:52.971 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:03:52.976 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:04:23.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:04:23.134 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:04:53.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:04:53.313 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:05:23.521 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:05:23.529 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:05:53.741 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:05:53.750 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:06:23.967 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:06:23.975 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:06:54.076 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:06:54.081 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:07:24.190 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:07:24.197 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:07:54.321 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:07:54.329 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:08:24.529 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:08:24.537 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:08:54.657 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:08:54.664 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:09:24.804 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:09:24.812 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:09:55.013 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:09:55.021 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:10:25.230 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:10:25.236 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:10:55.449 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:10:55.456 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:11:25.576 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:11:25.581 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:11:55.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:11:55.707 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:12:25.907 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:12:25.915 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:12:56.097 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:12:56.438 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:13:26.610 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:13:26.616 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:13:56.875 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:13:56.883 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:14:27.096 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:14:27.101 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:14:57.265 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:14:57.271 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:15:27.490 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:15:27.498 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:15:57.771 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:15:57.777 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:16:28.033 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:16:28.038 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:16:58.266 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:16:58.272 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:17:28.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:17:28.529 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:17:58.786 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:17:58.793 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:18:28.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:18:28.975 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:18:59.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:18:59.183 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:19:29.306 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:19:29.329 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:19:59.503 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:19:59.509 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:20:29.680 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:20:29.686 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:20:59.935 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:20:59.941 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:21:30.216 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:21:30.225 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:22:00.439 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:22:00.446 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:22:30.608 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:22:30.614 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:23:00.849 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:23:00.854 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:23:31.001 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:23:31.006 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:24:01.234 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:24:01.240 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:24:31.500 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:24:31.507 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:25:01.680 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:25:01.685 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:25:31.902 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:25:31.907 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:26:02.096 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:26:02.101 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:26:32.287 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:26:32.295 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:27:02.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:27:02.549 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:27:32.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:27:32.737 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:28:03.014 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:28:03.022 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:28:33.278 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:28:33.283 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:29:03.413 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:29:03.420 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:29:33.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:29:33.600 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:30:03.749 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:30:03.755 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:30:34.006 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:30:34.012 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:31:04.229 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:31:04.235 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:31:34.454 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:31:34.462 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:32:04.665 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:32:04.674 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:32:34.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:32:34.975 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:33:05.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:33:05.219 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:33:35.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:33:35.431 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:34:05.601 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:34:05.608 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:34:35.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:34:35.762 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:35:05.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:35:05.973 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:35:36.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:35:36.173 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:36:06.439 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:36:06.444 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:36:36.684 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:36:36.690 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:37:06.845 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:37:06.852 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:37:37.045 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:37:37.050 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:38:07.260 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:38:07.268 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:38:37.541 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:38:37.549 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:39:07.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:39:07.761 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:39:37.884 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:39:37.892 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:40:08.171 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:40:08.178 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:40:38.404 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:40:38.412 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:41:08.651 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:41:08.659 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:41:38.915 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:41:38.923 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:42:09.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:42:09.154 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:42:39.451 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:42:39.459 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:43:09.787 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:43:09.795 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:43:39.996 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:43:40.005 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:44:10.225 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:44:10.234 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:44:40.398 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:44:40.403 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:45:10.575 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:45:10.580 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:45:40.807 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:45:40.816 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-12T20:46:04.916 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-05-12T20:46:04.917 DEBUG:teuthology.task.console_log:Killing console logger for smithi116 2023-05-12T20:46:04.918 DEBUG:teuthology.task.console_log:Killing console logger for smithi182 2023-05-12T20:46:04.918 DEBUG:teuthology.exit:Finished running handlers